In today’s data-driven world, high-speed, long-distance data transmission is more important than ever. As service providers and data centers strive to meet the increasing demand for bandwidth and maintain control over their infrastructure costs, Dense Wavelength-Division Multiplexing (DWDM) has emerged as a crucial technology in coherent optical networks. This blog post delves into the exciting advancements in DWDM technology, with a special focus on the innovative OpenZR+ implementation, which promises to revolutionize the way service providers and data centers build efficient, converged IP/optical networks for both long-haul and DC to DC interconnection needs. Learn about the evolution of DWDM, the benefits it offers, and how Edgecore Networks and Smartoptics are offering comprehensive solutions that support OpenZR+ technology for the next generation of high-speed, long-distance data transport.

The Evolution of DWDM

Dense Wavelength-Division Multiplexing (DWDM) has been a driving force in the evolution of optical networks. It allows multiple data streams to be transmitted simultaneously over the same fiber optic cable by assigning each data stream a unique wavelength or “color” of light. This approach effectively multiplies the capacity of the fiber, enabling service providers to accommodate rapidly growing bandwidth demands without costly infrastructure upgrades.

DWDM technology has undergone several significant advancements since its inception, with the introduction of coherent detection and digital signal processing (DSP) being key milestones. Coherent detection allows for the recovery of both amplitude and phase information of the transmitted signal, enabling advanced modulation schemes that can transmit more data per wavelength. Meanwhile, DSP techniques enable improved signal recovery and error correction, which in turn allows for longer transmission distances without the need for signal regeneration.

These advances have made DWDM an indispensable technology in modern optical networks, and the industry is continuously working to develop even more efficient and flexible solutions. One such development is OpenZR+, a new implementation that combines the best features of existing standards to create a powerful solution for high-speed, long-haul data transport.

Expanding the Possibilities with OpenZR+ in DWDM Optical Networks

The world of data transmission has come a long way in recent years, and DWDM technology has played a significant role in meeting the needs of service providers by enabling high-speed, long-distance data transport. As data demands continue to grow, driven by applications such as video streaming, online gaming, conference calls, and cloud services, the need for more efficient and flexible solutions has become apparent. OpenZR+ is an innovative implementation that addresses these needs and takes DWDM technology to new heights.

The OpenZR+ standard combines the best features of existing implementations, such as 400ZR and Open ROADM, offering extended reach, multiple data rates, and improved power efficiency. With support for 100G, 200G, 300G, and 400G transmission rates and advanced modulation schemes like QPSK, 8QAM, and 16QAM, OpenZR+ enables reach and capacity optimization, as well as flexible configurations for diverse network requirements.

One of the key advantages of OpenZR+ is its ability to extend the transport distance even further by adopting oFEC (Open Forward Error Correction) from Open ROADM. oFEC is a type of Soft-Decision FEC that provides better recovery rates and ensures data correctness over long distances, up to thousands of kilometers. Although oFEC demands more complex hardware designs, longer latency, and higher power consumption, the trade-off is well worth it for improved performance and reach.

In addition to extending the reach and supporting multiple data rates, OpenZR+ enables interoperable and flexible coherent DWDM optical solutions in a compact, pluggable form factor. This simplification of network architecture reduces the costs of long-haul optical transport networks, allowing service providers to utilize DWDM via an OpenZR+ pluggable transceiver.

As more equipment manufacturers and service providers adopt OpenZR+ compliant solutions, the future of DWDM optical networks looks brighter than ever. With its ability to address a wide range of application scenarios, optimize reach and capacity, and reduce costs, OpenZR+ is poised to revolutionize the way we build and maintain high-speed, long-haul data transport networks. Stay tuned for more exciting developments in this rapidly evolving field, as OpenZR+ continues to shape the future of DWDM technology and the Bright modules are just behind the corner.

Introducing Edgecore’s Portfolio Supporting 400G ZR+

Edgecore Networks, a leading provider of traditional and open network solutions for enterprises, data centers, and telecommunication service providers, offers a comprehensive portfolio of hardware that supports 400G ZR+ technology. This portfolio includes four advanced models, two from the Cloud and Data Center portfolio, and two from the Telecom and Service Provider portfolio.

Switches from the Cloud and Data Center Portfolio:

 

Figure 1. DCS240 – 12.8T Data Center Switch (AS9726-32DB)

The DCS240 is a top-of-the-rack or spine switch designed for high-performance data centers. Equipped with 32 x 400G QSFP56-DD switch ports and the Broadcom Trident 4 switch series silicon, it delivers non-blocking line-rate performance. The switch comes pre-loaded with Open Network Install Environment (ONIE) for automated loading of compatible open-source and commercial NOS offerings – SONiC and OcNOS from IP Infusion are on the way. Most importantly, we can support up to 16 x 400G ZR+ using all upper QSFP-DD ports!

 

Figure 2. DCS520 – 25.6T Data Center Switch (AS9736-64D)

The DCS520 is a high-performance spine switch that supports line-rate L2 and L3 switching across 64 x 400G QSFP56-DD ports. The switch uses the Broadcom Tomahawk 4 switch series silicon for non-blocking line-rate performance and supports 400G ZR or ZR+ coherent optics with up to 24W power budget per port. This model, like a Beast, can provide 64 x 400G links under single chipset and control plane and 16 ports are supporting ZR+ (you can use 8 ports from the left and 8 ports from the right). The needed power budget for ZR+ is one, but the challenge is always related to heating. Edgecore did a great job here again! It is pre-loaded with ONIE and is compatible with Open Network Linux (ONL) and you could run today Enterprise SONiC by Edgecore. Soon we will see OcNOS from IP Infusion as well as other SONiC Distributions.

Routers from the Telecom and Service Provider portfolio:

 

Figure 3. AGR400 – 2.4T Aggregation Router (AS7946-30XB)

The AGR400 is a high-performance 100G aggregation router engineered with the latest Broadcom StrataDNX™ Qumran2C silicon, suitable for OpenBNG, 100G aggregation router, PE router, or data center TOR switch/router use cases. It comes with 18 x 100G QSFP28, 4 x SFP28 which can support 1G/10G and 25G, and finally, we have 4 x 400G QSFP-DD and two of them can support ZR+. From the software side, we have IP Infusion OcNOS, Casa software, or RtBrick Full Stack OS.

 

Figure 4. CSR440 – 800G Cell Site Router (AS7535-28XB)

The CSR440 is an open disaggregated cell site gateway platform designed for 5G mobile xHaul networks. This temperature-hardened platform supports a wide range of interfaces, including 1/10/25Gbps, 50/100Gbps, and 100/400Gbps – and going into the details, we have 24 x 1G/10G/25G SFP28, 2 x 100G QSFP28, and 2 x 400G QSFP-DD – yes, with ZR+ support! From the software, IP Infusion OcNOS, RtBrick Full Stack OS, and some new to come soon.

Edgecore’s portfolio of 400G ZR+ supported hardware provides robust and flexible solutions for various network requirements, catering to the needs of data centers, telecom operators, and service providers. These cutting-edge switches and routers ensure high performance, reliability, and scalability, allowing customers to build cost-effective and efficient networks. It’s time to forget about legacy transponders!

Smartoptics Solutions: The Ideal Complement to OpenZR+ Technology

Smartoptics, a leading provider of optical solutions, offers an ideal solution for data center interconnect (DCI) applications, particularly in situations where switches or routers support ZR+. The DCP-M40-C-ZR+ is a 40 channel DWDM open line system optimized for use with OpenZR+ pluggable coherent optics. This unique solution provides a cost-effective and simplified approach to implementing DWDM networks, enabling customers to take full advantage of the benefits offered by OpenZR+ technology.

 

Figure 5. The DCP-M40-C-ZR+ flexible open line system optimized for 400ZR+

The DCP-M40-C-ZR+ system is designed to support up to 40 wavelengths, each carrying up to 400G traffic, resulting in a total system capacity of up to 16Tbps. The system is compatible with Edgecore’s portfolio of switches and routers supporting OpenZR+ technology, allowing for seamless integration and efficient deployment. With its passive design, the DCP-M40-C-ZR+ offers a low power consumption solution, contributing to reduced operational expenses.

By pairing Smartoptics’ DCP-M40-C-ZR+ with Edgecore’s OpenZR+ enabled switches and routers, customers can achieve efficient, high-capacity, and long-reach optical transport solutions for their data center and telecommunications networks. Together, these technologies provide a powerful and flexible foundation for the ever-evolving demands of high-speed, long-haul data transport.

 

Figure 6. DCP-M for Point-to-point Links

The rapid growth of bandwidth demands has propelled the evolution of DWDM technology, with OpenZR+ emerging as the latest innovation in the field. Combining the best features of existing implementations, OpenZR+ enables extended reach, multiple data rates, and improved power efficiency, making it a powerful solution for today’s high-speed, long-haul data transport needs.

Edgecore Networks and Smartoptics are at the forefront of providing cutting-edge solutions that support OpenZR+ technology. Their comprehensive portfolio of switches, routers, and DWDM systems enables service providers to build efficient, converged IP/optical networks that cater to the ever-increasing demands for bandwidth and performance.

As the world continues to rely on data-intensive applications, OpenZR+ and the associated hardware solutions from Edgecore Networks and Smartoptics will play an increasingly critical role in shaping the future of DWDM optical networks. These technologies promise to revolutionize the way service providers design, deploy, and maintain their infrastructure, providing the necessary foundation for meeting the needs of an increasingly connected and data-driven world.

The networking landscape has been rapidly evolving, thanks to the growing demand for open networking and disaggregation. As network operators and data center managers seek to modernize their infrastructures, they are increasingly turning to solutions that provide flexibility, scalability, and ease of management. One such offering is the Enterprise SONiC Distribution by Broadcom, a robust and commercially supported version of the open-source SONiC network operating system (NOS). In this blog post, we’ll explore the various packages available within the Enterprise SONiC Distribution, with a special focus on the Campus Package and Power over Ethernet (PoE) use cases.

Enterprise SONiC Distribution by Broadcom: Packages Overview

Broadcom’s Enterprise SONiC Distribution offers a comprehensive suite of packages to cater to various networking environments and use cases. These include:

  1. Cloud Base Package: Designed for data center fabric underlay use cases, it includes essential features like eBGP, ZTP, programmatic API, QoS, ACL, and security features such as TACACS+. It also offers base telemetry features like Thresholds and Snapshots (BST).
  2. Cloud Advanced Package: Building on the Cloud Base Package, it adds Inband Flow Analyzer (IFA, version 2.0), Tail Stamping, Drop Monitor, and Linux PTP (KNETSync).
  3. Enterprise Base Package: Tailored for data center fabric underlay and overlay use cases, it offers features such as eBGP, ZTP, programmatic API, QoS, ACL, BGP EVPN, VXLAN, and more. It also includes base telemetry features like Thresholds and Snapshots (BST).
  4. Enterprise Advanced Package: Expanding on the Enterprise Base Package, it incorporates Inband Flow Analyzer (IFA, version 2.0), Tail Stamping, Drop Monitor, Linux PTP (KNETSync), and the Broadcom Debug Tool.
  5. Campus Package: Specifically designed for campus-specific platforms, it extends the L2/L3 features to support PoE, PoE+, and PoE-bt, port access control, LLDP-MED, port security, digital optical monitoring, time domain reflectometry, EVPN VXLAN, and more.

Exploring the Campus Package

The Campus Package is designed to cater to the unique needs of campus environments, providing a versatile solution for connecting edge devices and data centers. It is particularly useful in situations where campus devices such as POS systems, thin clients, and security cameras need to be connected to an existing data center infrastructure.

One of the key advantages (and a simply must) of the Campus Package is the support for Power over Ethernet (PoE), a technology that simplifies network deployments by delivering both power and data over a single Ethernet cable. By incorporating PoE, PoE+, and PoE-BT, the Campus Package enables seamless integration of various devices while reducing the need for additional power infrastructure.

To further demonstrate the capabilities of open networking hardware compatible with the Broadcom SONiC, let’s take a closer look at Edgecore’s offerings. Edgecore is one of the vendors who offer open networking hardware with support for different PoE standards, making them a great choice for campus networks.

Edgecore Hardware with PoE Support:

 

1. AS4630-54PE: This platform comes with 48x1G, 4x25G, and 2x100G ports, with PoE, PoE+, and PoE-BT support. It has been fully supported since the 3.5.0 release.

 

2. AS4630-54TE (MGMT): Although this model doesn’t feature PoE support, it’s worth mentioning as it offers a variety of ports including 48x1G, 4x25G, and 2x100G. It has been fully supported since the 4.0.0 release.

 

3. AS4630-54NPE: This platform is equipped with 36x10G, 12x10G, and 4x25G ports, with support for PoE, PoE+, and PoE-BT. Full support is available in the 4.1.1 release, which is expected to arrive in July 2023.

 

By adopting Edgecore’s open networking hardware, network operators can leverage the benefits of the Campus Package to create a seamless, efficient network infrastructure, meeting the specific needs of campus environments.

I’m sure that you are familiar with PoE, but let’s make a short review and summary of its use cases. PoE has become increasingly important for modern networks, particularly in campus environments where devices need to be deployed in hard-to-reach locations. Some noteworthy use cases include:

  1. Wireless Access Points: PoE simplifies the deployment of wireless access points by eliminating the need for separate power sources, making it easier to place them in strategic locations for optimal coverage.
  2. IP Cameras: Security cameras often need to be installed in remote or hard-to-reach areas, making PoE an ideal solution for powering these devices while ensuring a stable data connection.
  3. IP Telephony: As businesses transition to IP telephony, PoE enables the deployment of power-hungry IP phones without the need for separate power connections, simplifying the installation process and IoT Devices: The Internet of Things (IoT) is driving the proliferation of connected devices across campuses, including sensors, actuators, and controllers. PoE provides a reliable and cost-effective way to power these devices while ensuring seamless data connectivity.
  4. Lighting Systems: PoE-enabled LED lighting systems can be easily integrated into the network infrastructure, enabling centralized control and monitoring, as well as energy-saving features such as occupancy sensing and daylight harvesting.
  5. Digital Signage: PoE can be used to power digital signage displays, ensuring a reliable connection for content delivery while reducing the need for additional power outlets.

Are you using PoE? How do you see the needed budget for implementation? Total budget is definitely important but it’s also essential to consider the various types of PoE:

IEEE has released several PoE standards, including IEEE802.3af (standard PoE), IEEE802.3at (PoE+), and IEEE802.3bt (PoE++), which regulate power delivery to PDs. Understanding these standards is crucial for network administrators to ensure compatibility and efficient power management.

  1. IEEE 802.3af (Standard PoE): With a supply voltage of 44-57V and a supply current of 10-350mA, this standard provides a maximum power output of 15.4W per port. The minimum guaranteed power available at the PD is 12.95 watts per port, suitable for VoIP phones, sensors, and more.
  2. IEEE 802.3at (PoE+): This updated standard is backward-compatible with standard PoE and provides up to 30W of power per port. The minimum output power assured is 25W, supporting devices requiring more power, such as LCD displays, biometric sensors, and tablets.
  3. IEEE 802.3bt (PoE++): The latest PoE standard defines Type 3 (PoE++) and Type 4 (higher-power PoE) powering/wattage standards. Both types increase the maximum PoE power by delivering more power through two or more pairs of Ethernet cables. These modes are backward compatible with 802.3af and 802.3at and support devices with higher power requirements like video conferencing systems, laptops, and TVs.

Configuration Examples

Now that we have covered the basics, let’s dive into some configuration examples to give you an idea of how to configure PoE on a Broadcom SONiC switch. I need to tell you that there is not too much but mostly all what we need, but could be better 😉

! Configure PoE on an interface

interface Ethernet1/1

! Enable PoE

no poe disable

! Set the PoE detection mode to dot3bt followed by Legacy detection

poe detection dot3bt+legacy

! Set the port priority level to high

poe priority high

! Configure PoE on another interface

interface Ethernet1/2

! Enable PoE

no poe disable

! Set the PoE detection mode to dot3bt only

poe detection dot3bt

! Set the port priority level to low

poe priority low

! Reset PSE operation on all ports, if needed

clear poe counters

! Configure power management type for the system

poe power management dynamic

! View the current PoE configuration and system-wide status information

show poe

! View the POE port configuration information for individual ports or all ports

show poe port configuration all

This sample configuration demonstrates how to enable and configure PoE on different interfaces, set the detection mode, port priority level, and power management type for the system. It also shows how to reset PSE operation and view the PoE configuration and status information.

What, in your opinion, is missing in the current PoE configuration? …Personally, I would love to see a simple feature that could set up a schedule with synced calendars to disable PoE on specific ports, such as those connected to VoIP phones. This would help save energy during the night or over the weekend when no one is in the office.

The Enterprise SONiC Distribution by Broadcom provides a flexible and scalable solution for open networking, catering to a wide range of use cases with its various packages. The Campus Package, in particular, offers a comprehensive feature set tailored to the specific needs of campus environments, with its support for different types of Power over Ethernet being a key advantage.

By adopting the Campus Package and using open networking hardware such as Edgecore’s offerings, networking specialists can leverage the benefits of open networking and disaggregation, enabling seamless integration of various devices and creating a more streamlined, efficient network infrastructure. The future of networking is open, and Broadcom’s Enterprise SONiC Distribution is at the forefront of this transformation.

Are you ready to level up your knowledge on Power over Ethernet, campus deployments, and much more? Join our comprehensive “Introduction to Enterprise SONiC” course offered by Route2open Academy.

With our expert instructors guiding you through every step, you’ll learn about SONiC, its installation and setup process, redundancy methods, routing protocols, automation, and troubleshooting. Plus, you’ll have access to our supportive Route2open Forums where you can connect with like-minded individuals and share ideas.

Don’t miss this opportunity to enhance your skills and dive into the world of open networking systems. Click the link below to book your spot and start your journey with the Enterprise SONiC course today:

https://route2open.com/courses/r2o-son-brc-sa-r1-sonic-course/

Let’s build a successful future together with Route2open Academy.

The University of Texas at San Antonio (UTSA) operates massive workloads for large enterprises while educating its own students on cutting-edge open source technologies and providing research opportunities, all within the constraints of a tight budget.

The recently published case study shows their Cloud and Big Data Lab ecosystem leveraging Edgecore Networks 10G/40G Open Networking switches and Cumulus Linux to simplify their stack and enhance flexibility, while reducing acquisition cost and operational expenses.

Product Deployment

  • 2 x AS6712-32X 40G data center switch, serving as spine switches with 40G downlinks to leaf switches
  • 4 x AS5712-54X 10G data center switch, serving as leaf switches with uplinks to spine switches and downlinks to controllers and compute nodes
  • Cumulus Linux operating system

Background
The University of Texas at San Antonio (UTSA) is a state research university in San Antonio, Texas, US. With over 30,000 students, it is the largest university in San Antonio. UTSA is also home to the first Open Compute Project (OCP) Certification and Solution Laboratory in North America. The laboratory serves the goal to certify Open Compute technologies and key workloads for large enterprises while educating its own students on cutting-edge open source technologies and providing research opportunities.

As a rapidly evolving environment, the data center of UTSA must grow at a rapid pace while enabling research projects based on the latest technologies, within the constraints of a tight budget.

 

Solution
UTSA leverages OCP networking technologies with Cumulus Linux in the UTSA Cloud and Big Data Laboratory and in various cloud projects for research and education. Over 90% of server ports are based on OCP technology. Now, two thirds of the network infrastructure is based on OCP networking with AS6712-32X 32-port 40G switches and AS5712-54X 48-port 10G & 6-port 40G switches from Edgecore Networks

 

As the first OCP-approved 10G/40G switches, Edgecore open networking switches with pre-loaded ONIE enable different network operating systems to easily run on top of the Edgecore hardware, disaggregating the models with ONIE and Cumulus Linux. This disaggregation gives power back to users, with Linux as the network OS and the server OS.

 

The disaggregation goes one step further with Cumulus Linux: As a native linux network OS, it supports both networking and a range of widely available server packages, mostly open source. Switching from the world of various network operating systems, the team rapidly felt comfortable with Linux, a familiar tool. With Cumulus Linux, the switch is just another server with many accelerated ports; the administrator only needs to understand Linux. Since UTSA computer science graduates are skilled in UNIX/Linux, adoption was easy once they complete the program.

By leveraging Edgecore Open Networking technologies with Cumulus Linux, UTSA achieved simplified their stack and got flexibility that resulted in reducing both CapEx and OpEx.

 

Edgecore AS6712-32X

  • Spine switch supporting 10G or 40G spine interconnects
  • 32 fixed x 40 GbE QSFP+ switch ports in compact 1RU form factor
  • Full line-rate Layer 2 or Layer 3 forwarding of 2.56 Tbps full duplex

Edgecore AS5712-54X

  • 10G Top-of-Rack Switch for enterprise and cloud data centers
  • VXLAN and NVGRE tunneling support in hardware for network virtualization
  • Full line-rate Layer 2 or Layer 3 forwarding of 1.44 Tbps full duplex

 


Curious about how you can benefit from Opent Networking solutions as well? Get in touch with us and we will show you how.


Disclaimer: Please note that this case study is not the property of STORDIS and we are therefore not responsible if information made available in this case study is not accurate, complete or current. STORDIS was not involved in the production of this case study. The case study was published by Edgecore Networks. A more detailed description can be found here.

State-of-the-art technologies in the broadcasting industry and growing standards call for increased data traffic and demand the highest levels of throughput and storage. Česká televize is a public television broadcaster in the Czech Republic delivering six channels of news, sports, family, arts and educational content, producing the majority of their content in-house. STORDIS supported Interlab, a French solution provider focusing on the broadcasting and media industry, to realize a fully integrated, high-speed, yet cost-efficient network infrastructure.

As the Open Networking Expert, STORDIS aims to drive innovation in the field of Open Networking. Therefore, it was a great opportunity to support Interlab set up a future-proof network environment for Česká televize with the most efficient combination of high-quality hardware and software. Interlab employed an Edgecore AS5712-54X switch with PICOS®, an open Layer 2/3 network operating system created by Pica8.



Edgecore Networks offers scalable, disaggregated network solutions. Their industry-leading products are essentially qualified to meet network requirements in different markets, particularly in the broadcasting industry. Edgecore’s complete solutions generate value for customers by offering a broad product portfolio spanning data center switches, core switches, access switches, enterprise-level wireless devices and network management tools. STORDIS endorses the high quality of Edgecore’s bare metal switches and the spectrum of possibilities their products offer.

 

Pica8 developed a Linux-based operation system which runs on a large number of conventional white box switches from various manufacturers and perfectly complements the Edgecore AS5712-54X. The unique network operating system PICOS® provides unlimited, non-disruptive control of the enterprise applications, enables monitoring dynamic traffic and security and delegation capabilities. PICOS® is fully interoperable with the existing legacy infrastructure, increasing flexibility, performance, security and reliability at a fraction of the cost, which made it the perfect choice for the Czech television broadcaster.

 


Do you have any question or are curious how you could benefit from Open Networking? Get in touch with us and we will help you!


The rapid development of the media and broadcasting industry is setting high standards for network infrastructures in questions of flexibility, reliability and efficiency. Omnimago, a Germany-based full-service provider particularly specialized in post-editing, digitalization and storage, required a scalable, high-speed network infrastructure while sticking to a tight budget.

As the Open Networking Expert, STORDIS aims to drive innovation in the field of Open Networking. Therefore, it was a great opportunity to provide Omnimago with the most efficient combination of high-quality hardware and software and to supervise the installation.



Edgecore Networks offers scalable, disaggregated network solutions. Their industry-leading products are essentially qualified to meet network requirements in different markets, particularly in the broadcasting industry. Edgecore’s complete solutions generate value for customers by offering a broad product portfolio spanning data center switches, core switches, access switches, enterprise-level wireless devices and network management tools. One of these is the Edgecore AS5712-54X, which was deployed at Omnimago. As the expert in the field of Open Networking, STORDIS endorses the high quality of Edgecore’s bare metal switches and the spectrum of possibilities their products offer.

Pica8 developed an open Linux-based network operating system that runs on a large number of conventional white box switches from various manufacturers and perfectly complements the deployed Edgecore AS5712-54X. The unique network operating system PICOS® provides unlimited, non-disruptive control of the enterprise applications, enables monitoring dynamic traffic, as well as security and delegation capabilities. PICOS® is fully interoperable with the existing legacy infrastructure to increase flexibility, performance, security and reliability at a fraction of the cost, which made it the perfect choice for Omnimago in combination with the Edgecore AS5712-54X.


Do you have any question or are curious how you could benefit from Open Networking? Get in touch with us and we will help you!