Click here to close now.

Welcome!

Linux Authors: Elizabeth White, Pat Romanski, Carmen Gonzalez, Harry Trott, Adrian Bridgwater

Blog Feed Post

Building a Plexxi Network

[This post is penned by Plexxi executive Bill Koss]

Two months ago I read an interesting blog post by Greg Ferro titled “Cheap Network Equipment Makes a Better Data Centre.”  At Plexxi, I am the person who leads our sales team and I found the post interesting because I think there is a lot of disinformation in the market regarding the cost of procuring networks.  Every week it seems I read a report or article on networking margins, port prices, market share, SDN, bare metal, leaf/spine, open source, linux, etc.  When I speak to customers, there is an equal amount of confusion and in my view it perpetuates the current state in favor of the incumbents.

As a level set, when a potential client asks: what does Plexxi do?  I tell them we build ethernet switches based on merchant silicon; we use Linux for an operating system, we use a photonic inter-connect fabric and distributed controller architecture.  Our switches speak ethernet and IP, just like all ethernet switches, but it is the controller and photonic fabric that make our switches different.  Together we believe that our technology results in a system that has transformative scale, performance, and efficiency advantages compared to legacy network architectures.

wrk-blog-pic1

Recently we provided a proposal to a potential client regarding their network.  As with Greg Ferro’s project, we provided an all in proposal that included cables, software, transceivers, switches, controllers, accessories, support costs and the fabric interconnect ports.  There were two design options based around the size of the interconnect fabric, which most people refer to as the spine or core.   I have condensed some of the details for reading ease, but I think this is a transparent description of the proposal regarding (i) the costs of building a Plexxi network and (ii) how it is different with the choice of two different fabric options, much like the blog post from Greg.  Here is the summary table of the network design options:

# 10G Client Ports $ Per 10G Client Port Fabric Size

OSR

Total 1 Year Cost

288

$1,223 2.88 Tbps

1:1

$384,950

1152

$1,223 11.52 Tbps

1:1

$1,539,800

2304

$1,223 23.04 Tbps

1:1

$3,079,600

432

$517 1.44 Tbps

3:1

$243,160

1728

$517 5.76 Tbps

3:1

$972,640

3456

$517 11.52 Tbps

3:1

$1,945,280

In a Plexxi network, we use a controller architecture.  Our controller computes efficient photonic forwarding topologies.  This type of architecture, often referred to as SDN, provides a number of benefits, but it begins with a fluid pool of capacity within the fabric.  The capacity in our photonic fabric can be allocated, reassigned and reconfigured.  Without providing a long technical description of how our controller operates, an important concept to understand is we use 100% of the fabric and we do not implement spanning tree or block links.  We compute forwarding topologies using multi-flow commodity, graph theory math; that is one of the jobs of Plexxi Control.  A Plexxi fabric can be used inside your data center and the use of a photonic fabric means the fabric can be extended to campus and metro area designs.  Here are a few points regarding our controller and fabric architecture:

  • The photonic fabric is managed as pool of capacity
  • Applications and workloads that are important can be assigned fabric capacity
  • Capacities can change, evolve and forwarding topologies can be diurnal
  • Controller based fabrics are deterministic as opposed to distributed state fabrics that take time to compute state, which may or may not result in an optimal design.
  • Controller based fabrics can centrally compute optimal paths and provide fast convergence by pre-computing failure recovery states

The use of a controller with a photonic fabric provides a number of scaling benefits.  The most obvious benefit is the linear cost curves in terms of price per client port.  The following chart shows the 10G client port cost in scaling from 400 to 3400 ports.

wrk-blog-pic2

The linearity of the Plexxi architecture in terms of client port cost can also be seen in terms of power and cooling.  In a Plexxi architecture, the performance of the network benefits when the controller tries to keep packets in the photonic portion of the network as much as possible, thus limiting silicon switch hops and incurring latency.  Uniformed latency and uniformed power consumption per client power are benefits of the Plexxi architecture:

wrk-blog-pic3

A question we often get is whether a Plexxi network requires a greenfield or can it be deployed in a brownfield.  The answer is there are no greenfields.  Plexxi networks have been deployed in a number of variations.  We have had clients deploy Plexxi in the spine, while leaving the legacy ToR and server connections in place.  We have had clients deploy Plexxi as a replacement strategy for the their leaf/spine network, thus collapsing a two tier or three tier network to a single tier.  We have had clients deploy Plexxi between data centers providing a single hop, load-balanced fabric between data centers.  Traditionally, most Plexxi customers connect our switches to legacy routers and switches using 10G or 40G ports.  We have a handful of customers who have extended the Plexxi fabric via DWDM connections to legacy optical transport platforms.

Another question I have been asked is whether or not our photonic fabric is proprietary.  The way to think about our photonic fabric is to compare it to the fabric modules found in traditional core and spine switches.  What we have done at Plexxi is to take the backplane capacity in spine/core switches found in multi-tier networks and distribute that capacity into each switch.  When you add port capacity, you add fabric capacity.  Five years ago this type of network design was not possible, only with the advent of the modern controller architecture coupled with low cost, multi-path photonic interconnects has it become possible.   The design objective of a Plexxi network is to manage the network as a resource pool that can be correlated with the needs of compute and storage.   We believe that networking is entering the era of plenty and that networks built with rich amounts of path diversity are building blocks of the new networks.  We believe this because that has been direction of compute and storage.  Compute and storage have entered the era of plenty and it is time for the network to enter the era of plenty as well.  The era of plenty for networking will be built using a controller architecture because a controller architecture combined with photonics, merchant silicon and Linux, is the best means to deliver the following benefits:

  • Simplicity: Single tier photonic network
  • High Utilization: Load balanced L2 fabric
  • Controller Architecture: Unified view of network fabric
  • Uniformed Low Latency: Direct connectivity
  • Faster Failure Handling: Pre-computed forward topologies that converge rapidly to target optimum
  • Elastic Network Capacity: Large-scale computation and path optimization through Controller enables fluidity of network capacity
  • Reduced Cabling: Simplified network element deployment and insertion

/wrk

[Today's fun fact: The average American/Canadian drinks about 600 sodas a year. Of course, the American version is 72 ounces compared to Canada's 12 ounces.]

The post Building a Plexxi Network appeared first on Plexxi.

Read the original blog entry...

More Stories By Bill Koss

Bill Koss is VP of Sales at Plexxi. Sales is about having a keen understanding of customer needs and matching them to appropriate solutions so that everyone benefits. The best salespeople are fluent in both business and technology, translating product into value. Vice President of Sales he has acquired these skills over a 20-year career in networking and information technology.

Plexxi is Bill’s fifth venture-backed startup, having successfully exited CrossComm, SDL, Sonoma Systems and Internet Photonics. Notably, Ciena acquired Internet Photonics in 2004 to include the CN4200 platform, which became a $1B+ product line. While with Ciena, Bill held a variety of roles including VP of North American Sales and VP of Global Partners. During Bill’s tenure at Ciena, annual revenue grew from $290M to $700M.

@ThingsExpo Stories
17th Cloud Expo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS – software, platform, and infrastructure as a service.
P2P RTC will impact the landscape of communications, shifting from traditional telephony style communications models to OTT (Over-The-Top) cloud assisted & PaaS (Platform as a Service) communication services. The P2P shift will impact many areas of our lives, from mobile communication, human interactive web services, RTC and telephony infrastructure, user federation, security and privacy implications, business costs, and scalability. In his session at @ThingsExpo, Robin Raymond, Chief Architect at Hookflash, will walk through the shifting landscape of traditional telephone and voice services ...
Explosive growth in connected devices. Enormous amounts of data for collection and analysis. Critical use of data for split-second decision making and actionable information. All three are factors in making the Internet of Things a reality. Yet, any one factor would have an IT organization pondering its infrastructure strategy. How should your organization enhance its IT framework to enable an Internet of Things implementation? In his session at Internet of @ThingsExpo, James Kirkland, Chief Architect for the Internet of Things and Intelligent Systems at Red Hat, described how to revolutioniz...
For IoT to grow as quickly as analyst firms’ project, a lot is going to fall on developers to quickly bring applications to market. But the lack of a standard development platform threatens to slow growth and make application development more time consuming and costly, much like we’ve seen in the mobile space. In his session at @ThingsExpo, Mike Weiner is Product Manager of the Omega DevCloud with KORE Telematics Inc., will discuss the evolving requirements for developers as IoT matures and conduct a live demonstration of how quickly application development can happen when the need to comply...
Container frameworks, such as Docker, provide a variety of benefits, including density of deployment across infrastructure, convenience for application developers to push updates with low operational hand-holding, and a fairly well-defined deployment workflow that can be orchestrated. Container frameworks also enable a DevOps approach to application development by cleanly separating concerns between operations and development teams. But running multi-container, multi-server apps with containers is very hard. You have to learn five new and different technologies and best practices (libswarm, sy...
SYS-CON Events announced today that DragonGlass, an enterprise search platform, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. After eleven years of designing and building custom applications, OpenCrowd has launched DragonGlass, a cloud-based platform that enables the development of search-based applications. These are a new breed of applications that utilize a search index as their backbone for data retrieval. They can easily adapt to new data sets and provide access to both structured and unstruc...
Converging digital disruptions is creating a major sea change - Cisco calls this the Internet of Everything (IoE). IoE is the network connection of People, Process, Data and Things, fueled by Cloud, Mobile, Social, Analytics and Security, and it represents a $19Trillion value-at-stake over the next 10 years. In her keynote at @ThingsExpo, Manjula Talreja, VP of Cisco Consulting Services, will discuss IoE and the enormous opportunities it provides to public and private firms alike. She will share what businesses must do to thrive in the IoE economy, citing examples from several industry sector...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal an...
The security devil is always in the details of the attack: the ones you've endured, the ones you prepare yourself to fend off, and the ones that, you fear, will catch you completely unaware and defenseless. The Internet of Things (IoT) is nothing if not an endless proliferation of details. It's the vision of a world in which continuous Internet connectivity and addressability is embedded into a growing range of human artifacts, into the natural world, and even into our smartphones, appliances, and physical persons. In the IoT vision, every new "thing" - sensor, actuator, data source, data con...
Disruptive macro trends in technology are impacting and dramatically changing the "art of the possible" relative to supply chain management practices through the innovative use of IoT, cloud, machine learning and Big Data to enable connected ecosystems of engagement. Enterprise informatics can now move beyond point solutions that merely monitor the past and implement integrated enterprise fabrics that enable end-to-end supply chain visibility to improve customer service delivery and optimize supplier management. Learn about enterprise architecture strategies for designing connected systems tha...
There's Big Data, then there's really Big Data from the Internet of Things. IoT is evolving to include many data possibilities like new types of event, log and network data. The volumes are enormous, generating tens of billions of logs per day, which raise data challenges. Early IoT deployments are relying heavily on both the cloud and managed service providers to navigate these challenges. In her session at Big Data Expo®, Hannah Smalltree, Director at Treasure Data, discussed how IoT, Big Data and deployments are processing massive data volumes from wearables, utilities and other machines...
SYS-CON Events announced today that the "First Containers & Microservices Conference" will take place June 9-11, 2015, at the Javits Center in New York City. The “Second Containers & Microservices Conference” will take place November 3-5, 2015, at Santa Clara Convention Center, Santa Clara, CA. Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities.
Buzzword alert: Microservices and IoT at a DevOps conference? What could possibly go wrong? In this Power Panel at DevOps Summit, moderated by Jason Bloomberg, the leading expert on architecting agility for the enterprise and president of Intellyx, panelists will peel away the buzz and discuss the important architectural principles behind implementing IoT solutions for the enterprise. As remote IoT devices and sensors become increasingly intelligent, they become part of our distributed cloud environment, and we must architect and code accordingly. At the very least, you'll have no problem fil...
IoT is still a vague buzzword for many people. In his session at @ThingsExpo, Mike Kavis, Vice President & Principal Cloud Architect at Cloud Technology Partners, discussed the business value of IoT that goes far beyond the general public's perception that IoT is all about wearables and home consumer services. He also discussed how IoT is perceived by investors and how venture capitalist access this space. Other topics discussed were barriers to success, what is new, what is old, and what the future may hold. Mike Kavis is Vice President & Principal Cloud Architect at Cloud Technology Pa...
SYS-CON Events announced today that MetraTech, now part of Ericsson, has been named “Silver Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9–11, 2015, at the Javits Center in New York, NY. Ericsson is the driving force behind the Networked Society- a world leader in communications infrastructure, software and services. Some 40% of the world’s mobile traffic runs through networks Ericsson has supplied, serving more than 2.5 billion subscribers.
The 4th International Internet of @ThingsExpo, co-located with the 17th International Cloud Expo - to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA - announces that its Call for Papers is open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal today!
Since 2008 and for the first time in history, more than half of humans live in urban areas, urging cities to become “smart.” Today, cities can leverage the wide availability of smartphones combined with new technologies such as Beacons or NFC to connect their urban furniture and environment to create citizen-first services that improve transportation, way-finding and information delivery. In her session at @ThingsExpo, Laetitia Gazel-Anthoine, CEO of Connecthings, will focus on successful use cases.
The explosion of connected devices / sensors is creating an ever-expanding set of new and valuable data. In parallel the emerging capability of Big Data technologies to store, access, analyze, and react to this data is producing changes in business models under the umbrella of the Internet of Things (IoT). In particular within the Insurance industry, IoT appears positioned to enable deep changes by altering relationships between insurers, distributors, and the insured. In his session at @ThingsExpo, Michael Sick, a Senior Manager and Big Data Architect within Ernst and Young's Financial Servi...
The recent trends like cloud computing, social, mobile and Internet of Things are forcing enterprises to modernize in order to compete in the competitive globalized markets. However, enterprises are approaching newer technologies with a more silo-ed way, gaining only sub optimal benefits. The Modern Enterprise model is presented as a newer way to think of enterprise IT, which takes a more holistic approach to embracing modern technologies.