{"id":78709,"date":"2024-08-20T11:24:49","date_gmt":"2024-08-20T11:24:49","guid":{"rendered":"https:\/\/electronicsmaker.com\/?p=78709"},"modified":"2024-08-31T18:02:49","modified_gmt":"2024-08-31T18:02:49","slug":"ais-impact-on-data-center-networks","status":"publish","type":"post","link":"https:\/\/electronicsmaker.com\/ais-impact-on-data-center-networks","title":{"rendered":"AI\u2019s Impact on Data Center Networks"},"content":{"rendered":"
\n
\"\"
C P Manoharan, Director of Business Development, APAC SOUTH, Spirent Communications<\/figcaption><\/figure><\/div>\n\n\n

The rapid growth of AI is impacting large data centers as high volumes of traffic and intensive processing requirements are pushing the limits of hyperscale data centers. To successfully support AI\u2019s rapid growth, data center architectures and the high-speed networks they rely on, must be re-evaluated. AI application model complexity and size dictate the level of compute, memory and network type needed to connect AI accelerators (like GPUs) used for training and inferencing. At the same time, AI workloads are driving an unprecedented demand for low latency and high bandwidth connectivity between servers, storage, and accelerators.<\/p>\n\n\n\n

The scale required for support doesn\u2019t come from simply adding racks to a data center. Handling large AI training and inference workloads requires a separate, scalable, routable backend network infrastructure to connect distributed GPU nodes. AI apps have less impact on the frontend Ethernet networks that use general purpose servers to provide AI data ingestion for the training process.<\/p>\n\n\n\n

The requirements for new backend network differ considerably from traditional data center frontend access networks. In addition to higher traffic and increased network bandwidth per accelerator, the backend network needs to support thousands of synchronized parallel jobs, as well as data and compute-intensive workloads. The network must be scalable, and provide low latency and high bandwidth connectivity between servers, storage, and the GPUs essential for AI training and inferencing.<\/p>\n\n\n\n

Data center networks must transform to support new AI workloads<\/strong><\/p>\n\n\n\n

The AI data center journey is just beginning and will change dramatically as AI evolves, promising to be transformative and expensive. Data center architectures should be evaluated sooner rather than later, as new strategies will be required for success. GenAI applications are poised to accelerate a new era of high-speed Ethernet backend networks for data centers, as well as other emerging technologies.<\/p>\n\n\n\n

Field deployments of 400G Ethernet have started, 800G chipsets are being manufactured, and standards specifications are in development for 1.6 Terabit Ethernet, with each iteration representing a doubling of bandwidth. Backend AI networks are projected to migrate quickly to nearly all port speeds being at 800 Gbps and above by 2027, with triple-digit CAGR for bandwidth growth.<\/p>\n\n\n\n

New Ethernet technologies for better AI networking<\/strong><\/p>\n\n\n\n

For large-scale AI deployments, latency sensitivities can have a large impact on training performance, so a more deterministic flow control approach can be taken with InfiniBand. High-speed Ethernet and InfiniBand are expected to coexist in data center backend networks for the foreseeable future.<\/p>\n\n\n\n

Many organizations have begun deploying 400G and 800G with the RoCE v2 advanced protocol (RDMA over converged Ethernet, version 2) as the data center switch fabric. This low-cost data transfer network increases efficiency and improves CPU utilization and network performance, while reducing network latency and increasing bandwidth availability.<\/p>\n\n\n\n

A sound test and assurance strategy is the gateway to AI success<\/strong><\/p>\n\n\n\n

Test solutions help validate that the industry is leveraging the cost-intensive AI\/ML infrastructure to its maximum capabilities and organizations can safely unlock AI\u2019s full potential and transform marginal gains into monumental results by:<\/p>\n\n\n\n

Quantifying use cases –<\/strong><\/p>\n\n\n\n

\u2022 Identify AI-powered use cases that offer clear business outcomes where quality datasets are available.<\/p>\n\n\n\n

\u2022 Use digital twins to cost-efficiently and rapidly test use case efficacy and value, and provide feedback loops for continuous AI model learning.<\/p>\n\n\n\n

Developing a data architecture and management strategy –<\/strong><\/p>\n\n\n\n

\u2022 Data architecture, management, and hygiene should be addressed at an early stage to avoid cost shock, poor data quality, and inaccurate or biased AI models.<\/p>\n\n\n\n

\u2022 Validate that data center interconnect architectures can cope with the volume of data and high-speed data transfers and access required by AI learning and inference clusters. Consider 400G\/800G Ethernet supporting RoCE v2 to address the requirements of high performance, low latency, and a low-cost data transfer network.<\/p>\n\n\n\n

\u2022 Use real test data to accelerate AI model training with realistic scenarios and unique variations relevant to intended environments.<\/p>\n\n\n\n

\u2022 Use continuous test data from the live network to keep AI models current.<\/p>\n\n\n\n

Pursuing automation –<\/strong><\/p>\n\n\n\n

\u2022 Invest in an automation framework first, integrating AI to enhance and supercharge related processes.<\/p>\n\n\n\n

\u2022 Start with lower-risk internal processes and environments like labs and test beds to intelligently automate repetitive tasks, streamline complex processes and reduce human errors.<\/p>\n\n\n\n

Ensuring efficacy –<\/strong><\/p>\n\n\n\n

\u2022 AI and especially Generative AI (which is in its infancy) can present inaccurate information as though it were correct. While bad or erroneous data can be blamed, so can misalignment with desired business outcomes.<\/p>\n\n\n\n

\u2022 Continuously verify AI recommendation efficacy against golden scenarios and desired outcomes while providing closed-loop feedback for learning.<\/p>\n\n\n\n

\u2022 Use digital twins to provide a safe and realistic offline validation environment.<\/p>\n\n\n\n

\u2022 Use active testing in the operational networks to rapidly verify implemented recommendations and provide feedback loops for reinforcement or to trigger resolutions.<\/p>\n\n\n\n

Testing security –<\/strong><\/p>\n\n\n\n

\u2022 Explore using modern security solutions that are evolving to utilize AI to enhance their effectiveness and to counter AI-generated attacks.<\/p>\n\n\n\n

\u2022 Continuously test the efficacy of those security solutions for threat detection, false positives, prevention, and remediation response using hyper-realistic attacks, hacker attack behavior, and evasion techniques.<\/p>\n","protected":false},"excerpt":{"rendered":"

The rapid growth of AI is impacting large data centers as high volumes of traffic and intensive processing requirements are pushing the limits of hyperscale data centers. To successfully support AI\u2019s rapid growth, data center architectures and the high-speed networks they rely on, must be re-evaluated. AI application model complexity and size dictate the level […]<\/p>\n","protected":false},"author":2,"featured_media":78710,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[15],"tags":[356,4144],"yoast_head":"\nAI\u2019s Impact on Data Center Networks - Electronics Maker<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/electronicsmaker.com\/ais-impact-on-data-center-networks\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI\u2019s Impact on Data Center Networks - Electronics Maker\" \/>\n<meta property=\"og:description\" content=\"The rapid growth of AI is impacting large data centers as high volumes of traffic and intensive processing requirements are pushing the limits of hyperscale data centers. To successfully support AI\u2019s rapid growth, data center architectures and the high-speed networks they rely on, must be re-evaluated. AI application model complexity and size dictate the level […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/electronicsmaker.com\/ais-impact-on-data-center-networks\" \/>\n<meta property=\"og:site_name\" content=\"Electronics Maker\" \/>\n<meta property=\"article:published_time\" content=\"2024-08-20T11:24:49+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-31T18:02:49+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/electronicsmaker.com\/wp-content\/uploads\/2024\/08\/Untitled-1-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"298\" \/>\n\t<meta property=\"og:image:height\" content=\"298\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\">\n\t<meta name=\"twitter:data1\" content=\"Electronics Maker\">\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\">\n\t<meta name=\"twitter:data2\" content=\"3 minutes\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/electronicsmaker.com\/#website\",\"url\":\"https:\/\/electronicsmaker.com\/\",\"name\":\"Electronics Maker\",\"description\":\"Electronics Magazine\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/electronicsmaker.com\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/electronicsmaker.com\/ais-impact-on-data-center-networks#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/electronicsmaker.com\/wp-content\/uploads\/2024\/08\/Untitled-1-1.jpg\",\"width\":298,\"height\":298},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/electronicsmaker.com\/ais-impact-on-data-center-networks#webpage\",\"url\":\"https:\/\/electronicsmaker.com\/ais-impact-on-data-center-networks\",\"name\":\"AI\\u2019s Impact on Data Center Networks - Electronics Maker\",\"isPartOf\":{\"@id\":\"https:\/\/electronicsmaker.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/electronicsmaker.com\/ais-impact-on-data-center-networks#primaryimage\"},\"datePublished\":\"2024-08-20T11:24:49+00:00\",\"dateModified\":\"2024-08-31T18:02:49+00:00\",\"author\":{\"@id\":\"https:\/\/electronicsmaker.com\/#\/schema\/person\/df9e9cfbf590f29e49716824dd7d81f9\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/electronicsmaker.com\/ais-impact-on-data-center-networks\"]}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/electronicsmaker.com\/#\/schema\/person\/df9e9cfbf590f29e49716824dd7d81f9\",\"name\":\"Electronics Maker\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/electronicsmaker.com\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/a4af77a4fcb00c5dfc7c1ca124a492b4?s=96&d=mm&r=g\",\"caption\":\"Electronics Maker\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/posts\/78709"}],"collection":[{"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/comments?post=78709"}],"version-history":[{"count":1,"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/posts\/78709\/revisions"}],"predecessor-version":[{"id":78711,"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/posts\/78709\/revisions\/78711"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/media\/78710"}],"wp:attachment":[{"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/media?parent=78709"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/categories?post=78709"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/electronicsmaker.com\/wp-json\/wp\/v2\/tags?post=78709"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}