Delos Data's Modular Servers: A New Frontier in Rack-Scale Computing

high-performance computing, the rise of rack-scale architectures has introduced new hurdles for startups trying to keep pace with industry giants like AMD and Nvidia. Delos Data, a company backed by former Intel and Barefoot Networks executives, believes it has a solution. Their modular server platform, showcased at Computex 2026, is designed to give chip startups an edge in the increasingly competitive landscape.

Rack-Scale Complexity Simplified

Rack-scale computing involves packing numerous AI accelerators into a single rack, creating a substantial engineering challenge. Not only does it require sophisticated chip design, but also the integration of mechanical, thermal, and power engineering. Delos Data's approach aims to make easier this process by offering a chassis that resembles a switch more than a traditional GPU server.

The Delos platform boasts 36 OSFP ports, distributing nine per each of the four OAM sockets in the system. OAM, or open accelerator module, supports high-performance accelerators that demand more interconnect bandwidth and power delivery than standard PCIe cards. This flexibility is key, allowing for connection options ranging from standard DACs to pluggable transceivers.

Flexibility and Power Dynamics

Delos isn't alone in this arena. AWS has adapted Nvidia's MGX form factor for its Trainium 3 racks, while AMD's Helios rack has become an OCP standard. Yet, Delos argues its modular methodology offers greater flexibility. As CTO Dan Daly explains, "It makes it a little bit more flexible, maybe you want a scale up domain of 100 or maybe you want it a scale up domain of one."

This flexibility, however, doesn't eliminate power challenges. Larger compute domains requiring pluggable optics could see power consumption become a significant issue. It's a balance between efficiency and scalability. While copper cables offer lower power usage, the reach of optical solutions can't be ignored if one aims to scale further.

Beyond Hardware: The Software Orchestration Edge

Delos doesn't stop at hardware innovation. Their Nonstop AI network software platform promises to enhance how these networks operate. At Computex, Delos demonstrated the software's capacity for dynamic rerouting by allowing attendees to disrupt links and watch as the network self-corrected.

The potential here's notable. As enterprises aim to scale their AI capabilities, the ability to maintain network stability and efficiency becomes critical. Delos's software could be a breakthrough in that respect, offering a reliability layer atop their already flexible hardware.

So, why should this matter to you? Delos is addressing issues at the very heart of modern computing infrastructures. By simplifying rack-scale setups, they're not just offering a tool for chip startups, but possibly setting a new standard for accessible, efficient, and scalable computing. In a world where the compliance layer can make or break new platforms, Delos might just be paving the way to a more democratized tech landscape.