Infrastructure Design Engineer
Together AISan Francisco, California, United States · Posted 3 months agoDescription
About The Role
Together AI is building its infrastructure footprint at scale, and this role is central to making that happen. As an Infrastructure Design Engineer, you will own the design, planning, and technical execution of whitespace environments (where servers, storage, and network equipment are deployed) across our AI data center portfolio. You are the in-house expert who ensures that rack layouts, power distribution, cooling strategy, structured cabling, and physical infrastructure design are all built to support the density, redundancy, network and reliability requirements of large-scale AI GPU clusters.
You will serve as the lead engineer across our DC portfolio, creating white space designs, reviewing partner and contractor designs, and ensuring plans are executed to spec. You will work closely with the Infrastructure Strategy, Infrastructure Engineering, and Operations teams, as well as external MEP consultants, general contractors, and data center partners. This is a technical role on a small, high-accountability team where your judgment directly shapes our ability to bring capacity online on time and to spec.
Responsibilities
- Architect HPC clusters by designing whitespace layouts, including rack placement, aisle configuration, hot/cold aisle containment, equipment density, and airflow strategy for high-density GPU deployments
- Collaborate with electrical and mechanical engineers to integrate power and cooling infrastructure into whitespace environments
- Collaborate with Network Engineering to define and validate physical layer requirements (structured cabling, pathway planning, port density) for high-speed AI cluster interconnects, ensuring design compatibility with both physical and logical network architectures.
- Advise Data Center build teams/ contractors to ensure data center build out matches design and architecture specifications. Provide direction to optimize performance, scalability and cost-effectiveness
- Develop and maintain CAD/BIM drawings, schematics, capacity planning models, and technical documentation to support site design, construction, operations, and audits of data center white space
- Own capacity planning within the white space through modeling that incorporates growth, utilization, and infrastructure scaling
- Validate electrical and mechanical load distribution across whitespace fit-outs, including review of striping plans and upstream load balancing under normal and failover conditions.
- Partner with Infrastructure Strategy and Operations by providing design review and technical guidance during the white space fit-out phase.
- Drive continuous improvement in design standards, build processes, and quality assurance, including identifying opportunities to improve infrastructure reliability, reduce time-to-rack, and apply new technologies such as liquid cooling and high-density power architectures.
- Ensure all designs comply with applicable standards including TIA-942, Uptime Institute Tier guidelines, ASHRAE thermal recommendations, and relevant local codes and safety regulations.
Requirements
- 7+ years of experience in data center design, critical facilities engineering, or infrastructure delivery, with deep technical knowledge across the full stack (power, cooling, network) as it pertains to white space design and implementation
- Demonstrated experience serving as an owner's engineer or resident engineer, including reviewing consultant drawings, managing contractor compliance, and interpreting construction specifications and submittal documents
- Strong working knowledge of how facility electrical (UPS, switchgear) and cooling (CRAC/CRAH) infrastructures interface with, and support, high-density white space systems (PDUs, in-row cooling, CDUs, RPPs)
- Proficiency with CAD/BIM tools such as AutoCAD, Revit, or equivalent; ability to produce and review technical drawings, schematics, and capacity models
- Working knowledge of industry standards including TIA-942, Uptime Institute Tier classifications, ASHRAE thermal guidelines, and ANSI/BICSI; familiarity with local building codes and safety regulations
- Proven ability to manage multiple concurrent projects across different sites and work effectively with MEP engineers, general contractors, and equipment vendors in fast-moving environments.
- Willingness to travel to data center sites as required for technical due diligence, design inspections, and final white space deployment sign-off
Nice to Have
- Experience with liquid cooling systems for high-density GPU clusters, including direct liquid cooling (DLC), immersion cooling, or rear-door heat exchangers, and familiarity with associated power and plumbing infrastructure
- Background in hyperscale or AI-native infrastructure deployments, including reference architecture validation, and the development of final design acceptance criteria at scale.
- Familiarity with DCIM platforms, telemetry and monitoring systems, and infrastructure-as-code tooling for capacity and utilization tracking
About Together AI
Together AI is an AI-native cloud company building the infrastructure to make AI faster, cheaper, and more accessible. We’re rapidly scaling our GPU footprint: signing our own data center leases, building large-scale clusters, and expanding toward a global owned-infrastructure presence. Our research team has contributed to breakthroughs like FlashAttention, Hyena, and RedPajama, and we co-design across software, hardware, and algorithms to push the frontier of AI efficiency.
Compensation
We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $210-250K + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. Please see our Privacy Policy at https://www.together.ai/privacy
Similar jobs
Est. 275,000 USD
About the Role Together AI is scaling its physical AI infrastructure rapidly — and we're looking for a Director of Data Center Operations to help us build it right. This is a ground-floor opportunity to own the operation…
Est. 155,000 USD
About The Role Together AI is rapidly scaling its compute infrastructure across multiple sites and deployment types. The Associate, Infrastructure Strategy & Operations will be the analytical backbone of the Infrastr…
Est. 230,000 USD
Build the infrastructure powering the next generation of AI. At Together AI, you’ll build and operate one of the world’s largest GPU fleets used for frontier model training and inference. This isn’t a traditional infrast…
Est. 215,000 USD
About The Role Together AI is scaling its own data center infrastructure to power the next generation of AI workloads. We are looking for a Program Manager, Data Center Delivery to serve as our representative across our…
Est. 255,000 USD
About the Role Together AI is building the AI Native Cloud, an end-to-end platform for the fullgenerative AI lifecycle, combining the fastest LLM inference engine with state-of-the-artAI cloud infrastructure. The Togethe…
Est. 225,000 USD
About The Role Together AI is growing its compute footprint, and making sure new capacity meets our technical standards is an important priority for the company. Every new cluster has to clear a technical bar before it c…
Est. 156,500 USD
About the Role As a Strategic Finance Senior Associate at Together, you will own the cost side of our data center build-outs. Reporting to the Director of Strategic Finance, Infrastructure, you will be the financial coun…
Est. 275,000 USD
About the role As a Customer Success Engineer at Together AI, you will serve as the named technical owner for one of our most strategic customer relationships. You will be the primary technical point of contact across al…
Est. 260,000 USD
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f…
Est. 275,000 USD
About the Role In this role, you will operate, scale, and optimize multi-petabyte storage systems purpose-built for the world’s largest AI training and inference workloads. You’ll manage and scale high-performance parall…
Est. 120,000 EUR
About the Role Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As…
AI Infrastructure Systems Engineer Build the infrastructure powering the next generation of AI. At Together AI, you’ll build and operate one of the world’s largest GPU fleets used for frontier model training and inferenc…
Est. 235,000 USD
About the Role Together AI is looking for a Senior Network Engineer to design, deploy, and operate the global network infrastructure supporting our production services and high-performance AI compute environments. This i…
Est. 120,000 GBP
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f…
Est. 90,000 EUR
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f…
Est. 120,000 EUR
AI Infrastructure Systems Engineer Hybrid at our office in Amsterdam or Remote in the UK. Build the infrastructure powering the next generation of AI. At Together AI, you’ll build and operate one of the world’s largest G…
Est. 197,500 USD
About the Role Our product surface is expanding fast - GPU clusters, managed storage, networking, and observability - and we're adding a Product Manager to the Together Cloud team to own the day-to-day product work that…
Est. 205,000 USD
About the Role Together AI is looking for a Manager to own the commercial relationships with our international cloud compute suppliers and the market intelligence that drives our compute supply strategy. You will manage…
Est. 195,000 USD
About the Role Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As…
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f…
Est. 195,000 USD
About the role As a Technical Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'l…
Est. 260,000 USD
About the Role Together AI is hiring a Staff Platform Engineer to join the Product Foundations engineering organization and drive its service infrastructure strategy. Product Foundations builds and operates Together’s mi…
Est. 205,000 USD
About the Role Together AI is building the Inference Platform that brings the most advanced generative AI models to the world. Our platform powers multi-tenant serverless workloads and dedicated endpoints, enabling devel…
Est. 175,000 USD
About the Role We’re looking for a detail-oriented Data Center Operations professional to manage and track all break/fix activities across multiple data center locations. This role acts as the central point of coordinati…
Est. 120,000 EUR
About the Role Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As…
Est. 195,000 USD
About the role As a Technical Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'l…
About the Role As a Customer Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'll…
Est. 215,000 USD
About the Role Together AI is looking for a Commercial Counsel to support both the agreements that secure our infrastructure and the deals that drive our growth. You'll work alongside the Infrastructure, Sales, Finance,…
Est. 220,000 USD
About the Role As a Solutions Architect at Together AI, you will work with customers and prospects to create business value through Generative AI applications. Solutions Architects at Together are trusted advisors to our…
Est. 240,000 USD
About the Role The Turbo team sits at the intersection of efficient inference (algorithms, architectures, engines) and post‑training / RL systems. We build and operate the systems behind Together’s API, including high‑pe…