inhousefyi
← Back to listings

LLM Pre-training & Distributed Engineer (AI Infrastructure)

Hyphen Connect LimitedOregon, United States · Posted 4 months ago
Full-timeEst. 141,000 USD
Apply now

Description

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing  distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes.

Responsibilities:

  • Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
  • Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
  • Automate checkpointing and failure recovery during month-long training runs.

Required Skills:

  • Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
  • Experience managing SLURM or Kubernetes-based GPU clusters.
  • Strong systems engineering background (C++, CUDA, Python).

 

Similar jobs

Hyphen Connect LimitedSeattle, Washington, United States

Est. 141,000 USD

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…

Full-time
Hyphen Connect LimitedSan Francisco, California, United States

Est. 140,000 USD

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…

Full-time
Hyphen Connect LimitedBoston, Massachusetts, United States

Est. 140,000 USD

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…

Full-time

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…

Full-time

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…

Full-time
Hyphen Connect LimitedSingapore, Singapore

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…

Full-time
Hyphen Connect LimitedHong Kong, Hong Kong

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…

Full-time
Hyphen Connect LimitedOregon, United States

Est. 140,000 USD

We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…

Full-time

We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…

Full-time
Hyphen Connect LimitedSeattle, Washington, United States

Est. 141,000 USD

We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…

Full-time
Hyphen Connect LimitedOregon, United States

Est. 165,000 USD

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, e…

Full-time

We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…

Full-time
Hyphen Connect LimitedSan Francisco, California, United States

Est. 141,000 USD

We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…

Full-time
Hyphen Connect LimitedBoston, Massachusetts, United States

Est. 141,000 USD

We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…

Full-time
Hyphen Connect LimitedSingapore, Singapore

We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…

Full-time
Hyphen Connect LimitedOregon, United States

Est. 124,000 USD

We are searching for a Humanoid Robotic Engineer specialized in bipedal locomotion and manipulation. This role involves designing and implementing sophisticated control algorithms, with a focus on Reinforcement Learning,…

Full-time
Hyphen Connect LimitedOregon, United States

Est. 141,000 USD

We are seeking a talented Multimodal AI Systems Architect to develop and optimize AI systems that seamlessly integrate vision and audio models. This role focuses on enhancing our voice-to-voice interactions and multimoda…

Full-time
Hyphen Connect LimitedHong Kong, Hong Kong

We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…

Full-time
Hyphen Connect Limitednull, Oregon, United States

Est. 124,000 USD

We are seeking a talented and innovative Synthetic Data Engineer. In this role, you will design and implement domain-specific synthetic data generation pipelines, ensuring high-quality data management for training loops.…

Full-time
Robotic Engineer4 months ago
Hyphen Connect LimitedOregon, United States

Est. 124,000 USD

As a Robotics Software Engineer, you will be at the forefront of designing advanced algorithms and systems to optimize the efficiency of our robotic fleet. Your work will be critical in ensuring seamless communication an…

Full-time
Hyphen Connect LimitedSeattle, Washington, United States

Est. 165,000 USD

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, e…

Full-time

Est. 110,000 USD

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, e…

Full-time
Hyphen Connect LimitedShenzhen, China

Est. 45,000 USD

We are looking for an AI Engineer to join a Shipping SaaS Platform. This isn’t just a "prompt engineering" role—you will work at the intersection of deep mathematics and production-grade engineering to build, optimize, a…

Full-time
Hyphen Connect LimitedShenzhen, Guangdong, China

Est. 60,000 USD

We are looking for an AI Engineer to join a Shipping SaaS Platform. This isn’t just a "prompt engineering" role—you will work at the intersection of deep mathematics and production-grade engineering to build, optimize, a…

Full-time
Hyphen Connect LimitedBoston, Massachusetts, United States

Est. 165,000 USD

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, e…

Full-time
Hyphen Connect LimitedSan Francisco, California, United States

Est. 195,000 USD

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, e…

Full-time
Hyphen Connect LimitedOregon, United States

Est. 190,000 USD

We are seeking an innovative and experienced Embodied AI Researcher, focusing on the development and application of foundation models in robotics. The successful candidate will contribute to cutting-edge research, design…

Full-time
Hyphen Connect LimitedOregon, United States

Est. 155,000 USD

We are seeking a skilled Computer Vision Engineer. This role is pivotal in advancing robotic systems through high-fidelity spatial mapping and real-time object recognition. You will work closely with cutting-edge technol…

Full-time
Hyphen Connect LimitedOregon, United States

Est. 160,000 USD

We are searching for an AI Safety Specialist who will play a crucial role in enhancing the security and robustness of language models. You will ensure the safe deployment of AI systems by conducting adversarial testing,…

Full-time
Hyphen Connect LimitedSan Francisco, California, United States

Est. 144,000 USD

We are hiring for one of our ecosystem projects, an innovative AI and Web3 company building an Ethereum Layer 2 solution integrated with advanced AI agents. As the first engineer dedicated to this initiative, you will pl…

Full-time