LLM Pre-training & Distributed Engineer (AI Infrastructure)
Hyphen Connect LimitedHong Kong, Hong Kong · Posted 4 months agoDescription
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes.
Responsibilities:
- Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
- Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
- Automate checkpointing and failure recovery during month-long training runs.
Required Skills:
- Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
- Experience managing SLURM or Kubernetes-based GPU clusters.
- Strong systems engineering background (C++, CUDA, Python).
Similar jobs
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…
Est. 140,000 USD
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…
Est. 140,000 USD
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…
Est. 141,000 USD
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…
Est. 141,000 USD
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The idea…
We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…
We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…
We are hiring for one of our ecosystem projects in the financial services/ HFT space, we are looking for a Linux Trading System Engineer to build, improve, and maintain a complex Linux environment. This position is based…
Est. 80,000 USD
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, e…
We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…
We are seeking a talented and innovative Synthetic Data Engineer. In this role, you will design and implement domain-specific synthetic data generation pipelines, ensuring high-quality data management for training loops.…
We are hiring for one of our ecosystem projects in the financial services/ HFT space, we are looking for a Linux Trading System Engineer to build, improve, and maintain a complex Linux environment. This position is based…
We are hiring for one of our ecosystem projects in the financial services/ HFT space, we are looking for a Linux Trading System Engineer to build, improve, and maintain a complex Linux environment. This position is based…
Est. 60,000 USD
We are looking for an AI Engineer to join a Shipping SaaS Platform. This isn’t just a "prompt engineering" role—you will work at the intersection of deep mathematics and production-grade engineering to build, optimize, a…
Est. 45,000 USD
We are looking for an AI Engineer to join a Shipping SaaS Platform. This isn’t just a "prompt engineering" role—you will work at the intersection of deep mathematics and production-grade engineering to build, optimize, a…
Est. 141,000 USD
We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…
We are searching for a Humanoid Robotic Engineer specialized in bipedal locomotion and manipulation. This role involves designing and implementing sophisticated control algorithms, with a focus on Reinforcement Learning,…
Est. 140,000 USD
We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…
Est. 141,000 USD
We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…
Summary: Join our innovative proprietary trading firm dedicated to developing cutting-edge algorithmic execution tools for the cryptocurrency markets. In this role, you will focus on creating ultra-low-latency execution…
We are hiring for one of our ecosystem projects in the digital asset space. Currently seeking a Software Developer with expertise in C++ to design, develop, and optimize our HFT platform. You will work on low-latency, hi…
We are seeking a talented Multimodal AI Systems Architect to develop and optimize AI systems that seamlessly integrate vision and audio models. This role focuses on enhancing our voice-to-voice interactions and multimoda…
Est. 141,000 USD
We are seeking a skilled MLOps & Agentic Platform Engineer. This role involves managing model registries, developing continuous training loops, and implementing A/B testing infrastructure. The ideal candidate will ha…
Est. 45,000 USD
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, e…
As a Robotics Software Engineer, you will be at the forefront of designing advanced algorithms and systems to optimize the efficiency of our robotic fleet. Your work will be critical in ensuring seamless communication an…
We are hiring for one of our ecosystem projects. The company is a cutting-edge venture studio at the forefront of AI-powered media production. They're reshaping the media landscape by merging human creativity with artifi…
We are seeking a skilled Network Engineer, this role is critical to ensuring the seamless operation of our trading systems infrastructure, driving innovation, and delivering high-performance network solutions in a fast-p…
We are representing a leading force in the decentralized exchange (DEX). We are seeking a seasoned Data Engineer to spearhead the development of robust data architectures. In this role, you will be responsible for the en…