Member of Technical Staff — Backend/API Platform
RadixArkPalo Alto, California, United States · Posted 8 months agoDescription
About the Role
Requirements
-
4+ years experience building production backend systems, APIs, or platform infrastructure
-
Bachelor's or Master's degree in Computer Science, Engineering, or equivalent industry experience
-
Strong proficiency in Python, Go, or Rust with production-quality code standards
-
Experience designing and building REST/gRPC APIs at scale
-
Solid understanding of distributed systems, databases, caching, and message queues
-
Experience with authentication, authorization, rate limiting, and multi-tenancy
-
Familiarity with cloud platforms (AWS, GCP, Azure) and Kubernetes
-
Experience with monitoring and observability tools (Prometheus, Grafana, DataDog)
-
Understanding of ML serving infrastructure or high-throughput systems is a plus
Responsibilities
-
Design and build production APIs for SGLang and Miles: REST/gRPC endpoints, client SDKs, API versioning
-
Implement authentication, authorization, and rate limiting systems for multi-tenant deployments
-
Build control plane infrastructure: job scheduling, resource allocation, model deployment management
-
Create monitoring, logging, and observability systems for production inference and training workloads
-
Design and implement billing integration, usage tracking, and quota management
-
Build management dashboards and admin tools for cluster operations
-
Ensure API reliability, performance, and security at scale
-
Implement multi-tenancy isolation and security boundaries
-
Create deployment automation, CI/CD pipelines, and rollback procedures
-
Write comprehensive API documentation and integration guides
-
Partner with Systems Engineers to optimize end-to-end latency from API → serving layer
- Debug production issues and implement reliability improvements
About RadixArk
RadixArk is an infrastructure-first company built by engineers who've shipped production AI systems, created SGLang (30K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large-scale RL framework). Founded by AI infrastructure veterans from xAI and NVIDIA, we're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training. Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs.
Compensation
Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
Equal Opportunity
RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Similar jobs
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff, Developer Technology (DevTech) to make LLM inference and training dramatically faster, cheaper, and more accessible on modern GPU hardware. Our systems sit…
Est. 300,000 USD
About the Role RadixArk is seeking a Developer Advocate to build and engage our technical community around SGLang, Miles, and our open source infrastructure. SGLang already has 30K+ GitHub stars and serves billions of to…
Est. 300,000 USD
About the Role RadixArk is seeking experienced product-focused engineers to join our team in building the developer-facing surfaces of our inference and training infrastructure. As a Member of Technical Staff — Product,…
Est. 300,000 USD
About the Role RadixArk is looking for a Member of Technical Staff Cluster Infrastructure to architect and scale the core compute platform that powers frontier-level AI training and inference. You will design and operate…
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff — Inference to push the limits of large-scale AI inference. You will work on the core systems that serve frontier models at scale, optimizing performance, la…
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff — Kernel / Compiler / Communication to push the limits of performance for frontier AI systems. You will work at the lowest layers of the stack — kernels, run…
Est. 165,000 USD
About the Role As a Technical Program Manager at RadixArk, you'll drive the execution of complex, cross-functional programs across our inference and training infrastructure. You'll partner closely with Product Management…
Est. 300,000 USD
About the Role RadixArk is hiring a Member of Technical Staff — Performance in Palo Alto, CA — someone who can push LLM inference and training systems to the limit across real production workloads. You’ll work on the per…
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff - Inference-Multi-Hardware to push the limits of performance for frontier AI systems. Most performance engineering assumes a single vendor's stack. This role…
Est. 300,000 USD
About the Role RadixArk is hiring a Member of Technical Staff — CI / Infrastructure to own the infrastructure that keeps SGLang moving. Our CI system runs 300+ GPU tests across NVIDIA, AMD, Intel, and Ascend hardware poo…
Est. 140,000 USD
About The Role RadixArk is launching a full-time, paid, 1-year residency program for aspiring AI infrastructure engineers. You'll rotate across inference, training, kernels, compilers, and cluster infrastructure, working…
Est. 155,000 USD
About the Role RadixArk is seeking a Product Marketing Manager to own how SGLang, Miles, and our open source infrastructure are positioned and perceived across the market. SGLang already has 20K+ GitHub stars and serves…
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff — Inference-Multimodal & Diffusion to advance the frontier of generative modeling. You will work on cutting-edge diffusion and flow-based models for imag…
Est. 144,000 USD
Key Responsibilities Product Strategy & Roadmap Define, prioritize, and drive the product roadmap for inference and training infrastructure. Stay ahead of AI trends, including new model architectures, hardware optimi…
Est. 300,000 USD
About the Role As a Member of Technical Staff, Training, you will design, build, and operate the distributed systems behind large-scale model post-training — spanning training, inference, and orchestration, with a focus…
Est. 300,000 USD
About the Role RadixArk is looking for a Member of Technical Staff — TPU Systems to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU har…
Est. 150,000 USD
About the Role We're looking for a Head of Business Development to build the BD function at RadixArk from the ground up. The BD team is the institutional memory of this company — maintaining active relationships across e…
Est. 159,000 USD
About the Role We're looking for a hands-on Talent Operations Specialist to build and run the machinery behind talent and people ops as we scale. This isn't a traditional HR generalist role - it's for someone who treats…
Est. 115,000 USD
About the Role RadixArk builds the open-source AI infrastructure behind SGLang and Miles, used by developers and enterprises around the world. We're looking for a visual designer to join our design team and to give our b…
Est. 140,000 USD
(ID: 2025-1135) Axle is a bioscience and information technology company that offers advancements in translational research, biomedical informatics, and data science applications to research centers and healthcare organiz…
Est. 120,000 EUR
Location & work modality: Europe (remote) Start: ASAP Type of Contract: Full-time (permanent or freeelance) About Radian Arc Radian Arc, now part of InferX, Submer's AI cloud and GPU infrastructure platform, provides…
Est. 185,500 USD
Our Purpose At SentinelOne, we are driven by a clear purpose: to give the advantage to those who secure our future. As AI reshapes how organizations build, operate, and innovate, the responsibility to protect them become…
Est. 200,000 USD
Parallel Systems is pioneering autonomous battery-electric rail vehicles designed to transform freight transportation by shifting portions of the $900 billion U.S. trucking industry onto rail. Our innovative technology o…
Est. 120,000 EUR
Location & work modality: EMEA (remote) Start: ASAP Type of Contract: Permanent, full-time About Radian Arc Radian Arc, now part of InferX, Submer's AI cloud and GPU infrastructure platform, provides an infrastructur…
Est. 157,000 USD
Our Purpose At SentinelOne, we are driven by a clear purpose: to give the advantage to those who secure our future. As AI reshapes how organizations build, operate, and innovate, the responsibility to protect them become…
Est. 202,500 USD
About Reltio At Reltio®, an SAP Company, we believe data should fuel your success in the enterprise AI era. Our Context Intelligence Platform turns fragmented data into a trusted, connected context so AI agents and syste…
Est. 289,800 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 175,000 USD
We’re looking for a Staff AI Engineer to lead the design and delivery of AI/ML systems. This role is ideal for an experienced engineer who thrives on architectural decisions, can confidently own systems end-to-end, and c…
Est. 328,650 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 140,000 USD
Who we are: At Arkana Laboratories, everyone has an important role to fill. Come join us and be a part of a team dedicated to making life better for those who need it most. This place is packed with super-smart people wh…