inhousefyi
← Back to listings

Senior AI Backend Engineer

K HealthTel-Aviv, Israel · Posted 1 month ago
Full-time
Apply now

Description

About the role:

We are seeking a Senior Backend Engineer with deep backend engineering expertise and proficiency in one or more major programming languages (e.g., Python, Java, Go, Rust, or Kotlin), along with a strong understanding of AI models and agents. As a core member of our AI Engineering team, you will collaborate with data scientists, ML engineers, and product managers to build scalable, production-ready infrastructure and APIs that power intelligent systems.

What you'll be doing:

As a Senior Backend Engineer in the AI Engineering team, you will:

  • Build and maintain reliable, scalable backend services to support AI agent execution and orchestration.
  • Develop AI agent systems for complex operational workflows using LangChain, LangGraph, LiteLLM, and Langfuse.
  • Orchestrate a hybrid model stack that includes OpenAI and Google Gemini alongside self-hosted and fine-tuned LLMs like Gemma and Llama.
  • Build and maintain integrations with clinical systems (FHIR, EMR).
  • Drive observability and reliability using OpenTelemetry, Datadog, and Langfuse.
  • Design APIs (GraphQL, REST), background workers, and event-driven systems that interface with AI inference engines and agent runtimes.
  • Collaborate with Data Science, ML, and engineering teams to deploy AI features and improve the performance, scalability, and reliability of backend systems.
  • Participate in code reviews, knowledge sharing, and mentoring to elevate the team’s technical capabilities.

What we're looking for:

  • 6+ years of backend engineering experience, with strong proficiency in more than one major programming language (such as Python, Java, Go, Rust, or Kotlin).
  • Solid understanding of AI systems architecture and experience working in environments involving AI agents, LLMs, or inference pipelines.
  • Proven experience in building and scaling backend APIs, microservices, and background jobs.
  • Strong experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB, Redis), including schema design, data modeling, and query optimization.
  • Experience with message brokers and distributed systems (e.g., Pub/Sub, Redis Streams, RabbitMQ).
  • Highly adaptable, a strong team player, with the ability to quickly learn and apply new technologies.

Advantages:

  • Strong proficiency in Python and/or Node.js/NestJS.
  • Experience with clinical systems and healthcare data standards (FHIR, EMR/EHR).
  • Hands-on experience with AI agent frameworks such as LangChain, LangGraph, or LiteLLM.
  • Experience orchestrating hybrid model stacks combining commercial APIs (OpenAI, Google Gemini) with self-hosted or fine-tuned LLMs.
  • Familiarity with observability tools for AI systems (Langfuse, OpenTelemetry).

Who We Are:

Behind every leading health system is K Health’s AI-powered virtual care engine.

Esteemed health systems like Mayo Clinic, Cedars-Sinai, Mass General Brigham, Hackensack Meridian Health, and Hartford Healthcare partner with K Health to build and run modern primary virtual care clinics on their behalf.

Our deeply integrated model modernizes the primary care loop by using AI to put humans first. For our patients, we offer clinical AI (i.e., PatientGPT) and unparalleled access to close care gaps around the clock. For our Providers, we deliver provider-serving agentic solutions (i.e., Perfect Note) to eliminate administrative overload and burnout. And for the health systems, we deploy our top-grade Virtualists in AI-powered virtual clinics 24/7 to capture the patients' care journeys at step one, retain the journey through the system for longitudinal care, and strengthen profitability.

We’re founded in 2016, headquartered in New York City, and backed by nearly $400 million from leading investors including Valor Equity Partners, Claure Group, Mangrove Capital Partners, 14W, Notable Capital, Lerer Hippeau, Primary Venture Partners, Comcast Ventures, PICO Venture Partners, Max Ventures, and other strategic healthcare partners.

We offer competitive compensation packages based on industry benchmarks for function, level, and geographic location. Offer amounts are determined by multiple factors such as a candidate's experience and expertise.

We are proud to be an Equal Opportunity Employer and consider applicants for employment regardless of race, ethnicity, religion, color, national origin, ancestry, disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, sexual orientation, pregnancy, childbirth and breastfeeding, age, citizenship, military or veteran status, or any other class protected by applicable federal, state, and local laws. We’re deeply committed to building teams as diverse as the patients we serve and strive to cultivate an environment where everyone can bring their most authentic self to work. We depend on our differences to make our team stronger, our workplace more dynamic, and our product accessible to all of our users.

We are committed to maintaining the integrity of our hiring process and ensuring a safe environment for all candidates. All communication for job offers from K Health will come from email addresses ending in @khealth.com. K Health will never ask you to provide financial information about yourself during the recruitment process. We will never use personal email accounts or other domains for official correspondence. Our official job postings are only listed on our official website and reputable job boards. Be cautious of job offers from sources other than these platforms.

Similar jobs

K HealthTel-Aviv, Israel

About the role We are looking for an experienced clinician to serve as the medical voice inside our AI organization. In this role, you will work shoulder-to-shoulder with AI researchers, product managers, clinical manage…

Full-time
K HealthNew York, New York, United States

Est. 180,000 USD

About the Role: As a Senior Software Engineer at K Health, you are the champion of technical excellence for a high-stakes portfolio of clinical AI and a suite of products that serve the patients and the physicians. We do…

Full-time
K HealthNew York, New York, United States

Est. 175,000 USD

About the role: Our data engineering team is looking for an experienced professional with expertise in SQL, Python, and strong data modeling skills. In this role, you will be at the heart of our data ecosystem, designing…

Full-time
K HealthNew York, New York, United States

Est. 175,000 USD

About the role: As a Senior Product Manager, Clinician Experience you can expect to ship into production at major health systems, work at the AI frontier with real clinical constraints, and operate cross-functionally wit…

Full-time
K HealthNew York, New York, United States

Est. 175,000 USD

About the role:This is an opportunity to join K's critical InfoSec team as a Senior Security Engineer - AppSec and operate with foresight in protecting our infrastructure, applications, cloud security, and customer trust…

Full-time
K HealthNew York, New York, United States

Est. 275,000 USD

About the Company K Health is building the infrastructure for how America will access primary care — an AI-enabled virtual platform that meets patients where they are, embedded within the most trusted health systems in t…

Full-time
K HealthNew York City, New York, United States

Est. 170,000 USD

About the role As Director of Provider Operations, you'll lead the teams responsible for ensuring our physicians and advanced practice providers (APPs) are licensed, credentialed, onboarded, scheduled, and ready to deliv…

Full-time
K HealthNew York, New York, United States

Est. 250,000 USD

About the Company K Health is building the infrastructure for how America will access primary care — an AI-enabled virtual platform that meets patients where they are, embedded within the most trusted health systems in t…

Full-time
K HealthNew York, New York, United States

Est. 180,000 USD

About the Role: We are looking for a Director of Virtual Care Operations to lead and scale a fast-paced healthcare operations organization focused on delivering an exceptional virtual care experience for both patients an…

Full-time
K HealthRemote

Est. 330,000 USD

About the Position We are seeking a board-certified Endocrinologist to join our virtual care team on a flexible, PRN basis. This opportunity is ideal for an endocrinologist who values flexibility and wants to provide hig…

Full-timeRemote
K HealthNew York, New York, United States

Est. 70,000 USD

Job Summary: The Credentialing and Licensing Associate is responsible for managing the end-to-end credentialing lifecycle for healthcare clinicians across our medical network. This role ensures providers are accurately a…

Full-time
K HealthRemote

Est. 140,000 USD

About the role: At K Health, we're not just reimagining primary care, we're building the future of it, and we're looking for exceptional Family Medicine and Internal Medicine physicians to help lead the way. We've partne…

Full-timeRemote
K HealthRemote

Est. 300,000 USD

About the role: Join K Health as we partner with the nation's top-rated hospital systems to expand access to primary care in communities facing complex barriers to in-person care. We are looking for full-time Primary Car…

Full-timeRemote
K HealthRemote

Est. 275,000 USD

About the role: Join K Health as we partner with the nation's top-rated hospital systems to expand access to primary care in communities facing complex barriers to in-person care. We are looking for full-time Primary Car…

Full-timeRemote
K HealthRemote

Est. 315,000 USD

About the role: Join K Health as we partner with the nation's top-rated hospital systems to expand access to primary care in communities facing complex barriers to in-person care. We are looking for full-time Primary Car…

Full-timeRemote
K HealthRemote

Est. 315,000 USD

About the role: Join K Health as we partner with the nation's top-rated hospital systems to expand access to primary care in communities facing complex barriers to in-person care. We are looking for full-time Primary Car…

Full-timeRemote
K HealthRemote

Est. 275,000 USD

About the role: Join K Health as we partner with the nation's top-rated hospital systems to expand access to primary care in communities facing complex barriers to in-person care. We are looking for full-time Primary Car…

Full-timeRemote
K HealthRemote

Est. 260,000 USD

About the role: Join K Health as we partner with the nation's top-rated hospital systems to expand access to primary care in communities facing complex barriers to in-person care. We are looking for full-time Primary Car…

Full-timeRemote
K HealthRemote

Est. 155,000 USD

About the role: Join K Health as we partner with the nation's top-rated hospital systems to close care gaps by launching completely Virtual Comprehensive Care Clinics. We are seeking a full-time, board-certified Family N…

Full-timeRemote
K HealthRemote

Est. 190,000 USD

About the role: Join K Health as we partner with the nation's top-rated hospital systems to close care gaps by launching completely Virtual Comprehensive Care Clinics. We are seeking a full-time, board-certified Family N…

Full-timeRemote
K HealthRemote

Est. 285,000 USD

About the role: Join K Health as we partner with the nation's top-rated hospital systems to expand access to primary care in communities facing complex barriers to in-person care. We are looking for full-time Primary Car…

Full-timeRemote
Spring HealthSan Francisco, California, United States

Est. 194,275 USD

Our mission: eliminating every barrier to mental health. Spring Health is a global mental health company on a mission to eliminate every barrier to mental health. We're building a world where getting support is simple, p…

Full-time
Twin HealthRemote

Est. 202,500 USD

Twin Health At Twin Health, we empower people to improve and prevent chronic metabolic diseases, like type 2 diabetes and obesity, with a new standard of care. Twin Health is the only company applying AI Digital Twin tec…

Full-timeRemote
Spring HealthSeattle, Washington, United States

Est. 229,511 USD

Our mission: eliminating every barrier to mental health. Spring Health is a global mental health company on a mission to eliminate every barrier to mental health. We're building a world where getting support is simple, p…

Full-time
Spring HealthSan Francisco, California, United States

Est. 254,600 USD

Our mission: eliminating every barrier to mental health. Spring Health is a global mental health company on a mission to eliminate every barrier to mental health. We're building a world where getting support is simple, p…

Full-time
Spring HealthSeattle, Washington, United States

Est. 175,000 USD

Our mission: eliminating every barrier to mental health. Spring Health is a global mental health company on a mission to eliminate every barrier to mental health. We're building a world where getting support is simple, p…

Full-time
Spring HealthNew York City, New York, United States

Est. 240,000 USD

Our mission: eliminating every barrier to mental health. Spring Health is a global mental health company on a mission to eliminate every barrier to mental health. We're building a world where getting support is simple, p…

Full-time

Est. 227,500 USD

What you’ll be part of Garner is on a mission to transform the U.S. healthcare system — and we’re the only proven player doing exactly that. We partner with employers to redesign how healthcare works: applying 550+ propr…

Full-timeRemote
Garner HealthNew York City, New York, United States

Est. 257,500 USD

What you’ll be part of Garner is on a mission to transform the U.S. healthcare system — and we’re the only proven player doing exactly that. We partner with employers to redesign how healthcare works: applying 550+ propr…

Full-time
Spring HealthSan Francisco, California, United States

Est. 240,000 USD

Our mission: eliminating every barrier to mental health. Spring Health is a global mental health company on a mission to eliminate every barrier to mental health. We're building a world where getting support is simple, p…

Full-time