inhousefyi
← Back to listings

LLM Platform Engineer/Lead (m/f/d)

KayzenRemote Ā· Posted 7 months ago
Full-timeRemote
Apply now

Description

Remote from EMEA or Bangalore

Hello šŸ‘‹ I am Servesh, Co- founder and CTO at Kayzen, and I am now looking for a LLM Platform Engineer/Lead who will be part of our Engineering team. šŸ™Œ But wait, you have not heard of Kayzen before? 😃

Kayzen is a mobile demand-side platform (DSP) dedicated to democratizing programmatic advertising. We enable leading apps, agencies, media buyers, and brands to run programmatic customer acquisition, retargeting, and brand performance campaigns through its self-serve and managed service options. Built on the three core pillars of performance, transparency, and control, Kayzen powers the world’s best mobile marketing teams with bespoke solutions that fuel business growth and deliver a competitive advantage. With an unprecedented scale of 160B+ daily ad requests from 1.6B+ unique users worldwide, we serve up to 1B+ ads per day in 180 countries. Kayzen is accessible through our APIs and user interface.

The Team

The Platform Engineering team owns Real-time bidding (RTB) platform, a Real-time budget system, Real-time event processing, Stream data processing engine and multiple other complex large-scale distributed components and data pipelines. We work closely with data scientists, data analysts, product and business teams. We are responsible for some of the most technically challenging work, for example:

  • Handling ~2 Million Req/sec in sub-millisecond latency
  • Handing & managing ~Petabytes of data
  • Managing distributed systems deployed across multiple data centers
  • Optimizing JVM and Linux kernel for optimal performance
  • Managing our own data center spread across the globe consisting of thousand of powerful servers
  • Working on some of the most challenging problems of Ad-Tech

Sounds interesting. Isn't it?

About the Role

We are looking for an LLM Platform Engineer /Lead who can evangelise AI across the company and build the foundational tooling, frameworks, and workflows that allow teams to ship AI-powered features quickly and safely. This role is ideal for an experienced engineer who understands modern AI capabilities and focuses on developer velocity, reuse, and production readiness rather than training complex models from scratch.

Responsibilities

  • Design and build internal AI frameworks, SDKs, and shared libraries
  • Enable teams to integrate AI features with minimal friction
  • Set up standardized patterns for using LLMs, embeddings, agents, and workflows
  • Build reusable components for prompt management, evaluation, observability, and safety
  • Define best practices for AI usage, cost control, and reliability
  • Evangelise AI internally through documentation, examples, and hands-on guidance
  • Rapidly prototype AI-powered features and turn them into reusable building blocks
  • Own AI tooling from experimentation to production

Requirements

AI Tooling & Framework Experience (Core Focus)

    • Hands-on experience with LLM APIs (OpenAI, Anthropic, etc.)
    • Experience with RAG pipelines, embeddings, vector databases
    • Familiarity with prompt engineering, prompt versioning, and evaluation
    • Experience with AI orchestration frameworks
    • Good understanding of AI observability, cost monitoring, and failure modes
    • You’ve shipped at least one LLM-powered feature to production and iterated based on telemetry or user feedback.
    • Comfortable with embeddings, fine-tuning, vector search, tokenisation, and evaluation methodologies.
    • Familiar with data lakes/warehouses, feature stores, and streaming/batch ETL; cloud (AWS/GCP/Azure).

Strong Engineering & Platform Skills

    • Excellent Python skills (required)
    • Experience building frameworks, platforms, or developer tooling
    • Strong understanding of APIs, services, and system design
    • Writes clean, maintainable, production-grade code

Startup Mindset

    • Bias for shipping and iteration
    • Can translate AI complexity into simple abstractions
    • Comfortable with ambiguity and rapid change
    • Thinks in terms of leverage and reuse , not one-off solutions

Less About

    • Heavy model training or research
    • Designing custom ML algorithms
    • Academic optimisation work

Nice to have

  • Experience with agent-based systems and tool calling
  • Experience setting up guardrails, moderation, and safety checks
  • Familiarity with Docker, cloud infra, and CI/CD
  • Prior work in platform teams or enablement roles

What do we offer?

  • Reporting directly to Co-founder & CTO
  • Direct access to top management and an extremely ā€œvisibleā€ role
  • Exceptional career growth and learning opportunity
  • A unique opportunity to be part of an experienced team of industry experts and entrepreneurs who bring massive change to the Adtech market
  • A fun, driven, and multinational team located across Germany, India, UK, Argentina, Ukraine, Turkey, Spain and many more countries
  • A flexible work-from-home arrangement
  • A 500-dollar home-office setup budget
  • A 1000-dollar annual learning and development budget

Similar jobs

KayzenRemote

Hello šŸ‘‹ I am Servesh, Co- founder and CTO at Kayzen, and I am now looking for a Senior AI Engineer who will be part of our Engineering team. šŸ™Œ But wait, you have not heard of Kayzen before? 😃 Kayzen is a mobile demand…

Full-timeRemote
KayzenRemote

Fullstack Team Lead (m/f/d) India, Remote Hello šŸ‘‹ I am Servesh, Co- founder and CTO at Kayzen, and I am now looking for a Fullstack Team Lead to lead our Fullstack team. šŸ™Œ But wait, you have not heard of Kayzen before?…

Full-timeRemote
ArionkoderRemote

Est. 120,000 USD

Arionkoder is an AI consulting firm helping companies build, embed, and own AI systems that drive real business outcomes. We combine Product Development, Artificial Intelligence, and Team Augmentation to craft digital pr…

Full-timeRemote
KayzenRemote

Est. 80,000 EUR

Business Development Lead - Media Buyers (m/f/d) Berlin (onsite), EMEA Remote, US East Coast________________________ HellošŸ‘‹I am Tim, CEO and Co-Founder at Kayzen, and I am now looking for a Business Development Lead - M…

Full-timeRemote
KayzenRemote

Remote India HellošŸ‘‹I am Ashish, Product Operations Lead at Kayzen, and I am now looking for a Product Analyst to join our team šŸ™Œ But wait, you have not heard of Kayzen before?😃Kayzen is a mobile demand-side platform (…

Full-timeRemote

Est. 120,000 PLN

Company Background Our client is a global technology company transforming the way brands and agencies make marketing decisions. Its platform enables marketers to plan and activate cross-channel, programmatic media campai…

Full-timeRemote
N-iXRemote

Est. 120,000 EUR

N-iX is a global software development company founded in 2002, connecting over 2,400+ tech professionals across 40+ countries. We deliver innovative technology solutions in cloud computing, data analytics, AI, embedded s…

Full-timeRemote
KayzenRemote

Est. 120,000 EUR

Berlin,London,New York, EMEA Remote________________________ HellošŸ‘‹I am Tim, CEO and Co-Founder at Kayzen, and I am now looking for a Marketing Lead to join our team šŸ™Œ In this role, you will be leading all aspects of ma…

Full-timeRemote
INFUSERemote

OUR HIRING PROCESS: We will review your application against our job requirements. We do not employ machine learning technologies during this phase as we believe every human deserves attention from another human. We do no…

Full-timeRemote
Lynx AnalyticsNew York, New York, United States

Est. 140,000 USD

ROLE SUMMARY We are looking for a Senior Data Scientist to lead complex data science engagements that combine traditional statistical modelling with Generative AI. You will work hands-on with very large datasets across d…

Full-time
INFUSERemote

Est. 84,000 PLN

OUR HIRING PROCESS: We will review your application against our job requirements. We do not employ machine learning technologies during this phase as we believe every human deserves attention from another human. We do no…

Full-timeRemote
INFUSERemote

OUR HIRING PROCESS: We will review your application against our job requirements. We do not employ machine learning technologies during this phase as we believe every human deserves attention from another human. We do no…

Full-timeRemote
INFUSERemote

OUR HIRING PROCESS: We will review your application against our job requirements. We do not employ machine learning technologies during this phase as we believe every human deserves attention from another human. We do no…

Full-timeRemote
INFUSERemote

OUR HIRING PROCESS: We will review your application against our job requirements. We do not employ machine learning technologies during this phase as we believe every human deserves attention from another human. We do no…

Full-timeRemote
ManychatBarcelona, Spain

Est. 80,000 EUR

WHO WE ARE šŸŒ Creating content that resonates is great — turning that attention into growth is even better. That's what Manychat does. Our AI-powered automations help creators and brands engage with audiences across Inst…

Full-time
ManychatAmsterdam, Netherlands

Est. 120,000 EUR

WHO WE ARE šŸŒ Creating content that resonates is great — turning that attention into growth is even better. That's what Manychat does. Our AI-powered automations help creators and brands engage with audiences across Inst…

Full-time
LLMOps Engineer25 days ago
ALX AfricaRemote

About ALX Africa ALX Africa, a non-profit organisation under the ALX Foundation, is dedicated to unlocking the potential of Africa's digital future. Formerly part of Sand Tech Holdings, we've embarked on an independent j…

Full-timeRemote
KayzenRemote

Est. 60,000 EUR

Programmatic Trader (m/f/d) Berlin, Bangalore, Remote ________________________ HellošŸ‘‹I am Willian, Trading and Analytics Lead at Kayzen, and I am now looking for a Programmatic Trader to join our team šŸ™Œ About Kayzen Ka…

Full-timeRemote
AI/ML Developer4 months ago

Est. 120,000 PLN

We are launching a strategic pool of AI specialists to accelerate the growth of our AI Practice and turn strong market demand into scalable, repeatable capabilities. This role goes beyond project delivery-it is about sha…

Full-timeRemote
KayzenRemote

Est. 200,000 USD

President, US (m/f/d) New York region________________________ HellošŸ‘‹I am Tim, CEO and Co-Founder at Kayzen, and I am looking for our very first US hire: President, US. In this role, you will be owning all aspects of our…

Full-timeRemote
SQUADRemote

Team Summary Our distributed team is looking for an experienced Applied Scientist with a strong background in Large Language models to develop high-performance Generative AI features across Cloud and Edge environments. J…

Full-timeRemote
Senior AI EngineerMay 13, 2025
AmdarisSofia, Bulgaria

We fuse together exceptional talent who deliver outstanding software solutions. Our approach has helped us grow 60% in 2021, 94% in 2022, while in 2023 we joined forces with Insight, a Fortune 500 company and a leading s…

Full-time
Modus CreateRemote

AI Engineer (Python, Machine Learning, Generative AI/LLMs) About Us Founded in 2011, Modus is a global, fully remote team of world-class technologists who thrive in a collaborative, innovative environment. We’re a digita…

Full-timeRemote
Modus CreateRemote

Est. 141,000 USD

AI Engineer (Python, Machine Learning, Generative AI/LLMs) About Us Founded in 2011, Modus is a global, fully remote team of world-class technologists who thrive in a collaborative, innovative environment. We’re a digita…

Full-timeRemote
ALX AfricaRemote

About ALX Africa ALX Africa, a non-profit organisation under the ALX Foundation, is dedicated to unlocking the potential of Africa's digital future. Formerly part of Sand Tech Holdings, we've embarked on an independent j…

Full-timeRemote
GradialSeattle, Washington, United States

Est. 205,000 USD

Gradial is the marketing operations system of work that helps marketers and creatives move from idea to execution faster. Our platform orchestrates across martech stacks, workflows, and people to automate marketing execu…

Full-time
ArtefactNew York, New York, United States

Est. 200,000 USD

About the job Do you think like a management consultant, thrive in a startup environment, and can’t stop thinking about the intersection of data, technology, and marketing? With over 2000 employees, offices on five conti…

Full-time
LinkedIn Job WrappingNew York, New York, United States

Est. 200,000 USD

About the job Do you think like a management consultant, thrive in a startup environment, and can’t stop thinking about the intersection of data, technology, and marketing? With over 2000 employees, offices on five conti…

Full-time
Staff AI Engineer2 months ago
WorkatoRemote

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-timeRemote
AI Researcher3 months ago
WorkatoSingapore, Singapore

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-time