Software Engineer, Distributed Systems & AI Agents (Senior Level)
InstabaseBengaluru, India · Posted 24 days agoDescription
At Instabase, we're passionate about democratizing access to cutting-edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems in their industry. With customers representing some of the largest and most complex organizations in the world, and investors like Greylock, Andreessen Horowitz, and Index Ventures, our market opportunity is near infinite.
Instabase offers a consumption-based pricing model where customers can pay only for what they use, aligning directly with the value our products deliver. It empowers our clients to explore our AI Hub platform features extensively, enabling them to uncover crucial business insights. This customer-centric model allows Instabase to glean insights from diverse use cases and behaviors, ensuring we deliver top-tier solutions that provide unmatched advantages for everyday business operations.
With offices in San Francisco and Bengaluru, Instabase is a truly global company. We are people-first, and we've built a fearlessly experimental, endlessly curious, customer obsessed team who work together and help organizations around the world turn their unstructured data into insights instantly.
The Role
We are looking for a systems-minded engineer to build the distributed backend and execution infrastructure that powers AI agents. You will help build scalable, reliable, and secure systems at the intersection of distributed systems, agentic execution, and applied AI.
About the Team
The team tackles some of the most challenging technical problems in scaling the capabilities and utility of agents and agentic models. Our work enables best-in-class platforms that leverage the world’s most capable models and maximize the value of agentic products for users across enterprises, small and medium-sized businesses, and individuals. We work across several interconnected areas:
- Distributed systems for processing large-scale unstructured-data extraction workloads.
- Reliable backend infrastructure for agentic execution and long-running AI workflows.
- R&D into advances in LLMs and AI, including benchmarks and new approaches to solving complex platform and customer problems.
What You Will Do
- Take new ideas from 0-to-1 quickly, then evolve their architecture to scale by orders of magnitude—from early prototypes to production systems handling workloads that are 10×, 1,000×, or even 1,000,000× larger.
- Build scalable distributed systems for large-scale unstructured-data extraction and agentic workloads.
- Develop reliable execution infrastructure for scheduling, retries, timeouts, cancellation, rate limits, and failure recovery.
- Build agent runtimes that coordinate model calls, tool execution, durable state, multi-step loops, and human approvals.
- Evaluate emerging models and AI techniques through benchmarks and experiments, and apply them to new platform and customer problems.
- Own systems from design through production, including testing, observability, and pragmatic trade-offs across reliability, performance, security, and cost.
About You
- 5+ years of software engineering experience building and operating production backend systems, with the ability and experience toserve as a technical lead—setting direction, leading teams through complex projects, and mentoring and coaching engineers while remaining hands-on.
- Strong fundamentals in distributed systems, concurrency, APIs, data modeling, and failure handling.
- Experience with agentic execution systems, workflow orchestration, event processing, scheduling, or high-volume services.
- Proficiency in a backend language such as Python, Go, Java, Kotlin, Rust, or C++.
- Experience with queues, databases, caching, containers, cloud infrastructure, and production observability.
- Experience building or integrating ML, generative-AI, or LLM-based systems, including tool calling and agent workflows.
- A strong ownership mindset across design, deployment, monitoring, incident response, and continuous improvement.
Helpful experience: workflow engines or task executors; Kafka, Temporal, Celery, Ray, or similar systems; Kubernetes; agent runtimes, RAG, evaluations, model gateways, MCP, or AI observability.
Instabase is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Research shows that in order to apply for a job, women feel they need to meet 100% of the criteria while men usually apply after meeting about 60%. Regardless of how you identify, if you believe you can do the job and are a good match, we encourage you to apply.
Similar jobs
Est. 250,000 USD
At Instabase, we're passionate about democratizing access to cutting-edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems in their industry. With customers representing…
Est. 272,500 USD
At Instabase, we're passionate about democratizing access to cutting-edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems in their industry. With customers representing…
Est. 175,750 USD
At Instabase, we're passionate about democratizing access to cutting-edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems in their industry. With customers representing…
Est. 132,500 USD
At Instabase, we're passionate about democratizing access to cutting-edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems in their industry. With customers representing…
Est. 144,000 USD
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
Est. 157,000 USD
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
About SingleStore At SingleStore, we’re not just building a database company, we’re defining the future of data management. Going beyond multi-cloud, we offer customers flexible networking, storage, and compute options t…
Emergent builds autonomous coding agents that replace traditional software development by generating, testing, and deploying production applications directly from plain-language intent. Our systems run in production at g…
About EarnIn As one of the first pioneers of earned wage access, our passion at EarnIn is building products that deliver real-time financial flexibility for those with the unique needs of living paycheck to paycheck. Our…
Est. 120,000 GBP
As a Software Engineer on the AI Infrastructure team, you'll help build and evolve our agent sandboxing platform — the secure, high-performance code execution layer powering our agentic workflows, deployed across both in…
About EarnIn As one of the first pioneers of earned wage access, our passion at EarnIn is building products that deliver real-time financial flexibility for those with the unique needs of living paycheck to paycheck. Our…
Est. 202,500 USD
AI Infrastructure Engineer - Agent Sandbox Platform As a Software Engineer on the AI Infrastructure team, you'll help build and evolve our agent sandboxing platform — the secure, high-performance code execution layer pow…
Est. 175,000 USD
Gradial is the marketing operations system of work that helps marketers and creatives move from idea to execution faster. Our platform orchestrates across martech stacks, workflows, and people to automate marketing execu…
Est. 243,225 USD
Scale GP is building the infrastructure that makes enterprise AI seamless. We are looking for a Senior Infrastructure Engineer to act as a primary technical lead, engineering the 'paved road' for our knowledge retrieval…
Est. 132,500 GBP
About InstaLILY InstaLILY is an AI products and infrastructure company that puts execution at the frontier of enterprise AI. That work begins with Lily™, the world's first AI Forward Deployed Engineer, which learns how a…
HackerRank helps companies like NVIDIA, Amazon, and Microsoft hire and upskill the next generation of developers based on skills, not pedigree. Our platform is trusted by over 2,500 of the world’s most innovative compani…
Est. 279,450 USD
About Scale Scale's mission is to develop reliable AI systems for the world's most important decisions. As the leading AI data foundry, we provide the high-quality data and full-stack technologies that power the world's…
Est. 84,000 EUR
At Scale AI, we’re not just building AI tools—we’re pioneering the next era of enterprise AI. As businesses race to harness the power of Generative AI, Scale is at the forefront, delivering cutting-edge solutions that tr…
Est. 170,000 USD
About InstaLILY InstaLILY is an AI products and infrastructure company that puts execution at the frontier of enterprise AI. That work begins with Lily™, the world's first AI Forward Deployed Engineer, which learns how a…
Est. 150,000 GBP
Director, Forward Deployed Engineering At Scale AI, we're not just building AI tools—we're pioneering the next era of enterprise AI. The world's largest enterprises are racing to deploy Generative AI into the core of the…
Est. 202,500 USD
Scale GP is Scale's enterprise Generative AI platform—APIs and infrastructure for knowledge retrieval, inference, evaluation, and intelligent automation. We power mission-critical workflows for leading enterprises, helpi…
Est. 80,000 GBP
AI is becoming vitally important in every function of our society. At Scale, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most…
Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, natura…
Est. 120,000 GBP
At Scale AI, our mission is to accelerate the development of AI applications. For 10 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense…
Est. 245,700 USD
About Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative…
About DialpadDialpad is the AI platform for customer experience, built to resolve customer problems in real time across voice and digital. Our AI agents learn from your best human agents and improve with every interactio…
Est. 243,000 USD
About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with the world's leading enterprises and government organizations to accelerat…
Est. 283,500 USD
About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with the world's leading enterprises and government organizations to accelerat…