Description
About the Role
As a Principal Engineer, you will be responsible for the architectural design and end-to-end implementation of a high-performance OLAP query engine and semantic layer. The primary goal is to develop a custom JSON-based query language (DSL) and a translation engine that converts these requests into optimized SQL for columnar databases. This role requires a deep understanding of systems programming, compiler theory, and multi-dimensional data modeling to serve high-concurrency read loads in a microservices environment.
What You'll Do
- Architectural Design & Query Execution
- Compiler & DSL development: Design a custom JSON-based OLAP query language. Define eBNF grammars and build a translation layer to convert functional formulas and DSL requests into an optimized execution plan.
- SQL generation & optimization: Implement and oversee the generation of highly optimized SQL tailored for columnar databases including ClickHouse, SingleStore, and DuckDB.
- Semantic layer management: Architect the representation of multi-dimensional data models within columnar structures, ensuring efficient data retrieval and aggregation.
- Custom function logic: Implement logic for custom functions, determining the optimal balance between SQL push-down and application-layer execution
- Caching & Performance Engineering
- Multi-dimensional caching: Envisage and implement a distributed caching strategy for multidimensional data, utilizing shared memory systems like Redis.
- Concurrency & scaling: Build and maintain high-performance microservices using Java (Micronaut or Spring Boot) with Project Loom (Virtual Threads) to handle massive concurrent read loads.
- Low-level optimization: Manage system-level performance including connection pooling, array pooling, and off-heap memory management.
- JVM tuning: Apply expert knowledge of Java Garbage Collectors (including ZGC and Shenandoah) to maintain low-latency response times.
- Engineering Excellence & AI Integration
- AI-augmented development: Leverage AI coding agents and tools to accelerate the software development lifecycle, from prototyping to debugging.
- Technical documentation: Maintain a disciplined approach to software development by documenting architectural decisions, design patterns, and technical specifications.
- Technical leadership: Act as the primary technical authority on query engine internals, providing guidance on complex systems-level challenges.
What We're Looking For
- 15+ years in software engineering with a focus on backend systems and data infrastructure
- Strong theoretical and practical knowledge of compilers, ASTs, eBNF, and query planning
- In-depth understanding of SQL, query optimization, and the internal workings of columnar databases
- Expert proficiency in Java, specifically regarding multi-threading, asynchronous I/O, networking, and memory management
- Proven experience in designing distributed caching layers and managing state across microservices
- Ability to decompose complex data problems into scalable architectural components
- Clear verbal and written communication skills, with a strong tendency to document thoughts and architectural ideas
- A rigorous approach to software craftsmanship, including testing, telemetry, and performance benchmarking
- Minimum of 1 year of experience using AI coding agents to enhance development productivity
- Prior experience developing financial systems such as ERP, EPM, or General Ledger platforms is an added plus
Why this Role
You will own the internals of the query engine at the heart of a next-generation financial planning platform — the layer where compiler theory, columnar database performance, and multi-dimensional semantics converge.
Pay Transparency Statement
At Planful our top priority is to support our employees and ensure each individual has access to equal growth opportunities. Pay decisions take into consideration the individual's skillset, experience, knowledge, qualifications for the role, and specific work location.
The OTE range for this role is $325,000 - $375,000 USD per year, depending on experience and location. As a part of this role, you are also eligible for equity, benefits and wellbeing resources.
Similar jobs
Est. 250,000 USD
About the Role As a Forward Deployed Engineer, you own the technical success of a customer's rollout end to end — from initial data integration through modeling, validation, and go-live — and you feed what you learn dire…
Est. 92,500 USD
About Us Planful is the pioneer of financial performance management cloud software. The Planful platform, which helps businesses drive peak financial performance, is used around the globe to streamline business-wide plan…
Est. 175,000 USD
Jahnel Group’s mission is to provide the absolute best environment for software creators to pursue their passion by connecting them with great clients doing meaningful work. This is a full time position with one of our c…
Est. 161,500 USD
About Pantheon Pantheon WebOps Platform powers the open web, running more than 300,000 sites in the cloud for customers including Google, Princeton, Salesloft and Doctors Without Borders. Every day, thousands of develope…
Est. 120,000 GBP
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Est. 205,000 USD
PlanetScale is growing rapidly and reinventing the database space. The PlanetScale platform offers both Postgres and Vitess clusters. Vitess, an open-source database clustering system for horizontal scaling of MySQL, ena…
Est. 175,000 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 120,000 GBP
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
The Senior Staff Backend Engineer owns the core services at the heart of the platform: the data-intensive computation layer that turns curated financial and operational data into correct, reproducible, fully traceable re…
Est. 120,000 GBP
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Est. 65,000 USD
About Us Planful is the pioneer of financial performance management cloud software. The Planful platform, which helps businesses drive peak financial performance, is used around the globe to streamline business-wide plan…
Est. 120,000 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 80,000 EUR
About This Role: We're looking for a Senior, dbt-specialised Analytics Engineer to build and maintain the business-critical data models behind the client's credit, payments, and fraud/AML reporting. Our client is a fast-…
Est. 140,000 USD
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Est. 140,000 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 201,500 USD
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Est. 201,500 USD
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Est. 167,000 USD
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Est. 120,000 GBP
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Est. 120,000 GBP
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Application and Interview Impersonation Notice: Impersonating another individual when applying for employment, and/or participating in an interview process to assist another individual in obtaining employment, with Preci…
Est. 102,500 USD
About Us Planful is the pioneer of financial performance management cloud software. The Planful platform, which helps businesses drive peak financial performance, is used around the globe to streamline business-wide plan…
Est. 90,000 GBP
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Est. 199,350 USD
About Pantheon Pantheon WebOps Platform powers the open web, running more than 300,000 sites in the cloud for customers including Google, Princeton, Salesloft and Doctors Without Borders. Every day, thousands of develope…
Est. 90,000 EUR
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
Est. 245,475 USD
About Engine Engine is the all-in-one travel and spend management platform trusted by 38K+ businesses and groups representing 1.8M+ travelers. We're the retailer and the rails of business travel, the fastest-growing comp…
About Pantheon Pantheon WebOps Platform powers the open web, running more than 300,000 sites in the cloud for customers including Google, Princeton, Salesloft and Doctors Without Borders. Every day, thousands of develope…