Senior Test Automation Engineer - Data & AI Team (m/f/d)
SoficoZwijnaarde, East Flanders, Belgium · Posted 11 days agoDescription
What you’ll do...
- Own and evolve the test automation strategy for the Data & AI platform — unit, integration, contract, regression, and end-to-end — designing, building, and maintaining automated frameworks and suites integrated into CI/CD pipelines.
- Validate end-to-end business processes within sandboxed Miles environments, ensuring correctness, reliability, and safe failure handling.
- Develop API and contract testing approaches for distributed services and integrations.
-
Design and own evaluation approaches for AI-powered and agentic capabilities where outcomes are probabilistic rather than pass/fail: LLM-as-a-judge setups, baseline/benchmark datasets, and process/quality metrics for agent behavior.
-
Establish baselines and regression tracking for model and agent output quality over time, this alongside the deterministic CI gates.
- Collaborate across engineering domains to ensure platform-wide quality and release confidence.
- Drive continuous improvement in test automation practices and tooling, and act as a mentor and quality advocate, helping teams adopt effective automated testing approaches.
What you bring...
- Test automation engineering: unit/integration/e2e frameworks, CI/CD integration
- Testing APIs, backend services, microservices, and distributed systems
- Programming in Java and/or Python, including typed schemas, mocking, and test-data setup/teardown
- Designing scalable automation frameworks from the ground up, and coaching others in their adoption
- Non-deterministic / AI evaluation testing: LLM-as-a-judge, benchmarking, quality metrics for agentic systems (plus)
- Workflow orchestration platforms, cloud-native applications, and LLM/agentic systems (plus)
- Tooling such as Playwright, Kubernetes, and modern DevOps practices (advantage)
What's in it for you…
- Competitive salary package.
- Meal allowance provided per working day.
- Fully covered private health insurance, so you can focus on what matters most.
- Hybrid working and flexible hours, giving you the freedom to shape your workday.
- A modern co-working space offering a comfortable working environment.
- A structured onboarding program from day one, with a dedicated coach to help you get up to speed and grow in your role.
- Regular opportunities to connect beyond day-to-day work — casual drinks, team activities, and company-wide events.
Ready to build the secure and deterministic capabilities behind the next generation of mobility software? Join SOFICO and let's shape what's next together!
Similar jobs
Est. 80,000 EUR
Senior AI Engineer Why SOFICO? At SOFICO, we’re shaping the future of mobility - and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their automotive finance…
Est. 65,000 EUR
At SOFICO, we're building the future of mobility through Miles, our market-leading platform that helps companies manage leasing, fleet, and mobility operations worldwide. As an international team, we combine innovation,…
Est. 80,000 EUR
At SOFICO, we're building the future of mobility through Miles, our market-leading platform for leasing, fleet, and mobility operations worldwide. As an international team, we combine innovation, collaboration, and owner…
Est. 70,000 EUR
Why SOFICO? At SOFICO, we’re shaping the future of mobility — and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their leasing, fleet, and mobility operatio…
Est. 80,000 EUR
Why SOFICO? At SOFICO, we’re shaping the future of mobility — and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their leasing, fleet, and mobility operatio…
Est. 80,000 EUR
What the job is about As a Lead Test Automation Engineer, you are responsible for defining, implementing, and continuously improving the test automation strategy across the organization. You combine deep technical expert…
Est. 42,000 EUR
Are you ready to take quality to the next level? At Sofico, we develop Miles, our future-proof platform designed to support the full business lifecycle of automotive finance, leasing, fleet and mobility companies worldwi…
Est. 65,000 EUR
Why SOFICO? At SOFICO, we’re shaping the future of mobility - and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their leasing, fleet, and mobility operatio…
Est. 55,000 EUR
About the job Are you interested in challenging projects, technical innovation, implementing new ideas and solving complex problems? Our software, "Miles", is an ERP software for finance, leasing, fleet and mobility mana…
Est. 65,000 EUR
Why SOFICO? At SOFICO, we’re shaping the future of mobility - and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their automotive finance, leasing, fleet, a…
Est. 35,000 EUR
As a Functional Tester, you’ll focus on the functional testing of the Miles Enterprise Suite, an all-in-one solution covering front, mid, and back-office operations, configurable to meet our customers’ unique needs. You’…
Est. 45,000 EUR
Why SOFICO? At SOFICO, we’re shaping the future of mobility - and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their leasing, fleet, and mobility operatio…
Est. 45,000 EUR
Why SOFICO? At SOFICO, we’re shaping the future of mobility - and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their leasing, fleet, and mobility operatio…
Est. 55,000 EUR
What the job is about As a backend Software Engineer Microservices, your role involves expanding and enhancing our leading ‘Miles Enterprise’ solution. Miles offers a secure and cloud-native platform for automotive finan…
Est. 55,000 EUR
About the job Are you interested in challenging projects, technical innovation, implementing new ideas and solving complex problems? Our software, "Miles", is an ERP software for finance, leasing, fleet and mobility mana…
Est. 55,000 EUR
Why SOFICO? At SOFICO, we’re shaping the future of mobility - and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their leasing, fleet, and mobility operatio…
The Joblogic Story Established in 1998, Joblogic is the UK’s #1 Field Service Management (FSM) software platform. We are a global business with offices in the UK, Pakistan, and Vietnam. Since our management buy-out in 20…
Est. 55,000 EUR
Why SOFICO? At SOFICO, we’re shaping the future of mobility - and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their leasing, fleet, and mobility operatio…
Est. 65,000 GBP
About the job Are you interested in challenging projects, technical innovation, implementing new ideas and solving complex problems? Our software, Miles, is an ERP software for finance, leasing, fleet and mobility manage…
Est. 60,000 EUR
Who We Are At Platform Science, we’re working to connect everything that moves. Founded in 2015, we are an open IoT platform that partners with innovative fleets, application developers, vehicle manufacturers, and equipm…
About the Role We are looking for a motivated and detail-oriented QA Test Engineering Intern to join our Quality Engineering team. This internship offers an excellent opportunity to gain hands-on experience in software t…
Est. 55,000 EUR
At SOFICO, we’re shaping the future of mobility - and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their leasing, fleet, and mobility operations in one in…
Est. 90,000 EUR
About the job You are the visionary builder behind our software landscape. As a Technical Application Architect, you don't just design systems: you craft the blueprint for scalable, secure, and high-performance solutions…
Est. 60,000 EUR
What the job is about As a Performance Testing Specialist, you ensure the performance, stability, scalability, and reliability of our automotive software solutions through both proactive and reactive performance engineer…
Est. 84,000 PLN
Hello, let’s meet! Who We Are While Xebia is a global tech company, our journey in CEE started with two Polish companies – PGS Software, known for world-class cloud and software solutions, and GetInData, a pioneer in Big…
Est. 90,000 EUR
About the job You are the strategic mastermind behind the digital connectivity of our enterprise clients. As a Senior Integration Consultant, you don't just build interfaces; you define the integration architecture for m…
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Est. 55,000 EUR
About the job You are the strategic translator between the complex business worlds of our clients and the technological capabilities of our software "Miles". As a Senior Business Analyst, you dive deep into the operation…
Est. 80,000 EUR
About the job You are the expert navigator for our most complex client projects. As a Senior Implementation Consultant, you leverage your deep industry knowledge and technical expertise to steer global automotive and lea…
Est. 55,000 EUR
Why SOFICO? At SOFICO, we’re shaping the future of mobility - and we’re doing it together. Our software, Miles, is a leading platform that enables companies worldwide to manage their leasing, fleet, and mobility operatio…