Description
Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important projects for our clients, deliver market-leading propositions across the digital, online and mobile channels, and are recognised for our leadership in the application of agile and lean delivery methods to assure delivery. We have offices in Australia, India, South Africa, the UK, the EU and the USA.
Our Data Engineers are highly skilled in creating data pipelines for ingest, transformation and storage of data, usually at scale, and are familiar with standing-up analytics clusters.
This role involves using modern agile technical practices - including Continuous Integration and Deployment, TDD, and XP - to deliver timely and pragmatic solutions, as well as helping others to do their jobs in a more effective way.
Responsibilities
- Working with the client and the team to determine data processing and access needs and how best to deliver them.
- Creation and support of highly available data pipelines and storage solutions (e.g. data warehouses).
- Delivery of software using agile (pair programming, TDD, CI/CD, etc) practices.
- Automation of data infrastructure and deployments.
- Advocating agile practices to the client organisation.
- Mentoring client team members.
- Helping improve the team and clients’ data capabilities.
Required Skills
- Significant experience working on data pipelines, platforms and projects.
- Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP, Azure).
- Strong background in at least one programming language, Python or Scala preferable.
- Working with a variety of databases, data warehouses and distributed file systems in production environments.
- Strong experience in SQL and data modelling.
- Exposure with data processing at scale.
- Knowledge about GDPR and data security.
- Working with source control and infrastructure as code (Git/Github, Terraform, ansible etc.) and CI/CD tools.
- Understanding and being able to support data scientists or business intelligence teams - in data prep, mentoring and support functions.
- Strong collaboration and communication skills, including the ability to communicate effectively while working remotely with globally distributed
*This role is only open to candidates that are based in South Africa
Similar jobs
Description Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions forblue-chip enterprise and public sector clients across a range of industry sectors. We work on importantp…
Description Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important…
Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions forblue-chip enterprise and public sector clients across a range of industry sectors. We work on importantprojects for…
Senior Data Engineer Powering the future requires serious data infrastructure. We’re looking for a Senior Data Engineer to design, scale, and champion modern data solutions for us. About Sand Sand Technologies is a globa…
Est. 90,000 GBP
Senior Data Engineer Who we are Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the ent…
Est. 120,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer. Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate…
Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important projects fo…
Description Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important…
Takealot Fulfilment Solutions (TFS), a division of Takealot Online (RF) (Pty) Ltd, is looking for a highly talented Senior Data Analyst to join our team in Cape Town. Join Our Mission at Takealot Fulfilment Solutions | W…
Est. 84,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Description Equal Experts is an innovative consultancy specializing in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important…
About WPP Media WPP is the trusted growth partner for the world’s leading brands. With exceptional talent, trusted data and intelligence, and world-class partnerships – all united by our pioneering agentic marketing plat…
About us: Working at Tech Holding isn't just a job, it's an opportunity to be a part of something bigger. We are a full-service consulting firm that was founded on the premise of delivering predictable outcomes and high-…
Est. 840,000 SEK
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
About the Role We are looking for a Senior Data Engineer with strong experience in modern data platforms and cloud-based architectures. The ideal candidate has deep hands-on experience with Snowflake or Databricks, has b…
Project Description We are looking for a motivated Data Engineer to join our growing data team. This is a great opportunity for someone early in their career to gain hands-on experience with modern data technologies. You…
Who We Are Konrad is a next generation digital consultancy. We are dedicated to solving complex business problems for our global clients with creative and forward-thinking solutions. Our employees enjoy a culture built o…
Join Exadel as a Senior Data Engineer and bring logic to life. Solve analytical challenges and build solutions that matter—with a sharp, collaborative team. Why Join Exadel We’re an AI-first global tech company with 25+…
Est. 84,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Est. 80,000 GBP
Spaulding Ridge is an advisory and IT implementation firm. We help global organizations get financial clarity into the complex, daily sales, and operational decisions that impact profitable revenue generations, efficient…
Description Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important…
Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organis…
Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organis…
Who We Are Konrad is a next generation digital consultancy. We are dedicated to solving complex business problems for our global clients with creative and forward-thinking solutions. Our employees enjoy a culture built o…
Data Engineer Particle41 is seeking a talented and versatile Data Engineer to join our innovative team. As a Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and infra…
Est. 80,000 USD
Join Exadel as a Senior Data Engineer and bring logic to life. Solve analytical challenges and build solutions that matter—with a sharp, collaborative team. Why Join Exadel We’re an AI-first global tech company with 25+…
Est. 60,000 USD
Who We Are Konrad is a next generation digital consultancy. We are dedicated to solving complex business problems for our global clients with creative and forward-thinking solutions. Our employees enjoy a culture built o…
Job Title: Senior Data EngineerKey Skills: DBT, Python, SQL, Snowflake, DatabricksLocation: BrazilMode: RemoteWe at Coforge are hiring Senior Data Engineer with the following skill set.Key Responsibilities Delivery &…
Est. 120,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…