Remote Senior Data Engineer - Lakehouse & Spark

Capgemini Engineering; Aguascalientes; On-site; MXN 600,000 - 900,000; Full time

Benefits offered by this job

Flexible work location

Learning opportunities

Job summary

Capgemini Engineering is seeking a Senior Data Engineer for a Sr role with remote work options. You will design, build, and optimize data pipelines using Databricks, Spark, and Lakehouse architecture while coordinating with data scientists and analysts on ML workloads.

You will ensure data quality, governance, and security across multiple sources and cloud platforms. The role involves monitoring Databricks clusters, implementing orchestration with ADF, and documenting standards and best

Qualifications

• Experience with Delta Lake and Lakehouse architecture.
• Knowledge of Azure Data Factory (ADF) for orchestration.
• Exposure to CI/CD pipelines for data engineering.
• Experience with SQL and Spark SQL.
• Azure certifications related to data engineering.

Responsibilities

• Design, build, and maintain data pipelines and ETL with Databricks and Spark.
• Optimize data workflows for performance, scalability, and cost.
• Implement data lakehouse architecture and data ingestion from multiple sources.
• Collaborate with data scientists and analysts for analytics and ML workloads.
• Ensure data quality, governance, and security across assets.
• Monitor and troubleshoot Databricks clusters, jobs, and workflows.
• Integrate Databricks with AWS, Azure, or GCP and other systems.
• Document processes, standards, and best practices.

Skills

Delta Lake

Lakehouse architecture

CI/CD pipelines

SQL

Spark SQL

Data governance

Tools

Databricks

Apache Spark

Azure Data Factory

Job description

Sr- Data Engineer- Sr | Remote

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

Sr- Data Engineer- Sr | Remote

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

YOUR ROLE

• Design, build, and maintaindata pipelinesand ETL processes usingDatabricksandApache Spark.
• Optimize data workflows for performance, scalability, and cost efficiency.
• Implementdata Lakehouse architectureand manage data ingestion from multiple sources.
• Collaborate with data scientists and analysts to enable advanced analytics and machine learning workloads.
• Ensuredata quality, governance, and securityacross all data assets.
• Monitor and troubleshoot Databricks clusters, jobs, and workflows.
• Integrate Databricks withcloud services(AWS, Azure, or GCP) and other enterprise systems.
• Document processes, standards, and best practices for data engineering.
  
  

YOUR PROFILE

• Experience withDelta Lakeand Lakehouse architecture.
• Knowledge ofAzure Data Factory (ADF)for orchestration.
• Exposure to CI/CD pipelines for data engineering.
• Experience with SQL and Spark SQL.
• Azure certifications related to data engineering.
  
  

WHAT YOU’LL LOVE ABOUT WORKING HERE?

• At Capgemini Engineering, we encourage flexibility in how, when, and where people get their work done, allowing a better work-life balance, and greater empowerment. They partner with their managers to find an arrangement that works best for their role and their circumstances.
• At Capgemini Engineering, we’re always looking ahead. We’re part of a team that creates opportunities to achieve valuable change. Change that makes a difference. New connections, new technologies, new ways to work. It’s so energizing.
• At Capgemini Engineering, we make it easy for you to deepen knowledge and learn new skills while you’re still doing the day job.
  
  

About Capgemini

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 300,000 team members in nearly 50 countries. With its strong 50-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering, and platforms.

Get the future you want!

At Capgemini Mexico, we aim to attract the best talent and are committed to creating a diverse and inclusive work environment, so there is no discrimination based on race, sex, sexual orientation, gender identity or expression, or any other characteristic of a person. All applications welcome and will be considered based on merit against the job and/or experience for the position.