Data Engineer - Databricks (Remote, México)

The Big Jobsite

Aguascalientes

Remote

MXN 900,000 - 1,300,000

Full time

40 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Capgemini Engineering is seeking a Data Engineer to design, develop, and maintain scalable ETL/ELT data pipelines using Python and Databricks, joining a global team of engineers to help organizations leverage data for impactful results.

You will work with Spark, PySpark, Delta Lake, and Lakehouse architectures, integrating data from databases, APIs, files, and cloud storage while ensuring data quality and reliability in a remote-friendly setup.

Qualifications

  • Strong hands-on experience with Python, Databricks, Apache Spark, and PySpark.
  • Experience building and supporting production-grade ETL/ELT data pipelines.
  • Strong SQL skills and experience with data modeling, data transformation, and data quality practices.
  • Experience working with Delta Lake and Lakehouse architectures.
  • Experience integrating data from databases, APIs, files, and cloud storage, with understanding of Git, CI/CD, testing, and engineering best practices.

Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Python and Databricks.
  • Develop data processing and transformation solutions using Spark and PySpark.
  • Build, optimize, and maintain Databricks notebooks, workflows, and jobs.
  • Integrate data from multiple sources, including databases, APIs, files, and cloud storage, with cleansing, enrichment, and validation activities.
  • Optimize data pipelines and Spark workloads for performance, scalability, reliability, monitoring, logging, and troubleshooting.
  • Collaborate with analysts, developers, architects, and business teams while participating in code reviews, testing, CI/CD, and production support activities.

Skills

Python
SQL
Data Modeling
Spark

Tools

Databricks
PySpark
Spark
Git
CI/CD

Job description

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

Your role
  • Design, develop, and maintain scalable ETL/ELT data pipelines using Python and Databricks.
  • Develop data processing and transformation solutions using Spark and PySpark.
  • Build, optimize, and maintain Databricks notebooks, workflows, and jobs.
  • Integrate data from multiple sources, including databases, APIs, files, and cloud storage, while performing data cleansing, enrichment, and validation activities.
  • Optimize data pipelines and Spark workloads for performance, scalability, reliability, monitoring, logging, and troubleshooting.
  • Collaborate with analysts, developers, architects, and business teams while participating in code reviews, testing, documentation, CI/CD, and production support activities.
Your profile
  • Strong hands-on experience with Python, Databricks, Apache Spark, and PySpark.
  • Experience building and supporting production-grade ETL/ELT data pipelines.
  • Strong SQL skills and experience with data modeling, data transformation, and data quality practices.
  • Experience working with Delta Lake and Lakehouse architectures.
  • Experience integrating data from databases, APIs, files, and cloud storage, with understanding of Git, CI/CD, testing, and engineering best practices.
What you will love
  • Work on meaningful projects that use technology to solve real-world challenges.
  • Access continuous learning through internal academies, certifications, and mentorship.
  • Professional communities to connect with and support career growth
Need to know
  • This position is offered in a remote work model.
  • Employees have access to Capgemini offices located in Mexico City, Aguascalientes, and Guadalajara, providing flexibility for collaboration and team interactions when needed.
About Capgemini

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of over 420,000 team members in more than 50 countries. We deliver end-to end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. At Capgemini Mexico, we aim to attract the best talent and are committed to creating a diverse and inclusive work environment, so there is no discrimination based on race, sex, sexual orientation, gender identity or expression, or any other characteristic of a person. All applications welcome and will be considered based on merit against the job and/or experience for the position.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Azure Data Factory (Remote, México)
Data Engineer - Azure Data Factory (Remote, México)

The Big Jobsite • Aguascalientes

Remote
MXN 420,000 - 780,000
Data Engineer - Azure Data Factory (Remote, México)
Data Engineer - Azure Data Factory (Remote, México)

Capgemini Engineering • Aguascalientes

Hybrid
MXN 540,000 - 780,000
Meaningful projects
Continuous learning
Career acceleration programs
Cloud Data Engineer- ONSITE CDMX
Cloud Data Engineer- ONSITE CDMX

Capgemini Engineering • Aguascalientes

On-site
MXN 480,000 - 600,000
Diversity & inclusion
Continuous learning
Employee networks
+1
Data Engineer (Databricks+Snowflake)
Data Engineer (Databricks+Snowflake)

Capgemini • Aguascalientes

Remote
MXN 600,000 - 900,000
Middleware & Data Integration Engineer - APIs, Azure & Databricks (Hybrid, CDMX)
Middleware & Data Integration Engineer - APIs, Azure & Databricks (Hybrid, CDMX)

Capgemini • Aguascalientes

On-site
MXN 420,000 - 720,000
Continuous learning via internal acc.
Mentorship programs
Employee networks: OutFront, CapAbilty
+1
Data Engineer
Data Engineer

Capgemini • Aguascalientes

On-site
MXN 600,000 - 900,000
Data Engineer
Data Engineer

Capgemini • Aguascalientes

Remote
MXN 800,000 - 1,100,000
Production Support Engineer (Databricks)
Production Support Engineer (Databricks)

Capgemini • Aguascalientes

Remote
MXN 670,000 - 1,004,000
Ingeniero De Datos Aws
Ingeniero De Datos Aws

The Big Jobsite • Aguascalientes

On-site
MXN 900,000 - 1,600,000
Lead Data Engineer / Databricks
Lead Data Engineer / Databricks

Capgemini • Aguascalientes

On-site
MXN 900,000 - 1,300,000