Remote Databricks Data Engineer | Azure & Power BI

Capgemini Engineering; Aguascalientes; A distancia; MXN 600.000 - 900.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible work arrangements

Continuous learning opportunities

Descripción de la vacante

Capgemini Engineering is seeking a MID -Data Engineer- to design, build, and optimize scalable data pipelines and analytics solutions on the Databricks platform. You will leverage Python, SQL, and cloud services to transform and load data for analytics across engineering, manufacturing, and supply chain domains.

The role focuses on data replication, ETL/ELT development, governance, and collaboration with data scientists to enable ML workloads in a distributed environment.

Formación

• Bachelor’s degree in computer science, engineering, or related field.
• Hands-on experience with data engineering or big data development.
• Strong knowledge of SQL, Oracle, or SQL Server.
• Experience with Databricks Platform and Apache Spark (PySpark/Scala).
• Proficiency in Python and SQL; familiarity with Delta Lake and data lake architecture.
• Cloud experience (Azure, AWS, or GCP) and data orchestration tools (Azure Data Factory, Airflow).
• Understanding of data warehousing concepts and version control (Git).

Responsabilidades

• Design, develop, and support data replication and integration solutions using HVR.
• Build and maintain scalable data pipelines with Databricks (Spark, Delta Lake).
• Develop and optimize ETL/ELT processes for structured and unstructured data.
• Ensure data quality, integrity, and performance across large datasets.
• Implement data models and transformations for analytics and reporting.
• Collaborate with data scientists and analysts for advanced analytics and ML workloads.
• Integrate data from databases, APIs, and streaming systems.
• Optimize Spark jobs for performance and cost efficiency.
• Implement data governance, security, and access controls.
• Monitor and troubleshoot data pipelines and production issues.
• Support CI/CD pipelines and DevOps practices for data engineering workflows.
• Assist data migration and modernization initiatives.
• Ensure data quality, governance, security, and compliance.
• Create operational documentation and runbooks.
• Participate in production support and performance tuning activities.

Conocimientos

Databricks Platform

Python

SQL

Spark

Delta Lake

Azure

Power BI

Tableau

Git

CI/CD

Educación

Bachelor’s degree in computer science or engineering

Herramientas

Databricks Platform

Delta Lake

Azure Data Factory

Airflow

Git

CI/CD tooling

Power BI

Tableau

Descripción del empleo

Capgemini Engineering is seeking a MID -Data Engineer- to design, build, and optimize scalable data pipelines and analytics solutions on the Databricks platform. You will leverage Python, SQL, and cloud services to transform and load data for analytics across engineering, manufacturing, and supply chain domains.

The role focuses on data replication, ETL/ELT development, governance, and collaboration with data scientists to enable ML workloads in a distributed environment.