Data Engineer - Databricks

Zurich 56 Company Ltd; Estado de México; Presencial; MXN 1.032.346 - 1.290.433; Jornada completa

Descripción de la vacante

Zurich Capability Center is seeking a Data Engineer in Mexico. The role focuses on designing and maintaining scalable data pipelines using Databricks. Candidates should have a Bachelor's degree in Computer Science and 3+ years of experience in data engineering.

Strong skills in Python, SQL, and data architectures are required. The ideal candidate will collaborate with Data Scientists and Analysts to deliver reliable datasets and optimize ETL processes. Join a global team committed to making a difference.

Formación

• 3+ years of experience in Data Engineering, Data Warehousing, or Big Data environments.
• Hands-on experience with Databricks and distributed data processing.
• English level B2 or higher.

Responsabilidades

• Design, build, and maintain scalable data pipelines.
• Develop, optimize, and automate ETL/ELT processes.
• Collaborate with Data Scientists and Analysts to ensure data quality.

Conocimientos

Python

SQL

Databricks

Apache Spark

Data Lakes

ETL/ELT processes

Data modeling concepts

Git

Analytical skills

Problem-solving skills

Educación

Bachelor's Degree in Computer Science or related field

Herramientas

Azure Data Platform

Airflow

Kafka

Azure Data Factory

Descripción del empleo

134772

#ZCC

Zurich Capability Center is currently hiring a:

Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks and cloud-based data platforms.
• Develop, optimize, and automate ETL/ELT processes to support analytics, reporting, and machine learning initiatives.
• Work closely with Data Scientists, Analysts, ML Engineers, and business stakeholders to understand data requirements and deliver reliable datasets.
• Implement data ingestion frameworks from multiple structured and unstructured data sources.
• Build and maintain data models, data lakes, and data warehouses that support enterprise analytics needs.
• Ensure data quality, consistency, governance, and security across platforms.
• Optimize Spark workloads and Databricks environments for performance and cost efficiency.
• Support deployment and operationalization of machine learning solutions by providing production-ready datasets and feature pipelines.
• Collaborate with Azure, IT, and DevOps teams to implement CI/CD and DataOps best practices.
• Monitor, troubleshoot, and continuously improve data platform performance and reliability.

Your Skills and Experience

As a Data Engineer, your skills and experience will ideally include:

Required

• Bachelor's Degree in Computer Science, Engineering, Information Systems, Mathematics, or a related field.
• 3+ years of experience in Data Engineering, Data Warehousing, or Big Data environments.
• Strong programming skills in Python and SQL.
• Hands‑on experience with Databricks, Apache Spark, and distributed data processing.
• Experience designing and developing ETL/ELT data pipelines.
• Experience working with Data Lakes and modern data architectures.
• Understanding of data modeling concepts including Star Schema and Dimensional Modeling.
• Experience working with Git and version control systems.
• Strong analytical and problem‑solving skills.
• English level B2 or higher.

Preferred Qualifications

• Experience with Azure Data Platform services, including:
• Experience working with Delta Lake and Lakehouse architecture.
• Knowledge of orchestration tools such as Airflow, Databricks Workflows, or Azure Data Factory.
• Experience supporting Machine Learning use cases and MLOps practices.
• Familiarity with MLflow and model deployment processes.
• Knowledge of CI/CD, Infrastructure as Code, and DataOps practices.
• Experience with streaming technologies such as Kafka or Event Hubs.
• Experience working in Agile environments.
• Insurance industry experience is a plus.

Nice to Have

• Experience collaborating with Data Science teams and supporting AI/ML initiatives.
• Knowledge of Generative AI, LLM data pipelines, vector databases, and embedding workflows.
• Experience with Unity Catalog, data governance, and metadata management.
• Exposure to cloud-native architectures and enterprise-scale data platforms.

Position available only for candidates located in Mexico City, State of Mexico, or Guadalajara. Please apply only if you reside in one of these areas.

Who we are

Looking for a challenging and inspiring work environment where you can make a difference? At Zurich millions of individuals and businesses place their trust in our products and services every day. Our 53,000 employees worldwide form the basis of our success, enabling businesses and communities to face a world of risk with confidence. Imagine if you could help people do this all over the world. You’d give them confidence and reassurance by protecting what they love most. It’s a big challenge, but you will be supported by a world‑class team who believe in helping you to reach your full potential and deliver on our promises.

So be challenged. Be inspired. Help us make a difference.

At Zurich we are an equal opportunity employer. We attract and retain the best qualified individuals available, without regard to race/ethnicity, religion, gender, sexual orientation, age, or disability.