Data Engineer

Pyramid Consulting, Inc

Aguascalientes

Presencial

MXN 900.000 - 1.500.000

Jornada completa

Hace 2 días
Sé de los primeros/as/es en solicitar esta vacante

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Pyramid Consulting, Inc. seeks a Lead Data Engineer to drive design and implementation of scalable data pipelines using Databricks, Lakeflow Connect, and Delta Lake.

The role emphasizes ingestion from Oracle, MySQL, and SQL Server, building batch and streaming ETL/ELT workflows, and delivering robust data platform solutions with leadership across engineering teams. Ideal candidates bring 8+ years in data engineering, hands-on Databricks expertise, and a track record of architecture decisions and

Formación

  • 8+ years of experience in Data Engineering or Big Data.
  • Hands-on with Databricks and enterprise-scale ingestion.
  • Experience leading technical teams and architecture decisions.

Responsabilidades

  • Design scalable data ingestion frameworks with Databricks and Lakeflow Connect.
  • Develop batch and streaming pipelines across Oracle, MySQL, SQL Server, APIs and more.
  • Build ETL/ELT pipelines using Databricks, Spark, Delta Lake and cloud-native tech.
  • Architect end-to-end ingestion, transformation, storage, validation and monitoring.
  • Design scalable data pipeline architectures for analytics-ready datasets.
  • Implement data quality checks, validation, monitoring and error handling.

Conocimientos

Databricks
Lakeflow Connect
Delta Lake
Apache Spark
ETL/ELT design
Data Ingestion
Data Pipelines
Cloud Data Platforms
Leadership

Herramientas

Databricks Native Data Loader
Lakeflow Connect
Delta Lake
Apache Spark

Descripción del empleo

We're Hiring: Lead Data Engineer – Databricks (Data Ingestion & Lakeflow Connect)

Role: Lead Data Engineer

Specialization: Databricks, Lakeflow Connect, Data Engineering & Cloud Data Platforms

Job Description

We are looking for an experienced Lead Data Engineer with strong expertise in Databricks, enterprise data ingestion, and large-scale data engineering to lead the design and implementation of scalable, high-performance data pipelines.

The ideal candidate should have hands‑on experience with Databricks Native Data Loader, Lakeflow Connect, Delta Lake, Apache Spark, and enterprise data integration from relational databases such as Oracle, MySQL, and SQL Server.

The role involves driving data engineering architecture, optimizing ETL/ELT workflows, ensuring data quality and platform reliability, and providing technical leadership to engineering teams.

Key Responsibilities
  • Design and implement scalable data ingestion frameworks using Databricks Native Data Loader, Lakeflow Connect, and other Databricks‑native capabilities.
  • Develop and optimize batch and streaming data pipelines integrating Oracle, MySQL, SQL Server, APIs, and other enterprise data sources.
  • Build robust ETL/ELT pipelines using Databricks, Apache Spark, Delta Lake, and cloud-native technologies.
  • Architect end‑to‑end data ingestion, transformation, storage, validation, and monitoring solutions.
  • Design and maintain scalable data pipeline architectures to transform raw and unstructured data into analytics‑ready datasets.
  • Implement data quality checks, validation frameworks, pipeline monitoring, and error‑handling mechanisms.
  • Perform performance tuning, root cause analysis, and optimization of data pipelines and distributed processing workloads.
  • Drive automation, infrastructure optimization, scalability, and continuous improvement initiatives.
  • Implement unit testing, integration testing, and Test‑Driven Development (TDD) practices.
  • Ensure data governance, security, reliability, and compliance with enterprise engineering standards.
  • Provide technical leadership, mentorship, and guidance to junior data engineers.
  • Collaborate with Product, Architecture, Analytics, Engineering, and Business teams to translate requirements into technical solutions.
  • Drive engineering best practices across coding standards, CI/CD, DevOps, documentation, and code reviews.
  • Participate in architecture discussions, technical design reviews, Agile ceremonies, sprint planning, and estimation.
Required Technical Skills
  • Databases: Oracle, MySQL, Microsoft SQL Server.
  • Data Processing: Batch Processing, Streaming, Data Pipelines.
Experience & Qualifications
  • 8+ years of experience in Data Engineering, Data Integration, or Big Data technologies.
  • Strong hands‑on experience with Databricks and enterprise‑scale data ingestion solutions.
  • Proven experience designing and implementing scalable data pipelines and ETL/ELT frameworks.
  • Experience leading technical teams, mentoring engineers, and driving architecture decisions.
  • Strong communication, problem‑solving, and stakeholder collaboration skills.
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Data Engineer
Senior Data Engineer

Code17tek • México

Presencial
MXN 900.000 - 1.500.000
Data Engineer With Databricks
Data Engineer With Databricks

VeeRteq Solutions Inc. • Estado de México

Presencial
MXN 350.000 - 750.000
IT Data Engineer
IT Data Engineer

Eastman Kodak Company • Región Centro

Presencial
MXN 1.583.000 - 2.607.000
Lead Data Engineer: Databricks & Ingestion Architect
Lead Data Engineer: Databricks & Ingestion Architect

Pyramid Consulting, Inc • Aguascalientes

Presencial
MXN 900.000 - 1.500.000
Data Engineer Mexico
Data Engineer Mexico

V4C.ai • México

A distancia
MXN 420.000 - 660.000
Health insurance
Growth opportunities
Parental leave
+1
Data Engineer (Kafka)
Data Engineer (Kafka)

VeeRteq Solutions Inc. • Estado de México

Presencial
MXN 1.200.000 - 2.100.000
Solution Data Engineer Sr.
Solution Data Engineer Sr.

Turtle Trax S.A. • Región Centro

A distancia
MXN 1.224.632 - 1.574.527
Lead Data Engineer / Databricks
Lead Data Engineer / Databricks

Capgemini • Aguascalientes

Presencial
MXN 900.000 - 1.300.000
Azure Data Engineer
Azure Data Engineer

Lingaro • México

Presencial
MXN 700.000 - 1.100.000
Data Solution Architect
Data Solution Architect

Turtle Trax S.A. • Región Centro

A distancia
MXN 900.000 - 1.500.000