Senior Data Engineer: Cloud Lakehouse & Databricks Lead

EPAM Systems; Mexico; On-site; PHP 3,321,000 - 5,166,000; Full time

Benefits offered by this job

Career growth

LinkedIn learning

English classes

Employee stock purchase plan

Flexible schedule

Job summary

EPAM Systems in Mexico seeks a Lead Data Engineer to modernize data environments, focusing on cloud and lakehouse solutions using Databricks. You will lead scalable pipeline delivery, data migration, and governance, partnering with technical and business teams to deliver results.

The role requires 5+ years as a Data Engineer with strong consulting experience, Databricks expertise, advanced SQL, and Python/Scala proficiency, plus excellent communication and ownership mindset.

Qualifications

• 5+ years of experience as a Data Engineer.
• Proven consulting experience with clients and stakeholders.
• Hands-on data migration experience from on‑prem to cloud or platform‑to‑platform.
• Databricks expertise for development and optimization.
• Advanced SQL and data modeling proficiency.
• Python or Scala for data engineering workloads.
• Upper-intermediate English (B2).
• Strong analytical and solution-oriented mindset.
• Clear communication and teamwork focus.
• Proactive ownership mindset.

Responsibilities

• Design scalable batch and streaming data pipelines.
• Deliver data migration initiatives to cloud or between platforms.
• Develop and optimize data solutions using Databricks and Spark.
• Build ETL/ELT processes following data engineering best practices.
• Elicit requirements with technical and business teams in a consulting context.
• Ensure data quality, governance, and security across platforms.
• Monitor cloud performance and cost, and optimize accordingly.
• Troubleshoot production pipeline issues.
• Document architectures, processes, and migration strategies.

Skills

Databricks

SQL

Python/Scala

English B2

Consulting

Communication

Ownership mindset

Tools

Terraform

CI/CD

Power BI

Kafka

Unity Catalog

Job description

EPAM Systems in Mexico seeks a Lead Data Engineer to modernize data environments, focusing on cloud and lakehouse solutions using Databricks. You will lead scalable pipeline delivery, data migration, and governance, partnering with technical and business teams to deliver results.

The role requires 5+ years as a Data Engineer with strong consulting experience, Databricks expertise, advanced SQL, and Python/Scala proficiency, plus excellent communication and ownership mindset.