Lead Data Engineer: Cloud Pipelines & Databricks

EPAM Systems; Chile; Presencial; CLP 42.000.000 - 66.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical coverage

Lunch allowance

Internet & electricity allowance

Holiday bonuses

Year-end bonus

Learning culture

Additional income opportunities

Relocation assistance

Descripción de la vacante

EPAM Systems Chile is seeking a Lead Data Engineer to modernize data environments with cloud and lakehouse solutions using Databricks. You will design and deliver scalable data pipelines, lead migrations from on-prem to cloud, and establish governance in collaboration with technical and business teams.

The ideal candidate has 5+ years of data engineering experience, strong SQL, Python/Scala, and Databricks expertise, plus proven consulting skills and excellent communication.

Formación

• 5+ years of experience as a Data Engineer.
• Proven consulting experience with clients and stakeholders.
• Hands-on data migration across platforms or to cloud.
• Expertise with Databricks for development and optimization.
• Proficiency in advanced SQL and data modeling.
• Skills in Python or Scala for data engineering workloads.

Responsabilidades

• Design scalable batch and streaming data pipelines.
• Deliver data migration initiatives from on-premises to cloud or between platforms.
• Develop and optimize data solutions using Databricks and Apache Spark.
• Build ETL/ELT processes following data engineering best practices.
• Elicit requirements with technical and business teams in a consulting context.
• Ensure data quality, governance, and security across platforms.
• Monitor and optimize cloud performance and cost.
• Troubleshoot and resolve production pipeline issues.
• Document architectures, processes, and migration strategies.

Conocimientos

Data engineering experience

Consulting experience

SQL proficiency

Python/Scala

Communication skills

Ownership mindset

Analytical mindset

Teamwork

Herramientas

Databricks

Apache Spark

CI/CD for data pipelines

Terraform

Descripción del empleo

EPAM Systems Chile is seeking a Lead Data Engineer to modernize data environments with cloud and lakehouse solutions using Databricks. You will design and deliver scalable data pipelines, lead migrations from on-prem to cloud, and establish governance in collaboration with technical and business teams.

The ideal candidate has 5+ years of data engineering experience, strong SQL, Python/Scala, and Databricks expertise, plus proven consulting skills and excellent communication.