Senior Data Engineer: Cloud Lakehouse & Databricks Lead

EPAM Systems; Chile; On-site; CLP 66,960,000 - 111,600,000; Full time

Benefits offered by this job

Medical coverage

Lunch allowance

Internet allowance

Holiday bonus

Learning culture

Referral bonus

Job summary

EPAM Systems is seeking a Lead Data Engineer in Chile to modernize data environments with cloud and lakehouse solutions using Databricks. You will lead scalable pipeline delivery, data migration, and governance while partnering with technical and business teams.

You will design scalable batch and streaming pipelines, develop migrations from on-prem to cloud or cross-platform, and optimize Databricks-based solutions. Strong SQL, Python/Scala, and consulting mindset required.

Qualifications

• 5+ years of experience as a Data Engineer.
• Consulting experience working with clients and stakeholders.
• Hands-on experience with data migration projects, from legacy systems to cloud or platform-to-platform.
• Expertise in Databricks for development and optimization.
• Proficiency in advanced SQL and data modeling.
• Skills in Python or Scala for data engineering workloads.
• Upper-Intermediate English proficiency (B2, upper-intermediate).
• Strong analytical and solution-oriented mindset.
• Clear communication skills and teamwork focus.
• Proactive attitude with strong ownership mindset.

Responsibilities

• Design scalable batch and streaming data pipelines.
• Deliver data migration initiatives from on-premises to cloud or between platforms.
• Develop and optimize data solutions using Databricks and Apache Spark.
• Build ETL/ELT processes aligned with data engineering best practices.
• Elicit requirements with technical and business teams in a consulting context.
• Ensure data quality, governance, and security across platforms.
• Monitor and optimize cloud performance and cost.
• Troubleshoot and resolve production pipeline issues.
• Document architectures, technical processes, and migration strategies.

Skills

Databricks

SQL

Python/Scala

Data modeling

Data migration

Consulting

English (B2)

Communication

Ownership mindset

Teamwork

Tools

Power BI

Kafka

Unity Catalog

Terraform

ARM

CI/CD

Job description

EPAM Systems is seeking a Lead Data Engineer in Chile to modernize data environments with cloud and lakehouse solutions using Databricks. You will lead scalable pipeline delivery, data migration, and governance while partnering with technical and business teams.

You will design scalable batch and streaming pipelines, develop migrations from on-prem to cloud or cross-platform, and optimize Databricks-based solutions. Strong SQL, Python/Scala, and consulting mindset required.