Databricks Data Platform Lead — AI-Driven Analytics

EPAM Systems, Inc.; Colombia; A distancia; COP 70.000.000 - 110.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Healthcare benefits

Paid time off

Learning & development

Global career opportunities

Volunteer opportunities

Descripción de la vacante

EPAM Systems, Inc. seeks a Lead Data Engineer to build and evolve a next-generation analytics platform with a strong focus on Databricks and scalable data products.

You will lead hands-on delivery while providing technical leadership across ingestion, modeling, governance, and AI-enabled engineering practices. You will design scalable data ingestion and transformation, build batch and streaming pipelines, and deliver end-to-end data products supporting analytics across domains.

Formación

• 5+ years of data engineering experience.
• 1+ years of technical leadership guiding engineering standards and best practices.
• Strong platform delivery experience building enterprise analytics solutions end to end.
• Advanced Spark and PySpark expertise for large-scale processing.
• Solid data governance knowledge including security, quality, and lineage practices.

Responsabilidades

• Design scalable data ingestion, transformation, and data product frameworks.
• Define Databricks best practices, including Medallion Architecture, optimization, governance, and operational standards.
• Build batch, near real-time, and streaming pipelines using Databricks capabilities.
• Deliver end-to-end data products for analytics use cases across domains.
• Develop trusted analytical datasets, semantic models, and governed consumption layers for reporting.
• Implement data quality, lineage, monitoring, and observability across pipelines.

Conocimientos

Data engineering

Spark/PySpark

SQL

Databricks

Data governance

Leadership

CI/CD

Communication

Herramientas

Databricks

Apache Spark

PySpark

SQL

Scala

Descripción del empleo

EPAM Systems, Inc. seeks a Lead Data Engineer to build and evolve a next-generation analytics platform with a strong focus on Databricks and scalable data products.

You will lead hands-on delivery while providing technical leadership across ingestion, modeling, governance, and AI-enabled engineering practices. You will design scalable data ingestion and transformation, build batch and streaming pipelines, and deliver end-to-end data products supporting analytics across domains.