Senior Data Engineer

EPAM Systems, Inc.; Colombia; A distancia; COP 120.000.000 - 210.000.000; Jornada completa

Descripción de la vacante

EPAM Systems, Inc. seeks a Senior Data Engineer to build a retail and omnichannel analytics platform. You will drive hands-on data engineering, platform best practices, and scalable architecture to support ingestion, transformation, and self-service analytics.

You will define AI-enabled development patterns, lead cross-functional collaboration, and mentor engineers while delivering end-to-end data products, trusted datasets, and governed consumption layers across enterprise analytics initiatives.

Formación

• 3+ years of data engineering experience.
• Strong leadership and mentoring abilities.
• Proven project delivery across end-to-end analytics lifecycles.
• Proficiency in SQL for analytics and performance tuning.
• Experience with Spark / PySpark and Databricks.

Responsabilidades

• Design scalable data ingestion, transformation, and data product frameworks.
• Define Databricks best practices for medallion layers, governance, and performance.
• Build batch and near real-time pipelines using Databricks and Spark.
• Deliver end-to-end data products for retail and omnichannel analytics use cases.
• Develop trusted analytical datasets, semantic models, and governed consumption layers.
• Implement data quality, lineage, monitoring, and observability standards.
• Lead PoCs to evaluate and adopt new platform capabilities.
• Define AI SDLC and AI-assisted development patterns for engineering teams.
• Mentor engineers on reusable frameworks and operational excellence.

Conocimientos

Databricks

Apache Spark

PySpark

SQL

Leadership

Mentoring

Python

Herramientas

Databricks

Apache Spark

PySpark

Descripción del empleo

We are looking for a Senior Data Engineer to build a next-generation retail and omnichannel analytics platform, and we need you to drive hands-on data engineering, platform best practices, and scalable architecture. You will shape ingestion and transformation frameworks, enable self-service analytics, and advance AI-enabled engineering.ResponsibilitiesDesign scalable data ingestion, transformation, and data product frameworksDefine Databricks best practices for medallion layers, governance, and performanceBuild batch and near real-time pipelines using Databricks and SparkDeliver end-to-end data products for retail and omnichannel analytics use casesDevelop trusted analytical datasets, semantic models, and governed consumption layersImplement data quality, lineage, monitoring, and observability standardsLead proof-of-concepts to evaluate and adopt new platform capabilitiesDefine AI SDLC and AI-assisted development patterns for engineering teamsPartner with cross-functional stakeholders to align solutions and ensure adoptionMentor engineers on reusable frameworks and operational excellenceRequirements3+ years of data engineering experienceStrong leadership skills to drive technical direction and mentor engineersProven project delivery skills across end-to-end analytics lifecyclesAdvanced Databricks skills in enterprise production environmentsExpert Apache Spark and PySpark skills for scalable data processingStrong SQL skills for analytics, modeling, and performance tuningUpper-Intermediate English proficiency (B2)Nice to haveData architecture experience for lakehouse and enterprise analytics platformsData solution architecture experience to standardize patterns across teamsScala experience for Spark-based pipeline developmentWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.