Senior Data Engineer: Azure Databricks, PySpark & Global Scale
EPAM Systems
Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.
Benefits offered by this job
Job summary
EPAM Systems is seeking a Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at scale in Azure Databricks, running about 200 Databricks jobs across Europe, North America, and China, with a new China deployment planned.
The role emphasizes building scalable, cost-aware infrastructure, improving observability, and optimizing PySpark workloads for
Qualifications
- 3+ years hands-on data engineering experience.
- Experience with Azure Databricks and PySpark.
- Strong Python development skills.
- Experience optimizing large-scale Spark workloads.
- Background in production data platforms and monitoring.
Responsibilities
- Monitor health, stability, and performance of production data platform.
- Investigate and resolve performance issues and incidents.
- Analyze Databricks workloads and optimize PySpark jobs for performance and cost.
- Support 200+ existing Databricks jobs and pipelines.
- Design scaling strategies with cost-focused infrastructure.
Skills
Tools
Job description
EPAM Systems is seeking a Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at scale in Azure Databricks, running about 200 Databricks jobs across Europe, North America, and China, with a new China deployment planned.
The role emphasizes building scalable, cost-aware infrastructure, improving observability, and optimizing PySpark workloads for
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
