Lead Data Engineer: Python on AWS & Databricks

EPAM Systems; Mexico; On-site; PHP 3,689,000 - 5,164,000; Full time

Benefits offered by this job

Career growth opportunities

LinkedIn Learning access

English classes

Employee stock purchase plan

13th month bonus

Job summary

EPAM Systems is seeking a seasoned Lead Data Software Engineer to drive design, development, and optimization of scalable data solutions. You will guide a skilled team of engineers, architect data pipelines, and partner with cross-functional stakeholders to deliver impactful data products.

You will ensure data quality, governance, and cloud platform optimization while mentoring engineers and shaping the data engineering roadmap.

Qualifications

• 5+ years of experience in data engineering or software engineering roles, including at least 1 year in a lead capacity.
• Proficiency in Python for data processing and automation.
• Expertise in Amazon Web Services.
• Skills in Databricks for large-scale data processing and analytics.
• Background in designing and maintaining scalable data pipelines and ETL workflows.
• Understanding of data modeling, warehousing concepts, and performance optimization.
• Capability to lead technical teams and mentor junior engineers.
• Strong communication and collaboration skills for working effectively across cross-functional teams.
• Proficiency in English (both written and spoken) at a minimum of B2 level.

Responsibilities

• Lead the design, development, and deployment of scalable data engineering solutions.
• Architect and implement efficient data pipelines and ETL processes.
• Mentor and guide a team of data engineers, fostering best practices and technical growth.
• Collaborate with data scientists, analysts, and business stakeholders to capture data requirements.
• Ensure data quality, integrity, and governance across all engineering initiatives.
• Optimize performance, reliability, and cost-efficiency of cloud-based data platforms.
• Drive code reviews, technical documentation, and engineering standards.
• Troubleshoot complex data issues and deliver timely resolutions.
• Keep current with emerging data technologies and recommend improvements.
• Partner with leadership to shape the data engineering roadmap and strategy.

Skills

Leadership

Python

AWS

Databricks

Data modeling

Communication

English proficiency

Tools

Python

AWS

Databricks

Job description

EPAM Systems is seeking a seasoned Lead Data Software Engineer to drive design, development, and optimization of scalable data solutions. You will guide a skilled team of engineers, architect data pipelines, and partner with cross-functional stakeholders to deliver impactful data products.

You will ensure data quality, governance, and cloud platform optimization while mentoring engineers and shaping the data engineering roadmap.