Lead Data Software Engineer (Python, AWS, Databricks)

EPAM Systems; Mexico; On-site; PHP 3,689,000 - 5,164,000; Full time

Benefits offered by this job

Career growth opportunities

LinkedIn Learning access

English classes

Employee stock purchase plan

13th month bonus

Job summary

EPAM Systems is seeking a seasoned Lead Data Software Engineer to drive design, development, and optimization of scalable data solutions. You will guide a skilled team of engineers, architect data pipelines, and partner with cross-functional stakeholders to deliver impactful data products.

You will ensure data quality, governance, and cloud platform optimization while mentoring engineers and shaping the data engineering roadmap.

Qualifications

• 5+ years of experience in data engineering or software engineering roles, including at least 1 year in a lead capacity.
• Proficiency in Python for data processing and automation.
• Expertise in Amazon Web Services.
• Skills in Databricks for large-scale data processing and analytics.
• Background in designing and maintaining scalable data pipelines and ETL workflows.
• Understanding of data modeling, warehousing concepts, and performance optimization.
• Capability to lead technical teams and mentor junior engineers.
• Strong communication and collaboration skills for working effectively across cross-functional teams.
• Proficiency in English (both written and spoken) at a minimum of B2 level.

Responsibilities

• Lead the design, development, and deployment of scalable data engineering solutions.
• Architect and implement efficient data pipelines and ETL processes.
• Mentor and guide a team of data engineers, fostering best practices and technical growth.
• Collaborate with data scientists, analysts, and business stakeholders to capture data requirements.
• Ensure data quality, integrity, and governance across all engineering initiatives.
• Optimize performance, reliability, and cost-efficiency of cloud-based data platforms.
• Drive code reviews, technical documentation, and engineering standards.
• Troubleshoot complex data issues and deliver timely resolutions.
• Keep current with emerging data technologies and recommend improvements.
• Partner with leadership to shape the data engineering roadmap and strategy.

Skills

Leadership

Python

AWS

Databricks

Data modeling

Communication

English proficiency

Tools

Python

AWS

Databricks

Job description

We are looking for a seasoned Lead Data Software Engineer to spearhead the design, development, and optimization of scalable data solutions. In this position, you will guide a skilled team of engineers, architect resilient data pipelines, and partner with cross-functional stakeholders to deliver impactful data products that advance business goals.

Responsibilities

• Lead the design, development, and deployment of scalable data engineering solutions
• Architect and implement efficient data pipelines and ETL processes
• Mentor and guide a team of data engineers, fostering best practices and technical growth
• Collaborate with data scientists, analysts, and business stakeholders to capture data requirements
• Ensure data quality, integrity, and governance across all engineering initiatives
• Optimize performance, reliability, and cost-efficiency of cloud-based data platforms
• Drive code reviews, technical documentation, and engineering standards
• Troubleshoot complex data issues and deliver timely resolutions
• Keep current with emerging data technologies and recommend improvements
• Partner with leadership to shape the data engineering roadmap and strategy

Requirements

• 5+ years of experience in data engineering or software engineering roles, including at least 1 year in a lead capacity
• Proficiency in Python for data processing and automation
• Expertise in Amazon Web Services
• Skills in Databricks for large-scale data processing and analytics
• Background in designing and maintaining scalable data pipelines and ETL workflows
• Understanding of data modeling, warehousing concepts, and performance optimization
• Capability to lead technical teams and mentor junior engineers
• Strong communication and collaboration skills for working effectively across cross-functional teams
• Proficiency in English (both written and spoken) at a minimum of B2 level

We offer

• Career plan and real growth opportunities
• Unlimited access to LinkedIn learning solutions
• Constant training, mentoring, online corporate courses, eLearning and more
• English classes with a certified teacher
• Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
• Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
• Flexible work schedule and dress code
• Collaborate in a multicultural environment and share best practices from around the globe
• Hired directly by EPAM & 100% under payroll
• Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
• Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
• 13 % employee savings fund, capped to the law limit
• Grocery coupons
• 30 days December bonus
• Employee Stock Purchase Plan
• 12 vacations days
• Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
• Monthly non-taxable amount for the electricity and internet bills

EPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.

By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM´s Privacy Notice and Policy.

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.