Lead Data Engineer: Python, PySpark, AWS & Jenkins

Yoh; United States; Hybrid; USD 87,000 - 124,000; Full time

Benefits offered by this job

Medical Insurance

Health Savings Account (HSA)

Life & Disability Insurance

401K Retirement Savings Plan

Direct Deposit & weekly epayroll

Referral Bonus Programs

Certification and training programs

Job summary

Yoh, a Day & Zimmermann company, is seeking a Lead Data Engineer in McLean, VA. You will design and optimize scalable data pipelines using Python and PySpark, leveraging AWS and CI/CD with Jenkins, and provide technical leadership across engineering teams.

You will collaborate with data scientists and stakeholders, drive data engineering best practices, ensure data quality, and mentor junior engineers in a hybrid onsite role.

Qualifications

• Strong hands-on experience with Python and PySpark.
• Hands-on experience with AWS environments.
• Experience building or supporting CI/CD pipelines using Jenkins.
• Strong understanding of big data processing and data engineering principles.
• Ability to lead technical initiatives and collaborate across teams.
• Excellent communication, analytical, and problem-solving skills.

Responsibilities

• Design, develop, and maintain scalable data engineering and machine learning solutions.
• Build and optimize data pipelines using Python and PySpark.
• Leverage AWS services to support cloud-based data processing and application development.
• Develop, enhance, and maintain CI/CD pipelines using Jenkins.
• Troubleshoot performance, reliability, and data quality issues.
• Collaborate with data scientists, software engineers, and business stakeholders.
• Provide technical leadership, code reviews, and guidance to other team members.
• Apply best practices for testing, deployment, monitoring, and production support.

Skills

Python

PySpark

AWS

Leadership

Communication

Tools

Jenkins

Job description

Yoh, a Day & Zimmermann company, is seeking a Lead Data Engineer in McLean, VA. You will design and optimize scalable data pipelines using Python and PySpark, leveraging AWS and CI/CD with Jenkins, and provide technical leadership across engineering teams.

You will collaborate with data scientists and stakeholders, drive data engineering best practices, ensure data quality, and mentor junior engineers in a hybrid onsite role.