Remote Data Engineer: Scalable Pipelines & Delta Lake

McKesson Corporation; Irving (TX); On-site; USD 157,000 - 169,000; Full time

Job summary

McKesson Corporation is hiring a Data Engineer to design and maintain scalable data pipelines and platforms. You will analyze requirements to build end-to-end data solutions, including ingestion, transformation, modeling, and serving layers, with a focus on performance and cost efficiency.

You will implement Delta Lake features, collaborate on data contracts and SLAs, and mentor junior engineers while enjoying 100% telecommuting within the U.S.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering or related field.
• Five years of related experience as a data engineer.
• Two years of experience in SQL, Java, Python, MySQL, and Databricks.
• Experience with S3, GitLab, API integration and Katalon testing.

Responsibilities

• Independently design, develop, and maintain scalable, high performance data pipelines and data platforms.
• Analyze business and technical requirements to design end to end data solutions including ingestion, transformation, data modeling, and serving layers.
• Lead the design and implementation of ETL/ELT workflows optimizing for performance, reliability, and cost.
• Implement Delta Lake capabilities: schema enforcement, evolution, data versioning.
• Collaborate with Product, QA, and upstream teams to finalize data contracts, SLAs, and data delivery.
• Debug data issues involving distributed processing, growing data volumes, latency, and upstream changes.
• Enforce data governance, security, and compliance within Databricks with access controls and cataloging.
• Participate in design/code reviews, identify systemic issues, and propose pipeline/observability improvements.
• Mentor junior engineers and contribute to team knowledge sharing.
• 100% telecommuting allowed from any location in the U.S.

Skills

SQL

Java

Python

MySQL

Databricks

Amazon S3

GitLab

API Calls

Katalon

Education

Bachelor's degree in CS/CE or related field

Tools

Databricks

Amazon S3

GitLab

MySQL

Katalon

Job description

McKesson Corporation is hiring a Data Engineer to design and maintain scalable data pipelines and platforms. You will analyze requirements to build end-to-end data solutions, including ingestion, transformation, modeling, and serving layers, with a focus on performance and cost efficiency.

You will implement Delta Lake features, collaborate on data contracts and SLAs, and mentor junior engineers while enjoying 100% telecommuting within the U.S.