Senior Data Engineer

Medzown; United States; On-site; USD 90,000 - 120,000; Full time

Benefits offered by this job

Health insurance

Flexible working hours

Professional development opportunities

Job summary

A health technology company in the United States is seeking a highly skilled Senior Data Engineer to design, develop, and optimize scalable data pipelines in a cloud-first environment. The ideal candidate will have expertise in Python, Databricks, and AWS technologies, along with a solid understanding of data pipeline architecture and ETL processes. This role requires excellent problem-solving abilities and communication skills to effectively collaborate within an agile team. Join us to make a significant impact in precision medicine and patient care.

Qualifications

• 5+ years of experience in Python for data engineering, integration and scripting.
• 2+ years experience in Databricks ecosystem.
• 2+ years of experience with healthcare claims data.

Responsibilities

• Design and maintain robust ETL processes for complex data workflows.
• Develop scalable data pipelines using AWS services.
• Collaborate with cross-functional teams to deliver data solutions.

Skills

Python

Databricks

ETL processes

AWS services

Problem-solving

Communication

Education

Bachelor's degree in Computer Science or related field

Tools

AWS Lambda

MongoDB

Postgres

CI/CD tools

Job description

We are seeking a highly skilled and motivated Senior Data Engineer to design, develop, and optimize scalable data pipelines in a cloud-first environment. The ideal candidate will have a strong foundation in Python, Databricks, ETL processes, and modern data engineering practices, with expertise in AWS technologies and a deep understanding of pipeline design principles. This role requires a blend of technical proficiency, problem‑solving abilities, and excellent communication skills to collaborate effectively within an agile team.

Key Responsibilities

Data Platform and Pipeline Development

• Design, implement, and maintain robust ETL processes to support complex data workflows.
• Develop scalable, efficient, and maintainable data pipelines for processing large and complex datasets.
• Leverage parallel processing to handle multiple file streams and optimize performance.
• Utilize AWS services, including Lambda, SQS, Notification Services, API Gateway, and Secrets Manager, for data workflows and automation.
• Design and build pipelines and processes utilizing Databricks Delta Lake and Spark to support enterprise data warehouses for enterprise reporting and data science/machine learning.
• Manage and optimize cloud‑based SQL and NoSQL databases such as Postgres and MongoDB for scalable data storage solutions.

Scalability, Observability, and Maintainability

• Architect systems designed for scalability to meet growing data and user demands.
• Implement observability and telemetry tools to monitor pipeline health, track performance metrics, and resolve issues proactively.

Collaboration and Agile Practices

• Work collaboratively with cross‑functional teams, including data scientists, architects, analysts, and application developers, to deliver high‑quality data solutions.
• Thrive in a fluid, agile environment and be ready to closely work with leadership as needed.

Testing and CI/CD Pipelines

• Develop and enforce rigorous testing practices to ensure data accuracy and system reliability.
• Build and maintain CI/CD pipelines for automated testing and deployment of data workflows.

Problem‑Solving and Communication

• Apply excellent problem‑solving skills to troubleshoot and resolve data and system issues efficiently.
• Communicate effectively with technical and non‑technical stakeholders, translating complex concepts into actionable insights.

Required Skills and Qualifications

Technical Expertise

• 5+ years of experience in Python for data engineering, integration and scripting.
• 2+ years experience in Databricks ecosystem.
• 2+ years of experience with healthcare claims data.
• Extensive experience in designing ETL processes and data pipelines.
• Deep understanding of data pipeline architecture, scalability, and optimization techniques.
• Strong knowledge of AWS services: Lambda, SQS, Notification Services, API Gateway, Secrets Manager.
• Experience with NoSQL databases, particularly MongoDB Atlas.
• Experience with data transformation technologies like dbt is a plus.

Collaboration and Problem‑Solving

• Exceptional problem‑solving abilities and a proactive mindset.
• Excellent communication skills, capable of working effectively with diverse teams.
• Demonstrated ability to work collaboratively in an agile environment.

Testing and CI/CD

• Strong experience in testing practices for data engineering workflows.
• Hands‑on experience with CI/CD pipelines and automation tools.

Preferred Qualifications

• Familiarity with observability and telemetry tools such as AWS CloudWatch, Datadog, or similar.
• Experience with data security best practices and compliance (PHI, PII, HIPAA) requirements.

About Medzown

Medzown is transforming the way patients with cancer and other complex or rare diseases access life‑changing treatments. Our mission‑driven platform combines deep clinical expertise, advanced technology, and data science to deliver personalized treatment strategies—including clinical trials—to help patients find the right treatment at the right time.

We don’t just guide patients—we advocate for them every step of the way. Join us in shaping the future of precision medicine and making a real difference in people’s lives.

Equal Opportunity Employer Statement

Medzown is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex (including pregnancy, gender identity, and sexual orientation), national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran under applicable federal, state, and local laws. All qualified applicants will be considered for employment without regard to these or any other characteristics protected by law.

Seniority Level: Mid‑Senior level
Employment Type: Full‑time
Job Function: Information Technology
Industry: Hospitals and Health Care