Senior Data Engineer: Scalable Pipelines & Data Lakes

Employer Direct Healthcare; Dallas (TX); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical Insurance

Vision Insurance

Short & Long Term Disability

Life Insurance

401k with company match

Flexible Time Off

Job summary

Lantern is seeking a Senior Data Engineer to join the Data Engineering team in a hybrid role, with at least 3 days per week in our Dallas, TX office. You will design and implement scalable data pipelines and data models to support analytics across the organization.

Collaborate with stakeholders, use cloud platforms (Azure preferred, AWS or GCP), Spark/Databricks, and Terraform to deliver reliable, high-performance solutions with strong Python and SQL skills.

Qualifications

• 5+ years of experience as a Data Engineer, with a focus on building enterprise data solutions.
• 3+ years of cloud experience on Azure, AWS, or GCP.
• Strong Python and SQL skills; experience with relational databases.
• Experience with big data tech like Spark or Databricks.
• Experience with Terraform or IaC to manage cloud resources.
• Healthcare data standards like HL7, X12 EDI, FHIR helpful.
• Experience building data lakes and scalable data pipelines with data quality.

Responsibilities

• Design and implement scalable data pipelines.
• Ingest, transform, and ensure data quality across systems.
• Collaborate with stakeholders to model data for analytics.
• Develop data export solutions for external systems.
• Contribute to design docs, PoCs, and roadmaps.
• Support production jobs and troubleshoot issues.
• Write unit, integration, and functional tests.
• Participate in PR reviews and establish standards.
• Promote continuous learning and innovation.

Skills

Python

SQL

Azure

AWS

GCP

Spark

Databricks

Terraform

Data pipelines

Data modeling

Communication

HL7/FHIR

Tools

Power BI

REST APIs

SQL Server

Job description

Lantern is seeking a Senior Data Engineer to join the Data Engineering team in a hybrid role, with at least 3 days per week in our Dallas, TX office. You will design and implement scalable data pipelines and data models to support analytics across the organization.

Collaborate with stakeholders, use cloud platforms (Azure preferred, AWS or GCP), Spark/Databricks, and Terraform to deliver reliable, high-performance solutions with strong Python and SQL skills.