Remote Data Engineer: Health Data Modernization (Spark)

540.co LLC; Northern (KY); Hybrid; USD 110,000 - 150,000; Full time

Benefits offered by this job

Flexible PTO

Health insurance

401k with match

Remote work

Paid federal holidays

Job summary

540.co LLC is seeking a Data Engineer to design and implement scalable data pipelines and reusable data products in a Databricks environment. You will work hands-on with health and mission data to support enterprise reporting and decision-making.

The role requires 3+ years of data engineering experience, strong Python/SQL skills, and familiarity with Spark, Databricks, and API-based integrations. Remote work available for the continental US, with periodic travel as needed.

Qualifications

• 3+ years of data engineering, software engineering, or related technical experience.
• Strong proficiency with Python and SQL.
• Experience with Apache Spark or similar distributed data‑processing frameworks.
• Experience building and maintaining production data pipelines and ETL/ELT processes.
• Experience with Databricks or a similar modern data platform.
• Experience designing data models and analytics datasets.

Responsibilities

• Design, develop, and maintain scalable, production-ready data pipelines using Spark, Python, and SQL in a Databricks environment.
• Integrate and transform diverse health, financial, and operational datasets into reusable data products.
• Develop data models and analytics datasets that support enterprise reporting and decision-making.
• Build and maintain API-based data integrations across systems.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Implement data validation, quality checks, lineage, and governance practices.
• Contribute to automated testing, code reviews, and documentation.
• Collaborate with engineers and stakeholders to translate data needs into technical solutions.

Skills

Python

SQL

Spark

Databricks

ETL/ELT

Data modeling

REST APIs

Git

CLI

AI-assisted tools

Communication

Education

Bachelor's degree

Tools

Palantir Foundry

GitLab

CI/CD pipelines

Job description

540.co LLC is seeking a Data Engineer to design and implement scalable data pipelines and reusable data products in a Databricks environment. You will work hands-on with health and mission data to support enterprise reporting and decision-making.

The role requires 3+ years of data engineering experience, strong Python/SQL skills, and familiarity with Spark, Databricks, and API-based integrations. Remote work available for the continental US, with periodic travel as needed.