Remote Databricks Data Engineer: Pipelines & Lakehouse

Jobvite, Inc.; Northern (KY); Hybrid; USD 100,000 - 160,000; Full time

Benefits offered by this job

Generous PTO

Comprehensive health coverage

401(k) with company match

Commuter benefits

Job summary

MetaPhase is seeking a Data Engineer – Databricks to design, build, test, deploy, and sustain data pipelines in a Databricks environment. You will translate approved data requirements into reliable, well-documented code under leadership guidance.

You will own ingestion, transformation, validation, and publishing processes; implement data models and quality rules; maintain notebooks, jobs, and CI/CD; participate in code reviews and production support.

Qualifications

• Bachelor’s degree in a technical discipline and 3+ years in data engineering, software engineering, analytics engineering, or related field.
• Proficiency in Python and SQL with ETL/ELT development and maintenance experience.
• 1+ years hands-on experience with Databricks, Apache Spark, or similar cloud data engineering platform.
• Experience with structured/unstructured data, data validation, source-to-target mapping, and production support.
• Databricks Certification preferred; willing to obtain within 3 months if not possessed.
• Ability to obtain a U.S. Public Trust suitability determination and U.S. Citizenship is required.

Responsibilities

• Develop, test, deploy, and maintain batch and streaming data pipelines using Databricks, Python, SQL, Spark, and Delta Lake.
• Build ingestion, transformation, validation, and publishing processes into governed data products and analytics-ready datasets.
• Implement data models, data-quality rules, metadata, and documentation per architecture and governance standards.
• Configure and maintain Databricks notebooks, workflows, jobs, compute resources, and deployment artifacts.
• Participate in code reviews, testing, releases, and CI/CD.
• Monitor pipelines, troubleshoot production issues, and support incidents.
• Collaborate with architects, analysts, data owners, and engineers to deliver iterative improvements.
• Maintain comprehensive documentation for pipelines, sources, transformations, interfaces, tests, and procedures.

Skills

Python

SQL

Databricks

Apache Spark

Delta Lake

ETL/ELT

Data governance

Education

Bachelor's degree in a technical discipline

Tools

Git

Databricks

Delta Lake

Job description

MetaPhase is seeking a Data Engineer – Databricks to design, build, test, deploy, and sustain data pipelines in a Databricks environment. You will translate approved data requirements into reliable, well-documented code under leadership guidance.

You will own ingestion, transformation, validation, and publishing processes; implement data models and quality rules; maintain notebooks, jobs, and CI/CD; participate in code reviews and production support.