Remote Databricks Engineer - Scalable Data Pipelines

Blu Omega Inc.; Ashburn (VA); Remote; USD 80,000 - 110,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401(k) with company match

Life and AD&D insurance

Disability coverage

EAP & mental health resources

Telehealth

PTO and holidays

Wellness discounts

Job summary

Blu Omega Inc. is seeking a Databricks Engineer to design, build, and operate scalable data pipelines in a remote environment.

You will support a federal program focusing on data analytics and mission-critical government operations, using PySpark, Delta Lake, and Unity Catalog. The role requires 3+ years in data engineering and 2+ years with Databricks, plus strong Python skills and cloud platform knowledge.

Qualifications

• 3+ years in data engineering, analytics, or related technical roles.
• 2+ years hands-on experience with the Databricks platform.
• Strong experience developing data solutions using PySpark and Spark SQL.
• Experience with Databricks clusters, jobs, workflows, Delta Lake, and Unity Catalog in production.
• Experience designing automated data pipelines and transformation workflows.
• Experience integrating Databricks with CI/CD pipelines and SDLC tooling.
• Proficient in Python for data engineering and ML workflows.
• Knowledge of AWS, Azure, or GCP data services.
• Understanding of data quality, monitoring, and production support.

Responsibilities

• Design, build, and maintain scalable Databricks data pipelines with PySpark, Spark SQL, Delta Lake, and Unity Catalog.
• Develop automated ingestion, transformation, and processing workflows for analytics and reporting.
• Operate and optimize Databricks clusters, jobs, and workflows for reliability and cost efficiency.
• Integrate Databricks with CI/CD pipelines for automated deployments and testing.
• Implement data quality, validation, and observability frameworks.
• Monitor pipelines and production workloads to identify and resolve issues.
• Collaborate with stakeholders to translate requirements into technical solutions.
• Create and maintain documentation for data pipelines, architecture, and operations.

Skills

Databricks experience

PySpark

Spark SQL

Python

Analytical skills

Collaboration

Problem solving

Public Trust eligibility

Education

Bachelor’s degree in CS/DS/Engineering

Tools

Databricks

Delta Lake

Unity Catalog

CI/CD tooling

Job description

Blu Omega Inc. is seeking a Databricks Engineer to design, build, and operate scalable data pipelines in a remote environment.

You will support a federal program focusing on data analytics and mission-critical government operations, using PySpark, Delta Lake, and Unity Catalog. The role requires 3+ years in data engineering and 2+ years with Databricks, plus strong Python skills and cloud platform knowledge.