Databricks Engineer

Blu Omega Inc.; Ashburn (VA); Remote; USD 80,000 - 110,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401(k) with company match

Life and AD&D insurance

Disability coverage

EAP & mental health resources

Telehealth

PTO and holidays

Wellness discounts

Job summary

Blu Omega Inc. is seeking a Databricks Engineer to design, build, and operate scalable data pipelines in a remote environment.

You will support a federal program focusing on data analytics and mission-critical government operations, using PySpark, Delta Lake, and Unity Catalog. The role requires 3+ years in data engineering and 2+ years with Databricks, plus strong Python skills and cloud platform knowledge.

Qualifications

• 3+ years in data engineering, analytics, or related technical roles.
• 2+ years hands-on experience with the Databricks platform.
• Strong experience developing data solutions using PySpark and Spark SQL.
• Experience with Databricks clusters, jobs, workflows, Delta Lake, and Unity Catalog in production.
• Experience designing automated data pipelines and transformation workflows.
• Experience integrating Databricks with CI/CD pipelines and SDLC tooling.
• Proficient in Python for data engineering and ML workflows.
• Knowledge of AWS, Azure, or GCP data services.
• Understanding of data quality, monitoring, and production support.

Responsibilities

• Design, build, and maintain scalable Databricks data pipelines with PySpark, Spark SQL, Delta Lake, and Unity Catalog.
• Develop automated ingestion, transformation, and processing workflows for analytics and reporting.
• Operate and optimize Databricks clusters, jobs, and workflows for reliability and cost efficiency.
• Integrate Databricks with CI/CD pipelines for automated deployments and testing.
• Implement data quality, validation, and observability frameworks.
• Monitor pipelines and production workloads to identify and resolve issues.
• Collaborate with stakeholders to translate requirements into technical solutions.
• Create and maintain documentation for data pipelines, architecture, and operations.

Skills

Databricks experience

PySpark

Spark SQL

Python

Analytical skills

Collaboration

Problem solving

Public Trust eligibility

Education

Bachelor’s degree in CS/DS/Engineering

Tools

Databricks

Delta Lake

Unity Catalog

CI/CD tooling

Job description

Back Databricks Engineer Application Development Ashburn , Oklahoma Aug 20, 2026 Databricks Engineer Remote

Blu Omega is seeking a Databricks Engineer to support a federal program focused on data analytics and mission-critical government operations. This role operates within a remote environment and is responsible for designing, building, and operating scalable data solutions. The position requires experience supporting data engineering, analytics, and cloud-based data platforms.

Key Details

Location: Remote
Clearance: Ability to obtain and maintain a Public Trust or Suitability/Fitness determination

Responsibilities

• Design, develop, and maintain scalable Databricks data pipelines using PySpark, Spark SQL, Delta Lake, and Unity Catalog to deliver high-quality, mission-critical data assets
• Build and maintain automated ingestion, transformation, and processing workflows supporting analytics, reporting, and operational decision-making
• Operate and optimize Databricks clusters, jobs, and workflows ensuring reliability, performance, and cost efficiency
• Integrate Databricks with enterprise CI/CD pipelines and SDLC tooling for automated deployments, source control, and testing
• Implement data quality, validation, and observability frameworks to enhance data accuracy and trustworthiness
• Monitor and troubleshoot data pipelines, platform performance, and production workloads to identify and resolve issues proactively
• Collaborate with stakeholders and cross-functional teams to translate operational requirements into technical solutions
• Develop and maintain technical documentation related to data pipelines, architecture, and operational processes

Required Qualifications

• 3+ years of experience in data engineering, analytics, or related technical roles
• 2+ years of hands-on experience with the Databricks platform
• Strong experience developing data solutions using PySpark and Spark SQL
• Experience working with Databricks clusters, jobs, workflows, Delta Lake, and Unity Catalog in production environments
• Experience designing and maintaining automated data pipelines and transformation workflows
• Experience integrating Databricks with CI/CD pipelines and enterprise SDLC tooling
• Working knowledge of Python for data engineering, automation, and ML workflows
• Knowledge of cloud platforms such as AWS, Microsoft Azure, or GCP and associated data services
• Understanding of data quality, validation, monitoring, and production support practices
• Strong analytical and troubleshooting skills
• Effective collaboration skills with technical and non-technical teams
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination
• Bachelor’s degree in computer science, data science, engineering, or related field

Preferred Qualifications

• Experience supporting federal government or regulated industries
• Experience developing or operationalizing machine learning solutions within Databricks
• Experience with MLflow for machine learning lifecycle management
• Knowledge of streaming frameworks, real-time data processing, and observability tooling
• Experience implementing data governance, lineage, and access control practices
• Databricks certification or cloud platform certification from AWS, Azure, or GCP

Compensation

Salary Range: $80,000.00 - $110,000.00
Final compensation is based on technical skills, experience, education, certifications, and clearance.

Blu Omega Benefits & Perks

• Medical, Dental, and Vision coverage through national providers
• 401(k) with company match (eligible after 6 months; vesting applies)
• Company-paid Life and AD&D insurance with additional voluntary options
• Short-term and long-term disability options
• Employee Assistance Program (EAP) with 24/7 confidential support and mental health resources
• Telehealth and virtual care options
• Pet insurance, legal services, and identity theft protection options
• Paid Time Off (PTO) for eligible employees
• Paid federal holidays for salaried employees
• Access to wellness programs, discounts, and lifestyle benefits
• Benefits availability may vary based on role and employment status

Company Overview

Blu Omega is a Woman-Owned Small Business (WOSB) providing technology and cybersecurity solutions to federal agencies and enterprise clients nationwide. Headquartered in Ashburn, VA, we support mission-critical programs across civilian and defense sectors, including health, national security, and regulatory environments. We partner with government agencies and large integrators to deliver expertise in data modernization, cybersecurity operations, cloud and infrastructure modernization, and enterprise IT support, supporting task orders and programs that require cleared personnel and compliant delivery.

Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability.

#CJ #LI-Remote