Sr Databricks Data Engineer

Blu Omega Inc.; Ashburn, Northern (VA, KY); Hybrid; USD 150,000 - 165,000; Full time

Job description

Back Sr Databricks Data Engineer
Data Management Ashburn , VA Sep 25, 2026

Sr. Databricks Data Engineer
Remote

Blu Omega is seeking a Sr Databricks Data Engineer to support the CDC/NCIRD enterprise data and design support program. This role is responsible for designing, building, and optimizing scalable data pipelines and cloud-based data solutions supporting mission-critical federal programs.

Program Overview

Blu Omega supports the CDC’s mission to protect public health through data-driven decisions and solutions.

Key Details

Location: Remote
Clearance / Suitability: Public Trust eligibility required

Responsibilities

• Design, develop, and maintain scalable ETL/ELT workflows using Databricks, Python, PySpark, Spark SQL, and SQL.
• Build and optimize enterprise data solutions across Azure Data Lake Storage, Azure Data Factory, Databricks, and related Azure services.
• Transform, integrate, and organize structured and unstructured data from multiple sources into reliable, analytics-ready datasets.
• Design and optimize Delta Lake architectures, Delta Tables, and data models supporting high-performance analytics and machine learning workloads.
• Develop and maintain data lake and database solutions across SQL and NoSQL technologies.
• Implement data quality controls, testing, monitoring, and post-deployment validation throughout the data pipeline lifecycle.
• Automate data pipeline operations and Databricks workflows to improve reliability, scalability, and operational efficiency.
• Collaborate with data engineers, developers, analysts, and stakeholders within Agile teams to translate data requirements into scalable technical solutions.

Required Qualifications

• 8+ years of experience designing, developing, and maintaining scalable ETL/ELT workflows supporting analytics or machine learning workloads.
• 3+ years of hands-on Databricks experience, including Lakeflow Jobs, Databricks Workflows, Unity Catalog, Delta Lake, Delta Tables, or Delta Sharing.
• 3+ years of data engineering experience using Python, PySpark, Spark SQL, and/or SQL.
• 3+ years of experience working with database technologies such as SQL Server, PostgreSQL, MySQL, MongoDB, or similar platforms.
• 3+ years of experience applying data modeling techniques, including dimensional modeling and schemas optimized for Delta Lake and analytical query performance.
• Hands‑on experience with Azure Data Lake Storage, Azure Data Factory, and related Azure data services.
• Experience with NoSQL concepts and platforms such as Cosmos DB, Elasticsearch, or similar technologies.
• Experience transforming heterogeneous raw data into standardized datasets and automating pipeline operations.
• Ability to obtain and maintain a Public Trust clearance.
• Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder).

Compensation

Salary Range: $150,000.00 - $165,000.00
Final compensation is based on technical skills, experience, education, certifications, and clearance.

Benefits & Perks

• Medical, Dental, and Vision coverage through national providers
• 401(k) with company match (eligible after 6 months; vesting applies)
• Company-paid Life and AD&D insurance with additional voluntary options
• Short-term disability (company-paid) and long-term disability options
• Employee Assistance Program (EAP) with 24/7 confidential support and mental health resources
• Telehealth and virtual care options available through medical plans
• Pet insurance, legal services, and identity theft protection options
• Paid Time Off (PTO) for eligible employees
• Paid federal holidays for salaried employees
• Access to wellness programs, discounts, and lifestyle benefits

Company Overview

Blu Omega is a Woman-Owned Small Business (WOSB) providing technology and cybersecurity solutions to federal agencies and enterprise clients nationwide. Headquartered in Ashburn, VA, we support mission-critical programs across civilian and defense sectors, including health, national security, and regulatory environments. We partner with government agencies and large integrators to deliver expertise in cybersecurity operations, cloud and infrastructure modernization, data and analytics, and enterprise IT support.

Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability.

#CJ

#LI-Remote