Remote Senior Databricks Engineer - Secret Clearance

Koniag Government Services; Chantilly (VA); Remote; USD 120,000 - 170,000; Full time

Job summary

Koniag Emerging Technologies seeks a Senior Databricks Engineer to design, develop, and deploy scalable data infrastructure for a government client using the Databricks platform and Medallion Architecture.

The role requires an Active SECRET clearance, strong PySpark and SQL skills, CI/CD with Azure DevOps, API integration, and mentorship of junior staff while delivering reliable data pipelines and analytics solutions. This is a remote position with benefits for US-based employees.

Qualifications

• Active SECRET clearance required.
• 8+ years of data engineering experience with at least 3+ years in a senior Databricks role.
• Expert PySpark and SQL.
• Experience building data pipelines using Databricks and Medallion Architecture.

Responsibilities

• Design, develop, and deploy scalable data infrastructure on Databricks.
• Build data pipelines using Bronze-Silver-Gold Medallion architecture.
• Develop data quality standards and monitoring dashboards.
• Create reusable Python libraries and modules for data pipelines.
• Integrate data via RESTful APIs and external systems.
• Automate deployments using DABs and Azure DevOps across environments.
• Tune performance of Databricks clusters and Spark jobs.
• Collaborate with project managers and stakeholders.
• Mentor data engineering staff and enforce best practices.

Skills

Databricks

PySpark

SQL

CI/CD

Azure DevOps

REST API ingestion

Data modeling

Mentorship

Clear communication

Tools

Databricks Asset Bundles (DABs)

Azure Data Lake Storage Gen2

Git

Job description

Koniag Emerging Technologies seeks a Senior Databricks Engineer to design, develop, and deploy scalable data infrastructure for a government client using the Databricks platform and Medallion Architecture.

The role requires an Active SECRET clearance, strong PySpark and SQL skills, CI/CD with Azure DevOps, API integration, and mentorship of junior staff while delivering reliable data pipelines and analytics solutions. This is a remote position with benefits for US-based employees.