Senior Data Engineer - DoW Databricks Lakehouse

Doist; Arlington (VA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Flexible PTO

Health, dental and vision insurance

401k with employer match

Professional development

Paid cloud developer accounts

Referral bonuses

HQ office perks

Annual social events

Ticket access to events

Job summary

540 is seeking a Senior Data Engineer to lead Databricks-based data pipelines and lakehouse capabilities for a mission-critical modernization effort. You will guide architecture, data models, and governance while mentoring engineers to ensure data quality and secure operations. Arlington, VA candidates with U.S.

citizenship and DoW clearance preferred. You will collaborate with cybersecurity, engineers, and stakeholders to translate requirements into scalable solutions using Databricks, Spark,

Qualifications

• Bachelor's degree in Computer Science, Engineering or related field.
• 9+ years of data engineering or software engineering experience.
• Experience with enterprise-scale Databricks data platforms and pipelines.
• Strong Python/SQL skills and Spark ecosystem proficiency.
• Knowledge of data governance, security, and CI/CD practices.

Responsibilities

• Lead architecture and evolution of Databricks-based data pipelines and lakehouse capabilities.
• Translate mission requirements into scalable data architectures and implementation strategies.
• Define data engineering standards and reusable patterns across teams.
• Architect ETL/ELT pipelines using Python, SQL, PySpark, Spark, and Delta Lake.
• Design scalable data models, data contracts, and medallion architectures.
• Mentor engineers and drive data quality, lineage, and governance practices.

Skills

Databricks

Python

SQL

PySpark

Apache Spark

Delta Lake

Data governance

CI/CD

Education

Bachelor's degree in CS/Engineering

Tools

Unity Catalog

Job description

540 is seeking a Senior Data Engineer to lead Databricks-based data pipelines and lakehouse capabilities for a mission-critical modernization effort. You will guide architecture, data models, and governance while mentoring engineers to ensure data quality and secure operations. Arlington, VA candidates with U.S.

citizenship and DoW clearance preferred. You will collaborate with cybersecurity, engineers, and stakeholders to translate requirements into scalable solutions using Databricks, Spark,