Data Engineer (ETL & Databricks)

United States Digital Space LLC; United States; Remote; USD 145,000 - 165,000; Full time

Benefits offered by this job

Healthcare benefits

401k including employer match

Paid time off

Job summary

United States Digital Space LLC is seeking a Data Engineer to support a modern Databricks data platform for a federal client, enabling MI and BI initiatives. This role emphasizes Databricks notebooks, PySpark pipelines, and enterprise data governance in a remote work model.

The successful candidate will collaborate with cross-functional teams, design scalable data solutions, and ensure data quality across systems, with a compensation range of $145k-$165k and eligibility for a clear path to a

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field.

Responsibilities

• Develop, maintain, and optimize Databricks notebooks, workflows, and ETL/ELT pipelines.
• Build and maintain data ingestion pipelines using PySpark, SQL, and Delta Lake.
• Support Medallion Architecture (Bronze, Silver, Gold) and Lakehouse implementations.
• Assist with performance tuning, cluster optimization, and operational support.
• Support Unity Catalog, data governance, and security best practices.
• Support enterprise Master Data Management initiatives.
• Develop datasets supporting dashboards and analytics.
• Troubleshoot data quality and reporting issues.

Skills

Databricks

PySpark

SQL

Python

Data governance

Agile

MDM

Education

Bachelor's degree in a related field

Tools

Databricks

Unity Catalog

Delta Lake

AWS

Lakehouse

Job description

Overview: the company is seeking a Data Engineer to support the implementation, enhancement, and ongoing administration of a modern Databricks data platform supporting Management Information (MI) and Business Intelligence (BI) initiatives for a federal customer.

The successful candidate will have hands‑on experience developing and maintaining Databricks data solutions while supporting enterprise data management, governance, and Master Data Management (MDM) initiatives. This individual will work closely with technical teams and business stakeholders to build scalable data pipelines, improve data quality, and support reporting and analytics across multiple business systems.

This is an excellent opportunity for a mid‑level data engineer who enjoys working with modern cloud technologies, Databricks, and enterprise data platforms in a collaborative federal consulting environment. Location: Remote Salary Range: The salary for this position is between $145,000 – $165,000 annually. Factors affecting pay within this range may include geography/market, skills, education, experience, and other qualifications of the successful candidate.

Responsibilities

Databricks Engineering

Develop, maintain, and optimize Databricks notebooks, workflows, and ETL/ELT pipelines.

• Build and maintain data ingestion pipelines using PySpark, SQL, and Delta Lake.
• Support Medallion Architecture (Bronze, Silver, Gold) and Lakehouse implementations.
• Assist with performance tuning, cluster optimization, and operational support.
• Support Unity Catalog, data governance, and security best practices.

Master Data Management

Support enterprise Master Data Management initiatives.

• Assist with data quality, matching, standardization, and data stewardship activities.
• Work with enterprise data governance teams to improve metadata, lineage, and business glossary initiatives.
• Help ensure consistency and integrity of enterprise data across multiple systems.

Data & Business Intelligence

Partner with business users to understand reporting requirements.

• Support MI/BI reporting initiatives.
• Develop datasets supporting dashboards and analytics.
• Troubleshoot data quality and reporting issues.

Project Collaboration

Participate in Agile ceremonies.

• Work with cross‑functional technical teams.
• Document technical solutions and data flows.
• Participate in code reviews and knowledge sharing.

Qualifications

Experience

Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field.

• Minimum of 5 years of experience designing, developing, and supporting enterprise data solutions using Databricks.
• Minimum of 5 years of experience with SQL and Python/PySpark.
• Experience developing ETL/ELT pipelines and working with Delta Lake and Lakehouse architecture.
• Experience working within AWS cloud environments.
• Experience supporting enterprise data governance and data quality initiatives.
• Experience working in Agile development environments.

Required Certification

Must possess an active Databricks certification, such as:

• Databricks Certified Data Engineer Associate
• Databricks Certified Data Engineer Professional
• Databricks Certified Data Analyst Associate
• Databricks Certified Machine Learning Associate
• Other current Databricks certifications

Preferred Qualifications

Experience with one or more of the following:

• AWS Databricks
• AWS services (S3, IAM, Lambda, Glue, EMR, Redshift, Athena, CloudFormation, CloudWatch)
• Apache Spark
• Delta Lake
• Unity Catalog
• Master Data Management (MDM)
• Informatica MDM
• Reltio
• Profisee
• Snowflake
• Data Governance
• Data Catalog
• Metadata Management
• Data Lineage
• Power BI or Tableau
• Jira / Agile methodologies

Federal consulting experience is highly preferred. Experience supporting Public Trust programs is preferred.

Clearance Requirement

US Citizen

• Willing and able to obtain and maintain Public Trust Clearance
• Must meet updated ID requirements: https://www.gsa.gov/technology/it-contract-vehicles-and-purchasing-programs/federal-credentialing-services/get-appointment-help/bring-required-documents
• If you do not currently meet the ID requirements outlined, you must be willing and able to update your current forms of ID in a timely manner to complete the suitability process successfully.

We are not able to provide sponsorships to H1B or F1 visas.

This role is flexible in that it can be a FT/W2 or a 1099 with a potential to transition to a FT/W2 employee position in the future.

Benefits

The CompanyWe believe in generating success collaboratively, enabling long‑term mission success, and building trust for the next challenge. With you as our partner, let’s solve challenges, think innovatively, and maximize impact. As a valued member of our team, you have the unique opportunity to work in a diverse range of technology and business career paths, all while supporting our nation and delivering innovative technology solutions. We are a close community of experts that pride ourselves on creating an environment defined by teamwork, dedication, and excellence.

We hold three ISO certifications (27001:2013, 20000-1:2011, 9001:2015), two CMMI ML 3 ratings (DEV and SVC) and CMMC Level 2 Certification.

Industry RecognitionGrowth | Inc 5000’s Fastest Growing Private Companies, DC Metro List Fastest Growing; Washington Business Journal: Fastest Growing Companies, Top Performing Small Technology Companies in Greater D.C.Culture | Northern Virginia Technology Council Tech 100 Honoree; Virginia Best Place to Work; Washington Business Journal: Best Places to Work, Corporate Diversity Index Winner – Mid-Size Companies, Companies Owned by People of Color; Department of Labor’s HireVets for our work helping veterans transition; SECAF Award of Excellence finalist; Victory Military Friendly Brand; Virginia Values Veterans (V3); Cystic Fibrosis Foundation Corporate Breath Award

BenefitsWe offer competitive benefits package including paid time off, healthcare benefits, supplemental benefits, 401k including an employer match, discount perks, rewards, and more. We invest in our employees – Every employee is eligible for education reimbursement for certifications, degrees, or professional development. Reimbursement amounts may fluctuate due to IRS limitations. We want you to grow as an expert and a leader and offer flexibility for you to take a course, complete a certification, or other professional growth and networking. We are committed to supporting your curiosity and sustaining a culture that prioritizes commitment to continuous professional development.

We work hard; we play hard. the company is committed to incorporating fun into every day. We dedicate funds for activities – virtual and in‑person – e.g., we host happy hours, holiday events, fitness & wellness events, and annual celebrations. In alignment with our commitment to our communities, we also host and attend charity galas/events. We believe in appreciating your commitment and building a positive workspace for you to be creative, innovative, and happy.

Commitment Equal Opportunity Employment & VEVRAA

the company is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state or local law.

the company is strongly committed to compliance with VEVRAA and other applicable federal, state, and local laws governing equal employment opportunity. We have developed comprehensive policies and procedures to ensure our hiring practices align with these requirements. As part of our VEVRAA compliance efforts, the company has established an equal opportunity plan outlining our commitment to recruiting, hiring, and advancing protected veterans. This plan is regularly reviewed and updated to ensure its effectiveness. We encourage protected veterans to self‑identify during the application process. This information is strictly confidential and will only be used for reporting and compliance purposes as required by law. Providing this information is voluntary and will not impact your employment eligibility. Our commitment to equal employment opportunity extends beyond legal compliance. We are dedicated to fostering an inclusive workplace where all employees, including protected veterans, are treated with dignity, respect, and fairness.

Accommodations

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. Reasonable Accommodations may be made to enable qualified individuals with disabilities to perform the essential functions. If you need to discuss reasonable accommodations, please email [e-mail].