Senior Data Engineer (Databricks)

Data Surge

United States

Remote

USD 120,000 - 170,000

Full time

1 hour ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote-first work environment
PTO – Holidays + your birthday
401(k) with 4% Match, immediately vest
Growth and development opportunities

Job summary

Data Surge is seeking a skilled Data Engineer with deep Databricks and cloud experience to support our Federal Services team. You will help design and implement scalable data solutions, build and optimize pipelines, and automate infrastructure within secure cloud environments.

This role is ideal for experienced developers who enjoy tackling complex data engineering challenges, optimizing performance, and contributing to impactful government programs.

Qualifications

  • 5+ years of experience in data engineering or backend data infrastructure roles.

Responsibilities

  • Design, develop, and optimize robust data pipelines in Databricks to process and transform large-scale data sets.

Skills

Python
PySpark
Data modeling
Airflow
dbt
Terraform
Docker
Kubernetes
Databricks
Spark
Azure
AWS
GCP
CI/CD
Relational databases
NoSQL databases

Tools

Databricks
Airflow
dbt
Terraform
Docker
Kubernetes
Helm
Delta Lake
PostgreSQL
MySQL
NoSQL

Job description

Due to the nature of the role, this position requires U.S. Citizenship.

Data Surge is disrupting the services industry with cutting-edge technology that brings together the very best consultants from the big data, machine learning, and software modernization space.

At Data Surge, we value collaboration, curiosity, and being customer centric. Our team thrives on collective efforts, innovation, and a commitment to wellness, ensuring employees are empowered to thrive professionally and personally.

About the Role

We are seeking a skilled and motivated Data Engineer with deep Databricks and cloud experience to support our Federal Services team. In this role, you will help design and implement scalable data solutions, build and optimize pipelines, and automate infrastructure within secure cloud environments.

This role is ideal for experienced developers who enjoy tackling complex data engineering challenges, optimizing performance, and contributing to impactful government programs. You'll help shape robust, secure, and efficient pipelines that serve critical public-sector missions.

Day-to-Day Impact
  • Design, develop, and optimize robust data pipelines in Databricks to process and transform large-scale data sets
  • Collaborate with data scientists, engineers, and cloud architects to build reliable, secure data systems
  • Automate infrastructure provisioning using Terraform and manage resources on Azure (or AWS/GCP)
  • Monitor, troubleshoot, and support production-grade data pipelines and jobs
  • Develop CI/CD workflows to streamline deployment and version control of data processing code
  • Ensure security, performance, and reliability across all stages of data workflow
  • Utilize and manage Docker containers where needed to deploy data services
  • Participate in Agile team ceremonies and help shape iterative data delivery plans
  • Support continuous improvement in data architecture, automation, and governance practices
  • Other duties as reasonably required
  • 5+ years of experience in data engineering or backend data infrastructure roles
  • 2+ years of hands‑on experience with Databricks, Spark, or distributed data processing systems in a production environment
  • Deep proficiency with PySpark and Python for data engineering tasks
  • Experience with data modeling
  • Solid experience with Airflow, dbt, or other orchestration and transformation tools
  • Proven skills in data governance, lineage, or security best practices
  • Experience working with Azure (preferred), AWS, or Google Cloud
  • Strong working knowledge of CI/CD tools and version control workflows
  • Comfortable working with relational (e.g., PostgreSQL, MySQL) and NoSQL databases
  • Proven experience in monitoring, debugging, and scaling cloud-based data systems
  • Strong communication skills and ability to work independently in a remote team environment
  • Experience with Kubernetes and Helm for deploying data workloads (not required)
  • Solid experience with Terraform or other Infrastructure as Code tools
  • Familiarity with containerization using Docker
  • Knowledge of data lakehouse architectures and Delta Lake
  • Experience working on Federal or government projects
  • Existing security clearance (preferred but not required)
  • Databricks Certification
Learn More

Data Surge offers a competitive compensation and total rewards package.

  • Remote-first work environment
  • PTO – Including holidays + your birthday
  • 401(k) with 4% Match, immediately vested
  • Growth and development opportunities

Find out more about our story at www.datasurge.com.

Follow us on LinkedIn at https://www.linkedin.com/company/data-surge-llc.

As a participator in E-Verify, Data Surge electronically confirms employment eligibility of employees to work in the United States.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer (Databricks)
Data Engineer (Databricks)

Cogent People Inc • Columbia (MD)

Hybrid
USD 120,000 - 180,000
Health insurance
401(k) Plan
Life Insurance & Disability Coverage
+1
Senior Databricks Data Engineer - Cloud & Federal (Remote)
Senior Databricks Data Engineer - Cloud & Federal (Remote)

Data Surge • United States

Remote
USD 120,000 - 170,000
Remote-first work environment
PTO – Holidays + your birthday
401(k) with 4% Match, immediately vest
+1
Data Engineer (Databricks)
Data Engineer (Databricks)

Cogent People • Columbia (MD)

Hybrid
USD 120,000 - 180,000
Health, Dental, and Vision Insurance:
401(k) Plan: Matching contributions
Life Insurance & Disability Coverage
+1
Senior Data Engineer
Senior Data Engineer

shinvestmentsllc • United States

Remote
USD 120,000 - 170,000
Medical, dental, vision
401(k) plan
Data Engineer
Data Engineer

Gridiron IT • Washington

On-site
USD 120,000 - 180,000
Medical insurance
Dental insurance
Vision insurance
+5
Senior Data Engineer, Databricks
Senior Data Engineer, Databricks

TeamWorx Security, LLC • Columbia (MD)

Remote
USD 130,000 - 170,000
Health, Dental, & Vision Insurance
Short-Term Disability & Life Insurance
401(k) Matching
+6
Mid-Level Data Engineer, Databricks
Mid-Level Data Engineer, Databricks

The Security Centre Limited • Columbia (MD)

Remote
USD 90,000 - 130,000
Health, Dental & Vision
401(k) matching
Paid time off
+4
Databricks Specialist
Databricks Specialist

Experis-US • Washington

Hybrid
USD 96,000 - 124,000
Sr. Data Engineer
Sr. Data Engineer

Accenture PLC • Washington

Hybrid
USD 116,900 - 243,100
Hands-on experience
Mid-Level Data Engineer, Databricks
Mid-Level Data Engineer, Databricks

TeamWorx Security, LLC • Columbia (MD)

Remote
USD 90,000 - 130,000
Health insurance
Dental insurance
Vision insurance
+9