Senior Data Engineer (Databricks) - Contractor

Job Envoy

United States

Remote

USD 140,000 - 190,000

Part time

46 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fully remote in US
6-month+ contract option
Flexible start date
Exposure to modern Databricks lakeho​u
Professional development

Job summary

Job Envoy is partnering with a client in the United States to appoint a Senior Data Engineer (Databricks) on a remote contract basis. The role centers on designing scalable data platforms in cloud lakehouse environments, leveraging Databricks Delta Lake, Unity Catalog, and related technologies.

You will collaborate withSolution Architects and cross-functional teams to deliver robust data pipelines and reusable accelerators.

Qualifications

  • 2+ years of hands-on design and development of data pipelines with Databricks.
  • Experience with Delta Lake, Uniform (Iceberg), Delta Live Tables, Unity Catalog is a plus.
  • Proficient in SQL, Python/Java, and PySpark.
  • Familiarity with YAML-driven pipelines and Auto Loader.
  • Knowledge of CI/CD for Databricks assets and testing.

Responsibilities

  • Lead development of data engineering solutions on Databricks for scalable batch and streaming workloads.
  • Collaborate with architects and cross-functional teams to deliver data platform components.
  • Design data pipelines using Databricks features like Delta Lake, Unity Catalog, and Delta Live Tables.
  • Build and optimize pipelines for batch, micro-batch, and streaming ingestion/processing.
  • Implement data quality, observability, and auditing using native Databricks tools.

Skills

Databricks
Delta Lake
PySpark
SQL
Python
Airflow
dbt
YAML
CI/CD
Terraform
Cloud data platforms
Java
Presto
Redshift
BigQuery

Tools

Databricks
Delta Lake
Unity Catalog
Airflow
dbt
Terraform
Excel

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer (Databricks) – Contractor based in the United States.

As a Senior Data Engineer, you will play a key technical role in designing and delivering modern, scalable data platforms using Databricks and cloud-based lakehouse architectures. You will work with forward-thinking organizations to solve complex data challenges through advanced data engineering, distributed processing, and real-time data solutions. Collaborating closely with Solution Architects and cross-functional engineering teams, you will transform technical requirements into reliable and efficient data pipelines. You will also contribute to the development of reusable solution accelerators and innovative engineering practices within a specialized data engineering community. This remote contract opportunity offers the chance to work with modern data technologies, influence enterprise data architecture, and deliver measurable business impact.

Accountabilities
  • Lead the development and implementation of advanced data engineering solutions on the Databricks platform, ensuring scalability, reliability, and performance across batch and streaming workloads.
  • Work alongside Solution Architects and multidisciplinary teams to deliver client data platform components while contributing to technical innovation and shared engineering standards.
  • Design, develop, and implement data solutions using Databricks and its core platform capabilities, including Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog.
  • Build and optimize scalable data pipelines supporting batch, micro-batch, and streaming data ingestion and processing.
  • Implement configuration-driven data pipelines using YAML and modern ingestion technologies such as Auto Loader.
  • Develop robust data processing and transformation solutions using distributed computing frameworks and cloud lakehouse methodologies.
  • Design and maintain complex job orchestration and workflow patterns using Databricks Jobs and Workflows or tools such as Apache Airflow and dbt.
  • Implement data quality, pipeline auditing, monitoring, and observability solutions using native Databricks capabilities and frameworks such as Great Expectations, Collibra, and dbt.
  • Collaborate with Solution Architects to translate architectural designs into technical components and deliver high-quality implementations.
  • Participate in technical design sessions, break down complex development requirements into manageable tasks, and deliver assigned work within agreed timelines.
  • Contribute to Databricks Center of Excellence initiatives by developing reusable solution accelerators and promoting innovative engineering practices.
  • Explore emerging technologies, new Databricks features, and modern data engineering approaches to continuously improve platform capabilities.
  • Share technical knowledge, insights, and best practices with engineering colleagues and the broader technical community.
Requirements

The ideal candidate is an experienced data engineering professional with strong hands-on Databricks expertise, a solid understanding of modern cloud data architectures, and the ability to independently deliver complex technical solutions. You should combine advanced programming and distributed processing skills with a proactive mindset, strong problem-solving abilities, and a commitment to continuous learning.

  • At least 2 years of hands-on experience designing and developing data pipelines using Databricks.
  • Strong practical knowledge of Databricks platform features, including Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog.
  • Proven experience building robust, scalable, YAML configuration-driven data pipelines for batch, micro-batch, and streaming data processing.
  • Experience with data ingestion technologies such as Databricks Auto Loader.
  • Strong understanding of workflow orchestration and experience with Databricks Jobs and Workflows or alternative tools such as Apache Airflow and dbt.
  • Experience implementing data quality, pipeline auditing, monitoring, and observability solutions using Databricks-native features or tools such as Great Expectations, Collibra, and dbt.
  • Proficiency with big data technologies and distributed processing platforms, including Apache Spark, Presto, and Amazon EMR.
  • Experience with cloud data warehouses such as Amazon Redshift, Snowflake, and Google BigQuery.
  • Strong programming skills in SQL, stored procedures, and object-oriented languages such as Java and Python, including PySpark.
  • Familiarity with DevOps practices and CI/CD pipeline development, particularly using Databricks Asset Bundles with automated testing and validation.
  • Understanding of Infrastructure as Code (IaC) tools such as Terraform is a plus.
  • Familiarity with NoSQL databases and container management systems.
  • Exposure to AI and machine learning technologies such as MLflow, prompt engineering, and modern AI-agent workflows.
  • Ability to work independently with minimal supervision while collaborating effectively with architects and cross-functional engineering teams.
  • Strong analytical thinking, problem-solving skills, and the ability to break down complex technical challenges into practical solutions.
  • Curiosity, adaptability, and enthusiasm for exploring emerging data technologies and sharing knowledge with others.
Preferred Qualifications
  • Databricks Data Engineer Associate and/or Professional certification.
  • Experience delivering multiple successful Databricks implementation projects.
  • Previous involvement in developing reusable data engineering frameworks, accelerators, or enterprise-scale data platform solutions.
Benefits
  • Remote work: Fully remote contract opportunity available to professionals based in the United States.
  • Contract duration: Initial six-month engagement, with the possibility of extension.
  • Flexible start date: Expected start in December or January.
  • Technical innovation: Opportunity to work with modern Databricks technologies and advanced cloud data lakehouse architectures.
  • Professional development: Exposure to complex enterprise data challenges and opportunities to expand expertise across data engineering, AI, and distributed processing.
  • Collaborative environment: Work alongside experienced engineers, Solution Architects, and cross-functional technical teams.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Solution Architect, Delivery (Databricks)
Solution Architect, Delivery (Databricks)

Jobgether • United States

Remote
USD 140,000 - 210,000
Remote work within the United States
Competitive compensation
Professional development
+1
Senior Data Engineer – Databricks & AWS
Senior Data Engineer – Databricks & AWS

Robotics Technologies • Sunnyvale (CA)

On-site
USD 76,000 - 108,000
Databricks Engineer
Databricks Engineer

Dataflix • United States

Remote
USD 130,000 - 170,000
Senior Data Engineer | Remote
Senior Data Engineer | Remote

Tech in Motion • Chicago (IL)

Remote
USD 120,000 - 180,000
Fully remote
Bonus eligible
401(k) Program
+1
Databricks Engineer
Databricks Engineer

Princeton IT Services, Inc • United States

Remote
USD 130,000 - 180,000
Databricks Data Engineer
Databricks Data Engineer

Eliassen Group • United States

Remote
USD 150,000 - 154,000
Comprehensive benefits package
Remote work option
Data Team Lead
Data Team Lead

Incedo Inc. • San Rafael (CA)

Hybrid
USD 130,000 - 150,000
Medical insurance
Vision insurance
401(k)
Senior Databricks Data Engineer — Remote Contract
Senior Databricks Data Engineer — Remote Contract

Job Envoy • United States

Remote
USD 140,000 - 190,000
Fully remote in US
6-month+ contract option
Flexible start date
+2
Senior Data Engineer (Contract)
Senior Data Engineer (Contract)

coconutsoftware • United States

Remote
USD 63,000 - 91,000
Health and dental coverage
Virtual care
Disability coverage
+5
Databricks Engineer / Remote / Contract
Databricks Engineer / Remote / Contract

Motion Recruitment • United States

Remote
USD 83,000 - 152,000