Senior Data Engineer (Databricks) - Contractor

Jobgether

United States

À distance

USD 96 000 - 165 000

Plein temps

Il y a 17 heures
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Avantages offerts par ce poste

Remote work
Contract 6 months
Extension possibility

Résumé du poste

Jobgether is seeking a Senior Data Engineer (Databricks) on a remote US contract basis. You will design and deliver scalable data platforms using Databricks and lakehouse architectures, collaborating with architects and cross‑functional teams to build reliable data pipelines.

You will work with Delta Lake, Unity Catalog, and real-time data solutions, contributing to reusable accelerators and evolving engineering practices within a data community.

Qualifications

  • Hands-on experience designing and developing data pipelines with Databricks.
  • Proficiency with Delta Lake, Uniform (Iceberg), Delta Live Tables and Unity Catalog.
  • Experience building YAML-driven data pipelines for batch, micro-batch, and streaming processing.
  • Familiarity with Databricks Auto Loader for data ingestion.
  • Strong understanding of workflow orchestration using Databricks Jobs/Workflows or Apache Airflow/dbt.
  • Experience with data quality, monitoring, and observability using Databricks features or tools like Great Expectations.
  • Proficient in SQL and Python (including PySpark); knowledge of Java is a plus.
  • DevOps mindset with CI/CD pipelines; IaC experience with Terraform is a plus.
  • Experience with NoSQL and containerized environments; exposure to AI/ML tooling is a plus.

Responsabilités

  • Design, develop, and implement data solutions using Databricks core platform capabilities.
  • Build scalable data pipelines for batch, micro-batch, and streaming ingestion and processing.
  • Create configuration-driven pipelines using YAML and Auto Loader.
  • Develop robust data processing solutions using distributed computing and lakehouse methods.
  • Orchestrate complex jobs with Databricks Jobs/Workflows or Airflow/dbt.
  • Implement data quality, auditing, and observability leveraging native features and tools.
  • Collaborate with Solution Architects to translate designs into components and deliverables.
  • Contribute to reusable accelerators and promote best practices within the data engineering community.
  • Stay current with emerging Databricks features and modern data engineering approaches.

Connaissances

Databricks
Delta Lake
SQL
Python
PySpark
Airflow
dbt
Spark
Cloud data warehouses
CI/CD / DevOps
Terraform (IaC)

Outils

Databricks
Delta Live Tables
Unity Catalog
dbt
Airflow
Auto Loader
Apache Spark
Redshift
Snowflake
BigQuery
Terraform

Description du poste

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer (Databricks) – Contractor based in the United States.
As a Senior Data Engineer, you will play a key technical role in designing and delivering modern, scalable data platforms using Databricks and cloud-based lakehouse architectures. You will work with forward-thinking organizations to solve complex data challenges through advanced data engineering, distributed processing, and real-time data solutions. Collaborating closely with Solution Architects and cross-functional engineering teams, you will transform technical requirements into reliable and efficient data pipelines. You will also contribute to the development of reusable solution accelerators and innovative engineering practices within a specialized data engineering community. This remote contract opportunity offers the chance to work with modern data technologies, influence enterprise data architecture, and deliver measurable business impact.

Accountabilities
  • Design, develop, and implement data solutions using Databricks and its core platform capabilities, including Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog.
  • Build and optimize scalable data pipelines supporting batch, micro-batch, and streaming data ingestion and processing.
  • Implement configuration-driven data pipelines using YAML and modern ingestion technologies such as Auto Loader.
  • Develop robust data processing and transformation solutions using distributed computing frameworks and cloud lakehouse methodologies.
  • Design and maintain complex job orchestration and workflow patterns using Databricks Jobs and Workflows or tools such as Apache Airflow and dbt.
  • Implement data quality, pipeline auditing, monitoring, and observability solutions using native Databricks capabilities and frameworks such as Great Expectations, Collibra, and dbt.
  • Collaborate with Solution Architects to translate architectural designs into technical components and deliver high-quality implementations.
  • Participate in technical design sessions, break down complex development requirements into manageable tasks, and deliver assigned work within agreed timelines.
  • Contribute to Databricks Center of Excellence initiatives by developing reusable solution accelerators and promoting innovative engineering practices.
  • Explore emerging technologies, new Databricks features, and modern data engineering approaches to continuously improve platform capabilities.
  • Share technical knowledge, insights, and best practices with engineering colleagues and the broader technical community.
Requirements
  • At least 2 years of hands‑on experience designing and developing data pipelines using Databricks.
  • Strong practical knowledge of Databricks platform features, including Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog.
  • Proven experience building robust, scalable, YAML configuration‑driven data pipelines for batch, micro‑batch, and streaming data processing.
  • Experience with data ingestion technologies such as Databricks Auto Loader.
  • Strong understanding of workflow orchestration and experience with Databricks Jobs and Workflows or alternative tools such as Apache Airflow and dbt.
  • Experience implementing data quality, pipeline auditing, monitoring, and observability solutions using Databricks‑native features or tools such as Great Expectations, Collibra, and dbt.
  • Proficiency with big data technologies and distributed processing platforms, including Apache Spark, Presto, and Amazon EMR.
  • Experience with cloud data warehouses such as Amazon Redshift, Snowflake, and Google BigQuery.
  • Strong programming skills in SQL, stored procedures, and object‑oriented languages such as Java and Python, including PySpark.
  • Familiarity with DevOps practices and CI/CD pipeline development, particularly using Databricks Asset Bundles with automated testing and validation.
  • Understanding of Infrastructure as Code (IaC) tools such as Terraform is a plus.
  • Familiarity with NoSQL databases and container management systems.
  • Exposure to AI and machine learning technologies such as MLflow, prompt engineering, and modern AI‑agent workflows.
  • Ability to work independently with minimal supervision while collaborating effectively with architects and cross‑functional engineering teams.
  • Strong analytical thinking, problem‑solving skills, and the ability to break down complex technical challenges into practical solutions.
  • Curiosity, adaptability, and enthusiasm for exploring emerging data technologies and sharing knowledge with others.
Preferred Qualifications
  • Databricks Data Engineer Associate and/or Professional certification.
  • Experience delivering multiple successful Databricks implementation projects.
  • Previous involvement in developing reusable data engineering frameworks, accelerators, or enterprise‑scale data platform solutions.
Benefits
  • Remote work: Fully remote contract opportunity available to professionals based in the United States.
  • Contract duration: Initial six-month engagement, with the possibility of extension.
  • Flexible start date: Expected start in December or January.
  • Technical innovation: Opportunity to work with modern Databricks technologies and advanced cloud data lakehouse architectures.
  • Professional development: Exposure to complex enterprise data challenges and opportunities to expand expertise across data engineering, AI, and distributed processing.
  • Collaborative environment: Work alongside experienced engineers, Solution Architects, and cross‑functional technical teams.
Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior Data Engineer (Databricks) - Contractor
Senior Data Engineer (Databricks) - Contractor

Job Envoy • États-Unis

À distance
USD 140 000 - 190 000
Fully remote in US
6-month+ contract option
Flexible start date
+2
Solution Architect, Delivery (Databricks)
Solution Architect, Delivery (Databricks)

Jobgether • États-Unis

À distance
USD 140 000 - 210 000
Remote work within the United States
Competitive compensation
Professional development
+1
Senior Data Engineer - Fully Remote
Senior Data Engineer - Fully Remote

Sowelo Consulting sp. z o.o. sp. k. • États-Unis

À distance
USD 120 000 - 180 000
100% remote
Flexible hours
B2B contract
+1
Senior Data Engineer
Senior Data Engineer

Accion Labs • États-Unis

À distance
USD 120 000 - 170 000
Senior Data Engineer – Databricks & AWS
Senior Data Engineer – Databricks & AWS

Robotics Technologies • Sunnyvale (CA)

Sur place
USD 76 000 - 108 000
Senior Databricks Data Engineer — Remote Contract
Senior Databricks Data Engineer — Remote Contract

Job Envoy • États-Unis

À distance
USD 140 000 - 190 000
Fully remote in US
6-month+ contract option
Flexible start date
+2
Senior Data Engineer (Contract)
Senior Data Engineer (Contract)

coconutsoftware • États-Unis

À distance
USD 63 000 - 91 000
Health and dental coverage
Virtual care
Disability coverage
+5
Databricks Solution Architect
Databricks Solution Architect

KDR Talent Solutions Ltd • États-Unis

À distance
USD 120 000 - 180 000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

UNAVAILABLE • McLean (VA)

Sur place
USD 120 000 - 160 000
Senior Databricks Data Engineer | Remote Contract
Senior Databricks Data Engineer | Remote Contract

Jobgether • États-Unis

À distance
USD 96 000 - 165 000
Remote work
Contract 6 months
Extension possibility