Lead Data Engineer — Azure, Databricks & Streaming

8451

Cincinnati (OH)

Sur place

USD 125 000 - 207 000

Plein temps

Il y a 3 jours
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

84.51° is seeking a Lead Data Engineer in the United States to design, implement, and run big data solutions on Azure Cloud. You will lead Databricks‑based pipelines, streaming data, and APIs while guiding a blended onshore/offshore team and collaborating with Product, Data Science, and architectural partners.

The role emphasizes data governance, quality, and scalable architectures, with a strong focus on collaboration, mentorship, and continuous improvement.

Qualifications

  • Bachelor's degree in CS, MIS, math, analytics or equivalent.
  • 5+ years data engineering experience.
  • 5+ years Spark (Databricks, PySpark).
  • 5+ years Python and SQL development.
  • 2+ years leading or mentoring engineers (onshore/offshore).
  • Experience with event‑driven or streaming data using Spark Structured Streaming.
  • Schema management with Avro/Protobuf/JSON Schema and backward compatibility.
  • Azure data services like ADLS, Key Vault, AKS, Data Factory.
  • CI/CD, Git workflows, IaC; strong data modeling and Delta Lake.
  • Databricks Unity Catalog experience; data governance and access control.
  • REST APIs and Kubernetes experience; on‑call/incident response.

Responsabilités

  • Provide technical leadership to a blended onshore/offshore team.
  • Lead design and development of Databricks‑based solutions and set standards.
  • Design event‑driven data pipelines, streaming ingestion and publishing.
  • Define event contracts, schemas, and versioning with stakeholders.
  • Build pipelines with ordering, late data, deduping, retries, and backfill.
  • Collaborate with Data Science to deliver data and feature pipelines.
  • Develop data models, schemas, and operational procedures for continuity.
  • Own pipeline reliability, incident response, and latency monitoring.
  • Mentor junior engineers and promote best practices.

Connaissances

Data engineering
Spark / PySpark
Python
SQL
Leadership
Azure
Databricks
REST APIs
Kubernetes
Communication

Formation

Bachelor's degree in Computer Science or related field

Outils

Databricks
Azure Data Factory
Azure Kubernetes Service
Kafka
Delta Lake
Unity Catalog

Description du poste

84.51° is seeking a Lead Data Engineer in the United States to design, implement, and run big data solutions on Azure Cloud. You will lead Databricks‑based pipelines, streaming data, and APIs while guiding a blended onshore/offshore team and collaborating with Product, Data Science, and architectural partners.

The role emphasizes data governance, quality, and scalable architectures, with a strong focus on collaboration, mentorship, and continuous improvement.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Lead Data Engineer: Databricks & Azure Streaming Architect
Lead Data Engineer: Databricks & Azure Streaming Architect

84.51˚ • Cincinnati (OH)

Sur place
USD 125 000 - 207 000
Health insurance
401(k) with matching
Paid time off
Lead Data Engineer: Streaming Data on Azure & Databricks
Lead Data Engineer: Streaming Data on Azure & Databricks

84.51° • Cincinnati (OH), Chicago (IL)

Sur place
USD 125 000 - 207 000
Lead Data Engineer - Azure, Databricks & Streaming
Lead Data Engineer - Azure, Databricks & Streaming

84.51˚ • Chicago (IL)

Sur place
USD 125 000 - 207 000
Health benefits including medical, and
401(k) with Roth option
Health Savings Account (HSA) withMatch
+2
Lead Data Engineer: Azure & Databricks, Scale Personalization
Lead Data Engineer: Azure & Databricks, Scale Personalization

84.51˚ • Chicago (IL)

Sur place
USD 125 000 - 207 000
Health insurance
401(k) with Roth option and matching
Paid time off and holidays
Lead Data Engineer: Azure & Databricks, Mentorship
Lead Data Engineer: Azure & Databricks, Mentorship

8451 • Cincinnati (OH)

Sur place
USD 125 000 - 207 000
Health insurance
Dental coverage
Vision coverage
+6
Lead Data Engineer – Azure, Databricks & Snowflake (Remote)
Lead Data Engineer – Azure, Databricks & Snowflake (Remote)

Exusia, Inc. • Miami (FL)

À distance
USD 120 000 - 150 000
Lead Data Engineer - Azure Databricks & Lakehouse
Lead Data Engineer - Azure Databricks & Lakehouse

EPAM Systems • États-Unis

À distance
USD 140 000 - 170 000
Lead Data Architect & Engineer - Databricks Lakehouse
Lead Data Architect & Engineer - Databricks Lakehouse

CloudBigD • Atlanta (GA)

Sur place
USD 89 000 - 126 000
Lead Data Engineer — Azure Databricks & Data Architecture
Lead Data Engineer — Azure Databricks & Data Architecture

MetLife, Inc. • Cary (NC)

Hybride
USD 120 000 - 180 000
Health plan and benefits
401(k) with employer match
Paid time off and holidays
Lead Databricks & Cloud Data Engineer
Lead Databricks & Cloud Data Engineer

U.S. Bank • Earth City (MO)

Sur place
USD 133 000 - 157 000
Healthcare (medical, dental, vision)
Life insurance (basic & optional)
Disability insurance (short & long)
+6