Senior Data Engineering Tech Lead - AI & Databricks (Remote)

Jobgether

United States

Remoto

USD 55.000 - 90.000

Tempo pieno

6 giorni fa
Candidati tra i primi

Una candidatura completa in un minuto

Curriculum e lettera di presentazione personalizzati, pronti da inviare.

Supera i filtri ATS

Vantaggi offerti da questo lavoro

Meal allowance
Medical and dental insurance
Home office allowance
Fully remote, full-time employment
Learning and certification programs
Wellness and fitness benefits

Descrizione del lavoro

Jobgether seeks a senior Tech Lead – Data Engineering to drive the data layer for an enterprise AI product in a remote setup. You will lead scalable pipelines with Databricks, PySpark, and SQL, shaping medallion architecture and governance frameworks. collaboration with product teams, and delivery of incremental AI-ready datasets.

You will mentor engineers, enforce best practices, and partner with data governance to ensure secure, observable data operations across landing to gold layers.

Competenze

  • Strong hands-on Databricks, PySpark, and Spark SQL in production environments.
  • Practical knowledge of medallion architecture (landing, bronze, silver, gold).
  • Experience with Delta Lake, Unity Catalog, and Databricks Workflows.
  • Experience preparing data for generative AI, including embeddings and vector indexes.
  • Ability to integrate data with APIs while ensuring security and observability.
  • Strong data modeling skills across silver and gold analytical layers.
  • Familiarity with Git, CI/CD, automated testing, and data quality validation.
  • Experience in agile product teams and delivering incremental improvements.
  • Excellent communication with technical and business stakeholders.
  • Bachelor's degree in IT or related field.

Mansioni

  • Lead data pipelines using PySpark and SQL within Databricks.
  • Implement and evolve medallion architecture across data layers.
  • Work with Delta Lake, Unity Catalog, and Databricks Workflows to ensure reliability.
  • Prepare datasets for generative AI services including embeddings and vector indexes.
  • Integrate data with APIs and external services while maintaining security and observability.
  • Design and maintain gold data layer for product, Power BI, and analytics.
  • Develop reusable engineering frameworks and automated data quality controls.
  • Apply software delivery best practices: Git, CI/CD, testing, and documentation.
  • Collaborate with product teams for incremental, valuable deliveries.
  • Support governance teams on data classification, lineage, and access controls.

Conoscenze

Databricks
PySpark
Spark SQL
Medallion architecture
Delta Lake
Unity Catalog
APIs
Git & CI/CD
Data governance
Agile teams

Formazione

Bachelor's degree in IT

Strumenti

Databricks Genie
Power BI
Oracle
GoldenGate/CDC
SQL Server
Confluence

Descrizione del lavoro

Jobgether seeks a senior Tech Lead – Data Engineering to drive the data layer for an enterprise AI product in a remote setup. You will lead scalable pipelines with Databricks, PySpark, and SQL, shaping medallion architecture and governance frameworks. collaboration with product teams, and delivery of incremental AI-ready datasets.

You will mentor engineers, enforce best practices, and partner with data governance to ensure secure, observable data operations across landing to gold layers.

Ottieni la revisione del curriculum gratis e riservata.

o trascina qui il file.

Similar jobs

Offerte di lavoro simili che vale la pena confrontare

Senior AI & Data Engineer, Databricks - Remote
Senior AI & Data Engineer, Databricks - Remote

Eliassen Group • Austin (TX)

Remoto
USD 110.000 - 124.000
Medical, Dental, Vision benefits
401k with company matching
Life insurance
Staff AI & Data Engineer, Databricks — Remote
Staff AI & Data Engineer, Databricks — Remote

Eliassen Group • Stati Uniti

Remoto
USD 110.000 - 124.000
Remote Databricks Lead: Data Eng & ML Expert
Remote Databricks Lead: Data Eng & ML Expert

Jobgether • Stati Uniti

Remoto
USD 135.000 - 165.000
Health insurance
401(k) matching
Paid time off
+1
Senior AI & Data Engineer (Databricks) - Remote
Senior AI & Data Engineer (Databricks) - Remote

Eliassen Group • Denver (CO)

Remoto
USD 110.000 - 124.000
Staff AI & Data Engineer (Databricks) - Remote
Staff AI & Data Engineer (Databricks) - Remote

Eliassen Group • Madison (WI)

Remoto
USD 110.000 - 124.000
Remote Staff AI & Data Engineer (Databricks)
Remote Staff AI & Data Engineer (Databricks)

Eliassen Group • Olympia (WA)

Remoto
USD 110.000 - 124.000
Medical, Dental, Vision benefits
401k with company matching
Life insurance
Staff AI & Data Engineer on Databricks - Remote
Staff AI & Data Engineer on Databricks - Remote

Eliassen Group • City of Albany (NY)

Remoto
USD 110.000 - 124.000
Senior AI & Data Engineer (Databricks, Remote)
Senior AI & Data Engineer (Databricks, Remote)

Eliassen Group • Topeka (KS)

Remoto
USD 110.000 - 124.000
Remote Data Tech Lead - Databricks & Cloud Architect
Remote Data Tech Lead - Databricks & Cloud Architect

CI&T • Stati Uniti

Remoto
USD 160.000 - 230.000
Senior Data & AI Deployment Architect (Remote)
Senior Data & AI Deployment Architect (Remote)

Databricks Inc. • Stati Uniti

Remoto
USD 150.000 - 210.000