Senior Databricks Developer II Immediate II Remote

Compunnel Inc.

United States

A distancia

USD 140.000 - 190.000

Jornada completa

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Compunnel Inc. is seeking a Senior Databricks Developer with 8+ years of IT experience to design, develop, and optimize enterprise-scale data engineering solutions on Databricks.

You will implement Medallion Architecture, build scalable pipelines with PySpark, Python, and SQL, and modernize legacy ETL workloads within a cloud data platform. You will mentor junior developers, collaborate with architects and stakeholders, and ensure governance via Unity Catalog.

Formación

  • 8+ years of IT experience in data engineering or related field.
  • Hands-on Databricks development experience.
  • Experience modernizing data warehouses and migrating ETL workloads to Databricks.

Responsabilidades

  • Design, develop, and optimize scalable data pipelines using Databricks, PySpark, Python, and SQL.
  • Implement Medallion Architecture (Bronze, Silver, Gold).
  • Develop reusable data ingestion, transformation, validation, and processing frameworks.
  • Design and optimize Delta Lake tables and large Spark workloads.
  • Build and manage data workflows using Databricks Workflows.
  • Implement data governance with Unity Catalog, including RBAC and data masking.
  • Develop dimensional, reference, master, and curated data models.
  • Migrate legacy ETL processes and SQL Server/Oracle/Teradata workloads to Databricks.

Conocimientos

Databricks
PySpark
Python
Advanced SQL
Delta Lake
Unity Catalog
Medallion Architecture
ETL/ELT Development
Data Modelling
Spark Performance Tuning
Databricks Workflows

Descripción del empleo

Experience: 8+ Years
Role: Senior Databricks Developer

Job Summary

We are looking for an experienced Senior Databricks Developer with 8+ years of overall experience and strong hands-on expertise in designing, developing, and optimizing enterprise-scale data engineering solutions using Databricks.

The ideal candidate should have strong proficiency in Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, data modelling, and ETL/ELT pipelines. Experience in modernizing legacy data warehouses and migrating traditional ETL workloads to Databricks is essential.

Key Responsibilities
  • Design, develop, and optimize scalable data pipelines using Databricks, PySpark, Python, and SQL.
  • Implement Medallion Architecture (Bronze, Silver, and Gold layers).
  • Develop reusable frameworks for data ingestion, transformation, validation, and processing.
  • Design, implement, and optimize Delta Lake tables and large-scale Spark workloads.
  • Build and manage data workflows using Databricks Workflows.
  • Implement data governance and security using Unity Catalog, including RBAC, row/column-level security, and data masking.
  • Develop dimensional, reference, master, and curated data models.
  • Modernize legacy data warehouse solutions from SQL Server, Oracle, and Teradata to Databricks.
  • Migrate stored procedures and traditional ETL processes into scalable cloud-based ETL/ELT pipelines.
  • Perform Spark and SQL performance tuning, cost optimization, troubleshooting, and root-cause analysis.
  • Implement pipeline monitoring, error handling, and recovery mechanisms.
  • Support CI/CD, code reviews, testing, deployment, and production support.
  • Mentor junior developers and participate in technical and design discussions.
  • Collaborate with architects, business stakeholders, and onshore/offshore delivery teams.
Mandatory Technical Skills
  • Databricks
  • PySpark
  • Python
  • Advanced SQL
  • Delta Lake
  • Unity Catalog
  • Medallion Architecture (Bronze/Silver/Gold)
  • ETL/ELT Development
  • Data Modelling
  • Spark Performance Tuning
  • Databricks Workflows
Good to Have
  • Databricks AI capabilities.
  • Experience with SQL Server, Oracle, and Teradata migration.
  • Cloud data engineering experience.
  • CI/CD and production support.
Desired Candidate Profile
  • 8+ years of overall IT experience.
  • Strong hands-on experience in Databricks development.
  • Experience in enterprise-scale data engineering and warehouse modernization.
  • Strong problem-solving, analytical, and communication skills.
  • Ability to work independently and mentor junior team members.
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Databricks Developer
Senior Databricks Developer

Ethereum Technologies LLC • Pennsylvania

Presencial
USD 112.000 - 128.000
Senior Databricks Developer
Senior Databricks Developer

Robotics Technologies LLC • Pennsylvania

Presencial
USD 92.000 - 131.000
Senior Databricks Developer
Senior Databricks Developer

Robotic Process Automation LLC • Pennsylvania

Presencial
USD 95.000 - 128.000
Senior Databricks Developer
Senior Databricks Developer

Valiant Technologies LLC • Pennsylvania

Presencial
USD 92.000 - 131.000
Senior Databricks Developer
Senior Databricks Developer

Quantum Technologies LLC • Pennsylvania

Presencial
USD 96.000 - 131.000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

UNAVAILABLE • McLean (VA)

Presencial
USD 120.000 - 160.000
Senior Resident Solution Architect
Senior Resident Solution Architect

Unison Group • San Francisco (CA)

Presencial
USD 180.000 - 240.000
Databricks Engineer
Databricks Engineer

Dataflix • EE. UU.

A distancia
USD 130.000 - 170.000
Databricks Developer
Databricks Developer

Vservice It Solutions • EE. UU.

A distancia
USD 140.000 - 190.000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Alephys • Houston (TX)

Presencial
USD 120.000 - 180.000