Senior Databricks Data Engineer – PySpark & ETL

OpenTalent; United States; On-site; USD 120,000 - 160,000; Full time

Job summary

OpenTalent is seeking a data engineer to design and maintain robust ETL/ELT pipelines in a Databricks environment. You will leverage PySpark, Python, and SQL to transform large datasets and support analytics across the business.

Ideal candidates have strong data quality discipline, experience with multi-source ingestion, and the ability to optimize data processing at scale. This role emphasizes collaboration with analytics teams and product stakeholders.

Qualifications

• 5 years of experience in Data Engineering / ETL.
• 3 years of hands-on experience with Databricks.
• Strong experience with PySpark, Python, and SQL.

Responsibilities

• Develop and maintain ETL/ELT pipelines using Databricks and PySpark.
• Build data ingestion and transformation processes from multiple source systems.
• Develop and optimize PySpark and SQL code for large-scale data processing.
• Perform data validation, error handling, and data quality checks.

Skills

Data engineering

ETL

Tools

Databricks

PySpark

Python

SQL

Job description

OpenTalent is seeking a data engineer to design and maintain robust ETL/ELT pipelines in a Databricks environment. You will leverage PySpark, Python, and SQL to transform large datasets and support analytics across the business.

Ideal candidates have strong data quality discipline, experience with multi-source ingestion, and the ability to optimize data processing at scale. This role emphasizes collaboration with analytics teams and product stakeholders.