Senior Data Engineer: PySpark & Databricks (Remote)

OpenKrill; United States; Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Remote work 100%

USD pay

Paid time off

Autonomy

Top US companies

Job summary

OpenKrill is seeking a Data Engineer with 5–7 years of hands-on experience to join our client team. You will design, build, and optimize ETL pipelines using PySpark and Databricks, delivering scalable data solutions across business units.

You’ll collaborate with engineering and business teams, focus on performance tuning, data quality, and cost efficiency, and communicate complex concepts clearly. This role is fully remote with USD pay and a strong emphasis on autonomy and impact.

Qualifications

• 5–7 years hands-on data engineering in production
• Strong PySpark and Databricks proficiency
• Advanced knowledge of Databricks AutoLoader and Python
• Experience with end-to-end ETL processes and transformations
• Excellent problem-solving and cross-functional communication

Responsibilities

• Design, build, and maintain scalable ETL pipelines for large-scale data processing.
• Work with PySpark and Databricks to execute data transformations and workflows.
• Fine-tune pipelines for performance, scalability and cost efficiency.
• Collaborate with engineering and business teams to translate requirements into data solutions.
• Debug, resolve, and prevent pipeline bottlenecks and data issues.
• Enforce data quality, governance, and system performance standards.

Skills

PySpark

Databricks

Python

ETL pipelines

Data transformations

Job description

OpenKrill is seeking a Data Engineer with 5–7 years of hands-on experience to join our client team. You will design, build, and optimize ETL pipelines using PySpark and Databricks, delivering scalable data solutions across business units.

You’ll collaborate with engineering and business teams, focus on performance tuning, data quality, and cost efficiency, and communicate complex concepts clearly. This role is fully remote with USD pay and a strong emphasis on autonomy and impact.