Senior Azure Databricks Data Engineer

Ethereum Technologies LLC; Houston (TX); On-site; USD 100,000 - 140,000; Full time

Job summary

A leading technology firm in Houston seeks a Specialist to design and develop scalable data solutions leveraging Azure Databricks. The ideal candidate should have at least 7 years of relevant experience in data engineering, specifically with Azure Databricks. Responsibilities include leading the development of data pipelines, writing efficient PySpark and Python code, and mentoring junior engineers. This role offers the chance to work on enterprise-level data processing while promoting best practices in a collaborative team environment.

Qualifications

• 7 years of experience in designing and developing scalable data solutions.
• Expertise in Azure Databricks and data engineering principles.
• Ability to document data processes and pipelines.

Responsibilities

• Lead the design and development of complex data pipelines using Azure Databricks.
• Write clean, maintainable PySpark and Python code.
• Troubleshoot data pipelines and ensure high availability.
• Collaborate with stakeholders to gather requirements.
• Mentor junior team members on best practices.

Skills

Azure Databricks

PySpark

Python

ETL workflows

Data modeling

Job description

A leading technology firm in Houston seeks a Specialist to design and develop scalable data solutions leveraging Azure Databricks. The ideal candidate should have at least 7 years of relevant experience in data engineering, specifically with Azure Databricks. Responsibilities include leading the development of data pipelines, writing efficient PySpark and Python code, and mentoring junior engineers. This role offers the chance to work on enterprise-level data processing while promoting best practices in a collaborative team environment.