Senior Azure Databricks Data Engineer | Pipelines & ETL

Cloud Analytics Technologies, LLC; Houston (TX); On-site; USD 90,000 - 120,000; Full time

Job summary

A cloud data solutions firm in Houston seeks a Specialist with over 7 years of experience in designing and developing scalable data solutions using Azure Databricks. Responsibilities include optimizing data pipelines, implementing ETL workflows, and collaborating with cross-functional teams to align data solutions with business objectives. Candidates should be proficient in PySpark and Python, and expected to mentor junior team members and document workflows for knowledge sharing.

Qualifications

• 7 years of experience in designing and developing scalable data solutions using Azure Databricks.
• Experience with implementing and maintaining ETL workflows.
• Proficiency in writing maintainable PySpark and Python code.

Responsibilities

• Design, develop, and optimize scalable data pipelines using Azure Databricks.
• Implement and maintain ETL workflows for performance and reliability.
• Collaborate with teams to align data solutions with business needs.

Skills

Azure Databricks

Data pipeline optimization

PySpark

Data integration

ETL workflows

Job description

A cloud data solutions firm in Houston seeks a Specialist with over 7 years of experience in designing and developing scalable data solutions using Azure Databricks. Responsibilities include optimizing data pipelines, implementing ETL workflows, and collaborating with cross-functional teams to align data solutions with business objectives. Candidates should be proficient in PySpark and Python, and expected to mentor junior team members and document workflows for knowledge sharing.