Cloud Data Engineer - Azure Databricks & Lakehouse

JobCubby; Dallas, Northern (TX, KY); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Medical & Dental Plans

401k Savings Plans

Paid Time Off

Job summary

AmTrust Financial Services is seeking a Cloud Data Engineer to design and optimize scalable data lakehouse and data warehouse solutions for enterprise reporting and BI in a Microsoft Azure environment. You will build and tune ETL/ELT pipelines, develop reusable Databricks notebooks, and implement CI/CD using Azure DevOps and Git.

The role requires 7+ years in cloud data engineering with strong Python, PySpark, SQL, and Scala skills.

Qualifications

• 7+ years of cloud data engineering, ETL/ELT development, data warehousing, and enterprise analytics.
• Hands-on experience with Azure Databricks, Azure Synapse Analytics, Azure Data Factory, and modern cloud data lakehouse architectures.
• Proficiency in Python, PySpark, Spark SQL, SQL, T-SQL, and Scala for scalable notebooks and data processing.

Responsibilities

• Design, develop, and maintain scalable cloud-based data engineering solutions, including ETL/ELT pipelines and analytics workflows.
• Demonstrate expertise in data lakehouse design and data warehousing best practices.
• Develop, optimize, and troubleshoot complex SQL/T-SQL/PySpark workloads for performance, scalability, and cost efficiency.
• Code, test, deploy, and document Databricks notebooks and cloud-native data pipelines using Git, CI/CD, and Azure DevOps.

Skills

Azure Databricks

Azure Synapse Analytics

Python

PySpark

SQL

T-SQL

Scala

ETL/ELT

Databricks notebooks

Education

Bachelor's degree in Computer Science/Engineering/Math/Related

Tools

Azure DevOps

Git

CI/CD

Azure Data Factory

Job description

AmTrust Financial Services is seeking a Cloud Data Engineer to design and optimize scalable data lakehouse and data warehouse solutions for enterprise reporting and BI in a Microsoft Azure environment. You will build and tune ETL/ELT pipelines, develop reusable Databricks notebooks, and implement CI/CD using Azure DevOps and Git.

The role requires 7+ years in cloud data engineering with strong Python, PySpark, SQL, and Scala skills.