Cloud Data Engineer — Azure Databricks & Lakehouse Expert

AmTrust Financial Services Inc.; Dallas (TX); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical & Dental plans

401k savings plans

Paid Time Off

Job summary

AmTrust Financial Services Inc. seeks a seasoned Cloud Data Engineer to design, build, and optimize scalable data lakehouse and data warehousing solutions across Azure Databricks, Synapse Analytics, Data Factory, and SQL.

You will develop and optimize PySpark, Python, SQL/T‑SQL, and Scala workloads, create reusable Databricks notebooks, and implement CI/CD using Azure DevOps and Git. The role supports AI/ML initiatives, feature engineering, and MLOps to power advanced analytics.

Qualifications

• 7+ years of cloud data engineering, ETL/ELT development, data warehousing, and enterprise analytics.
• Experience with Azure Databricks, Azure Synapse Analytics, Azure Data Factory, and modern cloud-based data lakehouse architectures.
• Proficiency in Python, PySpark, Spark SQL, SQL/T-SQL, and Scala; ability to optimize and support scalable Databricks notebooks.

Responsibilities

• Design, develop, and maintain scalable cloud-based data engineering solutions including ETL/ELT pipelines, data integration, reports, and analytics workflows using Azure Databricks, Synapse, Data Factory, and SQL.
• Demonstrate expertise in cloud architecture, data lakehouse design, and data warehousing best practices; evaluate design alternatives and impacts.
• Develop, optimize, and troubleshoot complex SQL, T-SQL, Spark SQL, and PySpark workloads with a focus on performance, scalability, reliability, and cost efficiency.
• Code, test, tune, deploy, and document Databricks notebooks and cloud-native data pipelines using Git, CI/CD, and Azure DevOps.
• Manage development lifecycle for high-impact data initiatives from requirements to production support and continuous improvement.
• Support AI/ML initiatives with data prep, feature engineering pipelines, and scalable data platforms for analytics.

Skills

Azure Databricks

Azure Synapse

Python

PySpark

SQL

T-SQL

Scala

Databricks Notebooks

CI/CD

Azure DevOps

Git

Education

Bachelor's degree in CS/IS/Engineering

Tools

Azure Data Factory

Databricks

SQL Server

Job description

AmTrust Financial Services Inc. seeks a seasoned Cloud Data Engineer to design, build, and optimize scalable data lakehouse and data warehousing solutions across Azure Databricks, Synapse Analytics, Data Factory, and SQL.

You will develop and optimize PySpark, Python, SQL/T‑SQL, and Scala workloads, create reusable Databricks notebooks, and implement CI/CD using Azure DevOps and Git. The role supports AI/ML initiatives, feature engineering, and MLOps to power advanced analytics.