Cloud Data Engineer: Azure Databricks & AI Pipelines Lead

AmTrust Financial Services Inc.; Inwood (TX); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical & Dental Plans

Life Insurance

Health Care Flexible Spending

Dependent Care

401k Savings Plans

Paid Time Off

Job summary

AmTrust Financial Services Inc. seeks an experienced Cloud Data Engineer to design and optimize scalable data lakehouse and data warehousing solutions using Azure Databricks, Synapse Analytics, Data Factory, and SQL.

Proficiency in Python, PySpark, SQL, T-SQL, and Scala is required for building high-volume ETL/ELT pipelines and reusable notebooks. You will support AI/ML initiatives, feature engineering, and MLOps processes while collaborating with business stakeholders to deliver secure,

Qualifications

• 7+ years of cloud data engineering, ETL/ELT development, data warehousing, and enterprise analytics.
• Strong hands-on experience with Azure Databricks, Azure Synapse Analytics, Azure Data Factory, and modern cloud-based data lakehouse architectures.

Responsibilities

• Design, develop, and maintain scalable cloud-based data engineering solutions including ETL/ELT pipelines, data integration processes, reports, and analytics workflows using Azure Databricks, Synapse Analytics, Data Factory, and SQL.
• Develop, optimize, and troubleshoot complex SQL, T-SQL, Spark SQL, and PySpark workloads with a focus on performance and cost efficiency.
• Collaborate with stakeholders to translate requirements into scalable technical solutions and document data pipelines and notebooks.

Skills

Azure Databricks

Azure Synapse Analytics

Python

PySpark

SQL

T-SQL

Scala

Data lakehouse

Databricks notebooks

Git

Azure DevOps

CI/CD

Spark SQL

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Factory

Databricks

Git

Azure DevOps

Job description

AmTrust Financial Services Inc. seeks an experienced Cloud Data Engineer to design and optimize scalable data lakehouse and data warehousing solutions using Azure Databricks, Synapse Analytics, Data Factory, and SQL.

Proficiency in Python, PySpark, SQL, T-SQL, and Scala is required for building high-volume ETL/ELT pipelines and reusable notebooks. You will support AI/ML initiatives, feature engineering, and MLOps processes while collaborating with business stakeholders to deliver secure,