Remote Azure Databricks GenAI Platform Engineer

Fractal; United States; Remote; USD 130,000 - 160,000; Full time

Job summary

Fractal Analytics is seeking an Azure Databricks Engineer to design and optimize scalable data pipelines on Microsoft Azure, leveraging Delta Lake and PySpark. The role focuses on integrating Azure AI Foundry for AI and Generative AI use cases, enabling advanced analytics across the enterprise.

The ideal candidate has strong data engineering fundamentals, hands-on Azure experience, and the ability to deliver end-to-end data solutions that power AI-driven business outcomes.

Qualifications

• 8+ years of experience in data engineering or related field.
• Hands-on experience with Azure cloud services and data pipelines.
• Experience with Azure AI Foundry and AI/GenAI use cases is a plus.

Responsibilities

• Design, build, and optimize scalable data pipelines on Azure Databricks.
• Ingest data from structured and unstructured sources and implement ELT/ETL with PySpark.
• Develop Data Lakehouse architectures and CI/CD for data workflows.

Skills

PySpark

Spark SQL

Data Modeling

Education

Bachelor's or Master's degree

Tools

Azure Databricks

Delta Lake

Job description

Fractal Analytics is seeking an Azure Databricks Engineer to design and optimize scalable data pipelines on Microsoft Azure, leveraging Delta Lake and PySpark. The role focuses on integrating Azure AI Foundry for AI and Generative AI use cases, enabling advanced analytics across the enterprise.

The ideal candidate has strong data engineering fundamentals, hands-on Azure experience, and the ability to deliver end-to-end data solutions that power AI-driven business outcomes.