Azure cloud Data architect with Strong data bricks and data factory

ERPMARK INC; Greenfield (IN); On-site; USD 150,000 - 190,000; Full time

Job summary

ERPMARK INC. in Greenfield, IN is seeking an Azure cloud data architect with strong Databricks, PySpark, and ADF experience. The role focuses on building modern data engineering solutions and Lakehouse architectures using Databricks, PySpark, ADF, and Azure Synapse.

Ideal candidates bring 10+ years in IT with deep Azure cloud expertise and a solid Python/development background, collaborating closely with customers and agile teams to deliver scalable data platforms onsite.

Qualifications

• 10+ years of IT experience with cloud data platforms.
• Proven experience with Azure Databricks and PySpark.
• Strong experience in Azure Data Factory and ADLS Gen2.
• Proficient in Python and cloud DevOps practices.

Responsibilities

• Build and maintain modern Azure Data Engineering solutions.
• Develop Lakehouse architectures using Databricks, PySpark, ADF, and Azure Synapse.
• Apply DevOps practices and cloud-native engineering principles.
• Collaborate with teams and customers on solution design and coding standards.

Skills

Azure Databricks PySpark

Databricks Workflows

Unity Catalog

Azure Data Factory

ADLS Gen2

Azure SQL

Python

Azure Cloud Platform

Tools

GitHub Actions

Kafka

Airflow

Dagster

Logic Apps

Event Hubs

Job description

We're Hiring: Azure cloud Data architect with Strong data bricks and data factory

Location

Greenfield, IN (Onsite)

Employment Type

Full-Time (FTE)

Experience

10–20 years of overall IT experience

Mandatory Technical Skills

• 4+ years in Azure Databricks with PySpark


• 2+ years in Databricks Workflows & Unity Catalog


• 3+ years in Azure Data Factory (ADF)


• 3+ years in Azure Data Lake Storage Gen2 (ADLS Gen2)


• 3+ years in Azure SQL


• 2+ years in Python programming & package builds


• 5+ years in the Azure Cloud platform

Key Responsibilities

• Build and maintain modern Azure Data Engineering solutions.


• Develop Lakehouse architectures using Databricks, PySpark, ADF, and Azure Synapse.


• Apply DevOps practices and cloud-native engineering principles.


• Collaborate with teams and customers on solution design and coding standards.

Good To Have

Azure Entra ID/AD, GitHub Actions, CDC/Debezium, Kafka, Azure Event Hubs, Airflow, Dagster, Logic Apps, Google Cloud Pub/Sub, and Google Cloud Storage.