Azure Data Engineer - Databricks & Synapse Pipelines

BuzzClan; Indianapolis (IN); On-site; USD 130,000 - 180,000; Full time

Job summary

BuzzClan is seeking a Senior Data Engineer to design, build, and maintain secure data pipelines in Azure Databricks and Synapse. You will collaborate with data architects, scientists, and analysts to translate business needs into scalable data solutions.

The role emphasizes batch and streaming pipelines, governance, and documentation, with opportunities for mentorship as needed. Local Indiana candidates preferred for on-site work.

Qualifications

• Experience with Databricks notebooks in PySpark, Spark SQL, and R.
• Proficient with medallion (bronze/silver/gold) architecture and incremental ingestion.
• Experience with Unity Catalog for workspace catalogs, schemas, permissions, and lineage.
• Experience with ADLS Gen2 Parquet/Delta and CETAS.

Responsibilities

• Design and maintain batch and streaming data pipelines in Azure Databricks using PySpark, Spark SQL, and Delta Lake.
• Develop dimensional data models and SQL workloads in Azure Synapse Analytics to support reporting and dashboards.
• Orchestrate data workflows using Databricks Workflows and Synapse or Azure Data Factory pipelines with scheduling and alerting.
• Apply data governance and security controls (PHI/PII, HIPAA) in line with agency policy.
• Mentor or supervise junior team members as needed.

Skills

Strong communication

Team collaboration

Problem solving

Education

Master's degree in data science or related field

Bachelor's degree + 2+ years experience or 4+ years relevant experience

Certifications may substitute for formal education/experience

Tools

Databricks

Azure Databricks

PySpark

Spark SQL

Delta Lake

Azure Synapse Analytics

Azure Data Factory

Databricks Workflows

Unity Catalog

ADLS Gen2

Job description

BuzzClan is seeking a Senior Data Engineer to design, build, and maintain secure data pipelines in Azure Databricks and Synapse. You will collaborate with data architects, scientists, and analysts to translate business needs into scalable data solutions.

The role emphasizes batch and streaming pipelines, governance, and documentation, with opportunities for mentorship as needed. Local Indiana candidates preferred for on-site work.