Azure Data Engineer

Stellar Professionals; Indianapolis (IN); Hybrid; USD 110,000 - 150,000; Full time

Job summary

Stellar Professionals in Indianapolis is seeking a Data Scientist / Data Engineer to design, build, and maintain secure, scalable data solutions using Azure Databricks and Azure Synapse Analytics.

You will develop batch and streaming data pipelines, optimize data warehouses, and enforce data governance to deliver high-quality data products in a hybrid work setup (onsite 1 day per week).

Qualifications

• Master's degree in Data Science, CS, or related field.
• Bachelor's degree with 2+ years of relevant data engineering experience.
• 4+ years hands-on data engineering experience.

Education

Master's degree in Data Science, Computer Science, or related field

Bachelor's degree + 2+ years of relevant experience

4+ years of hands-on data engineering experience

Tools

Azure Databricks

Azure Synapse Analytics

ETL/ELT

Azure Data Factory (ADF)

Databricks Workflows

ADLS Gen2

Parquet/Delta formats

Git

Azure DevOps

Databricks Asset Bundles

Job description

Position: Data Scientist / Data Engineer

Work Arrangement: Hybrid (Onsite 1 day per week)

Location: Indianapolis, IN (Local candidates only)

Interview Process: Webcam only

Position Overview

We are seeking a Data Scientist / Data Engineer to design, build, and maintain secure, scalable data solutions using
Azure Databricks and
Azure Synapse Analytics. You will build batch and streaming data pipelines, optimize data warehouse workloads, and implement data governance standards to deliver high-quality, reliable data products.

Key Skills & Technical Requirements

• Azure Databricks: PySpark, Spark SQL, Delta Lake, Medallion Architecture (Bronze/Silver/Gold), Unity Catalog
• Azure Synapse Analytics: Dedicated & Serverless SQL pools, MPP architecture, Star-Schema Data Modeling (SCD Type 1/2)
• Data Integration & Pipelines: ETL/ELT, Auto Loader, Structured Streaming, Azure Data Factory (ADF), Databricks Workflows

Engineering & Operations:

• Data Lake & Storage: ADLS Gen2, Parquet/Delta formats, Schema Enforcement/Evolution, Time Travel
• DevOps & CI/CD: Git, Azure DevOps, Databricks Asset Bundles, Branching & PRs
• Performance & Governance: Cluster right-sizing, Spark UI troubleshooting, HIPAA/PHI/PII security, Role-Based Access Control (RBAC)

Qualifications

• Master's degree in Data Science, Computer Science, or related field;
  OR Bachelor's degree + 2+ years of relevant experience;
  OR 4+ years of hands-on data engineering experience.
• Preferred Certifications: Databricks Certified Data Engineer Associate/Professional or Microsoft Certified: Azure Data Engineer Associate (DP-203).