Senior Azure Data Engineer - Databricks & Synapse (Hybrid)

Technotopia Solutions LLC; Indianapolis (IN); Hybrid; USD 49,000 - 70,000; Full time

Job summary

State of Indiana seeks an IN - IDOH Data Scientist to design and implement scalable data pipelines in Azure Databricks and Synapse, delivering reliable data products while enforcing governance for PHI/PII data.

You will collaborate with data architects, scientists, analysts and project managers to translate business needs into robust technical designs, supporting both batch and streaming workloads in a regulated environment.

Qualifications

• Master's degree or 4+ years in relevant field with data engineering experience.
• 4+ years developing Databricks notebooks with PySpark, Spark SQL, and R.
• 4+ years with Delta Lake features and medallion architecture (Bronze/Silver/Gold).
• Strong written and verbal communication skills.

Responsibilities

• Design, build, and maintain batch and streaming data pipelines in Azure Databricks.
• Develop, load, and tune dimensional data models and SQL workloads in Azure Synapse.
• Govern data security controls and HIPAA compliance for health data.
• Collaborate with data architects, scientists, analysts and PMs on solution design.

Skills

PySpark

Spark SQL

Delta Lake

Azure Databricks

Azure Synapse

Data governance

SQL workloads

ETL pipelines

Education

Master's degree in Data Science or related field

Tools

Databricks

Azure Data Factory

Synapse Analytics

Delta Lake

Job description

State of Indiana seeks an IN - IDOH Data Scientist to design and implement scalable data pipelines in Azure Databricks and Synapse, delivering reliable data products while enforcing governance for PHI/PII data.

You will collaborate with data architects, scientists, analysts and project managers to translate business needs into robust technical designs, supporting both batch and streaming workloads in a regulated environment.