Data Scientist – Azure Databricks & Synapse Expert

Millenniumsoft; Indianapolis (IN); Presencial; USD 55.000 - 66.000; Jornada completa

Descripción de la vacante

Millenniumsoft in Indianapolis, IN is seeking a Data Scientist/Data Engineer to design, build, and maintain secure data solutions across Azure Databricks and Azure Synapse Analytics. The role focuses on data integration, governance, and scalable batch/streaming pipelines to deliver reliable data products for the agency.

The candidate will collaborate with cross-functional teams, implement a medallion lakehouse approach, and ensure compliance with HIPAA and agency policy while supporting

Formación

• Master's degree in data science, analytics, informatics, CS, math, engineering or related field.
• 4+ years hands-on data engineering experience or a relevant combination of education and experience.
• Certifications may substitute for formal requirements.
• Experience developing in PySpark, Spark SQL, and R.

Responsabilidades

• Design, build, and maintain secure, scalable data solutions across Azure Databricks and Synapse.
• Develop batch and streaming data pipelines and optimize data warehouse workloads.
• Enforce data governance and security controls (PHI/PII) per HIPAA and policy.
• Collaborate with data architects, scientists, analysts, and PMs on solution design.

Conocimientos

Azure Databricks

PySpark

Spark SQL

Delta Lake

Data governance

Batch/Streaming pipelines

Azure Synapse Analytics

Databricks Workflows

SQL workloads

Educación

Master's degree in data science/analytics/CS

Bachelor's degree + 2+ years data engineering

Herramientas

Azure Databricks

Azure Synapse Analytics

Delta Lake

Unity Catalog

ADF Pipelines

Descripción del empleo

Millenniumsoft in Indianapolis, IN is seeking a Data Scientist/Data Engineer to design, build, and maintain secure data solutions across Azure Databricks and Azure Synapse Analytics. The role focuses on data integration, governance, and scalable batch/streaming pipelines to deliver reliable data products for the agency.

The candidate will collaborate with cross-functional teams, implement a medallion lakehouse approach, and ensure compliance with HIPAA and agency policy while supporting