Data Scientist

JPS Tech Solutions Pvt Ltd; Indianapolis (IN); On-site; USD 120,000 - 180,000; Full time

Job summary

JPS Tech Solutions Pvt Ltd is seeking an experienced Data Scientist to support the agency’s data strategy by building and governing data pipelines, integrating sources, and modeling data in Azure-enabled environments.

The role focuses on batch and streaming pipelines using Azure Databricks and Azure Synapse Analytics, ensuring data quality, security, and HIPAA-compliant handling of PHI/PII. You will collaborate with cross-functional teams to deliver scalable data solutions.

Qualifications

• Experience with enterprise data integration and secure data environments.
• Ability to translate business requirements into technical solutions.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.
• Experience preparing technical documentation and supporting data engineering standards.

Responsibilities

• Design, develop, and maintain batch and streaming data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.
• Implement medallion architecture (Bronze, Silver, Gold) for data processing and integration.
• Develop, load, and optimize dimensional data models and SQL workloads in Azure Synapse Analytics.
• Orchestrate and monitor workflows using Databricks Jobs, Azure Data Factory, and Synapse pipelines.
• Perform data extraction, transformation, and loading (ETL) from multiple data sources.
• Implement data governance, quality, security, and stewardship standards.
• Apply Unity Catalog permissions, role-based access, data masking, and row- and column-level security.
• Ensure sensitive health data (PHI/PII) is protected in accordance with HIPAA and agency policies.
• Collaborate with data architects, data scientists, analysts, solution leads, and project managers.
• Participate in requirements gathering, solution reviews, and technical design discussions.
• Prepare technical documentation, diagrams, flowcharts, and implementation guidelines.
• Provide technical support, guidance, and training to project teams.

Skills

Data integration

Batch and streaming pipelines

ETL design

HIPAA/PHI/PII data protection

Cross-functional collaboration

Technical documentation

Requirements gathering

Tools

Azure Databricks

PySpark

Spark SQL

Delta Lake

Medallion architecture

Azure Synapse Analytics

Azure Data Factory

Databricks Workflows

Unity Catalog permissions

Job description

Job Summary

We are seeking an experienced Data Scientist to support the agency’s data strategy through data integration, pipeline development, data modeling, and governance. The role focuses on building and optimizing batch and streaming data pipelines using Azure Databricks and Azure Synapse Analytics while ensuring data quality, security, and compliance. The ideal candidate will collaborate with cross-functional teams to deliver reliable, scalable data solutions.

Key Responsibilities

• Design, develop, and maintain batch and streaming data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.


• Implement medallion architecture (Bronze, Silver, and Gold) for data processing and integration.


• Develop, load, and optimize dimensional data models and SQL workloads in Azure Synapse Analytics.


• Orchestrate and monitor workflows using Databricks Jobs, Azure Data Factory, and Synapse pipelines.


• Perform data extraction, transformation, and loading (ETL) from multiple data sources.


• Implement data governance, quality, security, and stewardship standards.


• Apply Unity Catalog permissions, role-based access, data masking, and row- and column-level security.


• Ensure sensitive health data (PHI/PII) is protected in accordance with HIPAA and agency policies.


• Collaborate with data architects, data scientists, analysts, solution leads, and project managers.


• Participate in requirements gathering, solution reviews, and technical design discussions.


• Prepare technical documentation, diagrams, flowcharts, and implementation guidelines.


• Provide technical support, guidance, and training to project teams.

Required Technical Skills

• Azure Databricks


• PySpark and Spark SQL


• Delta Lake and Medallion Architecture


• Azure Synapse Analytics


• Azure Data Factory


• Batch and Streaming Data Pipelines


• ETL and Data Integration


• Dimensional Data Modeling and SQL Optimization


• Databricks Workflows and Jobs


• Data Governance, Security, and Quality


• Unity Catalog and Role-Based Access Control


• HIPAA, PHI, and PII Data Protection

Additional Qualifications

• Experience with enterprise data integration and secure data environments.


• Ability to translate business requirements into technical solutions.


• Strong analytical, troubleshooting, and problem-solving skills.


• Excellent communication and collaboration skills.


• Experience preparing technical documentation and supporting data engineering standards.

Candidate Requirement

Local candidates only will be considered for this position.