Senior Data Engineer - Azure Databricks & Synapse Expert

JPS Tech Solutions Pvt Ltd; Indianapolis (IN); On-site; USD 120,000 - 150,000; Full time

Job summary

JPS Tech Solutions Pvt Ltd in the United States is seeking an experienced Data Scientist to drive enterprise data integration, pipeline development, data modeling, governance, and platform initiatives.

The role emphasizes hands-on work with Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Synapse Analytics, and Azure Data Factory, with a focus on secure data handling and scalable lakehouse architectures.

Qualifications

• 5+ years of experience in data engineering, data integration, and enterprise data platforms.
• Hands‑on experience with Azure Databricks, PySpark, Spark SQL, and Delta Lake.
• Strong experience with Azure Synapse Analytics, including dedicated and serverless SQL pools.
• Experience developing and supporting batch and streaming data pipelines.
• Hands‑on experience with Azure Data Factory and Databricks Workflows/Jobs.
• Strong SQL and data modeling skills, including dimensional modeling and workload optimization.
• Experience implementing data governance, security, access controls, and data quality practices.
• Knowledge of Unity Catalog, RBAC, row‑level security, column‑level security, and data masking.
• Experience working with sensitive or regulated data environments.
• Strong analytical, troubleshooting, documentation, and problem‑solving skills.
• Excellent communication skills with the ability to explain technical concepts to technical and non-technical stakeholders.
• Ability to collaborate effectively with cross-functional teams and multiple stakeholders.
• Local candidates only will be considered for this position.

Responsibilities

• Support data technology strategy and resolve complex data integration, quality, stewardship, and real-time data challenges.
• Design and implement scalable data integration and data processing solutions across multiple secure systems.
• Develop and maintain batch and streaming pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.
• Build data solutions using Bronze, Silver, and Gold lakehouse architecture.
• Develop and optimize dimensional data models and SQL workloads in Azure Synapse Analytics.
• Orchestrate and monitor data workflows using Databricks Workflows/Jobs, Azure Data Factory, and Synapse pipelines.
• Perform data extraction, transformation, loading, validation, and quality improvement across diverse data sources.
• Apply data governance and security controls, including Unity Catalog, RBAC, row-level security, column-level security, and data masking.
• Support secure management of PHI/PII data in accordance with applicable policies and security requirements.
• Participate in requirements gathering, solution reviews, technical design, and implementation activities.
• Collaborate with data architects, solution leads, data scientists, analysts, project managers, and business stakeholders.
• Troubleshoot pipeline failures, integration issues, performance problems, and production incidents.
• Contribute to data engineering standards, governance policies, procedures, and continuous improvement initiatives.
• Create technical documentation including data flows, diagrams, implementation details, and operational procedures.
• Provide technical guidance, training, and knowledge sharing to project teams as needed.

Skills

Azure Databricks

PySpark

Spark SQL

Delta Lake

Azure Synapse Analytics

Azure Data Factory

Data governance

RBAC

Unity Catalog

SQL

Data modeling

Tools

Databricks Workflows/Jobs

Azure Data Factory

Azure Databricks UI

Job description

JPS Tech Solutions Pvt Ltd in the United States is seeking an experienced Data Scientist to drive enterprise data integration, pipeline development, data modeling, governance, and platform initiatives.

The role emphasizes hands-on work with Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Synapse Analytics, and Azure Data Factory, with a focus on secure data handling and scalable lakehouse architectures.