Data Scientist / Data Engineer | DMS Systems | Indianapolis, IN (Hybrid)

DMS Systems; Indianapolis (IN); Hybrid; USD 140.000 - 190.000; Vollzeit

Zusammenfassung

DMS Systems in Indianapolis, IN, is seeking an experienced Data Scientist / Data Engineer to own cloud data platform engineering, PySpark transformations, and data governance for a hybrid role. You will design, build, and optimize data pipelines, Delta Lake architectures, and Azure Synapse environments to support enterprise analytics and regulatory compliance.

Ideal candidates have 8+ years in data engineering/science, deep Azure data platform expertise, and strong communication skills.

Qualifikationen

• 8+ years of progressive professional experience in IT, data engineering, and data science (minimum 2+ years with Bachelor’s or 4+ years hands-on data engineering).
• Hands-on expertise in Azure Databricks, PySpark, Spark SQL, Delta Lake, and Unity Catalog.
• Working knowledge of Azure Synapse Analytics (serverless and dedicated SQL pools) and star-schema modeling.
• Experience with workflow orchestration using ADF, Databricks Workflows, and CI/CD pipelines.
• Data governance, HIPAA compliance, PHI/PII protection, and enterprise security.
• Excellent English communication and cross-functional collaboration skills.
• C2C/W2 visa eligibility and ability to work hybrid in Indianapolis, IN.

Aufgaben

• Design, develop, test, optimize, and maintain scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.
• Implement Medallion Architecture, Unity Catalog, Delta Live Tables, and Auto Loader.
• Architect and optimize Azure Synapse Analytics environments with star-schema models and both dedicated and serverless SQL pools.
• Build and troubleshoot automated workflow pipelines using ADF and Databricks Workflows.
• Enforce HIPAA compliance and data governance, including RBAC in Unity Catalog.
• Implement CI/CD pipelines with Azure DevOps and Git version control.

Kenntnisse

Azure Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Delta Live Tables

Azure Synapse Analytics

Azure Data Factory

Databricks Workflows

Azure DevOps

Git

Star-schema modeling

Ausbildung

Bachelor’s or Master’s in Computer Science / Data Science / Software Engineering or related field

Tools

Azure Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Delta Live Tables

Azure Synapse Analytics

Azure Data Factory

Databricks Workflows

Azure DevOps

Git

Jobbeschreibung

Position Summary:

DMS Systems is actively seeking an experienced, high‑caliber, and technical Data Scientist / Data Engineer with 8+ years of progressive professional experience in big data engineering, cloud analytics, and advanced data science architectures to join our client project on a hybrid basis in Indianapolis, IN (open to C2C and W2 arrangements for local candidates). In this critical data infrastructure and analytics role, you will be responsible for designing, building, securing, and scaling robust data pipelines, data warehouses, and Medallion architecture frameworks on Microsoft Azure. You will leverage your deep specialist expertise in Azure Databricks, PySpark, Azure Synapse, and data governance frameworks to deliver uncompromised data reliability, high performance, and operational excellence. This opportunity offers competitive compensation, executive technical visibility, and exceptional career growth prospects within a premier global IT recruitment and staffing enterprise.

Detailed Job Description:

As a Data Scientist / Data Engineer supporting DMS Systems in Indianapolis, IN (Hybrid), you will take full operational, tactical, and technical ownership of cloud data platform engineering, PySpark data transformations, data lakehouse governance, and ETL/ELT workflow execution across mission‑critical enterprise systems. Your day‑to‑day responsibilities include designing, developing, testing, and maintaining scalable data pipelines utilizing Azure Databricks, Spark SQL, Delta Lake, Medallion Architecture, Unity Catalog, Delta Live Tables (DLT), and Auto Loader, architecting and optimizing Azure Synapse analytics environments utilizing dedicated and serverless SQL pools, star‑schema modeling, MPP architectures, PolyBase, and CETAS, establishing robust workflow orchestration and CI/CD deployment pipelines utilizing Azure Data Factory (ADF), Databricks Workflows, Azure DevOps, Git, and ADLS Gen2, enforcing strict data governance protocols including HIPAA compliance, PHI/PII protection, and Unity Catalog Role‑Based Access Control (RBAC), collaborating closely with cross‑functional software engineering, data science, and business analytics squads in Agile sprint cycles, conducting rigorous performance tuning, query optimization, and root cause analysis (RCA) across large‑scale datasets, preparing comprehensive technical documentation of data models, pipeline topologies, and operational runbooks, and managing application requirements by ensuring strict compliance with local candidate residency in Indianapolis and C2C/W2 visa transparency. You will utilize your proactive troubleshooting and analytical problem‑solving skills to resolve complex data pipeline failures and latency bottlenecks under strict service level agreements. Furthermore, you will manage application requirements ensuring strict compliance with local candidate residency in Indianapolis and C2C/W2 visa transparency.

Key Responsibilities:

• Design, develop, test, optimize, and maintain scalable data pipelines utilizing Azure Databricks, PySpark, Spark SQL, and Delta Lake.
• Implement modern data lakehouse patterns including Medallion Architecture, Unity Catalog, Delta Live Tables (DLT), and Auto Loader.
• Architect, configure, and optimize Azure Synapse Analytics environments with dedicated and serverless SQL pools and star‑schema models.
• Build, maintain, and troubleshoot automated workflow orchestration pipelines utilizing Azure Data Factory (ADF) and Databricks Workflows.
• Enforce rigorous enterprise data governance standards including HIPAA compliance, PHI/PII data protection, and Unity Catalog RBAC.
• Implement CI/CD deployment pipelines and version control workflows utilizing Azure DevOps, Git, and ADLS Gen2 storage.
• Provide expert level-3 technical troubleshooting, performance tuning, and query optimization for large-scale distributed datasets.
• Maintain accurate, comprehensive technical documentation of data schemas, pipeline architectures, and operational runbooks.

Required Qualifications & Skills:

• Bachelor’s or Master’s degree in Computer Science, Data Science, Software Engineering, Information Technology, or a related discipline (or equivalent experience).
• Minimum of 8+ years of progressive professional experience in IT, data engineering, and data science (minimum 2+ years with Bachelor’s or 4+ years hands‑on data engineering experience; relevant certifications can substitute).
• Strong, demonstrable hands‑on professional expertise in Azure Databricks, PySpark, Spark SQL, Delta Lake, and Unity Catalog.
• Comprehensive working knowledge and practical proficiency in Azure Synapse Analytics, serverless SQL pools, and star‑schema modeling.
• Deep practical experience in workflow orchestration utilizing Azure Data Factory (ADF), Databricks Workflows, and CI/CD pipelines.
• Solid practical experience in data governance, HIPAA compliance, PHI/PII protection, and enterprise security frameworks.
• Exceptional analytical, troubleshooting, debugging, and problem-solving capabilities under high-pressure conditions.
• Excellent written and verbal English communication skills with strong cross‑functional collaboration and stakeholder management abilities.
• Mandatory C2C/W2 visa eligibility and physical availability for hybrid professional operations (local candidates only) in Indianapolis, IN.

Nice-to-Have Skills:

• Professional certifications such as Microsoft Certified: Azure Data Engineer Associate (DP-203) or Databricks Certified Data Engineer.
• Prior professional working experience in top-tier healthcare, financial services, or enterprise data consulting firms.
• Hands‑on familiarity with Microsoft Power BI, semantic data modeling, and executive dashboard creation.
• Experience utilizing containerization platforms (Docker, Kubernetes) and infrastructure-as-code tooling (Terraform).
• Exposure to agile software development methodologies and enterprise ITSM ticketing platforms (Jira, ServiceNow).

Compensation and Contract Details:

Salary/Rate: Market Competitive / Enterprise Contract Package (C2C & W2). Contract Duration: Contract Engagement (C2C & W2) / Hybrid Work in Indianapolis, IN. Notice Period: Immediate to 30 Days Preferred. Deadline: Open until filled (Urgent Indianapolis Hybrid Data Engineering Opening).