Hybrid Data Engineer: Azure Databricks & Synapse Specialist

VIVA USA Inc; Indianapolis (IN); Hybrid; USD 110,000 - 160,000; Full time

Job summary

VIVA USA Inc. is seeking a skilled Data Engineer to design, build, and maintain secure data pipelines across Azure Databricks and Azure Synapse Analytics.

You’ll support data integration, pipeline development, governance, and documentation while collaborating with cross-functional teams to deliver reliable data products and robust data solutions. Responsibilities include batch and streaming data pipelines, dimensional modeling in Synapse, and enforcing data governance standards with PHI/PII

Qualifications

• Master's degree in data science, analytics, informatics, CS, math, engineering, or related field; OR 4+ years of hands-on data engineering.
• Bachelor's degree plus 2+ years of relevant experience; or 4+ years in a similar data engineering role.
• Databricks notebooks in PySpark, Spark SQL, and R including transformations, joins, aggregations, window functions.
• ACID, MERGE upserts, schema enforcement/evolution, time travel, and table maintenance.
• Medallion architecture and ingestion via Auto Loader, Structured Streaming, or Lakeflow/DLT.
• Unity Catalog usage for workspace catalogs, schemas, permissions, lineage; external locations, storage credentials.
• QL optimization: partitioning, shuffle, caching, Spark UI diagnostics.
• ADLS Gen2 Parquet/Delta, data governance, security controls, HIPAA-compliant handling.

Responsibilities

• Develop batch and streaming data pipelines in Azure Databricks (PySpark, Spark SQL, Delta Lake).
• Load and tune dimensional models and SQL workloads in Azure Synapse (dedicated/serverless) for reporting.
• Orchestrate workflows with Databricks Workflows and Synapse/ADF pipelines; schedule and monitor jobs.
• Define and enforce data governance policies and security controls for PHI/PII.
• Collaborate with data architects, scientists, analysts, and project managers to translate business needs into designs.
• Document solutions with flowcharts, diagrams, and readable code comments.

Skills

Databricks PySpark

Spark SQL

Delta Lake

Azure Databricks

Unity Catalog

Medallion architecture

Auto Loader/Structured Streaming

Azure Data Factory

Azure Synapse Analytics

Power BI

Git/GitHub CI/CD

Databricks Workflows

Education

Master's degree in data science / analytics

Bachelor's degree + 2+ years data engineering experience

Databricks Certifications (optional)

Tools

Azure Synapse

Azure Data Factory

Power BI connectivity

Job description

VIVA USA Inc. is seeking a skilled Data Engineer to design, build, and maintain secure data pipelines across Azure Databricks and Azure Synapse Analytics.

You’ll support data integration, pipeline development, governance, and documentation while collaborating with cross-functional teams to deliver reliable data products and robust data solutions. Responsibilities include batch and streaming data pipelines, dimensional modeling in Synapse, and enforcing data governance standards with PHI/PII