Azure Data Engineer — Onsite, Lakehouse & Synapse

Skywalk Global; Indianapolis (IN); On-site; USD 110,000 - 150,000; Full time

Job summary

Skywalk Global is seeking an Azure Data Engineer for an onsite role in Indianapolis to support reliable data products across integration, pipelines, modeling, governance, and documentation.

The role involves designing batch and streaming pipelines with Azure Databricks (PySpark, Spark SQL, Delta Lake), maintaining dimensional models in Azure Synapse, and ensuring HIPAA-compliant data governance. Collaboration with data architects, scientists, and analysts is essential.

Qualifications

• 4+ years of experience in data engineering.
• Master’s degree or Bachelor’s degree with 2+ years of relevant experience.
• Databricks notebooks using PySpark, Spark SQL, and R.
• Experience with CID transactions, MERGE upserts, schema enforcement/evolution, time travel, and OPTIMIZE.
• Medallion architecture and incremental ingestion via Auto Loader, Structured Streaming, or Lakehouse patterns.
• Working with Unity Catalog for permissions, lineage, and security.

Responsibilities

• Support data technology strategy and data quality stewardship.
• Oversee design and implementation of data solutions for integration and synthesis.
• Define and maintain data management policies and engineering standards.
• Provide training and technical support for projects.
• Gather requirements and explain technical concepts to stakeholders.
• Collaborate with data architects, scientists, and analysts on solution design.
• Extract, transform, and load data from diverse sources.
• Design and maintain batch and streaming Azure Databricks pipelines using PySpark, Spark SQL, and Delta Lake.
• Develop and tune dimensional data models and SQL workloads in Azure Synapse Analytics.
• Orchestrate workflows with Databricks Workflows/Jobs and Synapse or ADF pipelines; implement scheduling, alerting, and recovery.
• Apply HIPAA-compliant data governance and Unity Catalog security controls.
• Document solutions with diagrams, flowcharts, and well-commented code.
• Support operations by analyzing systems and recommending policy changes.

Skills

Data engineering

Communication

Problem solving

Education

Master’s degree in data science, analytics, informatics, CS, mathematics, engineering, or related

Bachelor’s degree + 2+ years experience

4+ years hands-on experience in data engineering

Tools

Azure Databricks

PySpark

Spark SQL

Delta Lake

Azure Synapse Analytics

Databricks Workflows/Jobs

Azure Data Factory

OPENROWSET

Parquet/Delta/CSV

ADLS Gen2

Hive/Hive-like data lake patterns

Unity Catalog

Job description

Skywalk Global is seeking an Azure Data Engineer for an onsite role in Indianapolis to support reliable data products across integration, pipelines, modeling, governance, and documentation.

The role involves designing batch and streaming pipelines with Azure Databricks (PySpark, Spark SQL, Delta Lake), maintaining dimensional models in Azure Synapse, and ensuring HIPAA-compliant data governance. Collaboration with data architects, scientists, and analysts is essential.