Data Engineer: Azure Synapse & Spark Pipelines

TEK Systems; Indianapolis (IN); Hybrid; USD 72,000 - 92,000; Full time

Job summary

TEKsystems is seeking a senior data engineering professional to design and optimize large-scale data pipelines and analytic platforms in cloud-native environments. The role emphasizes T-SQL, Spark via Synapse, and Python/Scala for ELT/ETL workflows.

You will architect data lakes and warehouse models on Azure Synapse, tune complex queries, and collaborate with analysts and data scientists to deliver robust data solutions. The position is contract-based with hybrid work in Indianapolis, IN.

Qualifications

• Bachelor's degree or equivalent years of experience in data or software engineering roles.
• Advanced skills in T-SQL and experience tuning queries for performance in large-scale distributed environments.
• Proficient use of Apache Spark, preferably within Synapse or Databricks, using Scala and/or Python.
• Experience with source control (Git) and CI/CD practices using Azure DevOps.
• Strong communication and leadership skills, with the ability to engage technical and non-technical stakeholders across the organization.
• Deep understanding of Azure Data Factory, Data Lake Gen2, and SQL pools (dedicated/serverless).
• Experience building end-to-end data pipelines that support analytics, reporting, and operational needs.

Responsibilities

• Build, optimize, and manage large-scale data pipelines and solutions for critical business insights and operations.
• Architect and implement data pipelines, data lakes, and warehouse models using Azure Synapse Analytics.
• Develop and optimize complex T-SQL queries, views, stored procedures, and data transformations in dedicated/serverless SQL pools.
• Leverage Spark (via Synapse) to process data with Scala and/or Python.
• Design and implement ELT/ETL workflows across structured, semi-structured, and unstructured sources.
• Collaborate with analysts, data scientists, and stakeholders to deliver reliable and performant data solutions.
• Monitor, troubleshoot, and optimize performance across Synapse pipelines, Spark pools, and Azure data services.
• Apply data governance, metadata management, and security practices including RBAC, encryption, and auditability.
• Work in Agile/Scrum teams using modern DevOps and CI/CD practices for data development and deployment.

Skills

Python

Azure

Azure Synapse

SQL

T-SQL

Scala

Spark

Databricks

Logic Apps

DevOps

Education

Bachelor's degree or equivalent

Tools

Azure Synapse

Azure Data Factory

Data Lake Gen2

Azure Databricks

Azure DevOps

Job description

TEKsystems is seeking a senior data engineering professional to design and optimize large-scale data pipelines and analytic platforms in cloud-native environments. The role emphasizes T-SQL, Spark via Synapse, and Python/Scala for ELT/ETL workflows.

You will architect data lakes and warehouse models on Azure Synapse, tune complex queries, and collaborate with analysts and data scientists to deliver robust data solutions. The position is contract-based with hybrid work in Indianapolis, IN.