Azure Data Engineer: Cloud Data Pipelines Expert

Quest Global; Indianapolis (IN); On-site; USD 110,000 - 150,000; Full time

Job summary

Quest Global is seeking a data engineer in Indianapolis to implement complex data projects across multiple platforms. You will collaborate with analysts, architects and data scientists to secure the data supply chain and visualize outcomes that support informed decisions.

The role focuses on building scalable data pipelines, transforming diverse data sources into unified datasets, and ensuring data quality and security across the data lifecycle.

Qualifications

• Degree level education in Mathematics, Scientific, Computing or Engineering discipline or equivalent experience.
• 6+ years of experience in Data Engineering roles including 2+ years leading end-to-end design and implementation of data solutions for large scale use cases.
• Experience in designing solutions using databases and data storage technology using Azure data management components.
• Experience building, optimizing and automating data pipelines and datasets using MS Azure components.
• Proficiency in Python using different modules for data munging.
• Knowledge of data processing tech/platforms such as Spark (Databricks).
• Experience with Azure DevOps.

Responsibilities

• Working with colleagues to understand and implement data product requirements.
• Delivering the data supply chain, understanding data ingestion, transformation, and dataset creation.
• Understanding how to analyse, cleanse, join and transform data.
• Implementing designed solutions on the selected platform with Data Ops considerations.
• Ensuring cloud infrastructure can meet solution requirements.
• Planning, designing and testing implementations and correcting errors.
• Managing data security, archiving, structure and storage.
• Supporting the solution architect with data architecture deliverables.

Skills

Python

Azure DevOps

Spark / Databricks

ETL / Data integration

Education

Bachelor's degree in Mathematics, Science, Computing or Engineering

Tools

Azure SQL

ADLS

Cosmos DB

Databricks

Job description

Quest Global is seeking a data engineer in Indianapolis to implement complex data projects across multiple platforms. You will collaborate with analysts, architects and data scientists to secure the data supply chain and visualize outcomes that support informed decisions.

The role focuses on building scalable data pipelines, transforming diverse data sources into unified datasets, and ensuring data quality and security across the data lifecycle.