Azure Data Engineer

Apptad Inc; Jackson (MI); On-site; USD 90,000 - 130,000; Full time

Job summary

Apptad Inc. in the United States seeks an Azure Data Engineer to design and implement scalable data solutions using Azure Synapse, Data Factory, and Databricks. You will build pipelines, manage data storage, and secure data with Key Vault.

The role requires hands-on scripting in Python, SQL, and CI/CD for deployment across Dev/QA/Prod environments, plus collaboration with stakeholders to deliver reliable data for analytics and BI.

Qualifications

• Hands-on experience with Azure Synapse Analytics and data integration services.
• Experience building and deploying data pipelines in ADF, Databricks, and SQL pools.
• Proficient in Python (PySpark), Pandas, and data processing libraries.
• Experience with API data retrieval and troubleshooting data issues.
• Experience with CI/CD deployment of data code across dev/QA/prod environments.

Responsibilities

• Design and implement end-to-end data solutions on Azure.
• Develop and maintain pipelines, notebooks, and data flows.
• Collaborate with teams to deploy code across environments.
• Enable data access via APIs and optimize performance.
• Troubleshoot data processing issues and support BI consumption.

Skills

Azure Synapse Analytics

Azure Data Factory

Azure Databricks

Azure Storage

Azure Key Vault

SQL Pools

CI/CD pipelines

Python

Power BI

API data ingestion

Tools

Python (PySpark)

Job description

Position-Azure Data Engineer

Location-Jackson, MI (3 days onsite)

Job Description

• Hands on Experience in Azure Synapse Analytics, Azure Data Factory and Data Bricks, Azure Storage, Azure Key Vault, SQL Pools CI/CD Pipeline Designing and other Azure services like functions, logic apps - Linked services, Various Runtimes, Datasets, Pipelines, Activities
• Strong Hands-on Experience in Various Activities like Control flow logic and conditions (For Each, if, switch, until), Lookup, Stored procedure, scripts, validations, Copy Data, Data flow, Azure functions, Notebooks, SQL Pool Stored procedures etc.
• Strong hands on exp in deployment of code throughout landscape (Dev -> QA -> Prod), Git Hub, CI/CD pipelines etc.
• Strong hands on creating the SQL stored procedures - Functions, Stored Procedures, how to call one SP into another, how to process record-by-record - Dynamic SQL - Data Bricks - Must have
• Strong background about the Python libraries like PySpark, Pandas, NumPy, MySQL, Oracle, PySpark libraries
• Must have strong hands on to get data through APIs
• Must be able to install libraries and help users to troubleshoot issues
• Must have knowledge to get the data through stored procedures via Python
• Should be able to debug the Python code Hands on experience in Spark Pools, Spark
• Should be able to merge data/delta loads through Notebooks
• Must have strong background about the Python libraries and PySpark - Hands on Exp on Power BI