Azure Data Engineer - Hybrid Data Pipeline Architect (Jackson)

Inclined Inc; Missouri; Hybrid; USD 95,000 - 135,000; Full time

Job summary

Inclined Inc. is seeking an experienced Azure Data Engineer to design and maintain enterprise data pipelines in a hybrid environment. The candidate will leverage Azure Synapse, ADF, Databricks, and SQL Server to enable scalable data solutions.

The role involves building data workflows, managing pipelines, writing complex SQL, and developing Python/PySpark solutions. Collaboration with BI and analytics teams is essential for delivering Power BI reporting and data insights.

Qualifications

• Hands-on experience with Azure Synapse Analytics, Azure Data Factory, Databricks, SQL Server, Python/PySpark.
• Experience designing and supporting enterprise data pipelines and CI/CD processes.
• Strong SQL skills and ability to develop complex data solutions.

Responsibilities

• Design, develop, and maintain data solutions using Azure Synapse Analytics, Azure Data Factory, Databricks, Azure Storage, SQL Pools, and Azure Key Vault.
• Develop ADF/Synapse linked services, datasets, pipelines, activities, and integration runtimes.
• Build complex data workflows using ForEach, If, Switch, Until, Lookup, Stored Procedure, Script, Validation, Copy Data, and Data Flow activities.
• Develop and maintain SQL Server stored procedures, functions, dynamic SQL, and complex data-processing logic.
• Work with Spark Pools, Spark, PySpark, and Databricks notebooks for large-scale data processing.
• Develop incremental/delta-load and data-merging solutions through notebooks.
• Develop Python solutions using libraries such as PySpark, Pandas, NumPy, PyMySQL, and other data-processing libraries.
• Retrieve and process data through REST APIs and stored procedures using Python.
• Debug Python/PySpark code and troubleshoot library, dependency, and runtime issues.
• Build and support integrations using Azure Functions and Logic Apps.
• Implement and support CI/CD pipelines and promote code across Development QA Production environments using Git-based deployment processes.
• Develop and support reporting/data visualization solutions using Power BI.
• Troubleshoot production data issues and collaborate with business, application, and data teams.

Skills

Azure Synapse Analytics

Azure Data Factory

Azure Databricks

SQL Server

Python/PySpark

Spark

Azure Storage

Azure Key Vault

SQL Pools

Git

CI/CD

Tools

Power BI

Azure Functions

Logic Apps

Job description

Inclined Inc. is seeking an experienced Azure Data Engineer to design and maintain enterprise data pipelines in a hybrid environment. The candidate will leverage Azure Synapse, ADF, Databricks, and SQL Server to enable scalable data solutions.

The role involves building data workflows, managing pipelines, writing complex SQL, and developing Python/PySpark solutions. Collaboration with BI and analytics teams is essential for delivering Power BI reporting and data insights.