Azure Cloud Data Engineer

JCW Group; Charlotte (NC); On-site; USD 150,000 - 180,000; Full time

Job summary

A leading data service firm in Charlotte, NC is looking for a Mid-Senior Data Engineer to support Azure Data Factory and Databricks during a significant cloud migration initiative. You will manage ETL/ELT workflows, ensuring their stability and performance while collaborating with engineering teams. The ideal candidate has strong experience with data engineering tools and services, emphasizes troubleshooting and optimization of data pipelines, and thrives in production environments with high responsibilities.

Qualifications

• Strong experience with Azure Data Factory, Databricks, and Azure‑based data engineering.
• Proven background in ETL/ELT processes, data integration, and orchestration.
• Solid understanding of cloud data services (ADLS Gen2, Azure SQL, Databricks, Functions, etc.)
• Hands‑on experience in monitoring, debugging, and optimizing production data pipelines.

Responsibilities

• Support and troubleshoot Azure Data Factory pipelines and Databricks jobs across production environments.
• Ensure stability, performance, and uptime of ETL/ELT workflows during cloud migration initiatives.
• Perform root‑cause analysis on pipeline failures, Spark issues, cluster timeouts, and data mismatches.
• Collaborate with engineering and DevOps teams to optimize workflows, deployments, and cloud integrations.

Skills

Databricks

ETL/ELT processes

Data integration

Tools

Azure Data Factory

Azure SQL

ADLS Gen2

Azure Functions

Job description

Base pay range

$150,000.00/yr - $180,000.00/yr

About the Role

You’ll be the key specialist supporting Azure Data Factory and Databricks during a major cloud migration initiative. If you thrive in fast‑paced production environments—solving pipeline failures, optimizing Spark jobs, and keeping complex data workflows running—this role gives you real responsibility, visibility, and technical ownership.

Responsibilities

• Support and troubleshoot Azure Data Factory pipelines and Databricks jobs across production environments.
• Ensure stability, performance, and uptime of ETL/ELT workflows during cloud migration initiatives.
• Perform root‑cause analysis on pipeline failures, Spark issues, cluster timeouts, and data mismatches.
• Collaborate with engineering and DevOps teams to optimize workflows, deployments, and cloud integrations.

Qualifications

• Strong experience with Azure Data Factory, Databricks, and Azure‑based data engineering.
• Proven background in ETL/ELT processes, data integration, and orchestration.
• Solid understanding of cloud data services (ADLS Gen2, Azure SQL, Databricks, Functions, etc.).
• Hands‑on experience in monitoring, debugging, and optimizing production data pipelines.

Required Skills

• Databricks
• ETL/ELT processes
• Data integration

Preferred Skills

• Experience with Azure SQL
• Knowledge of ADLS Gen2
• Familiarity with Azure Functions

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

Information Technology

Industries

Banking

Location

Charlotte, NC