Hybrid Data Engineer: HPC & Azure Pipelines

nTech Workforce; Oakbrook Terrace (IL); On-site; USD 80,000 - 100,000; Full time

Job summary

A leading workforce solutions company is looking for a mid-level Data Engineer to design and maintain data infrastructure and pipelines. This role involves implementing scalable data pipelines, collaborating with teams, and ensuring data quality across hybrid environments. Candidates should have a Bachelor's degree in Computer Science, 3-5 years of experience in data engineering, and proficiency in SQL and Azure services. This is an onsite position in Oakbrook Terrace, IL.

Qualifications

• 3-5 years of experience in data engineering or related field.
• Hands-on experience with Azure cloud data services.
• Strong command-line proficiency and UNIX/Linux administration skills.

Responsibilities

• Design and implement scalable data pipelines in hybrid environments.
• Collaborate with data scientists and business stakeholders to understand data needs.
• Mentor junior data engineers on best practices.

Skills

UNIX/Linux administration

SQL proficiency

Python programming

MLOps practices

Cloud services (Azure)

Data pipeline design

Data quality monitoring

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Factory

PostgreSQL

SQL Server

Docker

Spark

Databricks

Job description

A leading workforce solutions company is looking for a mid-level Data Engineer to design and maintain data infrastructure and pipelines. This role involves implementing scalable data pipelines, collaborating with teams, and ensuring data quality across hybrid environments. Candidates should have a Bachelor's degree in Computer Science, 3-5 years of experience in data engineering, and proficiency in SQL and Azure services. This is an onsite position in Oakbrook Terrace, IL.