Associate Data Engineer – Analytics & AI

IBM; Chicago, Northern (IL, KY); Hybrid; USD 71,000 - 107,000; Full time

Job summary

IBM Consulting is hiring an entry-level Associate Data Engineer in Chicago to harness data, build batch and real-time processing, and design scalable data architectures for modern cloud environments. You will collaborate across diverse teams to select appropriate data management systems and identify data requirements for insightful analyses.

Responsibilities include optimizing pipelines, building ETL/ELT processes, collecting and analyzing data, and creating visual dashboards.

Qualifications

• Ability to incorporate a variety of statistical and machine learning techniques.
• Basic understanding of Cloud (AWS, Azure, etc).
• Ability to use programming languages like Java, Python, Scala, etc., to build pipelines to extract and transform data from a repository to a data consumer.
• Ability to use ETL tools and/or data integration, or federation tools to prepare and transform data as needed.
• Exposure to ETL/ELT projects, data warehouse design, analytics pipelines, and capstone data engineering
• Willingness to travel up to 100%, based on project requirements.

Responsibilities

• Design scalable data architecture and management systems for modern cloud environments.
• Optimize existing data pipelines and processes for performance.
• Work with ETL/ELT ingestion pipelines.
• Collect and analyze data to identify trends and provide actionable insights.
• Troubleshoot data-related issues and resolve data inconsistencies.
• Create dashboards and reports to communicate findings to technical and non-technical stakeholders.
• Ensure data integrity, accuracy, and reliability through cleaning and validation.
• Translate client requirements into solution requirements with the project team.

Skills

Java

Python

Scala

SQL

ETL pipelines

Spark

Hadoop

Linux

Data visualization

Education

Bachelor's Degree

High School Diploma/GED

Tools

dbt

Snowflake

BigQuery

Airflow

Kubernetes

CI/CD basics

Job description

IBM Consulting is hiring an entry-level Associate Data Engineer in Chicago to harness data, build batch and real-time processing, and design scalable data architectures for modern cloud environments. You will collaborate across diverse teams to select appropriate data management systems and identify data requirements for insightful analyses.

Responsibilities include optimizing pipelines, building ETL/ELT processes, collecting and analyzing data, and creating visual dashboards.