Associate Data Engineer

IBM Computing; Calgary; On-site; CAD 70,000 - 90,000; Full time

Job summary

Join IBM as an Associate Data Engineer, where you'll design and maintain scalable data pipelines, collaborate with teams to integrate diverse data sources, and ensure data quality. This role offers a unique opportunity to work at the intersection of business and technology, fostering innovation in a dynamic environment.

Qualifications

• Eligibility to work in Canada without visa sponsorship.
• Willingness to live and work in Calgary, AB.
• Experience with data engineering tools and cloud platforms.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Collaborate with data scientists and engineers.
• Ensure data quality and integrity across systems.

Skills

Python

SQL

Data modeling

ETL pipeline development

Machine learning

Strong analytical skills

Effective communication

Education

Bachelor's degree in computer science

Tools

Apache Spark

Hadoop

Airflow

Kafka

AWS

Azure

GCP

Power BI

Tableau

Job description

Introduction

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your role and responsibilities

At IBM, we know technology. But technology is only as good as the results it delivers. Are you interested and adept in application development methodology and tools? The IBM Client Innovation Centre (CIC) occupies a unique position in the IT marketplace - at the intersection of business and technology. In this role, you'll work in our IBM CIC, delivering deep technical and industry expertise globally. Our centers provide locally based skills to foster innovation and technology adoption.

As a member of our team, you will help IBM clients solve challenging business problems, capitalize on market opportunities, and achieve tangible value in today’s economy.

We’re seeking passionate, innovative thinkers eager to drive progress, expand their network, and grow their careers. If you see yourself as a lifelong learner who believes no problem is too big and wants to unleash your potential, the Associate role is for you.

As an Associate Data Engineer, you will be able to:

• Design, build, and maintain scalable data pipelines and architectures in the cloud.
• Develop and manage data models and databases to meet various business needs.
• Collaborate with data scientists, analysts, and engineers to integrate data from diverse sources.
• Implement scalable, secure, and compliant data storage solutions.
• Ensure data quality and integrity across systems.
• Create processes and scripts to automate data cleaning, transformation, and loading (ETL/ELT).
• Participate in code reviews and adhere to best practices.
• Provide technical guidance and mentorship to junior team members as needed.

Required technical and professional expertise

Qualifications:

• Eligibility to work in Canada without future visa sponsorship (valid work permit, permanent residency, or Canadian citizenship).
• Willingness to live and work in Calgary, AB.

Preferred Education:

• Bachelor's degree in computer science, computer engineering, software engineering, or related fields.

Core Competencies:

• Programming: Python, SQL (Java or Scala is a plus)
• Data Engineering Tools: Apache Spark, Hadoop, Airflow, dbt, Kafka (preferred)
• Cloud Platforms: AWS, Azure, GCP (experience with services like S3, Redshift, BigQuery, Azure Data Lake)
• Databases: Relational (PostgreSQL, MySQL), NoSQL (MongoDB, Cassandra)
• AI & Analytics Tools: TensorFlow, PyTorch, scikit-learn, Jupyter, pandas, NumPy
• Data Visualization: Power BI, Tableau, matplotlib/seaborn

Additional Skills:

• Data modeling and ETL pipeline development
• Machine learning model development and evaluation
• Basic knowledge of CI/CD and version control (Git/GitHub)

Soft Skills:

• Strong analytical and problem-solving skills
• Effective communication and teamwork abilities
• Curiosity and eagerness to learn emerging tools and technologies

IBM is committed to diversity and equal opportunity. All qualified applicants will receive consideration regardless of race, color, religion, sex, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. We comply with all fair employment practices regarding citizenship and immigration status.