Tech Lead - Data & AI Platform (DBT, PySpark)

Infosys; Calgary; On-site; CAD 120,000 - 160,000; Full time

Job summary

Infosys seeks an experienced DBT PySpark Developer in Calgary to design, develop, and optimize scalable big data solutions. You will build high-performance batch and real-time data pipelines using Hadoop and Spark, collaborating with data engineers, architects and stakeholders to deliver robust processing systems.

Required qualifications include a Bachelor’s degree or equivalent, 7+ years IT experience, and strong expertise in DBT, Python, AWS, and PySpark.

Qualifications

• Bachelor’s degree or foreign equivalent required; equivalent progressive experience may substitute for education.
• At least 7 years of Information Technology experience.
• At least 7 years of experience in AWS Python technologies.

Responsibilities

• Design, develop, and optimize scalable big data solutions.
• Build high-performance batch and real-time data pipelines leveraging Hadoop and Spark.
• Collaborate with data engineers, architects and stakeholders to deliver robust data processing systems.

Skills

DBT

Python

AWS

PySpark

Data ingestion

Shell scripting

Snowflake

Oracle

SQL Server

SQL

Education

Bachelor’s degree or foreign equivalent

Tools

Snowflake

Oracle

SQL Server

Job description

Infosys seeks an experienced DBT PySpark Developer in Calgary to design, develop, and optimize scalable big data solutions. You will build high-performance batch and real-time data pipelines using Hadoop and Spark, collaborating with data engineers, architects and stakeholders to deliver robust processing systems.

Required qualifications include a Bachelor’s degree or equivalent, 7+ years IT experience, and strong expertise in DBT, Python, AWS, and PySpark.