Technology Lead - DBT PySpark Developer

Infosys; Calgary; Vor Ort; CAD 120.000 - 160.000; Vollzeit

Zusammenfassung

Infosys seeks an experienced DBT PySpark Developer in Calgary to design, develop, and optimize scalable big data solutions. You will build high-performance batch and real-time data pipelines using Hadoop and Spark, collaborating with data engineers, architects and stakeholders to deliver robust processing systems.

Required qualifications include a Bachelor’s degree or equivalent, 7+ years IT experience, and strong expertise in DBT, Python, AWS, and PySpark.

Qualifikationen

• Bachelor’s degree or foreign equivalent required; equivalent progressive experience may substitute for education.
• At least 7 years of Information Technology experience.
• At least 7 years of experience in AWS Python technologies.

Aufgaben

• Design, develop, and optimize scalable big data solutions.
• Build high-performance batch and real-time data pipelines leveraging Hadoop and Spark.
• Collaborate with data engineers, architects and stakeholders to deliver robust data processing systems.

Kenntnisse

DBT

Python

AWS

PySpark

Data ingestion

Shell scripting

Snowflake

Oracle

SQL Server

SQL

Ausbildung

Bachelor’s degree or foreign equivalent

Tools

Snowflake

Oracle

SQL Server

Jobbeschreibung

Infosys is seeking an experienced DBT PySpark Developer to design, develop, and optimize scalable bigdata solutions. The candidate will work on building high-performance batch and real-time data pipelines leveraging the Hadoop ecosystem and distributed computing frameworks(Spark). The role involves working closely with data engineers, architects, and business stakeholders to deliver robust, scalable, and efficient data processing systems.

Required Qualifications:

• Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
• Candidate must be located within commuting distance of Calgary, AB or be willing to relocate to the areas.
• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• At least 7 years of Information Technology experience
• At least 7 years of experience in AWS Python technologies.
• Strong expertise in:
• DBT , Python
• AWS
• PySpark
• Hands-on experience with:
• Data Ingestion pipelines
• Shell scripting
• Snowflake , oracle , SQL Server)
• Strong understanding of distributed computing concepts and data processing frameworks.
• Experience in building ETL/data pipelines for large-scale datasets.
• Proficiency in SQL and data modeling.

Preferred Qualifications:

• Hands-on experience with data lakes, data warehouses, and scalable ETL pipeline design, including batch and real-time processing architecture.
• Strong understanding and practical exposure to Agile software development methodologies (Scrum) and SDLC practices.
• Proven experience in Banking domain, supporting use cases such as fraud detection, risk analytics, regulatory reporting, and customer insights.
• Excellent analytical, problem-solving, and communication skills, with the ability to translate business requirements into scalable technical solutions.
• Demonstrated ability to work effectively in cross-functional, multi-stakeholder environments, collaborating with Business, Data Engineering, and Architecture teams.
• Experience with real-time data streaming frameworks such as Kafka and Spark Streaming for low-latency processing.
• Understanding data modeling concepts (dimensional modeling, snowflake schemas) to support analytics workloads.
• Experience and desire to work in a global delivery environment.

The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email, or face to face. Extensive travel may be required as per client and project needs.

What Visa status are we accepting for this req? :

Unable to Sponsor now or in the future

Additional Required Qualifications :

A knack of designing and developing scalable, high-quality and optimized solutions that meet complex business needs. The ability to evaluate and adopt emerging technologies, translating them into practical prototypes and deployment-ready strategies. The ability to build reusable frameworks, automation scripts, and knowledge assets that enhance team productivity. Strong problem solving mindset to debug complex technical issues and deliver error-free and reliable outcomes. Commitment to quality, performance and risk management, ensuring resilient and efficient project delivery. Proactive collaboration with internal team and client to drive knowledge sharing, continuous improvement and innovation.

Required Skill and Experience

Data Transformation: DBT (Data Build Tool

Experience in developing and applying generative AI models.

Proficiency in programming languages like Python

Stay up to date on the latest advancements in generative AI research and actively contribute to the continuous improvement of our AI capabilities.

About Us

Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

EEO

Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.