Lead Python Developer

IIBA (International Institute of Business Analysis); Mississauga; On-site; CAD 90,000 - 130,000; Full time

Job summary

A leading company is seeking a senior Applications Development Technology Lead Analyst to establish and implement application systems in collaboration with the Technology team. This role focuses on leading systems analysis and programming, managing data pipelines, and ensuring system integration for improved processes. Candidates should possess strong data processing and cloud computing skills, along with the ability to mentor developers.

Qualifications

• Manage large-scale data processing systems with frameworks like Apache Spark, Hadoop, Kafka.
• Experience building large-scale document processing applications using supervised learning models.
• Proficiency in Python or Scala and strong SQL skills.

Responsibilities

• Lead applications systems analysis and programming activities.
• Develop standards for coding, testing, debugging, and implementation.
• Serve as an advisor or coach to mid-level developers and analysts.

Skills

Python

Scala

SQL

Data orchestration

Data processing

Cloud platforms

Education

Bachelor's degree

Master's degree

Tools

Apache Spark

Hadoop

Kafka

Airflow

Docker

Kubernetes

Job description

The Applications Development Technology Lead Analyst is a senior position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The role's primary objective is to lead applications systems analysis and programming activities.

Responsibilities:

• Partner with management teams to ensure integration of functions to meet goals and identify system enhancements for new products and process improvements.
• Resolve high-impact problems through evaluation of business processes, system processes, and industry standards.
• Provide expertise in applications programming and ensure application design aligns with the architecture blueprint.
• Develop standards for coding, testing, debugging, and implementation based on system flow knowledge.
• Understand how business areas like architecture and infrastructure work together to achieve goals.
• Analyze issues and develop innovative solutions using interpretive thinking.
• Serve as an advisor or coach to mid-level developers and analysts, assigning work as needed.
• Assess risks in business decisions, ensuring compliance with laws, regulations, and policies, and report control issues transparently.

Qualifications:

• Design, build, and maintain scalable ETL/ELT data pipelines.
• Manage large-scale data processing systems with frameworks like Apache Spark, Hadoop, Kafka.
• Proficiency in Python or Scala.
• Expertise in data processing frameworks such as Spark, Hadoop, or Flink.
• Experience with cloud data platforms like AWS, Azure, or GCP.
• Strong SQL and database skills.
• Experience with data orchestration tools like Airflow or Prefect.
• Experience building large-scale document processing applications using supervised learning models and LLMs.
• Experience with Agentic RAG frameworks like LangChain, CrewAI, and Vector Databases.
• Knowledge in supervised models evaluation, tuning, and monitoring with Ray Tune and MLFlow.
• Familiarity with fine-tuning open-source LLMs is a plus.
• Knowledge of containerization (Docker, Kubernetes) is a plus.

Education:

• Bachelor's degree or equivalent; Master's preferred.

This job description provides a high-level overview of the work performed. Other duties may be assigned as required.