Software Engineer II (AI Integration)

TD Bank Group; Toronto; On-site; CAD 96,000 - 115,200; Full time

Job summary

TD Bank Group in Toronto, ON, is seeking an AI Engineer II to design, build, and deploy AI/ML solutions that optimize business processes and decision making. You will combine software engineering, data science, and ML to deliver production-grade AI systems.

The role requires 3-5 years of experience, strong Python skills, and hands-on work with LLMs, MLOps, and cloud deployment. You will collaborate with product teams, data engineers, and DevOps to scale models and ensure reliability.

Qualifications

• 3-5 years total experience in AI/ML engineering.
• Develop end-to-end pipelines including data preprocessing and deployment.
• Fine-tune LLM-based applications using advanced frameworks.
• Deploy models into production with CI/CD pipelines.
• Build scalable microservices or APIs for real-time inference.
• Collaborate with data engineering and DevOps teams.

Responsibilities

• Design, build, and deploy AI/ML solutions for business processes.
• Develop end-to-end data pipelines and feature engineering steps.
• Tune LLM-based applications using LangChain, LangSmith, or APIs.
• Deploy models into production using CI/CD pipelines.
• Create scalable services to serve ML models in real time.
• Monitor model drift, performance, and reliability.
• Collaborate with product managers and cloud/DevOps teams.
• Communicate complex concepts to non-technical stakeholders.

Skills

Python

LLMs/NLP

MLOps

Docker

Kubernetes

Cloud platforms

PyTorch

TensorFlow

Data structures

Software engineering

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field

Tools

MLflow

Kubeflow

Airflow

Docker

Kubernetes

Job description

Work Location: Toronto, Ontario, Canada Hours: 37.5 Line of Business: Technology Solutions Pay Details: $96,000 - $115,200 CAD TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs. As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.

Job Description: Engineer II - AI

The AI Engineer is responsible for designing, building, and deploying AI/ML solutions that enhance business processes, improve decision-making, and enable automation. This role combines software engineering, data science, and machine learning expertise to develop scalable AI systems in production environments.

Key Responsibilities

• 3-5 years total experience
• Develop end-to-end pipelines including data preprocessing, feature engineering, validation, and deployment.
• Fine-tune LLM-based applications using frameworks like LangChain, LangSmith, or OpenAI APIs.
• Deploy models into production using CI/CD pipeline.
• Build scalable microservices or APIs to serve ML models in real time.
• Implement monitoring for model drift, performance, and reliability.
• Collaborate with data engineering teams to define data requirements.
• Work with structured and unstructured datasets using Python, SQL, Spark, Pandas, etc.
• Ensure data quality, governance, and security.
• Evaluate new AI frameworks, tools, and techniques.
• Prototype solutions and run experiments to explore feasibility.
• Stay up to date with advancements in LLMs, vector embeddings, multimodal AI, and model compression/optimization.
• Work with product managers and business teams to translate business problems into AI solutions.
• Partner with cloud engineers and DevOps teams for scalable deployment.
• Communicate complex technical concepts to non-technical stakeholders.

Required Skills & Qualifications

• Strong programming skills in Python (NumPy, Pandas, Scikit-learn, PyTorch or TensorFlow).
• Experience with LLMs, NLP, or deep learning.
• Knowledge of MLOps tools: MLflow, Kubeflow, Airflow, Docker, Kubernetes.
• Experience with cloud platforms (AWS/GCP/Azure) and model deployment.
• Understanding of data structures, algorithms, and software engineering best practices.
• Problem-solving and analytical thinking.
• Ability to design scalable, maintainable systems.
• Strong communication and documentation skills.
• Collaboration in agile or cross-functional team environments.

Preferred Qualifications (Nice to Have)

• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field.
• Experience building large-scale AI systems or enterprise-grade ML applications.
• Experience working in regulated industries.
• Knowledge of vector databases , RAG systems, or generative AI applications.

Who We Are

TD is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches/stores. Every day, we strive to make every interaction, product, and experience remarkably human and refreshingly simple for over 27 million households and businesses in Canada, the United States and around the world. More than 95,000 TD colleagues bring their skills, talent, and creativity to foster deeper relationships, ensure disciplined execution, and build a simpler, faster banking experience. TD is deeply committed to being a leader in client experience, that is why we believe that all colleagues, no matter where they work, are client facing. Together, we are reimagining what banking can be for our clients, colleagues and communities.

Our Total Rewards Package

Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical, and mental well-being goals. Total Rewards at TD includes a base salary, variable compensation, and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off, banking benefits and discounts, career development, and reward and recognition programs. Learn more

Additional Information

We’re delighted that you’re considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we’re committed to providing the support our colleagues need to thrive both at work and at home.

Colleague Development

If you’re interested in a specific career path or are looking to build certain skills, we want to help you succeed. You’ll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities. If you’re passionate about helping clients and building deep, lasting relationships, TD offers diverse career paths where you can grow your expertise and make a meaningful impact. We're committed to your success and foster a respectful workplace where diverse perspectives are valued, everyone has fair opportunities to grow, and you can unlock your full potential to achieve your career goals. Here at TD, we hire and develop the best.

Training & Onboarding

We will provide training and onboarding sessions to ensure that you’ve got everything you need to succeed in your new role.

Interview Process

We’ll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.

Accommodation

Your accessibility is important to us. Please let us know if you’d like accommodations (including accessible meeting rooms, captioning for virtual interviews, etc.) to help us remove barriers so that you can participate throughout the interview process.

Language Requirement (Quebec only)

Sans Objet

We look forward to hearing from you!

Our Values

At TD we’re guided by our purpose to enrich the lives of our customers, communities and colleagues, and share a set of values that shape our culture and guide our behavior. In exchange for how our colleagues show up to help TD succeed, we are committed to delivering a colleague experience grounded in Impact, Growth and a Culture of Care. No matter where you work across TD, we empower you to make an impact at work and in your community, explore and grow your career and be part of our caring and inclusive culture.

Our Commitment to Diversity, Equity, and Inclusion

At TD, we’re committed to fostering an environment where all colleagues are encouraged to bring their authentic selves to work, experience equitable opportunities, and feel respected and supported. We’re dedicated to building an inclusive workforce that reflects the diversity of the customers and the communities in which we live and serve.

Helping to Make an Impact in Communities – TD Ready Commitment

TD has a long-standing commitment to help drive progress towards a more inclusive and sustainable future. That’s why we launched the TD Ready Commitment in 2018, now a multi-year North American initiative. Under the TD Ready Commitment, we are targeting a total of C$1 billion by 2030 in community giving across four key, interconnected drivers of change: Financial Security, Vibrant Planet, Connected Communities, and Better Health. It’s our goal to help support change, nurture progress, and contribute to making the world a better, more inclusive place for our customers, colleagues, and communities. Learn more: Canada | US | Europe & Asia Pacific