Software Engineer II (AI Integration)

United States Digital Space LLC; Toronto; On-site; CAD 96,000 - 115,200; Full time

Job summary

TD Bank is seeking an AI Engineer II to design, build, and deploy AI/ML solutions that automate and optimize business processes in production environments. The role blends software engineering, data science, and ML expertise to deliver scalable AI systems.

You will work with product teams and cloud/DevOps for scalable deployment, while staying current with LLM advancements and model optimization techniques. Toronto-based, with 37.5-hour weeks.

Qualifications

• Strong programming in Python with data libraries.
• Experience with LLMs, NLP, or deep learning.
• Knowledge of MLflow, Kubeflow, Airflow, Docker, Kubernetes.
• Cloud platforms experience (AWS/GCP/Azure).
• Understanding of data structures and software engineering practices.
• Problem-solving and analytical thinking.
• Ability to design scalable systems.
• Strong communication and documentation skills.
• Experience collaborating in agile teams.

Responsibilities

• Develop end-to-end AI pipelines from data preprocessing to deployment.
• Fine-tune LLM-based applications using LangChain, LangSmith, or OpenAI APIs.
• Deploy models to production via CI/CD pipelines.
• Build scalable microservices or APIs for real-time model serving.
• Monitor model drift, performance, and reliability.
• Collaborate with data engineering to define data requirements.
• Work with Python, SQL, Spark, Pandas on structured/unstructured data.
• Ensure data quality, governance, and security.
• Evaluate new AI frameworks and tools.
• Prototype solutions and run feasibility experiments.
• Stay updated on LLMs, embeddings, multimodal AI, optimization.
• Translate business problems to AI solutions with product teams.
• Coordinate with cloud engineers and DevOps for deployment.
• Explain complex concepts to non-technical stakeholders.

Skills

Python

LLMs/NLP

MLOps tools

Cloud platforms

Data structures & algorithms

Communication skills

Team collaboration

Education

Bachelor's or Master’s in CS/Engineering/Data Science

Tools

MLflow

Kubeflow

Airflow

Docker

Kubernetes

CI/CD pipelines

Job description

Work Location:

Toronto, Ontario, Canada

Hours:

37.5

Line of Business:

Technology Solutions

Pay Details:

$96,000 - $115,200 CAD

TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs.

As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.

Job Description:

Engineer II - AI

The AI Engineer is responsible for designing, building, and deploying AI/ML solutions that enhance business processes, improve decision-making, and enable automation. This role combines software engineering, data science, and machine learning expertise to develop scalable AI systems in production environments.

Key Responsibilities

• 3-5 years total experince
• Develop end-to-end pipelines including data preprocessing, feature engineering, validation, and deployment.
• Fine-tune LLM-based applications using frameworks like LangChain, LangSmith, or OpenAI APIs.
• Deploy models into production using CI/CD pipline.
• Build scalable microservices or APIs to serve ML models in real time.
• Implement monitoring for model drift, performance, and reliability.
• Collaborate with data engineering teams to define data requirements.
• Work with structured and unstructured datasets using Python, SQL, Spark, Pandas, etc.
• Ensure data quality, governance, and security
• Evaluate new AI frameworks, tools, and techniques.
• Prototype solutions and run experiments to explore feasibility.
• Stay up to date with advancements in LLMs, vector embeddings, multimodal AI, and model compression/optimization.
• Work with product managers and business teams to translate business problems into AI solutions.
• Partner with cloud engineers and DevOps teams for scalable deployment.
• Communicate complex technical concepts to non-technical stakeholders.

Required Skills & Qualifications

• Strong programming skills in Python (NumPy, Pandas, Scikit-learn, PyTorch or TensorFlow).
• Experience with LLMs, NLP, or deep learning.
• Knowledge of MLOps tools: MLflow, Kubeflow, Airflow, Docker, Kubernetes.
• Experience with cloud platforms (AWS/GCP/Azure) and model deployment.
• Understanding of data structures, algorithms, and software engineering best practices.
• Problem-solving and analytical thinking.
• Ability to design scalable, maintainable systems.
• Strong communication and documentation skills.
• Collaboration in agile or cross-functional team environments.

Preferred Qualifications (Nice to Have)

• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field.
• Experience building large-scale AI systems or enterprise-grade ML applications.
• Experience working in regulated industries.
• Knowledge of vector databases , RAG systems, or generative AI applications.

Who We Are:

TD is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches/stores. Every day, we strive to make every interaction, product, and experience remarkably human and refreshingly simple for over 27 million households and businesses in Canada, the United States and around the world. More than 95,000 TD colleagues bring their skills, talent, and creativity to foster deeper relationships, ensure disciplined execution, and build a simpler, faster banking experience. TD is deeply committed to being a leader in client experience, that is why we believe that all colleagues, no matter where they work, are client facing. Together, we are reimagining what banking can be for our clients, colleagues and communities.

Our Total Rewards Package

Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical, and mental well-being goals. Total Rewards at TD includes a base salary, variable compensation, and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off, banking benefits and discounts, career development, and reward and recognition programs. Learn more

Additional Information

We’re delighted that you’re considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we’re committed to providing the support our colleagues need to thrive both at work and at home.

Please be advised that this job opportunity is subject to provincial regulation for employment purposes. It is imperative to acknowledge that each province or territory within the jurisdiction of Canada may have its own set of regulations, requirements.

Colleague Development

If you’re interested in a specific career path or are looking to build certain skills, we want to help you succeed. You’ll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities.

If you’re passionate about helping clients and building deep, lasting relationships, TD offers diverse career paths where you can grow your expertise and make a meaningful impact.

We're committed to your success and foster a respectful workplace where diverse perspectives are valued, everyone has fair opportunities to grow, and you can unlock your full potential to achieve your career goals. Here at TD, we hire and develop the best.

Training & Onboarding

We will provide training and onboarding sessions to ensure that you’ve got everything you need to succeed in your new role.

Interview Process

We’ll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.

Accommodation

Your accessibility is important to us. Please let us know if you’d like accommodations (including accessible meeting rooms, captioning for virtual interviews, etc.) to help us remove barriers so that you can participate throughout the interview process.

We look forward to hearing from you!

Language Requirement (Quebec only):

Sans Objet