Senior AI/Machine Learning Engineer

Alert Media, Inc.; Ottawa; On-site; CAD 120,000 - 180,000; Full time

Benefits offered by this job

Paid healthcare and family planning

Annual bonus

Sabbatical after six years

Team lunches and PTO

Volunteer opportunities

Team building and celebrations

Job summary

AlertMedia, Inc. is seeking a Senior AI/ML Engineer to lead evaluation, training and integration of advanced AI models across our product suite.

You will help shape our AI strategy by selecting suitable models and optimizing performance through fine-tuning and prompt engineering. You will design evaluation pipelines for LLMs and traditional ML models, work with Elasticsearch-backed data systems, and collaborate with product and engineering teams to deploy AI features safely, scalably and

Qualifications

• 4–6+ years of experience in data science and/or software engineering, specifically in machine learning engineering, or applied AI.
• Experience with Elasticsearch or other large-scale search and indexing platforms.
• Proficiency in Python and ML libraries such as scikit-learn, PyTorch, TensorFlow, and Hugging Face.
• Experience with cloud-based ML tooling and data workflows.
• Demonstrated experience training and deploying supervised learning models, ideally in production.
• Strong understanding of LLMs and traditional ML methods.
• Ability to work independently and collaboratively on cross-functional teams.

Responsibilities

• Lead evaluation, training, and integration of AI/ML models across the product suite.
• Shape AI strategy by selecting models for use cases and optimizing performance via fine-tuning and prompt engineering.
• Design evaluation pipelines for LLMs and traditional ML models.
• Work with Elasticsearch-backed data systems powering AI pipelines.
• Collaborate with product and engineering teams to deploy AI features safely at scale.
• Monitor and improve model performance in production.

Skills

Python

ML libraries

Elasticsearch

SageMaker

Bedrock

Prompt engineering

Model fine-tuning

Evaluation

LLMs

Cross-validation

A/B testing

Cloud ML tooling

Data workflows

Education

Bachelor’s degree in CS/CE or related field

Tools

Elasticsearch

SageMaker

Bedrock

Job description

• AlertMedia is looking for an innovative and hands-on Sr. AI/ML Engineer with a strong background in applied machine learning and data science to lead the evaluation, training, and integration of advanced AI and machine learning models across our product suite
• In this role, you will help shape our AI strategy by identifying the most appropriate models for our use cases, optimizing their performance through fine-tuning and prompt engineering, and ensuring their responsible deployment within our platforms
• You will have the opportunity to show who you are throughout our interview process; we don’t ask any trick questions or expect you to perform a whiteboard exercise. We want to see you shine by showing us work you are most proud of!
• Train and fine-tune supervised learning models (e.g., classification, ranking, embeddings) for internal tools and customer-facing product features
• Lead prompt engineering and testing efforts to fine-tune LLM behavior for specific use cases across the product suite
• Design and implement evaluation pipelines for both LLMs and traditional ML models
• Work with and optimize Elasticsearch-backed data systems that power AI and intelligence pipelines
• Proactively identify opportunities to improve AI models, data pipelines, and engineering workflows beyond the existing roadmap
• Develop tools and frameworks to support prompt iteration, model benchmarking, and performance tracking
• Coordinate with security team to ensure adherence to AI compliance standards
• Evaluate and compare commercial and open-source LLMs (e.g., OpenAI, Anthropic, Mistral, Meta, etc.) for performance, cost, alignment, and reliability
• Collaborate with product and engineering teams to integrate AI features in a safe, scalable, and maintainable way
• Monitor, evaluate, and continuously improve the performance of AI and machine learning models in production
• Stay informed of emerging research in NLP, machine learning, and AI infrastructure, and evaluate potential applications for the business
• Contribute to AlertMedia’s culture, values and vision for the future

Benefits

• 100& Paid Healthcare: Take advantage of fully paid medical, dental, vision, disability, and life insurance for employees and subsidized for dependents.
• Bonus: Participate in the company-wide annual bonus based on their collective success.
• Family Planning: Leverage their 100% paid parental and new child bonding leave—12 weeks off for primary caregivers and 4 weeks off for secondary caregivers
• Paid Sabbatical: Pursue your interests with six weeks of paid sabbatical leave after six years of service.
• Tuesday Lunch: Get together for transparent company updates from leadership while enjoying a meal on AlertMedia
• PTO: Unplug, rest, and recharge with a flexible time off policy that encourages work-life balance without worrying about counting days!
• Give Back: Join your coworkers in giving back to the Austin community through quarterly volunteer opportunities
• Team Building and Celebrations: Take part in company celebrations, team buildings, and peer-nominated value award recognition

You are an applied AI and machine learning engineer with strong data science fundamentals, deeply curious about what’s possible with large language models and practical machine learning applicationsYou’re a collaborative engineer who thrives in a fast-moving environment, and you’re as comfortable training and fine-tuning models as you are crafting prompts or evaluating model outputsYou have a strong understanding of ML fundamentals, but you’re pragmatic in applying the right solution for the problemFamiliarity with model evaluation best practices, including offline metrics, cross-validation, and A/B testingThe ability and desire to work in a fast-paced challenging environment4–6+ years of experience in data science and/or software engineering, specifically in machine learning engineering, or applied AIExperience working with Elasticsearch or other large-scale search and indexing platforms2+ years of software engineering experience, Python preferredStrong organizational skills and ability to manage working on multiple projects in parallelProficiency in Python and ML libraries (e.g., scikit-learn, PyTorch, TensorFlow, Hugging Face)Experience with cloud-based ML tooling (e.g., SageMaker, Bedrock) and data workflowsExperience with prompt engineering, model fine-tuning, and evaluationDemonstrated experience training and deploying supervised learning models, ideally in production environments (a plus)Strong understanding of LLMs and traditional machine learning methodsBachelor’s degree in a technical field such as computer science, computer engineering or related field preferredAbility to work independently and collaboratively on cross-functional teams