Senior AI Engineer

RWS; Ireland; On-site; EUR 120,000 - 170,000; Full time

Job summary

RWS Senior AI Engineer role focuses on shaping architecture and delivering scalable AI platforms. The position blends research, software engineering, and testing to productionize next-generation AI features for enterprise customers.

You will lead evaluation strategies, governance, and tooling, while mentoring engineers and partnering with product and localization teams to align roadmaps across the business.

Qualifications

• Extensive software engineering experience delivering production systems.
• Proficiency in Python or similar language and strong testing discipline.
• Hands-on experience with LLMs or ML systems and their failure modes.
• Experience designing evaluation for AI/ML systems with metrics and pipelines.
• Ability to communicate technical direction and mentor others.

Responsibilities

• Contribute to design and architecture of core platform components and evaluation systems.
• Define evaluation strategy for AI capabilities and establish quality standards.
• Provide technical leadership, mentoring, and governance practices.
• Drive experimentation, observability, and platform tooling for production use.
• Collaborate across research, product, and localization to align roadmap.

Skills

5+ years software eng experience

Python

LLMs / ML systems

Evaluation metrics

Testing discipline

API design

Cloud infrastructure

CI/CD

Leadership potential

Tools

CI/CD tooling

Cloud platforms

Job description

The Senior AI Engineer is an individual contributor who defines technical direction while driving the quality, scalability, and reliability of next-generation AI-powered systems. This role operates at the intersection of research, software engineering, and advanced testing, transforming cutting-edge ideas into robust, production-ready platforms.

This is a senior individual contributor leadership role: the Senior AI Engineer operates as a force multiplier, shaping architecture and core platforms and frameworks, guiding teams, and also pioneering and designing research projects that are evaluated, presented, and then delivered at enterprise scale with high confidence.

About RWS

RWS is a global AI solutions company empowering the world’s most trusted enterprise AI.

Our proprietary Cultural Intelligence Layer, powered by 250,000 data specialists, cultural and language experts and deep domain professionals, backed by 45+ patents, makes enterprise AI culturally fluent, contextually accurate and secure, ensuring every interaction reflects a brand’s tone, context and customer values.

Through our Generate, Transform and Protect segments, we deliver intelligent content, enterprise knowledge, large-scale localization and IP protection for global growth. Trusted by 80+ of the world’s top 100 brands, RWS provides the confidence, governance and expertise organizations need to deploy AI safely, responsibly and at scale.

Headquartered in the UK, RWS is listed on AIM (RWS.L).

More information: rws.com .

About AI Platforms And Excellence

The AI Platforms and Excellence team aims to accelerate the development of external-facing, product-ready AI capabilities that materially differentiate RWS offerings, improve customer outcomes, and drive revenue growth across the business.

The team provides a centralized, execution-focused capability that productizes AI at scale. It delivers reusable platforms, proven patterns, and clear guardrails so product teams can rapidly ship secure, high-quality, and commercially relevant AI features, consistently and sustainably.

With a global reach, RWS provides technology and services to over 7500 end users worldwide. Our core functions encompass Enterprise & Technical Architecture, Network & Voice, Infrastructure, Service Delivery, Service Operations, Data & Analytics, Security & Quality Compliance, Transformation, Application Development, and Enterprise Platforms.

Key Responsibilities

Job Overview

Architecture and technical strategy

• Contribute to the design and architecture of core platform components and evaluation systems, making the load-bearing technical decisions and bearing accountability for their reliability, scalability, and long-term maintainability.
• Help set the technical direction for how AI capabilities are built, evaluated, and deployed across the company, and define a coherent platform vision that scales beyond your immediate team.
• Design reusable abstractions, SDKs, and services for model integration, prompt management, experimentation, and deployment that establish organization-wide patterns and reduce duplicated effort.

Research and delivery excellence

• Help define the evaluation strategy and methodology for AI capabilities across the company – automated metrics, human-in-the-loop workflows, test set management, and benchmarking – and establish the quality standards other teams build against.
• Build evaluation frameworks and developer tooling robust enough for production yet simple enough for non-specialist developers to adopt.
• Establish observability standards for AI systems – quality, performance, cost, and regression signals – and build dashboards and reporting that turn those signals into actionable decisions.
• Drive engineering rigor in delivery through testing discipline, reproducibility, sound experimental design, and statistically defensible measurement of model quality.

Technical leadership

• Provide technical leadership on the team's most ambiguous and highest-impact problems, scoping and sequencing work where direction is limited.
• Mentor engineers and raise engineering standards through code review, design review, and leading by example.
• Contribute to model and system governance practices including documentation (model cards, system cards), dataset and test-set versioning, reproducibility, and responsible-AI checks embedded directly into the platform.
• Act as a technical multiplier – codifying best practices into tooling and standards adopted by hundreds of developers.

Innovation and technology adoption

• Track developments in LLMs, evaluation research, and AI tooling, and translate them into pragmatic, well-scoped improvements to the platform.
• Prototype and de-risk emerging techniques and tools, shepherding the promising ones from experiment to supported capability.
• Champion the adoption of new platform capabilities across teams, lowering the barrier for developers to use them well.
• Keep the platform current and competitive without chasing novelty for its own sake.

Cross-functional collaboration and stakeholder leadership

• Partner with research, product, and localization leaders to align evaluation methodology with real-world quality and customer needs.
• Influence roadmap and technical strategy beyond your immediate team, building consensus across engineering and product stakeholders.
• Gather requirements from developers across the company and represent their needs in platform direction, acting as a trusted technical partner.
• Communicate technical direction, trade-offs, and quality standards clearly to both technical and non-technical audiences.

Skills & Experience

Required

• Significant software engineering experience (typically 5+ years) building and operating production systems, tools, libraries, or services that many other engineers depend on, with excellent API design, reliability, and developer experience. Also, a track record with CI/CD and cloud infrastructure.
• Proficiency in Python and/or another general-purpose language, with strong testing discipline
• Hands-on experience building with LLMs or other ML systems (prompt engineering, fine-tuning, retrieval, model integration), with an understanding of their failure modes and tradeoffs.
• Proven experience designing and leading evaluation for AI/ML systems: defining metrics and methodology, building evaluation pipelines, managing test sets, and reasoning rigorously about model quality and regressions.
• Strong command of evaluation concepts — various types of metrics (accuracy, precision, recall, F1), the distinction and tradeoffs between automated and human evaluation, statistical significance, and the limits of each approach.
• Excellent written and verbal communication, and a history of influencing technical direction across teams and mentoring other engineers.
• Comfort with ambiguity and the judgment to scope, prioritize, and sequence high-impact work with limited direction.

Preferred

• Deep experience evaluating NLP, machine translation, or content-generation systems, including metrics such as COMET, chrF++, BLEU, MetricX, and MQM-style human evaluation.
• Experience with experimentation and observability tooling, data/test-set versioning, and rigorous benchmarking workflows.
• Established practice in AI governance and documentation - model cards, system cards, reproducibility, and responsible-AI considerations - at an organizational level.
• Broad familiarity with the modern LLM ecosystem (open and proprietary models, orchestration frameworks, vector stores) and well-formed views on the tradeoffs.
• Experience supporting multilingual or localization-focused products at enterprise scale.

For all applicants in Poland and accordance with applicable pay transparency legislation, candidates will be informed of the salary range for this position prior to interview. Pay is determined without reference to previous salary history and is aligned to objective job‑related criteria.

Life at RWS

If you like the idea of working with smart people who are passionate about growing the value of ideas, data and content by making sure organizations are understood , then you’ll love life at RWS.

Our purpose is to unlock global understanding. This means our work fundamentally recognizes the value of every language and culture. So, we celebrate difference, we are inclusive and believe that diversity makes us strong. We want every employee to grow as an individual and excel in their career.

In return, we expect all our people to live by the values that unite us: to partner, putting clients fist and winning together, to pioneer, innovating fearlessly and leading with vision and courage, to progress, aiming high and growing through actions and to deliver, owning the outcome and building trust with our colleagues and clients.

RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.

RWS Values

Get the 3Ps right – Partner, Pioneer, Progress – and we´ll Deliver together as RWS.

Recruitment Agencies:

RWS Holdings PLC does not accept agency resumes. Please do not forward any unsolicited resumes to any RWS employees. Any unsolicited resume received will be treated as the property of RWS and Terms & Conditions associated with the use of such resume will be considered null and void.