AI Safety Research Scientist

Grid Dynamics; United States; On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Cutting-edge projects

Motivated, dedicated team

Corporate social events

Well-equipped office

Job summary

Grid Dynamics is seeking a skilled AI Safety/Data Analytics professional to apply language, culture, and market expertise for US English storefronts. You will analyze large datasets to identify loss patterns and develop tooling, dashboards, and workflows to support evaluation and reporting for product and engineering teams.

You will define evaluation frameworks, conduct stress tests on models, and collaborate with cross-functional experts to ensure safety and localization quality across

Qualifications

• Expert English (UK) with regional cultural nuances.
• Bachelor’s degree in a data-focused field.
• Experience in AI red teaming methodologies and reporting.
• Proficient Python for data analysis (pandas, NumPy, Jupyter) and SQL familiarity.
• Experience with large-scale datasets and interpreting complex data including loss patterns.
• Experience with LLMs or generative AI systems.
• Hands-on experience designing guidelines and annotation tasks for localization.
• Proven collaboration across cross-functional, multi-domain, multilingual teams.
• Comfort with sensitive and safety-related content.

Responsibilities

• Provide market expertise for US English locale and market insights.
• Analyze quantitative data to identify patterns and loss trends.
• Develop dashboards, scripts, and workflows to streamline evaluation and reporting.
• Translate findings into actionable insights for product and engineering teams.
• Define robust dataset criteria and perform adversarial/stress tests on models.
• Develop evaluation frameworks capturing safety criteria and fidelity to policies.
• Scale automated evaluation pipelines to collect and judge model outputs.

Skills

English (UK)

Python for data analysis

SQL

Cross-functional collaboration

Data interpretation

LLMs / Generative AI

Guidelines & annotation design

Vulnerability discovery

Education

Bachelor’s degree in Data Science/CS/Data Analytics

Tools

pandas

NumPy

Jupyter

Job description

Responsibilities

• Provide Market Expertise: Support specific digital storefronts by providing deep language, cultural, and market expertise for the US English locale.
• Analyze Data: Apply statistical and computational methods to identify patterns, trends, and loss patterns in quantitative data.
• Develop Tooling: Design and build dashboards, scripts, and workflows to streamline evaluation and reporting processes.
• Drive Insights: Translate qualitative and quantitative findings into actionable insights and strategic guidance for product and engineering teams.
• Stress-Test Models: Define dataset criteria and construct robust adversarial and stress-test datasets to evaluate system vulnerabilities.
• Define Frameworks: Develop evaluation frameworks that capture nuanced safety criteria, ensuring strict fidelity to safety policies.
• Scale Evaluations: Guide the development of automated evaluation pipelines to collect, automatically judge, and analyze model outputs at scale.

Min requirements

• Language Proficiency: Expert proficiency in English (UK), with a deep understanding of regional cultural nuances.
• Education: Bachelor’s degree in Data Science, Computer Science, Data Analytics, or a related technical field.
• Red Teaming: Expertise in AI red teaming methodologies, vulnerability discovery, and associated reporting strategies.
• Technical Skills: Intermediate to advanced proficiency in Python for data analysis (e.g., pandas, NumPy, Jupyter) and familiarity with SQL for data retrieval.
• Data Experience: Proven experience working with large-scale datasets and interpreting complex data (including identifying loss patterns).
• AI/ML Experience: Experience working with Large Language Models (LLMs) or generative AI systems.
• Guidelines/Annotation Task Design: Hands-on experience with guidelines and annotation task design and execution, including best practices for culturally and linguistically appropriate localization across languages.
• Collaboration: Proven experience working effectively with cross-functional, multi-domain, and multilingual experts.
• Content Resilience: Comfort and resilience working with sensitive topics and trust & safety content.

We offer

• Opportunity to work on cutting-edge projects
• Work with a highly motivated and dedicated team
• Corporate social events
• Well-equipped office

Please note that all onboardings must occur in person and you may be asked to travel to attend.

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.