Senior AI Safety Engineer – LLM Guardrails

News Corp; Austin (TX); On-site; USD 170,000 - 250,000; Full time

Benefits offered by this job

Healthcare benefits

401(k) with company match

Paid holidays

Flexible time off

Tuition reimbursement

Job summary

Realtor.com® is seeking a Sr AI Engineer to join the AI Integrations Team in Austin, TX. You’ll own the AI safety layer for the RealAssist platform, building classifiers and guardrails to ensure compliant, safe, and helpful AI experiences for real estate consumers.

You will design and run evaluation pipelines, curate labeled datasets, and collaborate with ML, backend, product, and legal teams to advance safe AI capabilities across our real estate products.

Qualifications

• Minimum 5+ years in software/ML engineering with hands-on LLM work.
• Bachelor’s degree or equivalent experience.
• Strong Python proficiency.
• Experience building or tuning LLM prompts and classifiers.
• Familiarity with guardrails and cloud guardrail services.
• Exposure to regulated/compliance-sensitive domains (housing, lending, healthcare).
• Red-teaming or AI-security background.

Responsibilities

• Design and implement guardrail and evaluation systems balancing safety, latency, and UX.
• Build LLM-as-a-judge classifiers for Fair Housing compliance and content moderation.
• Develop guardrail evaluation pipelines with labeled datasets and train/test splits.
• Integrate and operate cloud guardrail services in runtime screening with fail-open behavior.
• Collaborate with ML, backend, product, and legal/compliance stakeholders.

Skills

AI Safety

LLM Engineering

Python

Evaluation Metrics

Red-Teaming

Education

Bachelor's degree or equivalent experience

Tools

DeepEval

LangSmith

OpenAI Evals

Google Cloud Model Armor

Job description

Realtor.com® is seeking a Sr AI Engineer to join the AI Integrations Team in Austin, TX. You’ll own the AI safety layer for the RealAssist platform, building classifiers and guardrails to ensure compliant, safe, and helpful AI experiences for real estate consumers.

You will design and run evaluation pipelines, curate labeled datasets, and collaborate with ML, backend, product, and legal teams to advance safe AI capabilities across our real estate products.