Senior AI Engineer

Digital Realty

San Francisco (CA)

Remote

USD 160,000 - 190,000

Full time

37 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Digital Realty is seeking a Senior AI Engineer to design, build, and operate secure, production-grade AI solutions across the AI@Digital program. You will lead end‑to‑end AI architecture, integration with governed data sources, and collaboration with Legal, Compliance, Security, and data teams.

You will guide architectural decisions, oversee CI/CD pipelines, and mentor engineers while delivering scalable AI capabilities across enterprise data platforms and cloud environments, with emphasis on

Qualifications

  • Seven or more years of software engineering experience, including at least two years building and running LLM or generative AI applications in production.
  • Advanced Python engineering skills, including asynchronous web services, FastAPI or a similar framework, typed code, automated testing, and production API development.
  • Hands‑on experience designing retrieval‑augmented generation solutions using chunking, embeddings, hybrid retrieval, semantic ranking, reranking, and source citations.

Responsibilities

  • Translate complex business needs into secure, scalable AI architectures, including retrieval-augmented generation, natural-language-to-SQL agents, tool-using agents, and conversational assistants.
  • Build and operate production Python services using technologies such as FastAPI, asynchronous APIs, streaming responses, authentication, rate limiting, typed code, and automated testing.
  • Design advanced retrieval pipelines using chunking, embeddings, hybrid search, semantic reranking, query decomposition, intent routing, entity resolution, and inline citations.
  • Connect AI services to governed enterprise data, including Microsoft Fabric semantic models, lakehouse and warehouse sources, PostgreSQL, GraphQL services, and master data platforms.
  • Lead architectural decisions, document technical trade-offs through architecture decision records, and guide solutions through security and architecture reviews.
  • Oversee the production delivery of enterprise AI capabilities, including the LLM gateway, CI/CD pipelines, environment configuration, rollback planning, release validation, and platform reconciliation.
  • Partner with business stakeholders, data owners, Legal, Compliance, Security, and engineering teams to define use cases, data access requirements, delivery scope, risks, and release expectations.
  • Strengthen application security by addressing identity, network exposure, secrets management, least‑privilege access, WAF posture, dependency risks, and cloud‑security findings.
  • Implement observability using OpenTelemetry, Azure Monitor, and Application Insights to measure performance, latency, cost, reliability, and AI response quality.
  • Mentor engineers, review code and technical designs, maintain architecture documentation, and establish engineering standards across the AI@Digital platform.

Skills

Python
FastAPI
LLM / generative AI
Azure
SQL
Architecture design
Mentoring engineers

Education

Bachelor’s degree in computer science or related

Tools

PostgreSQL
GraphQL
OpenTelemetry
Application Insights
CI/CD pipelines
Git

Job description

Job Description
Senior AI Engineer

Location: Atlanta, GA | Austin, TX | Boston, MA | Charlotte, NC | Chicago, IL | Dallas, TX | Houston, TX | Los Angeles, CA | Miami, FL | New York, NY | Ashburn, VA | Phoenix, AZ | Portland, OR | San Francisco Bay Area, CA | Seattle, WA | Remote, US

Your Role

As a Senior AI Engineer on Digital Realty’s AI@Digital team within the Office of the Chief Data Officer, you will design, build, and operate secure, production-grade AI solutions that help teams find information, access governed enterprise data, and make better decisions.

This is a hands‑on technical leadership role combining AI architecture, backend engineering, cloud delivery, and stakeholder partnership. You will build solutions ranging from grounded conversational assistants and retrieval‑augmented generation applications to natural‑language‑to‑SQL and tool‑using agents. You will also establish the engineering standards and architectural patterns used across the AI platform.

What You’ll Do
  • Translate complex business needs into secure, scalable AI architectures, including retrieval-augmented generation, natural-language-to-SQL agents, tool-using agents, and conversational assistants.
  • Build and operate production Python services using technologies such as FastAPI, asynchronous APIs, streaming responses, authentication, rate limiting, typed code, and automated testing.
  • Design advanced retrieval pipelines using chunking, embeddings, hybrid search, semantic reranking, query decomposition, intent routing, entity resolution, and inline citations.
  • Connect AI services to governed enterprise data, including Microsoft Fabric semantic models, lakehouse and warehouse sources, PostgreSQL, GraphQL services, and master data platforms.
  • Lead architectural decisions, document technical trade-offs through architecture decision records, and guide solutions through security and architecture reviews.
  • Oversee the production delivery of enterprise AI capabilities, including the LLM gateway, CI/CD pipelines, environment configuration, rollback planning, release validation, and platform reconciliation.
  • Partner with business stakeholders, data owners, Legal, Compliance, Security, and engineering teams to define use cases, data access requirements, delivery scope, risks, and release expectations.
  • Strengthen application security by addressing identity, network exposure, secrets management, least‑privilege access, WAF posture, dependency risks, and cloud‑security findings.
  • Implement observability using OpenTelemetry, Azure Monitor, and Application Insights to measure performance, latency, cost, reliability, and AI response quality.
  • Mentor engineers, review code and technical designs, maintain architecture documentation, and establish engineering standards across the AI@Digital platform.
What You’ll Need
  • Seven or more years of software engineering experience, including at least two years building and running LLM or generative AI applications in production.
  • Advanced Python engineering skills, including asynchronous web services, FastAPI or a similar framework, typed code, automated testing, and production API development.
  • Hands‑on experience designing retrieval‑augmented generation solutions using chunking, embeddings, hybrid retrieval, semantic ranking, reranking, and source citations.
  • Experience building AI agents that call tools, interact with APIs, or generate controlled queries against structured enterprise data.
  • Production cloud experience, preferably with Microsoft Azure, including containers, managed identities, networking, API management, and CI/CD pipelines.
  • Demonstrated experience leading technical design, documenting architecture decisions, and presenting solutions through formal architecture or security reviews.
  • Working knowledge of SQL, enterprise data platforms, data contracts, and integration patterns, with experience partnering with data engineering teams.
  • Ability to translate business requirements into well‑scoped technical deliverables and explain AI capabilities, limitations, risks, and trade‑offs to non‑technical leaders.
  • Experience mentoring engineers, reviewing code and designs, and establishing standards for security, quality, testing, and production readiness.
  • Bachelor’s degree in computer science or a related discipline, or equivalent professional experience.

Experience with Microsoft Fabric, Azure AI Search, Azure OpenAI, Semantic Kernel, Copilot Studio, AI governance, OpenTelemetry, application-security testing, or enterprise data center environments would be an advantage.

A Bit About Us

Digital Realty brings companies and data together by delivering the full spectrum of data center, colocation and interconnection solutions. PlatformDIGITAL®, the company’s global data center platform, provides customers with a secure data meeting place and a proven Pervasive Datacenter Architecture (PDx®) solution methodology for powering innovation and efficiently managing Data Gravity challenges. Digital Realty gives its customers access to the connected data communities that matter to them with a global data center footprint of 300+ facilities in 50+ metros across 25+ countries on six continents.

To learn more about Digital Realty, please visit digitalrealty.com or follow us on LinkedIn and X.

A Bit About Our Team
Technology & Innovation

Our Technology & Innovation team strives to innovate alongside our customers and empower their businesses to thrive. We work closely with our customers to develop insights-based, data-driven technical solutions and differentiated value propositions on PlatformDIGITAL® across the world.

Operating in almost 50 cities globally means we understand how rapidly the world is evolving, so we’ve built a best‑in‑class development model to qualify, package and enable cloud‑to‑core‑to‑edge hybrid IT solutions. Our deep technical heritage, combined with our global footprint, means the Technology & Innovation team can create and deploy services and solutions that are at the heart of the digital economy.

What We Can Offer You
Health & Safety

Safety isn't just a priority here at Digital; it's critical to everything we do. Safeguarding lives, protecting assets, and securing data aren't just ideals; they're essential pillars of our commitment to excellence for our people, our partners, and our customers. We have a culture of care where every member of Team Digital embraces a relentless pursuit of working safely across Digital Realty. Together we are Safely Powering Progress.

Our Compensation Philosophy

Digital Realty offers its employees a highly competitive compensation package, excellent benefits, and an environment that recognizes and rewards your contributions. Central to our compensation philosophy is rewarding our employees for achieving the values and objectives aligned with the company’s overall goals and values.

Our published pay ranges reflect the minimum and maximum target for new‑hire pay for the full‑time position, determined by role, level, and geographical location. Individual pay is based on additional factors, including but not limited to job‑related skills, experience, and relevant education or training. An employee’s total compensation package varies by role and may include salary, cash bonus or commissions, and equity awards not quantified below.

Compensation range: $160,000–$190,000 annually. This compensation range represents the company’s good‑faith belief as to what it will pay as a base salary for this position at the time of posting.

Benefits: For this role, benefits include medical, dental, vision, life and AD&D insurance, 401(k) match, disability benefits, wellness and education benefits, an employee stock purchase plan, paid time off, holidays, and more.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer
Senior AI Engineer

Digital Realty • Dallas (TX)

On-site
USD 160,000 - 190,000
Health insurance
Dental insurance
Vision insurance
+3
Senior AI Engineer
Senior AI Engineer

Digital Realty • Denver (CO)

Remote
USD 160,000 - 190,000
Health insurance
401(k) match
Disability benefits
+5
Senior AI Engineer
Senior AI Engineer

Digital Realty • Seattle (WA)

Remote
USD 160,000 - 190,000
Senior AI Engineer
Senior AI Engineer

Hdep • United States

Remote
USD 160,000 - 190,000
Sr. Solutions Architect
Sr. Solutions Architect

Dreamwork • Chicago (IL)

Hybrid
USD 175,000 - 185,000
Medical, dental, vision
401(k) match
Paid time off
Sr. Solutions Architect
Sr. Solutions Architect

Digital Realty • Austin (TX)

Hybrid
USD 175,000 - 185,000
Sr. Solutions Architect
Sr. Solutions Architect

Digital Realty • Dallas (TX)

Hybrid
USD 175,000 - 185,000
Medical insurance
Dental insurance
Vision insurance
+9
Sr. Solutions Architect
Sr. Solutions Architect

Digital Realty • Los Angeles (CA)

Hybrid
USD 175,000 - 185,000
Medical, dental, vision benefits
401(k) match
Disability benefits
+1
Sr. Solutions Architect
Sr. Solutions Architect

Digital Realty • Chicago (IL)

Hybrid
USD 175,000 - 185,000
Senior Software Manager Platform
Senior Software Manager Platform

Digital Realty • Seattle (WA)

On-site
USD 155,000 - 175,000
Medical, dental, vision
Life and AD&D insurance
401(k) match
+5