AI Context & Semantics Backend Engineer

Socket.dev; Pleasanton (CA); Hybrid; USD 148,000 - 222,000; Full time

Benefits offered by this job

Flexible work arrangements

Job summary

Workday is hiring a Backend Software Engineer in the Context and Semantics team to build data and context infrastructure powering AI Agents. You’ll connect large language models to enterprise data stores and implement modern RAG pipelines with vector databases and query federation.

The role emphasizes scalable backend microservices, security, and collaboration with senior engineers and product managers to deliver robust AI platform features at scale.

Qualifications

• 3+ years of professional software engineering experience focusing on backend development, microservices, or data systems.
• 2+ years of strong hands-on programming in Java, Python, Scala, or Go.
• 1+ year of exposure to AI/ML concepts, LLM APIs, Vector Databases, or RAG architectures.

Responsibilities

• Feature Development & Coding: Design, develop, and test scalable backend microservices, APIs, and data pipelines powering the context and semantic layer for AI Agents.
• RAG & Vector Search Implementation: Build and maintain enterprise RAG pipelines, including embedding workflows, document chunking strategies, and vector database integrations (e.g., Pinecone, Milvus, Elasticsearch).
• Query & Semantic Integration: Develop distributed query execution features (e.g., Trino) to retrieve enterprise data securely for LLMs.
• LLM & Agentic Workflows: Implement orchestration logic and context-management components using AI frameworks (LangChain, LlamaIndex) for multi-turn agent interactions.
• Data Security & Governance: Ensure code adheres to enterprise standards for data privacy, tenant isolation, and RBAC.
• Operational Excellence: Write unit/integration tests, participate in code reviews, maintain reliability and low latency.
• Collaborative Execution: Work with Senior Engineers, Product Managers, and leads to translate requirements into code.

Skills

Backend development

Microservices

Data systems

Education

Bachelor’s degree in Computer Science/Software Engineering

Tools

SQL

Relational databases

Trino

Presto

Spark

Job description

Workday is hiring a Backend Software Engineer in the Context and Semantics team to build data and context infrastructure powering AI Agents. You’ll connect large language models to enterprise data stores and implement modern RAG pipelines with vector databases and query federation.

The role emphasizes scalable backend microservices, security, and collaboration with senior engineers and product managers to deliver robust AI platform features at scale.