Software Engineer, Full-Stack

We Love AI Jobs; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Ema builds AI employees that automate enterprise workflows across HR, IT, and finance. The role focuses on advancing agent evaluation, RL methods, and post-training improvements to deliver scalable production systems. You will design experiments, measure outcomes, and drive deployment across real workflows.

The position requires deep knowledge in reinforcement learning, retrieval, and memory, with opportunities to contribute from junior to senior levels. On-site work in the Bay Area is expected.

Qualifications

• Experience in agent evaluation and RL design.
• Ability to develop and evaluate training, retrieval, or inference improvements.
• Ownership of experiments from baseline through deployment and monitoring.

Responsibilities

• Define baselines and run experiments on agent behavior.
• Develop and evaluate training, retrieval, or inference improvements.
• Own serving, integration, deployment, monitoring, and failure analysis for project outcomes.

Skills

Agent evaluation

Reinforcement Learning

Post-training

Reward modeling

Retrieval and memory

Education

Master's or PhD in a relevant field

Job description

# Software Engineer, Full-StackEmaSan Francisco Bay AreaFull-timeAI tools:TRLveRLOpenRLHFvLLMSGLangUpload your resume once and Scout applies for youApply with ScoutShare this job:LinkedInXSave imageThis role combines applied research and production engineering to improve Ema’s enterprise workflow agents. You will work on areas such as agent evaluation, post-training, retrieval, and inference efficiency, owning experiments through deployment and monitoring; the posting welcomes candidates from junior through senior levels.* Permanent* On-site* Master’s or PhD in a relevant field, or equivalent experienc### Skills and expertiseAgent evaluationReinforcement learningPost-trainingReward modelingRetrieval and memoryvLLMSGLangGPU training### Key responsibilities* Define baselines, build test data or environments, and run experiments on agent behavior.* Develop and evaluate training, retrieval, or inference improvements using realistic workflows and benchmarks.* Own serving, integration, deployment, monitoring, and failure analysis for project outcomes.## How this job comparesCompared with 329 open mid-level machine learning jobs on October 10, 2026.Pay: This job does not publish its pay. The 119 open mid-level machine learning jobs that publish US pay start at $180K a year on average.Similar open jobs: We Love AI Jobs lists 329 open mid-level machine learning jobs at 145 companies.Remote work: This job is on site. 66 of the 329 mid-level machine learning jobs (20%) are remote.AI in this role: High. AI is the core of the work: building, training or deploying AI systems. The work directly develops, trains, evaluates, and deploys AI agents and models. The posting describes experimentation in post-training, reinforcement learning, retrieval, evaluation, and inference systems as core responsibilities.## Full descriptionAbout EmaEma builds AI Employees for HR, IT and Finance. Our AI Employees take on the busy work across the employee experience, from recruiting, onboarding and benefits to IT support, invoice processing and payroll, so people can spend their time on work that needs them. Founded by former executives from Google, Coinbase, Flipkart, and Okta, our team includes engineers from premier tech companies and graduates of Stanford, MIT, UC Berkeley, CMU, and IITs.We are backed by industry leading investors including Accel, Naspers/Prosus, Creaegis, Section32, and angels like Sheryl Sandberg and Dustin Moskovitz. Headquartered in Silicon Valley and with offices in London, Bangalore and Vancouver, Ema is at the frontier of what Agentic AI can do in production. We ship real systems that run real business processes at scale.Build agents that learn from the work they do.Ema builds AI employees that carry out complex workflows across enterprise applications. Our ML team works on the loop that makes them better: production traces become data, data becomes training and evaluation, and better agents produce better traces. The hard part is deciding which intervention will improve behavior in the next real workflow.The problem space• Harnesses and inference-time compute. Design context, tools, skills and orchestration for multi-step agents, including work across documents, slides, images, audio and video. Test where extra reasoning, search or verification earns its latency and cost. Build self-improvement loops with explicit permissions, evaluation gates and rollback.• Agent post-training. Curate trajectories for SFT, optimize preferences, or run RL on real agent tasks. Investigate methods such as DPO, GRPO or DAPO where they fit; compare process and outcome supervision, shape rewards, and distill useful frontier behavior into smaller models. Measure whether gains transfer beyond the training environment.• Environments and rewards. Turn enterprise workflows into reproducible training and evaluation environments: fixture tenants, simulated users who may get impatient and leave, and rewards grounded in verifiable outcomes. Find the shortcuts an agent can exploit before a training run optimizes for them.• Data engines and evaluation. Mine production agent-steps for failures; build curated corpora and useful synthetic augmentation. Calibrate judges against human labels, construct behavior-level benchmarks from real workflows, and quantify data quality, performance uplift and reliability across stochastic runs.• Retrieval, memory and context graphs. Connect enterprise information with user- and tenant-level learnings. Separate failures of retrieval from failures to use retrieved context; test what to retain, update and retrieve so that past experience improves the next decision.• Quality per dollar. Build and evaluate routing, ensembles, caching and small-model specialization. Measure downstream task success alongside latency and cost; a cheaper model is useful only if the complete agent still succeeds.You’ll go deep in a subset of these areas. Projects combine applied research with the engineering needed to make the result work in production.Own the experiment and the systemMost projects develop over roughly four to six months, with useful improvements shipping along the way. You’ll define the problem and baseline, build the data or environment needed to test it, run experiments, and own serving and integration. Follow the system through deployment, monitoring and failure analysis until it is ready for a clear engineering handoff.You’ll work with researchers and engineers across the Bay Area, Vancouver and India. We’re hiring from junior through senior levels, with project scope matched to your experience.What we’re looking for• Depth you can defend. Substantial work in at least one of agent/tool-use systems, post-training, reward modeling or RL environments, retrieval and memory, or evaluation design. Be ready to explain the mechanism, the alternatives you rejected and the failure modes you found. One area you can teach us beats five you’ve touched.• Evidence of zero-to-one ownership. A system, model or research project you took from an ambiguous problem to a working result. We want to understand your contribution, the tradeoffs you made, and what changed when the work met real users or realistic tasks.• Statistical judgment. You can size an experiment, choose meaningful baselines and held-out tests, and account for variation across tasks, seeds and repeated runs. You can distinguish a real improvement from judge bias, data leakage or a benchmark shortcut.• Production engineering judgment. You can debug across the model and system boundary, isolate a failure, and turn the result into maintainable production code.