Software Engineer, LLM Infrastructure

Gleanwork; Mountain View (CA); On-site; USD 175,000 - 270,000; Full time

Benefits offered by this job

Comprehensive benefits package

Home office improvement stipend

Annual education and wellness stipend

Healthy lunches daily

Job summary

Gleanwork in Mountain View is hiring software engineers to enhance their AI and assistant product for work. You will design and improve AI/ML systems and participate in a hybrid work model.

Ideal candidates should have 2-5 years of experience and a BA/BS in a relevant field. The position offers competitive salary potential ranging from $175,000 to $270,000 and includes a comprehensive benefits package.

Qualifications

• 2-5 years of experience in software engineering.
• Proven ability to design, build, and ship production-ready software.
• Strong coding skills and proactive attitude.

Responsibilities

• Design, build, and improve AI/ML systems and data pipelines.
• Work with and enable other engineers focused on Agentic capabilities.
• Mentor junior engineers.

Skills

Python

Go

Java

AI/ML infrastructure

Education

BA/BS in Computer Science, Math, Sciences, or related degree

Job description

About the Role

Glean is looking for software engineers to help build the world’s best search and assistant product for work. Our engineers work on a range of systems across the stack, including generative AI, RAG, query understanding, document understanding, domain‑adapted language models, natural language question‑answering, evaluation, and experimentation. We interact regularly with customers, deeply understand their pain points, and use whatever tool is necessary, simple or complex, to solve their problems.

You will

• Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale.
• Work with and enable other engineers focused on modeling and Agentic capabilities.
• Build agentic systems that leverage AI to proactively monitor, diagnose, debug, and maintain infrastructure health at scale across cloud deployments.
• Write robust code that's easy to read, maintain, and test.
• Mentor more junior engineers, or learn from battle‑tested ones.

About you

• 2‑5 years of experience.
• BA/BS in computer science, math, sciences, or a related degree.
• Proven ability to design, build, and ship production‑ready software, ideally around AI/ML infrastructure (batch processing pipelines, serving infrastructure, LLM orchestration, etc.).
• Strong coding skills (Python, Go, Java).
• Thrive in a customer‑focused, tight‑knit and cross‑functional environment – being a team player and willing to take on whatever is most impactful for the company is a must.
• A proactive and positive attitude to lead, learn, troubleshoot and take ownership of both small tasks and large features.

Location

• This role is hybrid (3‑4 days a week in our Mountain View office).

Compensation & Benefits

The standard base salary range for this position is $175,000 - $270,000 annually. Compensation offered will be determined by factors such as location, level, job‑related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.

We offer a comprehensive benefits package including competitive compensation, medical, vision, and dental coverage, generous time‑off policy, and the opportunity to contribute to your 401k plan to support your long‑term goals. When you join, you'll receive a home office improvement stipend, as well as an annual education and wellness stipend to support your growth and wellbeing. We foster a vibrant company culture through regular events, and provide healthy lunches daily to keep you fueled and focused.

AI-First Mindset at Glean

At Glean, AI fluency is core to how we work and we're committed to ensuring every new hire feels confident integrating AI into their everyday work. As part of the interview process, you'll complete a brief AI‑focused exercise or discussion so we can understand how you think about, design, and use AI to drive impact in your role. Feel free to reference any tools, platforms, or workflows you use today – prior Glean experience isn't required.

Equal Opportunity

We are a diverse bunch of people and we want to continue to attract and retain a diverse range of people into our organization. We're committed to an inclusive and diverse company. We do not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.