AI Frameworks Engineer ○ Boulder

Great Sky, Inc.; Boulder (CO); Hybrid; USD 120,000 - 170,000; Full time

Benefits offered by this job

Equity ownership

Employer-matched 401(k)

Health, dental, vision, life

Flexible PTO

Learning support

Job summary

Great Sky, Inc. is seeking an AI Frameworks Engineer in Boulder, CO to build the core software layer that connects research to scalable AI systems.

You will design abstractions and APIs for training, validation, and execution of graph-structured models, while ensuring reliability across research and production contexts. You will develop and maintain JAX and PyTorch infrastructure, implement robust validation, and create clean seams between research workflows and production harnesses.

Qualifications

• Bachelor's or Master's degree in Computer Science or related field or equivalent experience.
• Strong Python software engineering skills with library/framework development experience.
• Hands-on experience with JAX or PyTorch and training-loop internals.
• Ability to design clean APIs and abstractions in large codebases.
• Experience reasoning about graph-structured computation and runtime state.
• Excellent written and verbal communication for cross-functional collaboration.

Responsibilities

• Design, implement, and maintain core AI framework abstractions for graph-structured models.
• Build Python APIs for training workflows, losses, and optimizer interfaces.
• Develop and maintain JAX and PyTorch infrastructure for model execution.
• Design validation systems with clear diagnostics for researchers and production users.
• Organize research code into stable, well-tested framework components.
• Create seamless transitions between research workflows and production harnesses.
• Write high-quality tests for numerical behavior and protocol conformance.
• Collaborate with researchers and hardware/software engineers on architecture.

Skills

Python

API design

Testing

Graph computation

Communication

Education

Bachelor's or Master's in Computer Science

Tools

JAX

PyTorch

Job description

About Us

Great Sky is a technology startup based with a mission to rebuild AI from first principles. We are pursuing neuroscience-inspired hardware and algorithms that overcome the greatest challenges in scaling AI systems.

The Role

We are looking for an AI Frameworks Engineer to help build the core software layer that connects our research ideas to working, testable, scalable AI systems. This is a software engineering role focused on the internal AI framework: the abstractions, APIs, graph execution paths, training strategies, validation systems, and test infrastructure that make our research stack usable and reliable.

Key Responsibilities

• Design, implement, and maintain core AI framework abstractions for defining, training, validating, and executing novel graph-structured models.
• Build clean Python APIs for training workflows, including loss objects, model runtime bundles, optimizer/training strategy interfaces, and more.
• Develop and maintain JAX and PyTorch infrastructure for model execution, customizable training protocols, numerical parity tests, and reusable forward-pass utilities.
• Help design validation systems that catch incompatible model/loss/solver/topology combinations early, with clear diagnostics for researchers and production users.
• Organize research code into stable, well-tested framework components without slowing down exploration.
• Create clean seams between research-mode workflows and production harness workflows, so the same infrastructure can support ad hoc experiments, custom training loops, and ticketed/cloud training runs.
• Write high-quality tests for numerical behavior, protocol conformance, registry behavior, graph execution and training loops.
• Collaborate closely with researchers and hardware/software engineers to translate evolving research requirements into robust software architecture.
• Improve developer ergonomics: documentation, examples, error messages, package organization, type boundaries, and API consistency.
• Over time, help shape the broader AI software architecture that connects model design, simulation, training, validation, and hardware execution.

Qualifications

Required:

• Bachelor's or Master's degree in Computer Science or a related field, or equivalent professional experience.
• Strong Python software engineering skills, with experience building libraries, frameworks, or infrastructure used by other engineers or researchers.
• Hands-on experience with at least one modern ML framework, especially JAX or PyTorch.
• Proficiency with training-loop internals: forward passes, losses, gradients, optimizers, metrics, parameter/state handling, and numerical testing.
• Experience designing clean APIs and abstractions in complex codebases.
• Ability to reason about graph-structured computation, model execution, dependency boundaries, and runtime state.
• Strong testing instincts: unit tests, integration tests, regression tests, numerical parity tests, and clear failure modes.
• Ability to work in a research-heavy environment where requirements evolve and the right abstraction often emerges through iteration.
• Excellent written and verbal communication skills, especially when translating between research ideas and maintainable engineering designs.

Preferred:

• Prior experience working in an AI technology environment.
• Experience with typed Python, protocol-oriented design, dataclasses, Pydantic, package refactors, or public/internal SDK design.
• Familiarity with multi node and multi gpu training for JAX or PyTorch
• Experience with custom kernel writing in Triton/Cuda/Pallas
• Experience designing plugin or registry systems for losses, optimizers, training strategies, model components, or execution backends.
• Experience with compiler-adjacent or graph-adjacent systems: computational graphs, schedulers, IRs, topology validation, graph transformations, or hardware-aware execution.
• Experience working near hardware teams, accelerator teams, simulation teams, or low-level performance work.
• Familiarity with containers, cloud execution, job orchestration, experiment tracking, or production training harnesses.

Growth Opportunities

This role has a path toward broad technical ownership within Great Sky’s AI software stack.

As the team grows, you may help define framework architecture, set engineering standards, mentor other engineers, and lead major infrastructure projects spanning research workflows, simulation, training, validation, and hardware integration.

For the right person, this is a chance to build foundational infrastructure for a new kind of AI platform, rather than incrementally improving an existing transformer/GPU stack.

Benefits and Perks

• Meaningful equity ownership in an early-stage deep tech company
• Employer-matched 401(k)
• Health, dental, vision, and life insurance
• Flexible PTO
• Support for ongoing learning, conference attendance, and skill development

Our culture is onsite by default (we're founded by scientists who are used to working in the lab), with flexibility for hybrid arrangements. For the right person and role, we're open to filling roles remotely