Software Engineer, On Device

Karman; United States; Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Health insurance

Flexible paid time off

401k with company match

Health, dental, vision

Job summary

Karman is an NVIDIA-backed AI company expanding its engineering team and seeking a Software Engineer to productionalize our edge IoT platform. You will design, implement, test, and optimize Python-based edge software running on constrained devices, with emphasis on real-time telemetry, security, and observability.

You will collaborate across software, hardware, QA, data science, and leadership, contribute to CI/CD pipelines, and help raise the bar for performance and reliability in distributed

Qualifications

• 5+ years of professional software development experience.
• Experience designing distributed systems in resource-constrained environments.
• Proficiency in Python, C/C++, Rust, and Linux.
• Experience with device security (PKI, secure boot) and telemetry.
• Experience with CI/CD workflows (GitHub Actions or Jenkins).
• Strong knowledge of network protocols (REST, gRPC, MQTT, ZeroMQ).
• Excellent written and oral communication, teamwork.

Responsibilities

• Design, implement, test edge software in Python (and possibly Rust).
• Build and maintain CI/CD processes for reproducible deployments.
• Contribute to documentation and code reviews.
• Collaborate with software, hardware, QA, data science, and leadership teams.
• Lead feature implementation and drive process improvements.
• Mentor engineers through paired programming and testing scenarios.
• Foster open communication and continuous improvement.

Skills

Python

Linux

CI/CD

Distributed systems

Edge devices

REST APIs

gRPC

MQTT

ZeroMQ

Education

Bachelor's degree or equivalent

Tools

GitHub Actions

Jenkins

Docker

NVIDIA ML software stack

Jetson Platform

Job description

Karman is a fast-growing NVIDIA-backed AI company enabling AI data centers to dynamically orchestrate power and unlock more compute capacity from existing energy infrastructure. For over a decade, we have applied AI to the electric grid — bringing real-time visibility and power‑flow control to complex energy infrastructure. Our Karman platform, built on a custom NVIDIA module, brings that same capability to AI data centers, giving operators a way to better use the power already available to them.

We are expanding our engineering team and looking for a Software Engineer to support the productionalization of our IoT platform, with a primary emphasis on the software that runs on edge IoT devices. This edge software includes machine learning, optimization algorithms, and components that host these capabilities that must meet high standards of performance, security, reliability, and accuracy. We are looking for candidates who are mission‑driven, collaborative, adaptive and experienced in designing, writing, testing, and debugging distributed enterprise software at scale. Ideal candidates will possess knowledge of Python, Linux, continuous integration and deployment (CI/CD), with direct experience designing and developing successful enterprise software.

Responsibilities

• Design, propose, plan, implement, and test resource‑constrained, edge software in Python (and possibly lower‑level languages, e.g., Rust) including the implementation of precision telemetry collection, real‑time control interfaces, and robust system observability
• Create and maintain CI/CD processes as necessary to support development and deployment with a focus on reproducibility, regression testing for embedded systems, and deployment in real‑world, intermittently connected environments
• Contribute to internal and external technical documentation
• Collaborate with a cross‑functional team of software, hardware, quality assurance (QA), and power systems engineers; data scientists; and leadership
• Provide high‑quality, in‑depth code and architecture reviews, implement new features, and provide technical leadership while coordinating with project management, QA, and other internal teams
• Continually advocate for and implement process improvement and automation
• Foster a culture of open communication, innovation, and continual improvement
• Mentor other engineers using paired programming, code review, and collaborative test scenario design

Minimum Qualifications

• 5+ years of professional experience including 3+ years of experience developing production software and systems, or a combination of educational and professional experience commensurate with this level of experience
• Demonstrated ability to design and implement distributed systems utilizing microservices in a resource‑constrained environment (edge devices with limited memory, CPUs, GPU capacity, etc.)
• Extensive experience using Python, C/C++, Rust, and the Linux operating system
• Experience with device layered security, i.e. encryption (PKI), disk partitioning, secure boot, os kernel libraries, device drivers, os processes/daemons
• Data compression and schema management for device time series data
• Experience implementing and maintaining CI/CD workflows (e.g., GitHub Actions or Jenkins)
• Strong understanding of synchronous and asynchronous network communication, including REST APIs, gRPC, binary protocols, and distributed publish/subscribe messaging systems and protocols like MQTT and ZeroMQ
• Strong written and oral communication skills, with a proven track record of working effectively both individually and as part of a team

Enhanced Qualifications (Nice to Have)

• Experience designing, building and deploying applications and reusable libraries based on the NVIDIA ML software stack on the Jetson Platform
• Experience with system integration testing including HIL and SIL
• Understanding of SQL/NoSQL Database implementations (SQLite, Redis, Postgres, etc)
• Well‑versed in Docker/containerization
• Hands‑on knowledge of cloud platforms and services focused on IoT device management, security and OTA updates (AWS, Azure) preferably in the scale of million devices including managing release/versioning strategies and monitoring fleet‑wide performance metrics
• Experience with control systems applications (e.g. industrial processes, manufacturing, commercial buildings, SCADA) and/or power systems
• Experience working with software and systems deployed in modern data center environments, including telemetry ingestion, rack‑level integration, and coordination with orchestration platforms
• Experience with Shell scripting, helm charts, ansible, and prometheus tools

Salary Range:

$120,000 to $150,000 base compensation depending on experience and stock options. Salary will be commensurate with an individual's skills, training, years of experience, and in line with internal compensation bands.

Location:

This position is based onsite at our company headquarters in Ann Arbor, Michigan, with flexibility for occasional remote work.

Our Commitments:

Karman values the diversity of our team. We provide equal employment opportunities without regard to race, color, religion, creed, sex, gender, sexual orientation, gender identity or expression, national origin, age, physical disability, mental disability, medical condition, pregnancy or childbirth, sexual orientation, genetics, genetic information, marital status, or status as a covered veteran or any other basis protected by applicable federal, state and local laws.

• Creating a diverse and inclusive workplace that is welcoming, supportive, affirming and respectful
• Empowering employees to solve problems and work together to make a difference
• Providing mentorship and growth opportunities as part of a collaborative team
• A flexible work environment with flexible paid time off
• Competitive compensation and benefits, including health, dental, vision, and employer‑match 401k