Principle Systems Engineer

Invisible Technologies is the AI training and scaling partner for the leading foundation model providers, enterprises, and governments, bridging the gap between AI potential and production. Invisible’s unique AI Process Platform combines elite global human expertise, cutting edge technology, and deep institutional knowledge gained by training 80% of the world’s leading AI models. Trusted by AWS, Microsoft, and Cohere, we have an unparalleled ability to operationalize AI for real-world applications. Our explosive growth landed us the #2 spot on the Inc. 5000 in 2024, closing the year on $134m revenue.

About The Role

We are seeking a highly experienced Principal Systems Engineer to join our dynamic engineering team. The ideal candidate will possess over 20 years of extensive low-level Linux systems expertise and at least 10 years of robust Python programming experience. The Senior Systems Engineer will be responsible for designing, developing, and maintaining sophisticated workflow systems, managing execution isolation through containerization, creating and optimizing runtime environments, and developing and integrating APIs. Additionally, the candidate should demonstrate exceptional skills in memory management, complex debugging, modular system architecture, and event-driven architectures.

What You’ll Do

• Design, implement, and maintain sophisticated workflow and event-driven systems
• Develop isolated execution environments using containers (Docker, Kubernetes)
• Create and optimize runtime environments for performance and reliability
• Architect, implement, and maintain modular systems and robust APIs (e.g., GraphQL subscriptions)
• Conduct complex debugging sessions and resolve challenging system-level issues
• Optimize memory management strategies to enhance system efficiency
• Utilize Autogen 0.4 extensively to automate and streamline engineering processes
• Design and implement enterprise software systems with an emphasis on security, operations, observability, and identity management
• Ensure rigorous security standards and compliance with enterprise security policies
• Integrate robust observability tools (logging, metrics, tracing) to enhance monitoring and troubleshooting capabilities
• Implement identity management solutions, including authentication, authorization, and access control
• Provide mentorship and technical leadership to junior engineers
• Collaborate closely with cross-functional teams, including product management and operations
• Establish and promote engineering best practices and coding standards

What We Need

• Minimum 20 years of (equivalent) experience in low-level Linux systems engineering
• At least 10 years of professional experience with Python programming
• Demonstrated mastery of workflow systems, event-driven architectures, and API development (e.g., GraphQL subscriptions)
• Extensive experience in memory management, debugging complex systems, and creating runtime environments
• Solid understanding and experience with modular software architecture
• Experience designing and managing enterprise software systems focused on security, operations, observability, and identity
• Experience with cloud platforms (AWS, Azure, GCP)
• Extensive proficiency with version control systems, particularly Git
• Strong ability to document designs, specifications, and implementation details
• Excellent communication skills, capable of clearly conveying complex technical concepts to technical and non-technical stakeholders

Nice to have

• Bachelor's degree in Computer Science, Engineering, or equivalent experience
• Experience leading engineering teams or projects
• Familiarity with continuous integration and continuous deployment (CI/CD) pipelines
• Certifications relevant to Linux, containerization, and cloud technologies
• Strong understanding of security best practices in systems engineering
• Exceptional analytical and problem-solving abilities
• Strong organizational and leadership skills
• Excellent interpersonal skills, including collaboration, negotiation, and conflict resolution
• Self-motivated, proactive, and capable of driving projects independently
• Profound understanding and practical experience with Autogen 0.4
• A desire to develop the most consequential AI software system of the future!

What’s In It For You

Compensation:

Invisible is committed to fair and competitive pay, ensuring that compensation reflects both market conditions and the value each team member brings. Our salary structure accounts for regional differences in cost of living while maintaining internal equity.

An Invisible Talent Acquisition Partner can provide more information on which locations are included in each of our geographic pay tiers during the interview process. For candidates outside the U.S., compensation will be adjusted to reflect local market conditions and cost-of-living differentials.

Bonuses and equity are included in offers above entry level. Final compensation is determined by a combination of factors, including location, job-related experience, skills, knowledge, internal pay equity, and overall market conditions. Because of this, every offer is unique. Additional details on total compensation and benefits will be discussed during the hiring process.

What It’s Like to Work at Invisible:

At Invisible, we’re not just redefining work—we’re reinventing it. We operate at the intersection of advanced AI and human ingenuity, pushing the boundaries of what’s possible to unlock productivity and scale. Ownership is at the core of everything we do. Here, you won’t just execute tasks—you’ll build, innovate, and shape the future alongside world-class clients pushing the boundaries of AI.

We expect bold ideas, relentless drive, and the ability to turn ambiguity into opportunity. The pace is fast, the challenges are big, and the growth is unmatched. We’re not for everyone, and we’re okay with that. If you’re looking for predictable routines, this isn’t the place for you. But if you’re driven to create, thrive in dynamic environments, and want a front-row seat to the AI revolution, you’ll fit right in.