Senior AI Engineer

Towards AI, Inc.; Atlanta (GA); On-site; USD 120,000 - 150,000; Full time

Job summary

Towards AI, Inc. in Atlanta, GA is seeking a Senior AI Engineer to design and operate enterprise AI systems across a diverse portfolio. The engineer will lead various workstreams independently and serve as a technical authority, mentoring junior engineers.

The ideal candidate has at least 7 years of experience with 3 years in modern AI systems, proficient in Python, Linux, and container management. Strong communication skills are essential for engaging with client stakeholders.

Qualifications

• At least 7 years of experience in software, data, or infrastructure engineering.
• 3 years of focused experience in modern AI and LLM systems.
• Hands-on experience with AI Factory platforms and inference stacks.

Responsibilities

• Design, build, and operate enterprise AI systems for clients.
• Lead workstreams and serve as a technical authority.
• Mentor junior engineers and communicate with stakeholders.

Skills

Prompt Engineering

ML Ops

AI Engineering

Cloud Infrastructure

Tools

Docker

Kubernetes

AWS

Azure

Job description

# Senior AI Engineer## BlueAllyPublished 13 Jun 2026### Share this jobAtlanta, GA, USAFull Time## Role Highlights### Languages usedPythonCUDASAML### Key skillsPrompt EngineeringML OpsVector DatabaseCICDIACAI EngineerLLMsCloudInfrastructureInferenceRAGDeploymentRegressionStorageMachine LearningLoggingSecurityTroubleShootingContainersTestingCPUFireWallsOperationsEconomicsRoutingSOCKernelOptimization### Tools, Libraries and FrameworksGCPIOSKubernetesRBACMetalFirmWareGPUsLinuxDockerGitOpsDNSHelmSSOLDAPTerraformAWSAzureRayADAnsible## DescriptionThe role involves designing, building, and operating enterprise AI systems across a diverse client portfolio. Responsibilities include working across the entire AI stack, from inference engines and platform infrastructure to application-level engineering. The engineer will lead workstreams independently and serve as a technical authority for clients. Additionally, the position requires mentoring junior engineers and contributing to the development of reusable patterns and reference architectures. The role also entails engaging directly with client stakeholders to communicate technical recommendations and status updates.## Required Qualifications and SkillsCandidates must possess at least 7 years of experience in software, data, or infrastructure engineering, including 3 years specifically focused on modern AI and LLM systems. Required technical proficiencies include production-level Python, deep Linux engineering, container management, and hardware fundamentals. Applicants must have hands-on experience with AI Factory platforms, inference stacks like vLLM, MLOps, and RAG application development. Strong client-facing communication skills and the ability to mentor junior staff are also necessary. No specific degree is explicitly mandated, though various professional certifications in Kubernetes, cloud platforms, Linux, and specific hardware vendors are preferred.