Senior Platform Engineer

CAI Cox Automotive Corp Svcs., LLC; Atlanta (GA); Hybrid; USD 101,500 - 169,100; Full time

Benefits offered by this job

Flexible vacation with pay

Health care insurance

Retirement planning (401(k))

Job summary

CAI Cox Automotive Corp Svcs., LLC is seeking a Senior Platform Engineer responsible for the technical implementation of the centralized Enterprise AI Integration Platform. This role involves designing, implementing, and optimizing the central AI Gateway with a focus on high concurrency and security.

Qualified candidates should have a Bachelor’s degree and at least 4 years of relevant experience, with strong skills in Python and AWS services. The position also offers comprehensive benefits, including healthcare, flexible vacation, and a supportive work environment.

Qualifications

• Bachelor’s degree in a related discipline and 4 years of experience in a related field.
• Python development experience (4+ years) with async/await patterns.
• Deep knowledge of AWS services including ECS and ElastiCache.

Responsibilities

• Design, implement, and optimize the central AI Gateway MCP server.
• Implement comprehensive automated testing: unit and integration testing.
• Build and maintain the full observability stack.

Skills

Python development

AWS services

Database integration

Container platform skills

REST API security

Observability experience

Education

Bachelor’s degree in a related discipline

Tools

Docker

FastAPI

Redis

Job description

Job Summary

Senior Platform Engineer – Responsible for the technical implementation of Cox Automotive’s centralized Enterprise AI Integration Platform, which provides secure, observable, and self‑service AI gateway functionality for enterprise systems.

Compensation: Base salary range of $101,500 – $169,100 per year, with potential incentive program.

What You’ll Do

• Design, implement, and optimize the central AI Gateway MCP server – the governed endpoint through which all AI client connections route, using FastAPI + Uvicorn for high‑concurrency workloads.
• Build and maintain the Redis ElastiCache session layer that binds Microsoft Entra identity to role‑resolved MCP tool sets, including token lifecycle management, sliding TTL extension, per‑user quota enforcement, and distributed rate limiting.
• Implement the on‑demand connector provisioning engine – a system that provisions compute containers with enterprise client drivers, establishes VPC‑internal network paths, and retrieves credentials from AWS Secrets Manager when an AI agent declares intent to access a data source.
• Build enterprise system connectors as MCP tool sets such as Oracle DB, SharePoint Graph API, Rally, ServiceNow, and a vendor connector approval pipeline with ECR container image scanning and an Aurora‑backed connector registry.
• Implement comprehensive automated testing: unit, integration, load testing (1,000+ concurrent users), and chaos testing for connector fault tolerance.
• Build and maintain the full observability stack – structured logging, Prometheus metrics, Kinesis Firehose to OpenSearch indexing, and Grafana dashboards for per‑user, per‑tool, per‑session audit trails.
• Design and implement CI/CD pipelines for all platform components via GitHub Actions, with automated container image builds, ECS task definition updates, and blue/green deployments.
• Own security controls: Entra OIDC token validation, PII masking on all tool responses, WAF rule management, Secrets Manager integration with autorotation, and OWASP‑aligned secure API design.
• Maintain and extend the existing Snowflake MCP codebase that forms the foundation of the platform, including session management, RBAC, PII masking, configuration management, and secrets integration modules.
• Develop troubleshooting and diagnostic tools for production support.
• Create documentation, runbooks, and operational playbooks for platform support and maintenance.

Qualifications

• Bachelor’s degree in a related discipline and 4 years of experience in a related field (or equivalent combinations of education and experience).
• Python development experience (4+ years) with async/await patterns, FastAPI, multiprocessing, and production performance optimization.
• Hands‑on implementation experience with Model Context Protocol (MCP) servers, tool definitions, and client integration patterns.
• Deep knowledge of AWS services including ECS Fargate, ElastiCache Redis, Secrets Manager, Route53, ALB, ECR, Aurora PostgreSQL, SSM Parameter Store, CloudWatch, and Kinesis Firehose.
• Microsoft Entra ID / Azure AD integration experience: OIDC federation, group membership extraction via Graph API or JWT claims, RBAC pattern implementation.
• Database integration and optimization expertise with Oracle, PostgreSQL, Snowflake, and SQLServer, including connection pooling, query optimization, and schema introspection.
• Distributed systems patterns such as circuit breakers, retry with exponential backoff, bulkhead isolation, Redis‑backed distributed state, and graceful degradation.
• Container platform skills: Docker multi‑stage builds, ECS task definitions, non‑root container security, health‑check endpoint implementation.
• REST API security knowledge: JWT validation, rate limiting, input validation, PII detection and masking.
• Observability experience: structured JSON logging, Prometheus client instrumentation, distributed tracing concepts, and CloudWatch Logs Insights.
• Version control and CI/CD experience with Git, GitHub Actions, and automated testing pipelines.

Preferred Experience

• High‑concurrency MCP server development supporting enterprise‑scale concurrent sessions.
• Snowflake advanced optimization: warehouse sizing, query profiling, result caching, role‑based access patterns.
• Infrastructure‑as‑code with Terraform for AWS resource provisioning.
• On‑demand infrastructure provisioning: Ephemeral container lifecycle, VPC‑internal networking, dynamic credential injection.
• Redis advanced patterns: sliding window rate limiting, distributed quota enforcement, pub/sub for session events.
• Enterprise compliance: audit logging design, data governance patterns, OWASP Top10 remediation.
• Experience working with AI/LLM platforms, agentic frameworks, or AI developer tooling.
• Familiarity with the MCP ecosystem: Anthropic Claude integration, MCP client patterns in Claude.ai, Claude Code, or Copilot Studio.
• Security best practices including OWASP guidelines and secure coding practices.
• DevOps experience including infrastructure automation and deployment strategies.

Other Requirements

• Applicants must pass a pre‑employment drug test. Cox is a drug‑free workplace; use of illegal drugs during work hours, on company property, or in company vehicles is prohibited.

Benefits

The Company offers eligible employees flexible vacation with pay, seven paid holidays per year, up to 160 hours of paid wellness annually, and additional leave options such as bereavement, voting, jury duty, volunteer, military, and parental leave. Health care insurance (medical, dental, vision), retirement planning (401(k)), and paid days off (sick leave, parental leave, flexible vacation/wellness days, and/or PTO) are also provided.

Equal Employment Opportunity

Cox is an Equal Employment Opportunity employer. All qualified applicants and employees will receive consideration for employment without regard to age, race, color, religion or creed, national origin, sex (including pregnancy), sexual orientation, gender identity, disability, veteran status, genetic information, ethnicity, citizenship, or any other characteristic protected by law. Cox provides reasonable accommodations when requested by a qualified applicant or employee with a disability, unless such accommodations would cause undue hardship. EOE, including disability/vets.