Platform Engineer IV

Compunnel, Inc.; Greenwood Village (CO); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

AWS Certifications (SolutionsArchitect

DevOps Engineer or similar

Job summary

Compunnel, Inc. is seeking a Platform Engineer IV to design, build, and maintain AWS infrastructure for a data lake and AI agent runtimes. You will manage CI/CD pipelines, automation, and security across production environments, enabling scalable data science workloads.

Strong AWS, Terraform/CloudFormation, Python, and Docker skills are required. The role emphasizes cross-team coordination, secure data flow, and reliable orchestration of agent deployments with Grafana/Prometheus monitoring and

Qualifications

• Bachelor's degree in CS/IT/SE or equivalent practical experience.
• 5+ years of platform or infrastructure engineering with a bachelor’s, or 3+ years with a master’s degree.
• Experience working across teams and coordinating with external platform owners on connectivity and access requirements.
• Strong knowledge of AWS services (EC2, S3, IAM, VPC, Glue, Athena, EMR) and infrastructure as code (Terraform, CloudFormation).
• Proficiency in Python, Linux, containerization (Docker), and CI/CD tooling (GitLab).

Responsibilities

• Design and manage AWS infrastructure for data lake and AI runtime environments.
• Build and maintain CI/CD pipelines and instrument monitoring.
• Implement IaC and automation to ensure scalable, secure production environments.
• Coordinate cross-account connectivity and security groups for secure data flow.
• Develop and maintain integration code with upstream data providers and downstream consumers.
• Maintain production readiness with monitoring, alerting, and incident response.

Skills

Strong communication skills

Linux and shell scripting

Python programming

Git-based workflows

Cross-team collaboration

Security and compliance awareness

Education

Bachelor's degree in Computer Science, Information Technology, Systems Engineering, or related field

Master's degree with 3+ years of experience

Tools

AWS EC2

S3

IAM

VPC

Glue

Athena

EMR

Terraform

CloudFormation

Docker

LangSmith Deployments

Grafana/Prometheus

Kafka/SNS/SQS/EventBridge

REST APIs / boto3

Job description

Job Summary

Client's Infrastructure Intelligence and Analytics (IIA) team builds and operates the data platform and AI agent infrastructure that supports proactive network monitoring and autonomous investigation for network operations. The Platform Engineer IV designs, builds, and maintains AWS infrastructure supporting the IIA Data Lake, AI agent runtime environments, CI/CD pipelines, and graph database systems. The role also develops application code, automation, and internal tooling to ensure production environments remain stable, scalable, and secure while enabling data science and agentic AI workloads to operate reliably at scale.

Key Responsibilities

• Design and manage AWS infrastructure for the IIA Data Lake, including S3 storage, Glue Data Catalog, Athena query engine, and EMR compute clusters.
• Manage cross-account connectivity, VPC networking, security groups, and IAM roles and policies to enable secure data flow between IIA, upstream data providers, and downstream consumers.
• Build and maintain infrastructure for AI agent runtime environments, including compute resources for LangGraph agents deployed through LangSmith Deployments.
• Design and implement event-driven infrastructure, including triggers, message queues, and pub/sub frameworks that orchestrate agent execution and data pipeline workflows.
• Support the deployment and operation of AWS Neptune for the network topology graph, including capacity planning, schema design support, and performance tuning.
• Implement and manage Infrastructure as Code using Terraform and CloudFormation for repeatable and auditable environment provisioning.
• Manage IAM access key rotations, secrets management using AWS Secrets Manager and Delinea, and security compliance for on-premises and cloud integrations.
• Build and maintain CI/CD pipelines for AI agent deployments using GitLab CI/CD, Docker, and Artifactory.
• Manage container lifecycles for agents deployed through LangSmith Deployments, including image builds, versioning, and rollback procedures.
• Automate deployment workflows to enable reliable promotion of agents from development through production.
• Coordinate with platform teams on AI Gateway integration, cross-account deployment, and connectivity requirements.
• Support and maintain existing ETL pipelines written in Scala and Spark, including troubleshooting, enhancements, and onboarding of new data sources.
• Develop and maintain scripts, CLIs, small services, and automation utilities primarily using Python to support data ingestion, deployment, environment provisioning, and operational workflows.
• Develop integration code and services connecting IIA systems with upstream data providers, downstream consumers, and external platforms.
• Ensure production environment stability through monitoring, alerting, and incident response while maintaining SLAs for data pipeline availability and agent uptime.
• Implement production monitoring and alerting for deployed agents, including health checks, error rates, latency, and resource utilization.
• Coordinate with data, platform, cloud, and security teams on connectivity, firewall requests, and integration requirements.
• Support infrastructure needs for onboarding new data sources, including storage provisioning, access controls, pipeline compute, and scheduler maintenance.
• Support workflow orchestration using Airflow and event-driven triggers.
• Perform other duties as required.

Required Qualifications

• Strong communication skills with the ability to explain infrastructure decisions to non-infrastructure stakeholders.
• Expert-level experience with AWS services including EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets Manager, and CloudWatch.
• Strong experience with Infrastructure as Code, with Terraform preferred and CloudFormation acceptable.
• Experience managing cross-account AWS architectures, VPC peering, PrivateLink, and Transit Gateway configurations.
• Experience with IAM policy design, least-privilege access patterns, and service account management.
• Experience with Docker and container orchestration.
• Experience with CI/CD pipelines, preferably GitLab CI.
• Experience with event-driven architectures and messaging systems such as Kafka, SNS/SQS, and EventBridge.
• Proficiency with Linux-based operating systems and shell scripting.
• Experience with monitoring and alerting tools such as CloudWatch, Prometheus, Grafana, or similar platforms.
• Understanding of networking fundamentals including DNS, CIDR, NAT, VPC endpoints, firewalls, and security groups.
• Demonstrated ability to work across teams and coordinate with external platform owners on connectivity and access requirements.
• Proficiency in Python or a comparable general-purpose programming language for building automation, tooling, and applications.
• Strong software engineering fundamentals including Git-based workflows, code reviews, modular and reusable design, dependency management, and maintainable documentation.
• Experience writing automated unit and integration tests for application and infrastructure code and integrating those tests into CI/CD.
• Ability to write integration code against REST APIs and cloud SDKs such as AWS SDK/boto3.
• Bachelor's degree in Computer Science, Information Technology, Systems Engineering, or a related field, or relevant experience.
• With a bachelor's degree, 5+ years of platform or infrastructure engineering experience.
• With a master's degree, 3+ years of platform or infrastructure engineering experience.

Preferred Qualifications

• Experience with graph databases such as AWS Neptune or Neo4j, including deployment, scaling, and operational management.
• Experience with Apache Kafka or similar streaming platforms.
• Experience with Apache Spark, preferably Scala, for distributed and streaming data processing such as Spark Streaming or Structured Streaming.
• Experience with Airflow or similar workflow orchestration platforms.
• Experience in telecommunications or large-scale network operations environments.
• Familiarity with AI/ML infrastructure requirements, including model serving, GPU/CPU compute, and artifact management using MLflow or similar platforms.
• Experience with Splunk integration, particularly Edge Processor and MCP connectivity.
• Experience developing and operating small services or APIs such as FastAPI or Flask in production environments.

Certifications

• AWS certifications such as Solutions Architect, DevOps Engineer, or similar.