Senior Data Infrastructure Engineer — Scale & Low Latency

Selby Jennings; Chicago (IL); On-site; USD 120,000 - 160,000; Full time

Job summary

Selby Jennings is assisting a high-performance trading technology firm in finding a Data Infrastructure Engineer. You will design, deploy, and scale storage platforms and data pipelines across the business, with focus on latency-sensitive workloads and data-intensive apps.

You will optimize Linux environments, automate infrastructure with Ansible or Puppet, and implement robust monitoring. Kubernetes and Kafka experience is essential for this role.

Qualifications

• 5+ years in infrastructure, systems, or platform engineering focused on storage.
• Strong Linux admin, troubleshooting, and performance tuning.
• Hands-on with infrastructure-as-code and CM tools (Ansible or Puppet).
• Knowledge of distributed storage and enterprise storage environments.
• Experience supporting large-scale data platforms and big data ecosystems.
• Programming or scripting in Python, Java, or similar.
• Familiarity with observability/monitoring solutions (Prometheus).
• Experience in automated engineering environments and AI-assisted tools.
• Exposure to Kubernetes.

Responsibilities

• Architect, deploy, and maintain large-scale storage platforms, including distributed storage systems, object storage environments and data lake environments.
• Optimize Linux systems for storage efficiency, throughput, and overall performance.
• Develop and enhance infrastructure automation using tools such as Ansible, Puppet, or similar frameworks.
• Implement monitoring, alerting, and observability solutions to improve platform reliability and operational visibility.
• Collaborate with software and platform engineering teams to deliver scalable data infrastructure solutions.
• Support and enhance data streaming and messaging technologies, including Kafka-based environments.
• Contribute to containerized infrastructure initiatives leveraging Kubernetes and related technologies.

Skills

Linux administration

Python/Java scripting

Infrastructure automation

Distributed storage knowledge

Big data platforms

Observability

Tools

Ansible

Puppet

Prometheus

Kafka

Kubernetes

Job description

Selby Jennings is assisting a high-performance trading technology firm in finding a Data Infrastructure Engineer. You will design, deploy, and scale storage platforms and data pipelines across the business, with focus on latency-sensitive workloads and data-intensive apps.

You will optimize Linux environments, automate infrastructure with Ansible or Puppet, and implement robust monitoring. Kubernetes and Kafka experience is essential for this role.