Data Reliability Engineer III - India

CME Group; Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

Equal opportunity employer

Opportunities for career transformation

Job summary

CME Group, a leader in derivatives marketplaces, is looking for a Data Engineer/SRE in Bengaluru, India. This role focuses on designing and maintaining data infrastructure on Google Cloud Platform, ensuring reliability, performance, and security. Applicants should have over 5 years of experience in data engineering and a strong command of Python, GCP services, and tools like Docker and Kubernetes. Join CME Group to impact markets and transform industries.

Qualifications

• Bachelor’s or Master’s in Computer Science, Software Engineering, Data Science, or related field.
• 5+ years of experience in data engineering or data science, specific to GCP.
• Proven experience as a Data SRE or similar role focused on infrastructure management.

Responsibilities

• Design, build, secure, and maintain data infrastructure, including pipelines and warehouses.
• Implement monitoring and alerting systems to identify issues proactively.
• Optimize systems for performance, latency, and efficient processing.

Skills

Data engineering

Python

Cloud Computing (GCP)

Docker

Kubernetes

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

BigQuery

Dataflow

Cloud Storage

Relational databases

Kafka

Job description

Core Responsibilities

The core responsibilities focus on the reliability, automation, and performance of data systems on the Google Cloud Platform (GCP):

• Infrastructure & Automation: Design, build, secure, and maintain data infrastructure, including pipelines, warehouses, and processing platforms. This includes developing automation scripts to streamline operations and ensure scalability for growing data volumes.
• Monitoring & Incident Response: Implement robust monitoring and alerting systems to proactively identify issues. Respond to incidents promptly to minimize downtime and data loss.
• Quality & Optimization: Measure and monitor data quality. Optimize systems to reduce latency, improve performance, and ensure efficient processing.
• Collaboration: Work with data scientists, domain owners, and infrastructure teams to ensure effective data consumption, forecast growth, and plan capacity.
• Security & Compliance: Ensure data security and compliance with protection regulations by implementing access controls and encryption.
• Documentation: Maintain clear, up-to-date documentation for systems, configurations, and standard operating procedures.

Qualifications

Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, or a related field.

Experience

• 5+ years of experience in data engineering or data science on GCP.
• Proven experience as a Data SRE or similar role focused on infrastructure management.
• Solid understanding of SRE practices and software development best practices (Git, CI/CD).

Technical Proficiency

• GCP Services: BigQuery, Dataflow, Data Fusion, Dataproc, Cloud Composer, Pub/Sub, and Google Cloud Storage.
• Programming: Strong skills in Python (NumPy, Pandas, PySpark), Java (Spark, functional interfaces), or Scala.
• Data Tools: Relational databases, data warehousing, big data platforms, and data streaming (e.g., Kafka).
• Monitoring: Experience with Cloud Logging, ELK Stack, AppDynamics, New Relic, or Splunk.
• Google Associate Cloud Engineer or Data Engineer certification.
• Experience with Docker and Kubernetes.
• Knowledge of AI and ML tools.

Preferred Skills

• Experience in data engineering or data science on GCP.
• Proven experience as a Data SRE or similar role focused on infrastructure management.
• Solid understanding of SRE practices and software development best practices (Git, CI/CD).
• GCP Services: BigQuery, Dataflow, Data Fusion, Dataproc, Cloud Composer, Pub/Sub, and Google Cloud Storage.
• Programming: Strong skills in Python (NumPy, Pandas, PySpark), Java (Spark, functional interfaces), or Scala.
• Data Tools: Relational databases, data warehousing, big data platforms, and data streaming (e.g., Kafka).
• Monitoring: Experience with Cloud Logging, ELK Stack, AppDynamics, New Relic, or Splunk.
• Google Associate Cloud Engineer or Data Engineer certification.
• Experience with Docker and Kubernetes.
• Knowledge of AI and ML tools.

Company Overview

CME Group is the world’s leading derivatives marketplace. Here you can impact markets worldwide, transform industries, and shape tomorrow’s career.

Equal Opportunity Employer

At CME Group, we embrace our employees' unique experiences and skills to ensure that everyone’s perspectives are acknowledged and valued. As an equal‑opportunity employer, we consider all potential employees without regard to any protected characteristic.