Sr Data Operations Specialist

Apexon; Bengaluru; On-site; INR 1,500,000 - 3,000,000; Full time

Job summary

Apexon is seeking a Senior Data Operations Engineer with 8+ years of hands-on operational support to own and maintain batch jobs on our data engineering pipelines. This role ensures operational stability of data platforms across domains, enabling reliable delivery and rapid incident resolution.

You will monitor batch executions, participate in on-call rotations, drive incident management, and optimize performance across ETL/ELT pipelines, AWS Glue, S3, RDS, and Hadoop ecosystems.

Qualifications

• 8+ years of experience in data operations/production support roles.
• Strong understanding of ETL/ELT design, processing, and troubleshooting.
• Proficiency in Python and Java for pipeline support and automation.
• Deep experience with AWS services, particularly AWS Glue (jobs, crawlers, catalogs), S3 (data lake tables), and RDS databases.
• Cloudera Hadoop ecosystem: HDFS, Impala, and related components.

Responsibilities

• Monitor and support batch job execution across data engineering pipelines; proactively identify and resolve failures before they impact business operations.
• Participate in on-call rotation schedules, providing timely response to production incidents.
• Own and drive incident management, change ticket, and problem management processes following ITIL best practices.
• Proactively monitor ticket queues and address assigned items immediately, ensuring SLAs are met.
• Support administration activities across data platforms, including Tomcat application servers and related infrastructure.

Skills

Python

Java

ETL/ELT design

AWS services

Apache Spark

Tools

Informatica PowerCenter

Informatica BDM

AWS Glue

S3

RDS

HDFS

Impala

Job description

We are seeking a Senior Data Operations Engineer with 8+ years of hands-on operational support experience to own and maintain batch jobs on our data engineering pipelines. This role owns operational stability of data platforms supporting Tech domains and applications, ensuring reliable delivery, rapid incident resolution, and continuous performance improvement across the data ecosystem.

Key Responsibilities

Operations & Support

• Monitor and support batch job execution across data engineering pipelines; proactively identify and resolve failures before they impact business operations.
• Participate in on-call rotation schedules, providing timely response to production incidents.
• Own and drive incident management, change ticket, and problem management processes following ITIL best practices.
• Proactively monitor ticket queues and address assigned items immediately, ensuring SLAs are met.
• Support administration activities across data platforms, including Tomcat application servers and related infrastructure.

Technical Ownership

• Develop, troubleshoot, and optimize Python and Java code supporting batch and pipeline operations.
• Identify and resolve performance bottlenecks; implement code and query optimizations for operational efficiency.
• Support and maintain ETL/ELT data pipelines with deep understanding of data extraction, transformation, loading, and processing patterns end to end.
• Manage and troubleshoot AWS Glue jobs, crawlers, and workflows supporting pipeline orchestration.
• Support data storage and database layers including S3 (data lake tables), RDS databases, and query/performance tuning.
• Support Oracle databases and OLTP systems, including query tuning and operational troubleshooting.
• Administer and support Cloudera Hadoop ecosystem components including HDFS and Impala for distributed data storage and querying.
• Work with Apache Spark for large-scale batch and distributed data processing troubleshooting and tuning.
• Maintain and support BI tools, including Tableau and Power BI, for downstream reporting and analytics consumers.
• Manage code libraries and dependencies, ensuring version currency and compatibility.

Governance, Quality & Security

• Serve as gate reviewer for code being promoted to production, validating operational readiness and adherence to standards before release.
• Ensure developers complete required operational validations (testing, documentation, rollback plans) prior to deployment.
• Work within Git repositories, review pull requests, and enforce branching/merge standards for operational code changes.
• Identify, track, and remediate security vulnerabilities in a timely manner in coordination with security teams.
• Support end-to-end product lifecycle management, including deprecation, upgrades, and decommissioning of applications and pipelines.

Domain & Business Knowledge

• Develop deep understanding of Tech domain applications and business processes to inform troubleshooting and support decisions.
• Partner with business and SME stakeholders to translate operational issues into actionable fixes.

Required Skills & Qualifications

• 8+ years of experience in data operations/production support roles.
• Strong understanding of ETL/ELT design, processing, and troubleshooting.
• Informatica PowerCenter and/or Informatica BDM skills.
• Proficiency in Python and Java for pipeline support and automation.
• Strong hands-on experience with AWS services, particularly AWS Glue (jobs, crawlers, catalogs), S3 (data lake table structures), and RDS databases.
• Deep experience with Cloudera Hadoop ecosystem: HDFS, Impala, and related components.