Data Platform Support Engineer

Viaprom Technologies; Mumbai; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Viaprom Technologies is seeking a skilled Data Platform Support Engineer with 3–5 years of experience to join our team in Mumbai. You will monitor and optimize data workflows built on Airflow, troubleshoot EMR/Redshift clusters, and develop Python scripts for automation.

Ideal candidates will have strong Python/SQL skills, hands-on Airflow experience, and exposure to BFSI data ecosystems. You will collaborate with multi-disciplinary teams, support on-call rotations, and contribute to platform

Qualifications

• 3–5 years of experience in data engineering or data platform support roles.
• Strong proficiency in Python and SQL.
• Hands-on experience with Apache Airflow, including DAG development and debugging.
• Experience with Amazon Redshift, AWS EMR, and other AWS services (S3, Lambda, CloudWatch).
• 3–5 years of BFSI domain experience, preferably supporting data platforms or production data environments.

Responsibilities

• Monitor and support data workflows built using Apache Airflow, troubleshooting DAG failures and performance issues.
• Troubleshoot and resolve issues in AWS EMR clusters and Redshift data warehouse environments.
• Write and optimize SQL queries.
• Develop and maintain Python scripts for automation and housekeeping.
• Perform hands-on troubleshooting across the data ecosystem, including compute, storage, and orchestration layers.
• Implement and maintain monitoring and alerting using AWS CloudWatch.
• Collaborate with cross-team engineers to ensure platform availability.
• Participate in on-call rotations and provide timely production support.
• Document processes, configurations, and troubleshooting steps for knowledge sharing.

Skills

Python

SQL

Apache Airflow

Amazon Redshift

AWS EMR

AWS CloudWatch

CI/CD

Git

Data pipelines

Tools

Terraform

Spark

Hive

Job description

• We are seeking a skilled and proactive Data Platform Support Engineer with 3 to 5 years of experience to join our team.
• This role is critical in ensuring the smooth operation, maintenance, and enhancement of our data infrastructure and workflows.
• The ideal candidate will have hands-on experience with Airflow, Redshift, EMR, Python, SQL, and AWS, and will be responsible for monitoring, troubleshooting, and optimizing the data ecosystem.The ideal candidate should have prior experience working in the Banking/Financial Services (BFSI) domain, with exposure to banking data platforms, applications, or financial data workflows.
• Key Responsibilities: Monitor and support data workflows built using Apache Airflow, including troubleshooting DAG failures and performance issues.
• Troubleshoot and resolve issues in AWS EMR clusters and Redshift data warehouse environments.
• Write and optimize SQL queries.
• Develop and maintain Python scripts for automation and housekeeping.
• Perform hands-on troubleshooting across the data ecosystem infrastructure, including compute, storage, and orchestration layers.
• Implement and maintain monitoring and alerting systems for data infrastructure such as Redshift, EMR, and Airflow using AWS cloud watch.
• Collaborate with engineers from cross teams to ensure platform availability.
• Participate in on-call rotations and provide timely support for production issues.
• Document processes, configurations, and troubleshooting steps for knowledge sharing.

Required Skills & Qualifications:

• 3-5 years of experience in data engineering or data platform support roles.
• Strong proficiency in Python and SQL.
• Hands-on experience with Apache Airflow, including DAG development and debugging.
• Experience with Amazon Redshift, AWS EMR, and other AWS services (e.g., S3, Lambda, CloudWatch).
• 3-5 years of experience in the Banking/Financial Services (BFSI) domain, preferably supporting data platforms, data engineering, or production data environments.
• Proven experience in platform monitoring and hands-on troubleshooting in cloud-based data environments.
• Excellent problem-solving and communication skills.
• Ability to work independently and collaboratively in a fast-paced environment.
• Experience with CI/CD tools and practices.
• Familiarity with version control systems like Git.

Preferred Qualifications:

• Familiarity with terraform.
• Exposure to big data technologies such as Spark or Hive.
• Keywords Apache Airflow, AWS, Amazon Redshift, AWS EMR, AWS CloudWatch, Data Engineering, Data Pipeline Support