Data Engineer III

RX Global; Chennai District; On-site; INR 1,500,000 - 2,100,000; Full time

Benefits offered by this job

Health insurance

Flexible working arrangement

Paid time off

Job summary

RX Global in Chennai is seeking a data engineer to design and maintain scalable data pipelines using AWS, Python and SQL, with a strong focus on ETL/ELT workflows and data governance. You will collaborate with data scientists, analysts and BI teams in Agile sprints to improve performance in Athena/Databricks and deliver secure, scalable data solutions for large datasets.

The role also covers real-time streaming with Kinesis or Kafka, CI/CD pipelines, and IAM/ Lake Formation for robust data

Qualifications

• 3+ years in data engineering or software engineering with data focus.
• Proven delivery of production-grade data pipelines across multiple components.
• Experience translating business needs into scalable data solutions.
• Experience working in Agile, cross-functional teams.

Responsibilities

• Design and build ETL/ELT pipelines for ingestion, transformation and loading.
• Use AWS Glue, Lambda and Step Functions.
• Schedule and monitor workflows with Step Functions or Glue Workflows.
• Create CI/CD pipelines using CloudFormation, Terraform or CDK.

Skills

Python

SQL

Scala

AWS

Big Data

Education

Bachelor's Degree

Tools

CloudFormation

Terraform

CDK

Git

CI/CD

Job description

About the role:

This role focuses on building and maintaining scalable data pipelines and platforms using AWS, Python/SQL, and big data tools. It involves managing large datasets, optimizing ETL/ELT workflows, ensuring strong security and governance, and supporting real-time and batch data integration. The position requires hands‑on experience with AWS services, DevOps practices, and Agile collaboration, along with strong problem‑solving skills and the ability to translate business needs into reliable data solutions.

Responsibilities:

• Design and build ETL/ELT pipelines to ingest, transform, and load data.
• Use AWS services like Glue, Lambda and Step Functions.
• Schedule and monitor workflows using Step Functions or AWS Glue Workflows.
• Create CI/CD Pipelines based on CloudFormation, Terraform, or CDK.

Data Storage and Management

• Manage structured and unstructured data using services like:
• Amazon S3
• Amazon Glue Catalogue
• Amazon DynamoDB
• Amazon RDS or Aurora
• Amazon Redshift
• Ensure data partitioning, indexing, and lifecycle management.

Data Integration

• Integrate data from multiple sources (APIs, on‑prem databases, third‑party tools).
• Use AWS Glue, Kinesis, or Kafka for real‑time or batch data streaming.

Performance Optimization

• Tune ETL jobs and query performance on Athena or Databricks.
• Optimize storage formats (e.g., Parquet, ORC) for cost and speed.

Security & Compliance

• Implement data encryption, IAM roles, and access policies.
• Ensure compliance with data governance and privacy policies (GDPR).
• Use AWS Lake Formation and IAM for access control and auditing.

Monitoring & Maintenance

• Monitor pipeline health and performance using CloudWatch, CloudTrail, and custom dashboards.
• Set up alerts and logging for failures and anomalies.

Working with Data Scientists, Analysts, and BI teams to understand data needs.

Participate in Agile processes, sprint planning, and retrospectives.

Requirements:

• Typically, 3+ years of professional data engineering or software engineering experience with a strong data focus.
• Proven delivery of complex, production‑grade data pipelines and platforms across multiple components and domains.
• Experience translating ambiguous business and analytical requirements into scalable, governed data solutions.
• Experience working in Agile, cross‑functional teams with product, analytics, and data science partners.
• Bachelor’s Degree (Engineering/Computer Science preferred but not required); or equivalent experience required.
• AWS Services: S3, Glue, Redshift, Athena, EMR, Lambda, Cloud Formation, Kinesis, DynamoDB, SQS, SNS, Lake Formation
• Languages: Python, SQL, Scala
• Big Data Tools: Apache Spark, DataBricks, Hadoop, Kafka
• DevOps: Git, CI/CD, CloudFormation or Terraform
• Data Security: Strong experience
• AWS infrastructure: Familiarity with AWS VPC, EC2 Instances, Network policies, and Cloud Watch
• Experience operating very large data warehouses or data lakes.
• Strong Team Player.
• Security and governance-minded approach aligned to Secure SDLC and data protection practices.
• Ability to interface competently with other technical personnel or team members to finalize requirements.
• Ability to write and review portions of detailed specifications for the development of complex system components.
• Understanding of automation/other tools to increase efficiency.
• Strong problem solving and research skills.
• Ability to troubleshoot and resolve process inefficiencies (i.e. bugs) in the repository.
• Strong attention to detail.
• Strong oral and written communications skills.

Work in a way that works for you

We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long‑term goals.

Working for you

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

• Comprehensive Health Insurance: Covers you, your immediate family, and parents.
• Enhanced Health Insurance Options: Competitive rates negotiated by the company.
• Group Life Insurance: Ensuring financial security for your loved ones.
• Group Accident Insurance: Extra protection for accidental death and permanent disablement.
• Flexible Working Arrangement: Achieve a harmonious work‑life balance.
• Employee Assistance Program: Access support for personal and work‑related challenges.
• Medical Screening: Your well‑being is a top priority.
• Modern Family Benefits: Maternity, paternity, and adoption support.
• Long‑Service Awards: Recognizing dedication and commitment.
• New Baby Gift: Celebrating the joy of parenthood.
• Subsidized Meals in Chennai: Enjoy delicious meals at discounted rates.
• Various Paid Time Off: Take time off with Casual Leave, Sick Leave, Privilege Leave, Compassionate Leave, Special Sick Leave, and Gazetted Public Holidays.

About Business:

RX is a global leader in events and exhibitions, leveraging industry expertise, data, and technology to build businesses for individuals, communities, and organizations. With a presence in 25 countries across 41 industry sectors, RX hosts approximately 350 events annually. RX is committed to creating an inclusive work environment for all our people. RX empowers businesses to thrive by leveraging data‑driven insights and digital solutions. RX is part of RELX, a global provider of information‑based analytics and decision tools for professional and business customers. For more information, visit www.rxglobal.com.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.