Senior Member Technical Staff

Nielsen Holdings Plc; India; On-site; INR 2,400,000 - 3,400,000; Full time

Job summary

Nielsen Holdings Plc is seeking an experienced Senior Data Engineer to lead the architecture and delivery of high-throughput data ingestion systems in a cloud environment. You will guide a team of engineers, own end-to-end development, and ensure scalable ETL pipelines using Java and Python.

Ideal candidates have 7–8 years of software engineering experience, strong streaming data expertise with Spark, Kafka, and AWS services, and excellent communication skills to collaborate with product

Qualifications

• 7 to 8 years of professional software engineering experience, with at least 1–2 years in a leadership, lead, or architectural capacity.
• Proven track record of building and scaling high-volume data ingestion or streaming platforms.
• Strong problem-solving skills with a deep understanding of system design, data structures, and algorithms.
• Excellent communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholders.

Responsibilities

• Lead the technical design, architecture, and implementation of high-throughput data ingestion systems and ETL pipelines.
• Guide, mentor, and elevate a team of Engineers, fostering a culture of technical excellence and best practices.
• Write clean, scalable, and maintainable code primarily in Java and Python.
• Monitor and resolve performance issues related to memory, CPU, data transfer, and queue processing.
• Partner with product managers and scrum masters to drive Agile/Scrum ceremonies, sprint planning, and timely delivery of features.
• Oversee the full software development lifecycle from design to deployment and infrastructure management.

Skills

Java

Python

Apache Spark

ETL pipelines

Kubernetes

Docker

AWS

SQL

Education

Bachelor's degree in Computer Science or related field

Tools

Kafka

SQS

Job description

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.

Job Description

Job Location: Bangalore/Mumbai

Key Responsibilities

• Technical Leadership: Lead the technical design, architecture, and implementation of high-throughput data ingestion systems and ETL pipelines.
• Team Mentorship: Guide, mentor, and elevate a team of Engineers, fostering a culture of technical excellence and best practices.
• Hands-on Development: Write clean, scalable, and maintainable code primarily in Java and Python.
• Performance Optimization: Proactively monitor and resolve complex issues related to high memory and CPU consumption, bottlenecks in data transfer, and queue processing.
• Agile Delivery: Partner with product managers and scrum masters to drive Agile/Scrum ceremonies, sprint planning, and timely delivery of features.
• End-to-End Ownership: Oversee the full software development lifecycle, from system design and data formatting/analytics to deployment and infrastructure management.

Technical Requirements

Core Backend & Data Engineering

• Languages: Expert-level proficiency in Java and Python.

Data & Big Data

• Deep understanding of Apache Spark, ETL pipeline design, data formatting, and data analytics.

Databases

• Strong hands-on experience with both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, MongoDB, Cassandra) databases.

Messaging/Queues

• Proven experience working with message brokers and queues (e.g., Kafka, AWS SQS, RabbitMQ) to manage asynchronous data transfer.

Cloud Platform

• Extensive experience with AWS cloud services (e.g., S3, EC2, EMR, Lambda, RDS).

DevOps & CI/CD

• Hands-on experience setting up and managing deployment pipelines using GitLab or Jenkins.

Containerization

• Solid understanding and experience deploying applications using Kubernetes (K8s) and Docker.

Infrastructure as Code (IaC)

• Familiarity with IaC tools (e.g., Terraform, AWS CloudFormation) to provision cloud resources.

Additional Skills

• Methodology: Strong practical experience working within and leading Scrum/Agile environments.

Qualifications

• 7 to 8 years of professional software engineering experience, with at least 1–2 years in a leadership, lead, or architectural capacity.
• Proven track record of building and scaling high-volume data ingestion or streaming platforms.
• Strong problem-solving skills with a deep understanding of system design, data structures, and algorithms.
• Excellent communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholders.