Member Technical Staff II (Data+Backend)

The Nielsen Company; India; On-site; INR 1,500,000 - 2,400,000; Full time

Job summary

The Nielsen Company in India is seeking a Senior Software Engineer to design, develop and maintain large-scale data platforms and metadata solutions.

You will collaborate with cross-functional teams and implement resilient data pipelines, while adopting GenAI tools to enhance capabilities and efficiency.

Qualifications

• Strong programming skills in Python, Java or Scala.
• Experience with distributed data systems (Spark or Flink).
• Experience designing RESTful APIs and backend patterns.
• Experience with one or more cloud platforms (AWS, Azure, GCP).
• Knowledge of data storage (HDFS, S3) and Lakehouse architectures.

Responsibilities

• Design, develop and maintain scalable and robust data pipelines and systems.
• Architect and implement solutions for managing & processing large-scale datasets with fast refresh cycles, ensuring high performance, scalability & accuracy.
• Write clean, maintainable & extensible code following best practices & standards.
• Conduct design and code reviews to ensure high-quality deliverables and adherence to best practices.
• Ensure robust data governance by implementing and maintaining frameworks for data lineage, quality, traceability and consistency across systems.
• Troubleshoot and resolve complex issues, ensuring reliability, availability, observability, minimal downtime and SLA compliance.
• Collaborate with cross-functional teams, including data scientists, engineers & product managers, to translate business requirements into technical solutions.
• Stay up-to-date with emerging technologies, including advancements in GenAI & leverage AI-driven tools, frameworks & LLMs to augment solutions & skill-sets.
• Mentor and guide junior engineers, fostering a culture of learning, innovation & continuous improvement within the team.

Skills

Python

Java

Scala

Algorithms

Data Processing

Stream Analytics

Event-driven Architectures

Spark

Flink

RESTful APIs

AWS

Azure

GCP

HDFS

S3

Parquet

Delta Lake

PostgreSQL

MySQL

MongoDB

Airflow

Docker

Kubernetes

CI/CD

Data Visualization

Agile

NoSQL

Education

Bachelor’s degree in Computer Science or Engineering

Master’s degree in Computer Science or Engineering

Tools

Docker

Kubernetes

CI/CD

Airflow

Spark

Flink

Job description

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content — wherever and whenever it's consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.

We are looking for a talented Senior Software Engineer with strong programming skills to join our dynamic team. If you are passionate about technology and eager to work on challenging projects, we want to hear from you!

Job Purpose

• Develop and enhance our flagship Video, Audio, Automotive and Sports metadata software solutions.
• Design applications with a Platform-first mentality where scale, consistency and reliability are at the core of every decision.

Job Description

As a Sr. Engineer, you will be responsible for designing, developing, and maintaining high-quality, large scale data platforms. You will collaborate with cross-functional teams to define, design, and ship new features, while also ensuring the performance, quality, and responsiveness of our data pipelines and applications.

Key Responsibilities

• Design, develop and maintain scalable and robust data pipelines and systems.
• Architect and implement solutions for managing & processing large-scale datasets with fast refresh cycles, ensuring high performance, scalability & accuracy.
• Write clean, maintainable & extensible code following best practices & standards.
• Conduct design and code reviews to ensure high-quality deliverables and adherence to best practices.
• Ensure robust data governance by implementing and maintaining frameworks for data lineage, quality, traceability and consistency across systems.
• Troubleshoot and resolve complex issues, ensuring reliability, availability, observability, minimal downtime and SLA compliance.
• Collaborate with cross-functional teams, including data scientists, engineers & product managers, to translate business requirements into technical solutions.
• Stay up-to-date with emerging technologies, including advancements in GenAI & leverage AI-driven tools, frameworks & LLMs to augment solutions & skill-sets.
• Mentor and guide junior engineers, fostering a culture of learning, innovation & continuous improvement within the team.

Skills and Expertise

• Advanced programming skills in Python, Java, or Scala, with strong understanding of algorithms, data processing, stream analytics and event-driven architectures.
• Experience in working with distributed data systems such as Spark or Flink.
• Proven experience in designing, building and maintaining scalable RESTful APIs and services, along with solid understanding of backend patterns and frameworks.
• Experience with one or more Cloud platforms (AWS, Azure, GCP).
• Deep understanding of distributed storage systems (HDFS, S3), modern file formats (Parquet, Arrow) and Lakehouse architectures (Delta Lake, Paimon)
• Knowledge of database systems, including NoSQL stores (Cassandra, MongoDB), relational databases (Postgres, MySQL) and data orchestration tools (Airflow).
• Expertise in designing, building and tuning systems for high throughput, low latency, resilient and cost-efficiency architectures.
• Working proficiency with Agile development methodologies and CI/CD practices.
• Familiarity with containerization (Docker, K8s) and Dataviz tools is good to have.

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 4 to 6 years of professional experience in Backend and Data Engineering, with hands-on expertise in managing large-scale datasets and real-time event processing.
• Excellent problem-solving skills, resourcefulness & creative thinking to work effectively in a dynamic and fast-paced environment.
• Adept at articulating complex technical concepts and solutions, ensuring clarity and alignment across diverse technical and non-technical audiences.