Engineer – Data Backend - Python

News Corporation; Gurgaon; Hybrid; INR 900,000 - 1,300,000; Full time

Benefits offered by this job

Hybrid work model

Meals provided on site

Flexible leave options

Insurance for you and your family

Job summary

News Corporation is seeking an Engineer with 2-3 years of backend/data engineering experience to join the CXAD team within the Experiences & Platforms portfolio. You will build and operate data pipelines and backend systems to enable analytics and personalised experiences.

You will work with large-scale datasets, collaborate with multiple stakeholders, and contribute to reliable, scalable data platforms. A hybrid work model and on-site meals are provided as part of our flexible benefits.

Qualifications

• 2-3 years of experience in backend, data engineering, or platform engineering environments.
• Strong programming skills in Python, with experience writing clean, maintainable, and well-tested code
• Strong SQL skills and an understanding of relational and analytical data concepts.
• Hands-on experience designing, developing, maintaining, or supporting data pipelines.
• Good understanding of software development principles, including version control, testing, debugging, and code reviews.

Responsibilities

• Develop, maintain, and enhance data pipelines using Python and SQL, ensuring they are reliable, scalable, and maintainable.
• Build and manage data workflows using technologies such as Airflow and other data engineering and orchestration platforms.
• Work with large-scale customer and behavioural datasets to transform and prepare data for consumption by downstream teams.
• Collaborate with analytics, machine learning, recommendations, product, and other stakeholder teams to understand their data requirements and deliver fit-for-purpose solutions.
• Write clean, maintainable, and well-tested code following engineering best practices and coding standards.
• Participate in code reviews, technical discussions, and team ceremonies, contributing to the continuous improvement of the team's engineering practices.
• Troubleshoot pipeline and production issues, identify root causes, and contribute to maintaining the reliability and operational stability of data platforms.
• Contribute to automation, tooling improvements, monitoring, and other initiatives that improve the reliability and efficiency of data pipelines.
• Learn and adopt new technologies and engineering practices while sharing knowledge and contributing to a collaborative team environment.

Skills

Python

SQL

Data pipelines

Backend engineering

Communication

Tools

Airflow

Kafka

Docker

Terraform

CI/CD

Job description

What the role is all about:

We are looking for an Engineer with 2-3 years of experience to join the CXAD team within the Experiences & Platforms portfolio. The team builds and operates data platforms and pipelines that enable teams across the business to better understand customer behaviour and deliver data-driven experiences.

As part of the CXAD team, you will work with large-scale customer and behavioural datasets and contribute to building reliable, scalable data pipelines and backend systems. The data and platforms we build support a wide range of use cases across the business, including analytics, machine learning, personalisation, recommendations, product insights, and reporting.

This is an opportunity to work on complex data engineering problems in a distributed team, collaborate with a wide range of stakeholders, and build systems that have a direct impact on how our products understand and serve our customers.

While no two days are likely to be the same, your typical responsibilities will include:

• Develop, maintain, and enhance data pipelines using Python and SQL, ensuring they are reliable, scalable, and maintainable.
• Build and manage data workflows using technologies such as Airflow and other data engineering and orchestration platforms.
• Work with large-scale customer and behavioural datasets to transform and prepare data for consumption by downstream teams.
• Collaborate with analytics, machine learning, recommendations, product, and other stakeholder teams to understand their data requirements and deliver fit-for-purpose solutions.
• Write clean, maintainable, and well-tested code following engineering best practices and coding standards.
• Participate in code reviews, technical discussions, and team ceremonies, contributing to the continuous improvement of the team's engineering practices.
• Troubleshoot pipeline and production issues, identify root causes, and contribute to maintaining the reliability and operational stability of data platforms.
• Contribute to automation, tooling improvements, monitoring, and other initiatives that improve the reliability and efficiency of data pipelines.
• Learn and adopt new technologies and engineering practices while sharing knowledge and contributing to a collaborative team environment.
• Who we're looking for:
• 2-3 years of experience working in backend, data engineering, or platform engineering environments.
• Strong programming skills in Python, with experience writing clean, maintainable, and well-tested code
• Strong SQL skills and an understanding of relational and analytical data concepts.
• Hands-on experience designing, developing, maintaining, or supporting data pipelines.
• Good understanding of software development principles, including version control, testing, debugging, and code reviews.
• Ability to understand and work with existing codebases, troubleshoot issues, and contribute to production systems.
• Understanding of data engineering concepts such as batch processing, ELT/ETL, data transformation, data quality, and data reliability.
• Ability to work collaboratively with engineers, data engineers, product teams, and business stakeholders.
• Good communication skills and the ability to explain technical concepts clearly.
• Ability to work collaboratively and autonomously in a fast-paced environment.
• Willingness to learn new and complex technologies and contribute to a culture of knowledge sharing and continuous improvement.

Bonus points for:

• Experience working with cloud platforms, particularly AWS and/or GCP.
• Experience building and integrating APIs using Python or any other programming language.
• Knowledge or hands-on experience with CI/CD practices and tools.
• Exposure to real-time or streaming data pipelines and technologies such as Kafka.
• Exposure to workflow orchestration tools such as Airflow.
• Experience with Docker and containerised applications.
• Exposure to Infrastructure as Code tools such as Terraform.
• Understanding of observability, monitoring, and operational practices for production systems.
• Experience working with open-source technologies and tooling.

What we offer:

• A hybrid and flexible approach to working.
• Transport options to help you get to and from work, including home pick-up and drop-off.
• Meals provided on site in our office.
• Flexible leave options including parental leave, family care leave and celebration leave.
• Insurances for you and your immediate family members.
• Programs to support mental, emotional, financial and physical health & wellbeing
• Continuous learning and development opportunities to further your technical expertise.

The values we live by:

Our values are at the core of how we operate, treat each other, and make decisions. We believe that how we work is equally important as what we do to achieve our goals. This commitment is at the heart of everything we do, from the way we interact with colleagues to the way we serve our customers and communities.

Our commitment to Diversity, Equity, and Inclusion: We are committed to providing a working environment that embraces and values diversity, equity and inclusion. We believe teams with diverse ideas and experiences are more creative, more effective and fuel disruptive thinking - be it cultural and ethnic backgrounds, gender identity, disability, age, sexual orientation, or any other identity or lived experience. We know diverse teams are critical to maintaining our success and driving new business opportunities. If you've got the skills, dedication and enthusiasm to learn but don't necessarily meet every single point on the job description, please still get in touch.