Senior Engineer, Data Engineering

News Corporation; India; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

News Corp India is seeking a Senior Data Engineer to design and optimize data platforms within the GCP ecosystem. You will work on a high-performance data warehouse, solving critical business problems rather than merely moving data.

The role focuses on ETL/ELT pipelines with PySpark on Dataproc, BigQuery optimization, and lakehouse governance using BigLake, Cloud Composer, and Terraform. Mentorship and cross-functional collaboration are essential.

Qualifications

• Senior Data Engineer with 4-6+ years hands-on data engineering experience.
• Strong GCP expertise focused on BigQuery, Dataproc, and data warehousing.
• Proficient in Python, SQL, and CI/CD; IaC mindset with Terraform.
• Solid data modeling knowledge (Star/Snowflake) and lakehouse governance.
• Experience in the News/Media domain is a plus.

Responsibilities

• Lead architecture and optimization for major data initiatives.
• Design scalable ETL/ELT pipelines in GCP using Cloud Composer and PySpark.
• Optimize BigQuery with partitioning, clustering, and materialized views.
• Implement BigLake governance bridging data lakes and warehouses.
• Drive automation from data ingestion to infra deployment using IaC and CI/CD.
• Mentor mid-level engineers and promote best coding and architectural practices.
• Collaborate with cross-functional teams to deliver high-performance data solutions.

Skills

Python

SQL

BigQuery

GCP

Airflow

Dataform

Terraform

CI/CD

Data Modeling

Mentorship

Tools

Dataproc

BigQuery

BigLake

PySpark

Cloud Composer

Airflow

Terraform

CircleCI

GitHub

Job description

Bangalore

Full time

Job Description :

Senior Data Engineer | Data Engineer News Corp India | Location: Bengaluru

About the Role

We are looking for a Senior Data Engineer (and Data Engineer) with excellent analytical abilities in the GCP Ecosystem. At News Corp India, our Data Warehouse is our primary product. You won't just move data; you will solve critical business problems by architecting high-performance, automated data environments. This isn't just about moving data from A to B. You’ll be expected to understand the "why" behind the data, solving complex business problems through efficient pipeline design and a "Thinking Data" mindset - where AI and advanced analytics are simply part of your standard toolkit.

The Technical Core

• Data Warehousing: Expert-level BigQuery (Partitioning, Clustering, Slot Management).
• Lakehouse Architecture: Implementing BigLake for unified governance.
• Distributed Processing: Processing large-scale datasets using PySpark on Dataproc.
• Orchestration & Code: Python, SQL, and Cloud Composer (Airflow).
• DevOps: Terraform (IaC), CircleCI, and GitHub. Key Responsibilities The Senior Data Engineer will be the technical lead for major initiatives, focusing on architecture, optimization, and setting best practices.
• Data Architecture & Design: Design and architect scalable, high-performance ETL/ELT pipelines in GCP using Cloud Composer and PySpark on Dataproc.
• Query & Cost Optimization: Lead the optimization of BigQuery performance—utilizing Partitioning, Clustering, Materialized Views, and slot management to drastically reduce latency and GCP costs.
• Lakehouse Governance: Implement and manage BigLake to bridge the gap between data lakes and warehouses, ensuring unified governance and security for structured and unstructured data.
• Advanced Automation & Infrastructure: Drive automation efforts from data ingestion to infrastructure deployment using Terraform (IaC) and CircleCI, ensuring modular, reproducible, and self-healing systems.
• Data Quality & Operations Leadership: Define and implement robust "Self-Healing" pipelines with sophisticated logging, alerting, and data quality checks to ensure the warehouse remains the ultimate "Source of Truth."
• Business Problem Solving: Collaborate closely with cross-functional teams and business stakeholders to translate complex requirements into high-performance data architectures and actionable solutions.
• Mentorship & Best Practices: Mentor mid-level engineers, review their designs, and champion best-in-class coding and architectural standards.
• Continuous Evolution: Stay ahead of the curve by proactively championing and implementing new GCP methods and tools to solve emerging data challenges.

Skills & Competencies

• Experience: Senior Level - 4 - 6+ years of hands-on Data Engineering experience.
• GCP Proficiency: Deep knowledge of GCP services with a focus on BigQuery, DataForm, Cloud Composer, Cloud Storage, Cloud functions and Dataproc.
• Transformation Tools: Proficiency in Dataform for managing version-controlled SQL workflows and modeling within BigQuery.
• Strong Coding: Excellent Python and SQL skills. You write modular code that is easy to test and maintain.
• Architectural Knowledge: Solid understanding of Data Modeling (Star Schema, Snowflake) and Data Operations.
• Automation Mindset: Expert experience with CI/CD tools and Infrastructure-as-Code is essential.
• Domain Knowledge: Experience in the News or Media industry is a strong plus.

Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status or any other protected characteristic.

Reasonable Accommodation

We are committed to providing reasonable accommodation for qualified individuals with disabilities in our job application and/or interview process. If you need assistance or accommodation in completing your application or participating in an interview due to a disability, email us at [e-mail] . Please put "Reasonable Accommodation" in the subject line and provide a brief description of the type of assistance you need. This inbox will not be monitored for application status updates.

Please refer to the privacy notice at the bottom of this page for submitting any data access, deletion, or other data subject rights requests, where permitted under your local laws and regulations.

News Corp (Nasdaq: NWS, NWSA; ASX: NWS, NWSLV) is a global, diversified media and information services company focused on creating and distributing authoritative and engaging content and other products and services. The company comprises businesses across a range of media, including: information services and news, digital real estate services and book publishing. Headquartered in New York, News Corp operates primarily in the United States, Australia and the United Kingdom, and its content and other products and services are distributed and consumed worldwide. More information is available at: http://newscorp.com.

If you are a current employee in Workday, please navigate to the Jobs Hub and select Browse Jobs to apply internally.