Senior Data Engineer

FOX Tech; Bengaluru; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

Fox Corporation is expanding its FOX Emerging Tech data platform team in Bengaluru to design and implement robust data ingestion, transformation, and processing frameworks. You will collaborate with product managers, data scientists, and engineers to translate business requirements into scalable data solutions.

The role emphasizes building batch and streaming pipelines, ensuring security and governance, and creating reliable data products for analytics and ML workloads.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field with 4+ years of experience building large-scale data engineering solutions and data platforms.
• Strong experience building data platforms using Databricks, Snowflake, or modern cloud-native data ecosystems.
• Hands-on expertise with Python, PySpark, SQL, and distributed data processing frameworks such as Apache Spark or Flink.
• Experience building both batch and streaming data pipelines using Kafka, Kinesis, Spark Structured Streaming, or equivalent.
• Strong understanding of dimensional modeling, data warehousing, and lakehouse architecture patterns.
• Experience with workflow orchestration platforms such as Airflow or Astronomer.
• Experience working with AWS services such as S3, Lambda, Glue, DynamoDB, Redshift, EMR, and related cloud technologies.

Responsibilities

• Design and Develop: Design robust data ingestion, transformation, and processing frameworks using Databricks, Spark, Kafka, Airflow, DBT, and cloud-native services. Build and optimize data models, lakehouse architectures, and data products that serve analytics, reporting, machine learning, and operational use cases.
• Collaboration: Partner closely with product managers, analysts, data scientists, and software engineers to understand business requirements and translate them into scalable data solutions.
• Security and Governance: Ensure all data systems adhere to security, privacy, and governance requirements. Implement best practices around access controls, encryption, data lineage, and compliance.
• Documentation and Quality: Create and maintain technical design documents, data flow diagrams, source-to-target mappings, and operational runbooks. Develop comprehensive testing strategies and automation to ensure reliability and correctness of data products.

Skills

Problem solving

Ownership & accountability

Analytical thinking

Communication

Education

Bachelor's or Master’s degree in Computer Science/Engineering

Tools

Databricks

Snowflake

Python

PySpark

SQL

Apache Spark

Flink

Kafka

Kinesis

Airflow

Astronomer

AWS S3

AWS Lambda

AWS Glue

DynamoDB

Redshift

EMR

Job description

OVERVIEW OF THE COMPANY

Fox Corporation Under the FOX banner, we produce and distribute content through some of the world's leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant content, while building an organization that thrives on creative ideas, operational expertise and strategic thinking.

JOB DESCRIPTION

About FOX Corporation:

FOX Corporation is a leader in the entertainment and media industry, delivering innovative content through our news, sports, and entertainment brands. With a dynamic portfolio that includes FOX News, FOX Sports, and the FOX Television Network, we reach millions of viewers across various platforms every day. At FOX, we aim to entertain, inform, and connect people around the globe, all while shaping the future of the media landscape.

About FOX Emerging Tech:

FOX Emerging Tech is at the forefront of technological innovation within FOX Corporation, driving the exploration and development of cutting-edge digital experiences. Our mission is to push the boundaries of traditional media and entertainment by leveraging advanced technologies such as blockchain, AI, machine learning, and immersive media. We seek to disrupt the way content is created, distributed, and consumed, always staying ahead of the curve to meet the ever-evolving demands of audiences worldwide.

Our team is dedicated to fostering creativity and building scalable solutions that empower FOX to thrive in a rapidly changing digital world. Whether it’s pioneering new platforms, enhancing user experiences, or creating tools for next-gen content, FOX Emerging Tech is shaping the future of entertainment.

About the job:

We believe in the future of entertainment – across all platforms and for all audiences.

FOX has always given unfettered access to the moments that have collectively captivated us. The breaking story. The unmissable final. The outrageous touchdown. The shocking cliffhanger. We changed the game on sports and news production. Now we’re looking to change the game again.

We are pioneering the future of news, sports and entertainment in the digital realm. It's an audacious mission. We're challenging ourselves to be the first to do it - to disrupt the digital entertainment category and redefine the live experience for the next generation. And we're doing it by starting from scratch.

Think of FOX as a start up with the backing of a fortune 500 corporation. You will be part of a new team with full permission to reinvent, disrupt, and build in a highly collaborative and transparent environment. FOX has always been an advocate for the disruptive spirit. And now we're looking for like-minded people for news-focused initiatives within the Emerging Technologies organization. This role helps extend and evolve digital products that support newsroom workflows, content discovery, and audience engagement.

A Snapshot Of Your Responsibilities

Design and Develop: Develop robust data ingestion, transformation, and processing frameworks using technologies such as Databricks, Spark, Kafka, Airflow, DBT, and cloud-native services. Build and optimize data models, lakehouse architectures, and data products that serve analytics, reporting, machine learning, and operational use cases.

Collaboration: Partner closely with product managers, analysts, data scientists, and software engineers to understand business requirements and translate them into scalable data solutions.

Security and Governance: Ensure all data systems adhere to security, privacy, and governance requirements. Implement best practices around access controls, encryption, data lineage, and compliance.

Documentation and Quality: Create and maintain technical design documents, data flow diagrams, source-to-target mappings, and operational runbooks. Develop comprehensive testing strategies and automation to ensure reliability and correctness of data products.

What You’ll Need:

Experience:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field with at least 4+ years of experience building large-scale data engineering solutions and data platforms.

Expertise:

• Strong experience building data platforms using Databricks, Snowflake, or modern cloud-native data ecosystems.
• Hands-on expertise with Python, PySpark, SQL, and distributed data processing frameworks such as Apache Spark or Flink.
• Experience building both batch and streaming data pipelines using technologies such as Kafka, Kinesis, Spark Structured Streaming, or equivalent.
• Strong understanding of dimensional modeling, data warehousing, and lakehouse architecture patterns.
• Experience with workflow orchestration platforms such as Airflow or Astronomer.
• Experience working with AWS services such as S3, Lambda, Glue, DynamoDB, Redshift, EMR, and related cloud technologies.

Problem Solving: Strong analytical and troubleshooting skills with the ability to identify bottlenecks, optimize performance, and solve complex data challenges at scale.

Design: Experience designing scalable, resilient, and observable data systems with a strong focus on reliability, performance, and maintainability.

Data and AI Enablement: Experience building data foundations that support advanced analytics, machine learning, and AI-driven applications. Exposure to modern data and AI platforms such as Databricks, MLflow, SageMaker, Vertex AI, or similar ecosystems is highly desirable.

Ownership and Accountability: Self-driven mindset with a strong sense of ownership. Ability to take initiatives from concept through production deployment and ongoing operational support.

Communication: Excellent communication and collaboration skills with the ability to work effectively across technical and non-technical stakeholders.

Good to Have

• Experience with containerization and orchestration technologies such as Docker and Kubernetes.
• Experience working with semi-structured or unstructured datasets and NoSQL databases.
• Experience building APIs and data services.
• Knowledge of data governance, cataloging, lineage, and metadata management solutions.
• Open-source contributions or active participation in the data engineering community.
• Interest in emerging technologies including AI, machine learning, and modern data platform architectures.

Learn more about Fox Tech at #foxtech

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, disability, protected veteran status, or any other characteristic protected by law. We will consider for employment qualified applicants with criminal histories consistent with applicable law.