Senior Data Platform Engineer Big Data Warehousing

Fox Corporation; Los Angeles (CA); Hybrid; USD 184,000 - 202,000; Full time

Benefits offered by this job

Medical/dental/vision

401(k) plan

Paid time off

Other benefits

Job summary

Fox Corporation seeks a Senior Data Engineer within the Data Platforms team to build robust data engineering solutions, pipelines and analytics-ready data for BI across Fox brands. You will design, implement and optimize data pipelines, ensure data quality and security, and collaborate with cross-functional teams in a fast-paced environment.

Telecommuting is permitted up to 25% per week within normal commuting distance of Los Angeles, CA.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, Data Science, Mathematics, Statistics, Engineering or related field.
• At least five years of progressive data engineering experience with Python and PySpark.
• Experience building Lakehouse or batch/streaming pipelines in Databricks.

Responsibilities

• Collaborate with Agile teams to design and develop data engineering solutions.
• Build distributed, low-latency data pipelines with high availability.
• Develop optimized data engineering solutions for Big Data workloads.
• Create real-time data ingestion solutions for streaming workloads.
• Ensure data quality and monitor production data for accuracy and accessibility.
• Document design specs, data flows and test plans; perform troubleshooting.
• Automate end-to-end data pipelines and validations; implement security controls.
• Collaborate with analytics and business teams to improve data models for BI.

Skills

Python

PySpark

Snowflake

Fivetran

dbt

Kafka

Kinesis

Spark

Hadoop

Flink

Airflow

AWS S3

AWS EC2

AWS EMR

AWS Lambda

AWS RDS

AWS Redshift

AWS Glue

Education

Bachelor’s degree in Computer Science/Engineering/Data Science/Math/Statistics

Tools

Databricks

Job description

Fox Corporation seeks a Senior Data Engineer within the Data Platforms team to build robust data engineering solutions, pipelines and analytics-ready data for BI across Fox brands. You will design, implement and optimize data pipelines, ensure data quality and security, and collaborate with cross-functional teams in a fast-paced environment.

Telecommuting is permitted up to 25% per week within normal commuting distance of Los Angeles, CA.