Senior Data Engineer - Scalable Cloud Data Platforms

Cast & Crew; United States; Remote; USD 135,000 - 165,000; Full time

Benefits offered by this job

Medical

Dental

Vision

PTO

Health and wellness programs

Employee discounts

Job summary

Cast & Crew is seeking an experienced Senior Data Engineer to design, build, and operate scalable data platforms that power analytics, reporting, and AI‑driven solutions across the entertainment production ecosystem.

This role focuses on building reliable, cloud‑native data pipelines that ingest, transform, secure, and serve operational data for internal engineering teams, business intelligence, and customer‑facing applications.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or related field.
• 5+ years of experience building production data platforms and pipelines.
• Strong Python development experience.
• Strong SQL development and query optimization skills.
• Experience designing and maintaining ETL/ELT pipelines.
• Experience with relational databases (PostgreSQL, MySQL, Aurora).
• Experience with NoSQL databases (DynamoDB, MongoDB, document databases).
• Experience building data lakes and cloud-native data architectures.
• Experience with cloud data warehouses (Snowflake, BigQuery, Redshift).
• Experience with AWS services (S3, Lambda, ECS/EKS, IAM).
• Experience with streaming data and message systems (Kafka, Kinesis, SNS/SQS).
• Experience with Airflow, Prefect, or Dagster for orchestration.
• Experience with CI/CD pipelines (Azure DevOps, GitHub Actions).
• Experience building highly available, scalable production systems.
• Strong understanding of data modeling, partitioning, indexing, and performance optimization.

Responsibilities

• Design, build, and operate scalable data platforms and pipelines.
• Develop cloud-native data architectures for analytics and AI workloads.
• Ingest, transform, secure, and serve operational data for internal teams.
• Collaborate with software engineers, platform teams, and data consumers.

Skills

Python

SQL

ETL/ELT pipelines

Data modeling

Data pipelines

AWS

Kafka

Airflow

Git

CI/CD

Education

Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or related field

Tools

Airflow

Git

Dagster

Snowflake

BigQuery

Redshift

Job description

Cast & Crew is seeking an experienced Senior Data Engineer to design, build, and operate scalable data platforms that power analytics, reporting, and AI‑driven solutions across the entertainment production ecosystem.

This role focuses on building reliable, cloud‑native data pipelines that ingest, transform, secure, and serve operational data for internal engineering teams, business intelligence, and customer‑facing applications.