Senior Data Engineer: Cloud Data Platforms & AI

401 Cast & Crew LLC; United States; Remote; USD 135,000 - 165,000; Full time

Benefits offered by this job

Medical

Dental

Vision

PTO

Wellness programs

Employee discounts

And more

Job summary

Cast & Crew is seeking an experienced Senior Data Engineer to design, build, and operate scalable data platforms that power analytics, reporting, and AI-driven solutions across the entertainment production ecosystem. This role focuses on cloud-native data pipelines that ingest, transform, secure, and serve operational data for internal engineering teams, BI, and customer-facing applications.

You will work with software engineers, platform engineers, product teams, and data consumers, leveraging

Qualifications

• Bachelor’s degree in CS/Engineering or related field.
• 5+ years building production data platforms and pipelines.
• Strong Python development experience.
• Strong SQL development and query optimization skills.
• Experience designing ETL/ELT pipelines.
• Experience with relational databases (PostgreSQL, MySQL, Aurora).
• Experience with NoSQL databases (DynamoDB, MongoDB).
• Experience building data lakes and cloud-native data architectures.
• Experience with cloud data warehouses (Snowflake/BigQuery/Redshift).
• Experience with AWS services including S3, Lambda, EventBridge, DynamoDB, ECS/EKS, and IAM.
• Experience building event-driven and streaming data solutions.
• Experience with Kafka, SNS/SQS, Kinesis.
• Experience with Airflow, Prefect, or Dagster.
• Experience with Git and CI/CD pipelines.

Responsibilities

• Design, build, and operate scalable data platforms and pipelines.
• Develop cloud-native data platforms for analytics, reporting, and AI workloads.
• Create reliable real-time data processing solutions and secure data integrations.
• Collaborate with software, platform, product teams and data consumers.
• Leverage AI-assisted development tools to accelerate delivery and improve productivity.

Skills

Python

SQL

ETL/ELT

PostgreSQL

NoSQL

Data Lakes

Cloud Data Warehouses

AWS

Kafka

Airflow

CI/CD

Data Modeling

DynamoDB

MongoDB

OpenSearch

Education

Bachelor’s degree in Computer Science/Engineering

Tools

Git

Azure DevOps

GitHub Actions

Job description

Cast & Crew is seeking an experienced Senior Data Engineer to design, build, and operate scalable data platforms that power analytics, reporting, and AI-driven solutions across the entertainment production ecosystem. This role focuses on cloud-native data pipelines that ingest, transform, secure, and serve operational data for internal engineering teams, BI, and customer-facing applications.

You will work with software engineers, platform engineers, product teams, and data consumers, leveraging