Senior Data Engineer

Brooksource; United States; Remote; USD 96,000 - 117,000; Full time

Job summary

Brooksource is seeking a Senior Data Engineer for a remote in the US, focusing on a new two-project data initiative across a core Data Layer and Release Hub. You will shape data architecture, normalize and transform data from ~10 sources, and enable long-term retention for forecasting and analytics.

The role requires hands-on AWS experience, streaming/CDCs, and proficiency in Java or Python. Expect collaboration with CRM platforms like Salesforce and a push toward scalable, maintainable

Qualifications

• Must have hands-on experience with AWS as primary environment.
• Experience with streaming and change-data-capture tools (Kafka, Flink, Debezium).
• Proficiency with SQL Server, MySQL, Postgres or similar databases.
• Experience with lakehouse architecture and tools (Iceberg, AWS Glue, Lake Formation).
• Familiarity with DuckDB or similar analytical querying tools.
• Experience with Terraform for infrastructure as code.
• Experience with GitHub Actions or similar CI/CD tools.
• Proficiency in Java or Python for data application development.
• Experience designing data normalization and transformation logic across multiple sources.
• Ability to design for long-term data retention and support analytics/forecasting.

Responsibilities

• Design and evolve data architecture supporting real-time and batch data movement, primarily within AWS.
• Build normalization and transformation pipelines from ~10 sources while preserving raw data.
• Implement and manage streaming and batch data ingestion using Kafka, Flink, Debezium.
• Write and maintain infrastructure as code for pipeline components using Terraform.
• Work with streaming tech to move data in near real-time and batch exports.
• Collaborate with stakeholders to define data retention for historical analysis.
• Advise on architecture decisions across overlapping projects for reuse and efficiency.
• Collaborate with CRM teams on data integration points (Salesforce).
• Contribute to an inclusive and diverse team culture.

Skills

AWS

Kafka

Flink

Debezium

Java

Python

SQL

CI/CD

Terraform

GitHub Actions

Education

Bachelor's degree in Computer Science

Tools

Iceberg

AWS Glue

Lake Formation

Salesforce

Terraform

Job description

Senior Data Engineer

Remote (Eastern or Central time zone preferred)

Contract (Remote)

Compensation: $70 - $85 per hour

ABOUT THE ROLE

Join a leading Media & Entertainment organization as a Senior Data Engineer, where you will play a pivotal role in a newly forming data engineering initiative spanning two major projects: a core Data Layer platform and Release Hub. These systems ingest performance data from approximately 10 external sources and distribute it to internal storage, cloud analytics platforms, and CRM environments. You will help shape the data architecture, own normalization and transformation logic across sources, and design for long-term data retention to support historical analysis and forecasting. This is an opportunity to influence core data architecture decisions, work with large-scale datasets, and contribute to a diverse and inclusive work culture in a fast-paced environment.

WHAT YOU'LL DO

• Design and evolve data architecture supporting both real-time and batch data movement, primarily within AWS.
• Build normalization and transformation pipelines that reconcile data from approximately 10 different sources while preserving raw data.
• Implement and manage streaming and batch data ingestion using technologies such as Kafka, Flink, and Debezium.
• Write and maintain infrastructure as code for pipeline components using tools like Terraform.
• Work with streaming technologies to move data in near real-time, alongside batch/export-based ingestion.
• Partner with engineering and business stakeholders to define how retained data supports historical analysis and forecasting.
• Advise on architecture decisions where multiple related projects' infrastructure overlaps, maximizing reuse and efficiency.
• Collaborate with CRM-focused business solutions teams on data integration points, including platforms like Salesforce.
• Contribute to a diverse, equitable, and inclusive work culture.

WHAT YOU BRING

• Strong hands-on experience with AWS as the primary environment for day-to-day work.
• Experience with streaming and change-data-capture tools (e.g., Kafka, Flink, Debezium).
• Proficiency working with various source databases (SQL Server, MySQL, Postgres).
• Experience with lakehouse architecture and tools (Iceberg, AWS Glue, Lake Formation).
• Familiarity with DuckDB or similar analytical querying tools.
• Experience with Terraform for infrastructure as code.
• Experience with GitHub Actions or similar CI/CD tools.
• Proficiency in Java or Python for data application development.
• Experience designing data normalization and transformation logic across multiple disparate data sources.
• Ability to design for long-term data retention and support downstream analytics/forecasting use cases.
• Exposure to integrating with CRM platforms (e.g., Salesforce) as a data source or destination is a plus.
• Strong analytical and problem-solving skills with exceptional attention to detail.
• Excellent verbal and written communication skills.

WHAT'S IN IT FOR YOU

• Work for a globally recognized leader in Media & Entertainment.
• Ownership of core data architecture decisions within a newly forming data engineering initiative.
• Direct influence over how data is structured, retained, and delivered across multiple projects.
• Opportunity to work with large-scale datasets and modern cloud data platforms.
• Grow your career in a fast-paced, innovative environment.
• Be part of a diverse, equitable, and inclusive team culture.

Applications will be accepted through September 25, 2026.