Senior Data Engineer - Remote, Own Data Architecture

Brooksource; United States; Remote; USD 96,000 - 117,000; Full time

Job summary

Brooksource is seeking a Senior Data Engineer for a remote in the US, focusing on a new two-project data initiative across a core Data Layer and Release Hub. You will shape data architecture, normalize and transform data from ~10 sources, and enable long-term retention for forecasting and analytics.

The role requires hands-on AWS experience, streaming/CDCs, and proficiency in Java or Python. Expect collaboration with CRM platforms like Salesforce and a push toward scalable, maintainable

Qualifications

• Must have hands-on experience with AWS as primary environment.
• Experience with streaming and change-data-capture tools (Kafka, Flink, Debezium).
• Proficiency with SQL Server, MySQL, Postgres or similar databases.
• Experience with lakehouse architecture and tools (Iceberg, AWS Glue, Lake Formation).
• Familiarity with DuckDB or similar analytical querying tools.
• Experience with Terraform for infrastructure as code.
• Experience with GitHub Actions or similar CI/CD tools.
• Proficiency in Java or Python for data application development.
• Experience designing data normalization and transformation logic across multiple sources.
• Ability to design for long-term data retention and support analytics/forecasting.

Responsibilities

• Design and evolve data architecture supporting real-time and batch data movement, primarily within AWS.
• Build normalization and transformation pipelines from ~10 sources while preserving raw data.
• Implement and manage streaming and batch data ingestion using Kafka, Flink, Debezium.
• Write and maintain infrastructure as code for pipeline components using Terraform.
• Work with streaming tech to move data in near real-time and batch exports.
• Collaborate with stakeholders to define data retention for historical analysis.
• Advise on architecture decisions across overlapping projects for reuse and efficiency.
• Collaborate with CRM teams on data integration points (Salesforce).
• Contribute to an inclusive and diverse team culture.

Skills

AWS

Kafka

Flink

Debezium

Java

Python

SQL

CI/CD

Terraform

GitHub Actions

Education

Bachelor's degree in Computer Science

Tools

Iceberg

AWS Glue

Lake Formation

Salesforce

Terraform

Job description

Brooksource is seeking a Senior Data Engineer for a remote in the US, focusing on a new two-project data initiative across a core Data Layer and Release Hub. You will shape data architecture, normalize and transform data from ~10 sources, and enable long-term retention for forecasting and analytics.

The role requires hands-on AWS experience, streaming/CDCs, and proficiency in Java or Python. Expect collaboration with CRM platforms like Salesforce and a push toward scalable, maintainable