Senior Data Engineer

Brooksource; Oakland (CA); On-site; USD 130,000 - 190,000; Full time

Job summary

You will ensure performance, reliability, and cost efficiency while collaborating with solution leads, data modelers, analysts, and business partners in an agile DevSecOps pod model.

Qualifications

• Bachelor’s degree with 5 - 7 years of relevant experience in data engineering or enterprise data solutions.
• Hands-on experience with DBT.
• Deep understanding of data modeling, integration patterns, data architecture, data quality, and data warehousing.
• Advanced hands-on expertise in SQL, including automation and pipeline optimization.
• Strong experience with cloud platforms (Azure preferred) and services such as ADLS, Synapse, and Data Factory.
• Extensive experience with modern data platforms including Snowflake, Databricks, and orchestration tools such as Airflow or Tidal.
• Proven experience implementing CI/CD pipelines, Infrastructure as Code, and DataOps practices.
• Strong understanding of security, privacy, and compliance requirements in regulated environments.
• Experience working with large-scale, distributed data platforms and parallel processing architectures.
• Excellent communication and stakeholder engagement skills.
• Proven ability to lead technically without formal people management responsibility.
• Preferred: Healthcare industry experience, including exposure to Epic or similar ecosystems.

Responsibilities

• Lead the design and implementation of complex, data pipelines and data products from development through production
• Translate solution designs and business requirements into detailed technical architecture and implementation plans
• Architect and build scalable, secure, and highly available data solutions across enterprise data platforms
• Apply advanced data modeling techniques (Data Vault 2.0, dimensional, and domain-oriented models) to support analytics and reporting needs
• Embed data quality, testing, security, and observability by design across data pipelines
• Drive operational excellence, including incident analysis, stabilization, performance tuning, and deployment optimization
• Identify and implement optimization opportunities related to performance, reliability, and cloud cost management
• Influence and evolve data engineering standards, patterns, and frameworks used by delivery teams
• Provide technical leadership and mentorship to Data Engineers and Senior Data Engineers through design reviews and code reviews
• Work within an agile / DevSecOps pod model, collaborating closely with solution leads, data modelers, analysts, and business partners
• Support integration of AI/ML-ready datasets by ensuring data is well-modeled, reliable, and governed
• Communicate complex technical concepts clearly to both technical and non-technical stakeholders

Skills

DBT

SQL

Data modeling

Azure

Snowflake

Databricks

Airflow

CI/CD

Infrastructure as Code

Security & compliance

Stakeholder comms

Technical leadership

Education

Bachelor’s degree in related field

Tools

DBT (Data Build Tool)

Airflow

Terraform

Azure

Snowflake

Databricks

Job description

The Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Data Engineer, Consultant will report to the Sr Manager, Data Solutions / Manager. This role serves as a senior individual contributor and technical leader, responsible for driving end‑to‑end delivery of complex data engineering solutions across cloud data platforms. The DE‑C partners closely with Solution Design Leads, Architects, Product Managers, and business stakeholders to translate solution designs and business requirements into scalable, secure, and production‑ready data products.

The Data Engineer, Consultant is expected to lead by influence and technical depth, establish and reinforce engineering best practices, and ensure data solutions meet high standards for performance, reliability, security, and cost efficiency.

Your Work

In this role, you will:

• Lead the design and implementation of complex, data pipelines and data products from development through production
• Translate solution designs and business requirements into detailed technical architecture and implementation plans
• Architect and build scalable, secure, and highly available data solutions across enterprise data platforms
• Apply advanced data modeling techniques (Data Vault 2.0, dimensional, and domain‑oriented models) to support analytics and reporting needs
• Embed data quality, testing, security, and observability by design across data pipelines
• Drive operational excellence, including incident analysis, stabilization, performance tuning, and deployment optimization
• Identify and implement optimization opportunities related to performance, reliability, and cloud cost management
• Influence and evolve data engineering standards, patterns, and frameworks used by delivery teams
• Provide technical leadership and mentorship to Data Engineers and Senior Data Engineers through design reviews and code reviews
• Work within an agile / DevSecOps pod model, collaborating closely with solution leads, data modelers, analysts, and business partners
• Support integration of AI/ML‑ready datasets by ensuring data is well‑modeled, reliable, and governed
• Communicate complex technical concepts clearly to both technical and non‑technical stakeholders

Your Knowledge and Experience

• Bachelor’s degree with 5 - 7 years of relevant experience in data engineering, cloud platforms, or enterprise data solutions
• Hands on Experience with DBT (Data Build Tool)
• Deep understanding of data modeling, integration patterns, data architecture, data quality, and data warehousing
• Advanced hands‑on expertise in SQL, including automation and pipeline optimization
• Strong experience with cloud platforms (Azure preferred) and services such as ADLS, Synapse, and Data Factory
• Extensive experience with modern data platforms including Snowflake, Databricks, and orchestration tools such as Airflow or Tidal
• Proven experience implementing CI/CD pipelines, Infrastructure as Code, and DataOps practices
• Strong understanding of security, privacy, and compliance requirements in regulated environments
• Experience working with large‑scale, distributed data platforms and parallel processing architectures
• Excellent communication and stakeholder engagement skills
• Proven ability to lead technically without formal people management responsibility
• Preferred: Healthcare industry experience, including exposure to Epic or similar ecosystems

Disclaimer

Brooksource, Medasource, and Calculated Hire are part of the Eight Eleven Group family of companies and operate under Eight Eleven Group, LLC. All employees receive the same benefits, policies, and terms of employment.

EEO

We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of race, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, marital status, military or veteran status, citizenship, pregnancy (including childbirth, lactation, and related conditions), or any other protected status in accordance with applicable federal, state, and local laws.

Brooksource offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.

Pay Disclaimer

The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.