Senior Data Engineer — Cloud Data Solutions Leader

Brooksource; Oakland (CA); On-site; USD 130,000 - 190,000; Full time

Job summary

You will ensure performance, reliability, and cost efficiency while collaborating with solution leads, data modelers, analysts, and business partners in an agile DevSecOps pod model.

Qualifications

• Bachelor’s degree with 5 - 7 years of relevant experience in data engineering or enterprise data solutions.
• Hands-on experience with DBT.
• Deep understanding of data modeling, integration patterns, data architecture, data quality, and data warehousing.
• Advanced hands-on expertise in SQL, including automation and pipeline optimization.
• Strong experience with cloud platforms (Azure preferred) and services such as ADLS, Synapse, and Data Factory.
• Extensive experience with modern data platforms including Snowflake, Databricks, and orchestration tools such as Airflow or Tidal.
• Proven experience implementing CI/CD pipelines, Infrastructure as Code, and DataOps practices.
• Strong understanding of security, privacy, and compliance requirements in regulated environments.
• Experience working with large-scale, distributed data platforms and parallel processing architectures.
• Excellent communication and stakeholder engagement skills.
• Proven ability to lead technically without formal people management responsibility.
• Preferred: Healthcare industry experience, including exposure to Epic or similar ecosystems.

Responsibilities

• Lead the design and implementation of complex, data pipelines and data products from development through production
• Translate solution designs and business requirements into detailed technical architecture and implementation plans
• Architect and build scalable, secure, and highly available data solutions across enterprise data platforms
• Apply advanced data modeling techniques (Data Vault 2.0, dimensional, and domain-oriented models) to support analytics and reporting needs
• Embed data quality, testing, security, and observability by design across data pipelines
• Drive operational excellence, including incident analysis, stabilization, performance tuning, and deployment optimization
• Identify and implement optimization opportunities related to performance, reliability, and cloud cost management
• Influence and evolve data engineering standards, patterns, and frameworks used by delivery teams
• Provide technical leadership and mentorship to Data Engineers and Senior Data Engineers through design reviews and code reviews
• Work within an agile / DevSecOps pod model, collaborating closely with solution leads, data modelers, analysts, and business partners
• Support integration of AI/ML-ready datasets by ensuring data is well-modeled, reliable, and governed
• Communicate complex technical concepts clearly to both technical and non-technical stakeholders

Skills

DBT

SQL

Data modeling

Azure

Snowflake

Databricks

Airflow

CI/CD

Infrastructure as Code

Security & compliance

Stakeholder comms

Technical leadership

Education

Bachelor’s degree in related field

Tools

DBT (Data Build Tool)

Airflow

Terraform

Azure

Snowflake

Databricks

Job description

You will ensure performance, reliability, and cost efficiency while collaborating with solution leads, data modelers, analysts, and business partners in an agile DevSecOps pod model.