Lead Data Engineer

DataJobs; San Francisco (CA); Hybrid; USD 130,000 - 155,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Analytical Mechanics Associates (AMA) is seeking a Lead Data Engineer to drive analytics product design, modernize pipelines, and deliver governed reporting for executives and operations. The role is hybrid in California with an agile environment and CTZ alignment.

You will own Power BI semantic models, data governance, and end-to-end data delivery while mentoring teammates and shaping engineering culture.

Qualifications

• BA/BS in a technical field (math, IT, engineering, accounting, or computational finance).
• 5+ years analytics or data engineering with 5+ years BI visualization experience (Power BI/Tableau/DOMO).
• Strong production experience with Databricks, Snowflake, Azure Data Factory, or similar cloud platforms.
• Advanced SQL and Python skills; experience building ingestion, transformation, and analytics pipelines.
• Experience with data governance, quality monitoring, lineage, and access controls.
• Experience modernizing legacy SQL/SSIS/integration workloads.
• Experience with Git, Azure DevOps, CI/CD, testing and controlled production releases.
• Experience with Data Vault 2.0 or governed historical modeling.
• Ability to communicate with technical and non-technical stakeholders.
• Must have a primary place of business in the Central Time Zone.

Responsibilities

• Lead analytics product design including dashboard layouts and semantic models.
• Deliver production-grade reports and dashboards with KPI validation.
• Develop Power BI semantic models for executive and operational reporting.
• Build data pipelines using Databricks, Azure Data Factory, or Snowflake.
• Implement data governance including column docs and access controls.
• Mentor engineers and collaborate across data environment and data presentation streams.

Skills

BI visualization

Power BI

Tableau

Databricks

Snowflake

Azure Data Factory

SQL

Python

Git

Azure DevOps

CI/CD

Data Vault 2.0

DAX

Education

BA/BS in a technical field

Master’s degree in Data Science

Tools

Databricks

Snowflake

Azure Data Factory

Power BI

Tableau

DOMO

SQL

Python

SSIS

Azure DevOps

Git

CI/CD

Data Vault 2.0

Job description

Analytical Mechanics Associates (AMA) is hiring a full-time Lead Data Engineer for a California hybrid role. In this position, you will help shape analytics product design, modernize data pipelines, and deliver governed reporting experiences that support both operational teams and executive stakeholders. The team works in an agile, hybrid environment aligned to the Central Time Zone.

What you'll deliver

• Analytics product design leadership, including dashboard layouts, visualization approach, and semantic model architecture.
• Production-grade reports and dashboards, including direct stakeholder engagement and KPI validation.
• Power BI semantic models for executive dashboards and operational reporting, enabling governed self-service analytics.
• Data pipelines built with Databricks, Azure Data Factory, and/or Snowflake using a structured layered architecture: Raw, Transformed, and Analytics.
• Automated data quality checks, reconciliation, pipeline monitoring, alerts, and operational support dashboards.
• Modernization of legacy workloads by reverse-engineering and transforming SQL, SSIS, or integration processes into maintainable patterns.
• Enterprise-grade data governance covering column-level documentation, role‑based access controls, standardized metric definitions, and full data lineage traceability.

How you'll work with the team

• Partner with business leaders to translate operational and analytical needs into scalable technical solutions.
• Provide technical direction across two primary work streams: data environment and data presentation.
• Mentor team members and help establish a consistent, collaborative engineering culture.
• Troubleshoot technical issues and proactively detect data issues using automated validation and monitoring.

Core requirements

• BA/BS in a technical field (including mathematics, information technology, engineering, accounting, or computational finance).
• 5+ years of professional experience in business analytics or data engineering, including 5+ years hands‑on with BI visualization tools such as Power BI, Tableau, DOMO, or equivalent platforms.
• Strong production experience with Databricks, Snowflake, Azure Data Factory, or a comparable modern cloud data platform.
• Advanced SQL and Python skills.
• Experience building ingestion, transformation, and analytics pipelines.
• Experience implementing data governance, quality monitoring, lineage, and access controls.
• Experience reverse‑engineering and modernizing legacy SQL, SSIS, or integration workloads.
• Experience with Git, Azure DevOps, CI/CD, testing, and controlled production releases.
• Experience with Data Vault 2.0 or another governed historical modeling approach.
• Ability to communicate effectively with technical teams and non‑technical stakeholders.
• Demonstrated ownership from design through production support.
• Strong documentation, troubleshooting, and problem‑solving skills.
• Must have a primary place of business in the Central Time Zone.

Tools you'll use

• Power BI, Tableau, DOMO, Databricks, Azure Data Factory, Snowflake
• SQL, Python, SSIS
• Azure DevOps, CI/CD, Git
• Data Vault 2.0, DAX

Preferred qualifications

• Certification in data visualization with Power BI.
• Experience with Microsoft Fabric Lakehouse, Warehouse, Data Pipelines, Dataflow Gen2, DirectLake, and semantic models.
• Experience with Spark, Delta Lake, dbt, or dbt-fabric.
• Proficiency in DAX, Tableau, or other BI visualization tools.
• Experience with API integrations, vendor-file automation, and workflow automation.
• Experience with AWS-based data services (Lambda, S3, Glue, Athena).
• Familiarity with Azure Key Vault, service principals, managed identities, and Microsoft Purview.
• Experience setting technical standards and mentoring engineers or analysts.
• Master’s degree in Data Science, Applied Mathematics, or a related field.

Compensation: USD 130,000 - 155,000 per year.