Data Architect & Engineer — Hybrid, Databricks-Driven Data Hub

Estaff LLC; Sacramento (CA); Hybrid; USD 140,000 - 180,000; Full time

Job summary

Estaff LLC in Sacramento, CA is seeking a hands-on Data Architect and Engineer to centralize data in a governed, single location for a hybrid project. Analysts, dashboards, apps, and business users will rely on this data as the first phase covers public state and federal data.

The role involves building pipelines from public portals, REST APIs, and internal systems, setting architecture standards, and enabling data discovery with AI tools while ensuring data quality and security.

Qualifications

• 7+ years in data engineering or related role.
• Experience in enterprise-scale data engineering or architecture.
• Strong Python and SQL.
• Experience with Spark or cloud data platforms (Databricks, Snowflake, BigQuery).
• Experience pulling data from REST APIs, databases, or other sources.
• Excellent writing and documentation habits.
• Hands-on Databricks (Delta Lake, Unity Catalog, Jobs).
• Experience governing sensitive data (access controls, masking, privacy).
• Data governance program experience (data contracts, data stewardship, cross-agency sharing).
• Experience writing skill files or prompts for AI coding assistants.
• Experience with GIS or location-based data.

Responsibilities

• Build and maintain automated pipelines from public portals, APIs, and internal systems into Delta tables.
• Assist the program manager with platform architecture, naming standards, and documentation.
• Collaborate with data hub governance on architecture, data sharing, data contracts, ownership and quality.
• Advise on protecting sensitive data with row/column access rules and separate from public data.
• Ensure data reliability with monitoring, alerts and quality checks.
• Set up datasets and documentation for data exploration by experts and business users using AI tools.
• Write and maintain skill files to guide AI coding assistants for consistent pipelines.
• Help other departments build pipelines using shared templates.

Skills

Python

SQL

Databricks

Data governance

REST APIs

Documentation

GIS data

Access controls

Data contracts

Spark

AI prompts

Tools

Databricks

Snowflake

BigQuery

Job description

Estaff LLC in Sacramento, CA is seeking a hands-on Data Architect and Engineer to centralize data in a governed, single location for a hybrid project. Analysts, dashboards, apps, and business users will rely on this data as the first phase covers public state and federal data.

The role involves building pipelines from public portals, REST APIs, and internal systems, setting architecture standards, and enabling data discovery with AI tools while ensuring data quality and security.