Join DataSF as a hands‑on Data Engineer and help City departments bring their data onto the Unified Data Platform. In this hybrid role in San Francisco, you will build and maintain production pipelines, develop transformations with dbt on Snowflake, and support the transition from legacy publishing workflows to modern platform‑based feeds.
This project-based position is anticipated to last 36 months and is not eligible for a permanent civil service hiring list. The role is classified as Permanent Exempt (PEX), meaning the position is excluded from the competitive civil service examination process and serves at the discretion of the appointment officer.
What you will do
- Build and maintain production data pipelines that load department data onto the platform, including tests and documentation so others can run and support them.
- Develop and test data models in dbt that transform raw department inputs into clean, well‑documented tables used by analysts across the City.
- Create financial and budget data products using the City’s financial and workforce systems to support migration off legacy reporting and improve accuracy for budgeting and planning.
- Support platform cost and usage reporting so the team and partner departments can understand platform expenses and how resources are utilized.
- Assist in transitioning publishing workflows from legacy systems to the platform, including public‑facing open data feeds.
- Investigate and resolve data quality issues by tracing errors to their source, fixing them, and adding tests to prevent repeat issues.
- Support department onboarding by helping analysts understand and use the models you build.
- Participate in code review and expand into reviewing others’ code as your experience grows.
Required qualifications
- An associate degree in computer science, computer engineering, information systems, or a closely related field (or equivalent), from an accredited college or university, or equivalent course credits/units: at least 60 semester or 90 quarter credits/units, with a minimum of 20 semester or 30 quarter credits/units in one of the fields above or a closely‑related field.
- One (1) year of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of a system or platform.
- One additional year of relevant experience may substitute for the required degree.
- Completion of the 1010 Information Systems Trainee Program may be substituted for the required degree.
Desirable qualifications
- Experience building real data-moving or data-transforming projects and the ability to explain design and challenges encountered.
- Strong SQL skills and familiarity with at least one programming language, ideally Python, plus strong attention to numerical accuracy and early detection of incorrect‑looking data.
- Experience with financial, budget, or ERP data is a plus, along with familiarity with dbt, Snowflake, or Terraform.
- Strong potential and ability to learn new tools and the platform stack while on the job.
Tools you will use
dbt, Snowflake, SQL, Python, Terraform
Application timing
- Application opening: Wednesday, September 23, 2026
- Application deadline: Wednesday, September 30, 2026 at 11:59pm PST
- Required supplemental questionnaire: submitted at time of application: https://forms.cloud.microsoft/g/r5AP7vN0qM
Applications are reviewed to confirm minimum qualifications by the final filing date. Please ensure your application clearly explains how you meet the stated requirements, and be prepared to provide verification of qualifying education and experience if requested during the process.