Data Engineer (1042) - Data Enablement - DataSF, Office of City Administrator

City-and-County-of-SAN-Francisc; San Francisco (CA); On-site; USD 140,000 - 180,000; Full time

Job summary

City and County of San Francisco is seeking a Data Engineer to join DataSF's Data Enablement team. You will build and maintain production data pipelines, transform raw data using dbt on Snowflake, and help transition publishing workflows to the platform.

The role emphasizes data accuracy and hands-on execution with mentorship from senior engineers. The position requires technical capabilities, the ability to learn quickly, and a commitment to delivering reliable data for city services and open

Qualifications

• Associate degree in computer science, computer engineering, information systems, or closely related field or equivalent (60+ credits with relevant coursework).
• 1 year of experience analyzing, installing, configuring, enhancing, and/or maintaining system components.
• One year of additional experience may substitute for the degree; 1010 IS Trainee Program may substitute for degree.

Responsibilities

• Build and maintain production data pipelines with tests and documentation.
• Develop dbt data models transforming raw data into clean tables used by analysts.
• Create financial and budget data products to support budgeting and planning.
• Support platform cost and usage reporting for departments.

Skills

SQL

Data modeling

Data pipelines

Education

Associate degree in CS/IS or related

Tools

dbt

Snowflake

Terraform

Python

Job description

Data Engineer (1042) - Data Enablement - DataSF, Office of City Administrator

• Full-time
• Work Hours: Regular
• Job Code and Title: 1042-IS Engineer-Journey
• Fill Type: Permanent Exempt

Permanent Exempt (PEX):Full Timeposition is excluded by the Charter from the competitive civil service examination process and shall serve at the discretion of the appointment officer. Theanticipatedduration of this project position is thirty-six (36) months and will not result in an eligible list or permanent civil service hiring. Project-based positions cannot be ongoing or exceed 36 months.

Specific informationregardingthis recruitment processare listed below:

About the Office of the City Administrator: The Office of the City Administrator includes 20+ agencies and over 1,000 dedicated staff who provide essential services to San Francisco residents and businesses and improve the administration of government. Our Mission The City Administrator’s Office is strongly committed to ensuring efficient and effective government services, increasing the City’s safety and resiliency, strengthening the local economy, supporting equity and inclusion, and optimizing the City’s capital planning and infrastructure.

Our Vision

We are committed to ensuring that the City's services are inclusive, efficient, equitable, and culturally competent for San Franciscans of all races, ethnic backgrounds, religions, and sexual orientations. This commitment requires comprehensive review and thorough analysis of existing practices and policies to remove barriers to real inclusion.

We are also committed to ensuring that the Department is a safe, equitable, and inclusive workplace for individuals of all races. This includes creating opportunities for hiring, promotion, retention, training, and development, for all employees, including but not limited to Black, Indigenous, and people of color (BIPOC).

Want to build robust and scalable data infrastructure to power data-driven City services? Join the DataSF team to empower and expand the use of data in government!

DataSF’s mission is to transform the way San Francisco works with data. We believe that data, when harnessed effectively, can improve transparency, resident engagement, and government performance. We are committed to removing barriers and making it easier for all people to access services and knowledge, and we actively seek team members whose diverse life experiences reflect the residents we serve. The department has a hybrid work schedule. DataSF runs the City’s open data program and the Unified Data Platform (UDP), the shared space where departments build, manage, and use trusted data together. Our work supports citywide priorities such as permitting, street coordination, and public safety. We are a small team with a citywide mandate, and we are hiring for roles that will help the platform grow well and serve more departments.

The Data Engineer will be part of our data enablement practice, the portion of the team that helps City departments bring their data onto the platform and put it to work. This position will build and maintain production data pipelines, develop and test data models in dbt on Snowflake, and transition publishing workflows from legacy systems to the platform. The role works closely with senior engineers who provide code review and hands‑on mentorship, and spends time with department analysts to understand data at its source. This is a hands‑on engineering role—you don’t need years of experience, but you do need to have built things before, care deeply about data accuracy, and learn quickly.

Examples of Important and Essential Duties:

• Build and maintain production data pipelines that bring department data onto the platform, complete with tests and documentation so they can be run and maintained by others.
• Develop data models in dbt that transform raw department data into clean, well‑documented tables relied on by analysts across the City.
• Create financial and budget data products—models built on the City’s financial and workforce systems that support migration off legacy reporting and provide departments with accurate numbers for budgeting and planning.
• Support platform cost and usage reporting so the team and partner departments can understand platform expenses and how resources are used.
• Help transition publishing workflows from legacy systems onto the platform, including public‑facing open data feeds.
• Investigate and resolve data quality issues by tracing errors to their source, fixing problems, and adding tests to prevent future occurrences.
• Support department onboarding by helping analysts understand and use the models you build.
• Participate in code review and grow into reviewing others’ code as your experience increases.

Education:

An associate degree in computer science, computer engineering, information systems, or a closely related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in one of the fields above or a closely-related field].

Experience:

One (1) year of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of a system or platform.

Substitution:

One year of additional experience as described above may be substituted for the required degree.

Completion of the 1010 Information Systems Trainee Program may be substituted for the required degree.

Note(s):

One-year full-time employment is considered equivalent to 2000 hours (2000 hours of qualifying work experience is based on a40 hourwork week). Any overtime hours that you work above forty (40) hours per week are not included in the calculation todeterminefull-time employment.

Applicants must meet minimum qualification requirements by the final filing date unless otherwise noted.

Desirable Qualifications: The stated desirable qualifications may be used toidentifyjob finalists at the end of the selection process when candidates are referred for hiring.

Experience building real data-moving or data-transforming projects—whether from a job, internship, or personal work—and the ability to explain how they were designed and what challenges arose.

Ability to write SQL and familiarity with at least one programming language, ideally Python; strong attention to numerical accuracy and instinct for identifying when data doesn’t look right.

Experience with financial, budget, or ERP data is a plus, as is familiarity with dbt, Snowflake, or Terraform.

Strong potential and intuition working with data, with the ability to learn new tools and the platform stack on the job.

Selection Procedures

The selection process will include evaluation of applications in relation tominimumrequirements. Dependingon the number of applicants, the Department mayestablishand implementadditionalscreening mechanisms to comparatively evaluation qualifications of candidates. If this becomes necessary, only those applicants whose qualifications most closely meet the needs of the Department will be invited for an interview.

Applicants who meet the minimum qualifications are not guaranteed to advance throughall ofthe steps in the selection process.

Verification

• Please make sure it is clear in your application exactly how you meet the minimum qualifications.
• Applicants maybe requiredtosubmitverification of qualifying education and experience at any point in the application and/or departmental selection process.

After application submission, candidates deemed qualified must complete all subsequent steps to advance in this selection process, which includes completion of a supplemental questionnaire at the time of application. Please see this link tosubmitthe supplemental questionnaire:

Additional Information Regarding Employment with the City and County of San Francisco:

Applicants will receive a confirmation email from [e-mail] that their online application has been received in response to every announcement for which they file. Applicants shouldretainthis confirmation email for their records.Failure to receive this email means that the online application was notsubmittedor received.

Applicants may be contacted by email about this recruitment and, therefore, it is their responsibility to ensure that their registered email address isaccurateand keptup-to-date. Also, applicants must ensure that email from CCSF is not blocked on their computer by a spam filter. To prevent blocking, applicants should set up their email to accept CCSF mail from the following addresses (@sfgov.org, @sfdpw.org, @sfport.com, @flysfo.com, @sfwater.org, @sfdph.org, @asianart.org, @sfmta.com, @sfpl.org, @dcyf.org, @first5sf.org, @famsf.org, @ccsf.edu, @smartalerts.info, and @smartrecruiters.com).

HR Analyst Information:If you have any questionsregardingthis recruitment or application process, please contact the exam analyst at [e-mail] .

The City and County of San Francisco encourages women, minorities and persons with disabilities to apply. Applicants will be considered regardless of their sex, race, age, religion, color, national origin, ancestry, physical disability, mental disability, medical condition (associated with cancer, a history of cancer, or genetic characteristics), HIV/AIDS status, genetic information, marital status, sexual orientation, gender, gender identity, gender expression, military and veteran status, or other protected category under the law.

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply