Databricks Data Engineer I - Analytics Systems

State of North Carolina - Office of the State Auditor; North Carolina; On-site; USD 88,000 - 131,000; Full time

Job summary

The North Carolina Office of the State Auditor (OSA) is seeking an Applications Systems Specialist I to join our Data Engineering Team. You will translate business and audit requirements into scalable data architectures and develop Python/PySpark solutions for data ingestion and delivery.

We expect strong knowledge of Databricks governance, testing strategies, and mentoring engineers. This is a full-time on-site role within the NC state government, with comprehensive benefits and a focus on data

Qualifications

• Knowledge of deployment approaches such as Databricks Asset Bundles, infrastructure as code and configuration as code.
• Thorough knowledge of enterprise data governance principles, including data ownership, stewardship, classification, metadata, lineage, retention, access control, and lifecycle management.
• Experience in designing, developing and supporting production solutions in Databricks.

Responsibilities

• Translate business and audit requirements into scalable technical designs, data models, processing workflows, and platform configurations.
• Develop advanced Python, PySpark, and Spark SQL solutions for data ingestion, transformation, enrichment, reconciliation, and delivery.
• Define and execute testing strategies for pipelines, transformations, workflows, integrations, and governed data products.
• Mentor engineers working with Databricks, Python, PySpark, SQL, data pipelines, testing, deployment, and governance.
• Design and implement Databricks governance structures using Unity Catalog and related platform capabilities.

Skills

Data governance

Data pipelines

Testing strategies

Mentoring engineers

Education

Bachelor's degree in CS or IT

Associate degree in CS or IT

GED with 8 years experience

Tools

Databricks

Python

PySpark

Spark SQL

Unity Catalog

Job description

The North Carolina Office of the State Auditor (OSA) is seeking an Applications Systems Specialist I to join our Data Engineering Team. You will translate business and audit requirements into scalable data architectures and develop Python/PySpark solutions for data ingestion and delivery.

We expect strong knowledge of Databricks governance, testing strategies, and mentoring engineers. This is a full-time on-site role within the NC state government, with comprehensive benefits and a focus on data