Data Architect

State of North Carolina

Raleigh (NC)

On-site

USD 92,000 - 139,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

State benefits

Job summary

The North Carolina Department of Public Instruction is seeking a Data Architect to lead the unified data platform for the Student Longitudinal Data Service (SLDS) using Databricks on Microsoft Azure. This role requires hands-on work weekly in data modeling, pipeline development, and platform configuration.

You will set engineering standards, work with multiple units and partners, and ensure compliance with FERPA and security frameworks while optimizing costs and delivering robust data solutions.

Qualifications

  • Bachelor’s degree in Computer Science or a related IT field, Business Administration, Project Management or closely related degree.
  • Three years of experience in IT project management or technical project management related work.
  • Equivalent combination of education and experience may qualify.

Responsibilities

  • Design the reference architecture for the unified data platform that hosts the SLDS.
  • Build and maintain ingestion, transformation, and orchestration pipelines using Databricks tools such as Lakeflow declarative pipelines, jobs, Delta Lake, Spark SQL, and Python.
  • Establish engineering standards, coding conventions, code review practices, and reusable pipeline templates for data engineers, analysts, and contractors.
  • Define the conceptual, logical, and physical data models for the SLDS, covering students, staff, schools, courses, programs, assessments, enrollment, and outcomes across the P-20W continuum.
  • Design effective-dated and historical structures, identity resolution, and cross-year/linkage for longitudinal analysis.
  • Ensure FERPA, IDEA, NIST, FedRAMP/GovRAMP compliance; align with GovRAMP requirements.
  • Define data quality rules, validation, reconciliation, and report data quality measures.
  • Manage compute, storage, and costs with tagging, budgets, and cost reviews; report usage to leadership.
  • Prepare architecture documents, decision records, roadmaps, and training materials.

Skills

Lakehouse architecture
Azure Data Lake
Entra ID integration
Private networking
Key Vault
Python
SQL
Spark
Terraform
Git CI/CD
Data modeling
Identity resolution

Education

Bachelor’s degree in Computer Science / IT

Tools

Lakeflow
Delta Lake
PySpark
Azure Data Lake Storage
Terraform

Job description

About Us

The North Carolina Department of Public Instruction (NCDPI) is charged with implementing the state's public school laws for pre-kindergarten through 12th grade public schools at the direction of the State Superintendent of Public Instruction and State Board of Education.

Description of Work

*This is a time-limited position. It is full‑time (40 hours per week) with State Benefits for a limited time. If you have questions concerning the time-limited status of this position, you may inquire at the interview.

* The Data Architect is the principal architect and lead builder of the unified data platform that underlies the NCDPI Student Longitudinal Data Service (SLDS). The position designs, builds, and operates this platform on Databricks within the agency's Microsoft Azure environment, so that student, educator, school business, and program data from the agency and PSUs can be integrated, governed, secured, and made available for reporting, research, and decision making. The position reports to the Director of Enterprise Architecture and is expected to do hands‑on technical work each week, including data modeling, pipeline development, platform configuration, and code review, in addition to setting standards for others. The Data Architect works with business units, PSUs, the Chief Information Security Officer's team, data engineers, analysts, vendors, and State partners, including NCDIT, to turn business, statutory, and privacy requirements into working platform capabilities. The position also supports the data needs of School Business Systems Modernization (SBSM).

Job Responsibilities
  • Design the reference architecture for the unified data platform that hosts the Student Longitudinal Data Service (SLDS).
  • Build and maintain ingestion, transformation, and orchestration pipelines using Databricks tools such as Lakeflow declarative pipelines, jobs, Delta Lake, Spark SQL, and Python.
  • Establish engineering standards, coding conventions, code review practices, and reusable pipeline templates for data engineers, analysts, and contractors.
  • Define the conceptual, logical, and physical data models for the SLDS, covering students, staff, schools, courses, programs, assessments, enrollment, and outcomes across the P‑20W continuum.
  • Design effective‑dated and historical structures, unique identifier management, identity resolution, and cross‑year and cross‑source linkage that support longitudinal analysis.
  • Design the platform to meet the Family Educational Rights and Privacy Act (FERPA), the Individuals with Disabilities Education Act (IDEA), and other applicable federal and State requirements, and to align with NIST, State security standards, and GovRAMP requirements set by the agency security office.
  • Define data quality rules, validation, reconciliation, and exception handling, and report data quality measures to data owners.
  • Manage compute, storage, and consumption costs through tagging, cluster policies, budgets, and regular cost review, and report platform cost and usage to leadership.
  • Prepare architecture documents, decision records, roadmaps, and training materials.
Knowledge Skills and Abilities / Management Preferences

Recruitment Range: $91,600.00 - $139,050.00

Manager Preferences
  • Experience designing and operating lakehouse architectures with medallion layering on Microsoft Azure, including Azure Data Lake Storage, Entra ID integration, private networking, and Key Vault.
  • Experience with Python, SQL, and Spark for pipeline development, with Terraform or comparable infrastructure-as-code tools, and with Git-based CI/CD.
  • Experience modeling longitudinal or historical data, including effective dating, slowly changing dimensions, and student or person identity resolution.
  • Experience applying FERPA and security frameworks such as NIST and FedRAMP or GovRAMP to a data platform in a regulated environment.
  • Experience within an education or government environment, preferably North Carolina State government.

Important: This posting closes at 11:59:59 PM the night BEFORE the End Date above.

If you have student loans, becoming a state employee includes eligibility for the Public Service Loan Forgiveness Program. Visit www.studentaid.gov to learn more.

Primary Purpose for the Office of Enterprise Architecture

The Office of Enterprise Architecture provides strategic and technical leadership for NCDPI’s enterprise technology architecture, modernization planning, and technology governance. The Office develops target‑state architectures, solution designs, standards, design patterns, and roadmaps that align systems, data, applications, infrastructure, and cloud services with agency business needs, statutory requirements, security expectations, and operational priorities. The Office works with NCDPI business units, technology teams, agency leadership, vendors, the Department of Information Technology (NCDIT), and Public School Units (PSUs) on enterprise systems modernization, data infrastructure, the agency data platform, and interoperability. Its work supports S.L. 2017‑57 Section 7.16(a), in which the General Assembly directed the modernization of State and local education data systems and the provision of a common reporting and analytics system.

Minimum Education and Experience

Some state job postings say you can qualify by an “equivalent combination of education and experience.” If that language appears below, then you may qualify through EITHER years of education OR years of directly related experience, OR a combination of both. See the Education and Experience Equivalency Guide for details.

Bachelor’s degree in Computer Science or a related IT field, Business Administration, Project Management or closely related degree from an appropriately accredited institution and three years of experience in IT project management or technical project management related work; or an equivalent combination of education and experience.

EEO Statement

The State of North Carolina is an Equal Employment Opportunity Employer and dedicated to providing employees with a work environment free from all forms of unlawful employment discrimination, harassment, or retaliation. The state provides reasonable accommodation to employees and applicants with disabilities; known limitations related to pregnancy, childbirth, or related medical conditions; and for religious beliefs, observances, and practices.

All job postings close at 11:59pm the night before the End Date on the posting.

North Carolina State Government

North Carolina State Government is one of the state’s largest employers, with over 76,000 employees all working toward a common goal: a safer and stronger North Carolina.

We are a large organization comprised of various agencies, offices, and universities, each providing important public services.

Eligible state employees are entitled to comprehensive benefits, including a variety of leave options, professional development opportunities, insurance, and more.

To learn more about the benefits of being a North Carolina state employee, visit the N.C. Office of State Human Resources' website.

Permanent, temporary, and time-limited state government jobs can be found from the mountains to the coast. Find your next opportunity today!

State Application Resources/Frequently Asked Questions

Valuing Education and Experience. The State of North Carolina values the knowledge and experience of our jobseekers and current state employees. Approximately 91 percent of state job classifications allow experience to be substituted for education or do not require a post‑secondary degree. Learn more about how you may qualify for a position through education or directly related experience, or a combination of both, with the Education and Experience Equivalency Guide.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Architect
Data Architect

Arts In Wilmington • North Carolina

Remote
USD 92,000 - 139,000
Section Chief - Digital Learning Programs
Section Chief - Digital Learning Programs

State of North Carolina • Raleigh (NC)

On-site
USD 71,000 - 109,000
IDEA Consultant: Assistive Technology & AEM
IDEA Consultant: Assistive Technology & AEM

Public Instruction • North Carolina

Hybrid
USD 64,000 - 93,000
Administrative Associate II
Administrative Associate II

Department of Administration • North Carolina

On-site
USD 31,000 - 42,000
Paid holidays
Health benefits
State retirement
Mechanical Engineer III
Mechanical Engineer III

Department of Administration • Wake Crossroads (NC)

On-site
USD 70,000 - 103,000
12 paid holidays
Health, Dental & Vision benefits
NC State Retirement Plan
Curriculum and Data Coordinator
Curriculum and Data Coordinator

Adult Correction • United States

On-site
USD 64,000 - 112,000
Health Insurance options
Retirement plans
Paid vacation
Senior Frontend Developer Specialist – EHRA
Senior Frontend Developer Specialist – EHRA

State of North Carolina • Wake Forest (NC)

Hybrid
USD 88,000 - 131,000
Administrative Specialist - (Temporary)
Administrative Specialist - (Temporary)

OSHR Temporary Solutions • Raleigh (NC)

On-site
USD 26,000 - 37,000
HDHP health insurance eligibility for
HDHP health insurance eligibility for
Applications Systems Specialist
Applications Systems Specialist

State of North Carolina • Wake Forest (NC)

Hybrid
USD 95,000 - 116,000
Hybrid work model
Technical Lead
Technical Lead

Health & Human Services • United States

Hybrid
USD 88,000 - 131,000
Health benefits
Paid leave
Hybrid work options