Onsite Databricks Data Architect for Materials Research

Estrada Consulting, Inc; Clearfield (UT); On-site; USD 83,000 - 117,000; Full time

Job summary

Estrada Consulting, Inc. is seeking a Databricks data developer and architect to design and implement a materials research database onsite in Clearfield, Utah. The role involves building pipelines from machines to Azure Blob Storage and staging production data on Databricks for analytics and data science.

The project runs for six months with a start in January 2027 and a rate of $60–$85 per hour (W2). A strong background in SQL, Python, and cloud data services is required, along with U.S.

Qualifications

• Three years or more of data engineering experience.
• Experience building data ingestion pipelines, data models and pipeline monitoring and alerting.
• Strong SQL and Python.
• Cloud experience (Azure, AWS or GCP), including IaaS and PaaS services.
• Data security, permission management and secure networking experience.
• U.S. citizen able to work onsite in Clearfield, Utah, full time.

Responsibilities

• Build extraction from each machine (log files, controller registers, instrument outputs and microscope images) into Azure Blob Storage.
• Create the Databricks staging environment with data types checked and enforced.
• Design and build the production data model for research use, including tables that reference images in blob storage.
• Build orchestration with alerts when loads fail or data is missing or corrupt.
• Support automated reporting and analytics on production data with the center's staff.
• Document the pipelines and data model, and pair with student interns so the center can maintain them.

Skills

Data engineering

SQL

Python

Cloud experience

Data security

Onsite work

Tools

Databricks

Azure

Azure Government

Delta Lake

Azure Data Factory

Job description

Estrada Consulting, Inc. is seeking a Databricks data developer and architect to design and implement a materials research database onsite in Clearfield, Utah. The role involves building pipelines from machines to Azure Blob Storage and staging production data on Databricks for analytics and data science.

The project runs for six months with a start in January 2027 and a rate of $60–$85 per hour (W2). A strong background in SQL, Python, and cloud data services is required, along with U.S.