Senior Databricks Data Engineer | OCDS & Gov Data Pipelines

Scicom Infrastructure Services; Oregon; Hybrid; USD 120,000 - 160,000; Full time

Job summary

Scicom Infrastructure Services seeks a Data Engineer / Business Analyst to support a large-scale Databricks implementation. The role bridges business, governance, and engineering, defining requirements, data contracts, and OCDS mappings while developing robust data pipelines.

Ideal candidates will have hands-on OCDS knowledge and five+ years in data engineering with Databricks, Spark, PySpark, SQL, and data governance experience. This hybrid position serves the US market from Oregon.

Qualifications

• Minimum five years in data engineering, analytics, or integration fields.
• Hands-on experience with Databricks and OCDS is required.
• Ability to map procurement data to OCDS structures and schemas.
• Proven ability to translate requirements into user stories and data contracts.

Responsibilities

• Lead requirements-gathering with diverse stakeholders and document data contracts.
• Design and implement Databricks data pipelines and models aligned to OCDS.
• Conduct source-system analysis, data profiling, and mappings.
• Ensure data quality, lineage, and governance across contracted datasets.

Skills

Databricks

PySpark

SQL

Data modeling

Data governance

Open Contracting Data Standard (OCDS)

Stakeholder facilitation

Education

Bachelor’s degree in a related field

Tools

Delta Lake

REST APIs

JSON

Job description

Scicom Infrastructure Services seeks a Data Engineer / Business Analyst to support a large-scale Databricks implementation. The role bridges business, governance, and engineering, defining requirements, data contracts, and OCDS mappings while developing robust data pipelines.

Ideal candidates will have hands-on OCDS knowledge and five+ years in data engineering with Databricks, Spark, PySpark, SQL, and data governance experience. This hybrid position serves the US market from Oregon.