Backend API Integration Engineer - Databricks & ServiceNow

Jobtailor; Washington (WA, District of Columbia); On-site; USD 120,000 - 180,000; Full time

Job summary

Jobtailor is seeking a backend/API integration engineer to implement Databricks REST API write-back for labeled outputs and provenance, and to build robust Duality back-end integrations with catalog intake, translation, and async lifecycles.

You will also integrate ServiceNow for routing, develop storefront backend services, coordinate DataCard write-back with the Solution Architect, and design scalable async queue and retry mechanisms while ensuring DoD-compliant metadata structure.

Qualifications

• Bachelor's degree in CS/SE or related field; equivalent experience allowed (2-for-1).
• 6+ years total professional experience, 4+ years backend/API integration
• Strong Python backend development, production-grade
• Experience with REST API integration and async job lifecycles (submission, polling, retry, webhooks)
• Familiarity with Databricks REST API or Spark/Databricks
• JSON schema design and structured metadata handling
• Active TS/SCI clearance

Responsibilities

• Implement Databricks REST API write-back for labeled outputs and provenance records
• Build and validate Duality back-end integration: catalog intake, parameter translation, async job lifecycle
• Implement ServiceNow REST integration for routing intake path
• Develop storefront backend services: API layer between frontend and platform components
• Implement DataCard write-back coordination with Solution Architect
• Design and maintain async job queue management and retry logic
• Structure output metadata for DataCard provenance per DoD distribution requirements

Job description

Jobtailor is seeking a backend/API integration engineer to implement Databricks REST API write-back for labeled outputs and provenance, and to build robust Duality back-end integrations with catalog intake, translation, and async lifecycles.

You will also integrate ServiceNow for routing, develop storefront backend services, coordinate DataCard write-back with the Solution Architect, and design scalable async queue and retry mechanisms while ensuring DoD-compliant metadata structure.