Backend, Integration Engineer

Jobtailor; Washington (WA, District of Columbia); On-site; USD 120,000 - 180,000; Full time

Job summary

Jobtailor is seeking a backend/API integration engineer to implement Databricks REST API write-back for labeled outputs and provenance, and to build robust Duality back-end integrations with catalog intake, translation, and async lifecycles.

You will also integrate ServiceNow for routing, develop storefront backend services, coordinate DataCard write-back with the Solution Architect, and design scalable async queue and retry mechanisms while ensuring DoD-compliant metadata structure.

Qualifications

• Bachelor's degree in CS/SE or related field; equivalent experience allowed (2-for-1).
• 6+ years total professional experience, 4+ years backend/API integration
• Strong Python backend development, production-grade
• Experience with REST API integration and async job lifecycles (submission, polling, retry, webhooks)
• Familiarity with Databricks REST API or Spark/Databricks
• JSON schema design and structured metadata handling
• Active TS/SCI clearance

Responsibilities

• Implement Databricks REST API write-back for labeled outputs and provenance records
• Build and validate Duality back-end integration: catalog intake, parameter translation, async job lifecycle
• Implement ServiceNow REST integration for routing intake path
• Develop storefront backend services: API layer between frontend and platform components
• Implement DataCard write-back coordination with Solution Architect
• Design and maintain async job queue management and retry logic
• Structure output metadata for DataCard provenance per DoD distribution requirements

Job description

• Implement Databricks REST API write-back for labeled outputs, DataCard provenance records, and synthetic content outputs


• Build and validate the Duality back-end integration: catalog intake form configuration, parameter translation to Duality generation API, async job lifecycle management (submission, tracking, retry, completion), output handling


• Implement ServiceNow REST integration for white-glove routing intake path


• Build and maintain storefront backend services (API layer between frontend UI and platform components)


• Implement DataCard write-back path in coordination with Solution Architect


• Design and maintain async job queue management and retry logic across all integration surfaces


• Structure output metadata for DataCard provenance records per DoD distribution statement requirements

Requirements

• Bachelor's degree in Computer Science, Software Engineering, or related field required. Equivalent experience may substitute for degree on a 2-for-1 basis.


• 6+ years total professional experience, 4+ years backend or API integration engineering


• Python backend development - strong, production-grade


• REST API integration with async job lifecycle patterns (submission, polling, retry, webhook handling)


• Databricks REST API or strong Spark/Databricks platform familiarity


• JSON schema design and structured metadata handling


• Active Secret clearance with TS/SCI eligibility.