Backend Integration Engineer — Databricks & APIs

Innodata Inc.; Washington (Washington County); On-site; USD 103,000 - 110,000; Full time

Job summary

Innodata Inc. is seeking a Backend/Integration Engineer for its Federal Practice. You will build the data services storefront’s backend, stand up ingest pipelines, and implement reliable write-back into our lakehouse in a secure IL4 environment.

Work closely with the Solution Architect to ensure secure, scalable integrations; own queue management, async job lifecycles, and DoD-compliant metadata structures. 20-week phase, strong backend focus.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, or related field; 2-for-1 substitution allowed.
• 6+ years total experience, 4+ years backend or API integration engineering.
• Proficient Python backend development; production-grade.
• REST API integration with async lifecycles (submission, polling, retry, webhook handling).
• Databricks REST API or strong Spark/Databricks familiarity.
• JSON schema design and structured metadata handling.
• Active Secret clearance with TS/SCI eligibility.

Responsibilities

• Implement Databricks REST API write-back for labeled outputs, DataCard provenance records, and synthetic content outputs.
• Build and validate the Duality back-end integration: catalog intake form configuration, parameter translation to Duality generation API, async job lifecycle management (submission, tracking, retry, completion), output handling.
• Implement ServiceNow REST integration for white-glove routing intake path.
• Build and maintain storefront backend services (API layer between frontend UI and platform components).
• Implement DataCard write-back path in coordination with Solution Architect.
• Design and maintain async job queue management and retry logic across all integration surfaces.
• Structure output metadata for DataCard provenance records per DoD distribution statement requirements.

Skills

Python

REST API

Async processing

Backend development

Data integration

Education

Bachelor's degree in CS/SE

Tools

Databricks

ServiceNow

Spark

Job description

Innodata Inc. is seeking a Backend/Integration Engineer for its Federal Practice. You will build the data services storefront’s backend, stand up ingest pipelines, and implement reliable write-back into our lakehouse in a secure IL4 environment.

Work closely with the Solution Architect to ensure secure, scalable integrations; own queue management, async job lifecycles, and DoD-compliant metadata structures. 20-week phase, strong backend focus.