Remote Content Pipeline Engineer for AI Document Processing

Black Canyon Consulting; Oregon; Híbrido; USD 120.000 - 180.000; Jornada completa

Descripción de la vacante

Black Canyon Consulting seeks a Content Pipeline Engineer to design reusable ingestion pipelines for PDFs, scanned documents, maps, and other unstructured content, including OCR, parsing, metadata enrichment, indexing, and retrieval. The role is remote within the United States.

You will implement embeddings, vector indexes (OpenSearch or equivalent), and semantic retrieval, collaborate with GIS and data-science teams, and develop agentic workflows with tests, logging, and quality controls to

Formación

• 5+ years of software engineering, data engineering, search, document-processing, or related experience.

Responsabilidades

• Design and implement reusable ingestion and processing pipelines for PDFs, scanned documents, images, forms, maps, and other unstructured content.
• Implement OCR and multimodal document-processing workflows for both standard documents and map-related materials.
• Extract text, tables, metadata, identifiers, and domain-specific attributes from source documents.
• Support extraction of information from plats and survey drawings, including legal descriptions, labels, bearings, distances, and other spatially relevant information.
• Develop document parsing, classification, normalization, chunking, and metadata-enrichment processes.
• Maintain linkage and provenance between extracted information, source documents, originating systems, and related business records.
• Build document and vector indexes using OpenSearch or comparable technologies.
• Implement embeddings, semantic search, and retrieval pipelines.
• Develop APIs and reusable interfaces enabling downstream applications and AI services to search and retrieve document content.
• Implement agentic workflows for activities such as document classification, extraction strategy selection, validation, exception handling, and quality assurance.
• Establish confidence thresholds and human-review processes for uncertain or ambiguous extractions.
• Work with GIS engineers to connect map and document extraction results with georeferenced and vectorized geometry.
• Work with Data Scientists to create evaluation datasets and measure OCR, extraction, retrieval, and classification quality.
• Build automated testing, monitoring, and observability for document-processing pipelines.
• Optimize processing for accuracy, throughput, repeatability, and cost.

Conocimientos

Python development

OCR processing

Vector databases

Semantic retrieval

LLM workflows

Automated testing

Logging

Error handling

Problem solving

Educación

Bachelor's degree in Computer Science, Software Engineering, Data Science, Information Systems, or a related technical field

Herramientas

OpenSearch

LangChain

LangGraph

AWS

OCR tools

Descripción del empleo

Black Canyon Consulting seeks a Content Pipeline Engineer to design reusable ingestion pipelines for PDFs, scanned documents, maps, and other unstructured content, including OCR, parsing, metadata enrichment, indexing, and retrieval. The role is remote within the United States.

You will implement embeddings, vector indexes (OpenSearch or equivalent), and semantic retrieval, collaborate with GIS and data-science teams, and develop agentic workflows with tests, logging, and quality controls to