Senior Data Backend Engineer — AI Pipelines & Microservices

Hidden Jobs; United States; Remote; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity opportunity

Benefits package

Competitive base salary

Job summary

Hidden Jobs is seeking a Senior backend engineer to design microservices and distributed data pipelines powering AI for autonomous vehicles. You will shape large-scale architectures for video data curation, behavioral search, and dataset management to enable efficient AI training at scale.

You will build and optimize microservices, streaming and ETL workflows, and collaborate with AI teams to deploy Retrieval-Augmented Generation models and RAG workflows.

Qualifications

• Must have 6+ years with MS or 8+ years with BS in CS/Engineering
• Strong Python or Golang proficiency
• Experience with distributed data systems and ETL pipelines

Responsibilities

• Design and build microservices, workflows, and distributed apps for data mining and AI training
• Implement streaming, logging, security, auth, orchestration, and data management solutions
• Develop and deploy AI models including Retrieval-Augmented Generation workflows
• Analyze and optimize complex distributed systems for high throughput
• Build and maintain ETL pipelines across the data lifecycle

Skills

Python

Golang

Kubernetes

SQL

Data mining

AI development

Education

MS with 6+ years or BS with 8+ years in CS/Engineering

Tools

Kubernetes

Helm

Hive

Parquet

SQL

Milvus

Job description

Hidden Jobs is seeking a Senior backend engineer to design microservices and distributed data pipelines powering AI for autonomous vehicles. You will shape large-scale architectures for video data curation, behavioral search, and dataset management to enable efficient AI training at scale.

You will build and optimize microservices, streaming and ETL workflows, and collaborate with AI teams to deploy Retrieval-Augmented Generation models and RAG workflows.