Senior Cloud Data Engineer — AI Data Pipelines & Vector DBs

Gilder Search Group; Los Angeles (CA); Hybrid; USD 120,000 - 170,000; Full time

Benefits offered by this job

Long-term project

Compensation in USD

Paid time off

Job summary

Prediktive is seeking a Cloud Data Engineer based in Latin America to work on a long-term project for a Los Angeles–based Data Analytics and BI services company. You will help design and build the data store for autonomous agents and create scalable, multi‑modal data pipelines.

The role involves embedding data in vector and graph databases, developing RESTful APIs with Python (FastAPI/Django), and deploying data workloads on GCP.

Qualifications

• 5+ years of Data Engineering experience with production AI data systems.
• 5+ years Python experience with FastAPI, Pydantic, SQLAlchemy, and SQL.
• Hands-on with vector databases (Pinecone, ChromaDB) and building RAG pipelines.
• Experience with Airflow/Cloud Composer/Prefect and BigQuery.
• Experience on GCP or AWS and building scalable data services.

Responsibilities

• Design and build multi-modal data ingestion pipelines from relational databases and unstructured sources (PDFs, Word, diagrams).
• Develop embeddings in vector databases and graph databases to enable multi-step agent reasoning.
• Integrate autonomous coding agents into development workflows to plan, generate, and refactor data infrastructure and microservices.
• Collaborate with AI engineers to design evaluation pipelines and gold datasets for verification and quality scoring of AI outputs.
• Develop and maintain RESTful APIs using Python to expose structured and validated data.
• Deploy, monitor, and optimize data workloads on GCP using Vertex AI and BigQuery.

Skills

English

Data engineering

Python

Education

Bachelor’s degree in a relevant field

Tools

FastAPI

Django

SQLAlchemy

SQL

Pydantic

Airflow

BigQuery

Vertex AI

Pinecone

ChromaDB

Neo4j

Cloud Composer

Prefect

Job description

Prediktive is seeking a Cloud Data Engineer based in Latin America to work on a long-term project for a Los Angeles–based Data Analytics and BI services company. You will help design and build the data store for autonomous agents and create scalable, multi‑modal data pipelines.

The role involves embedding data in vector and graph databases, developing RESTful APIs with Python (FastAPI/Django), and deploying data workloads on GCP.