Founding Data Engineer

Alldus International Consulting

San Francisco (CA)

On-site

USD 150,000 - 200,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity

Job summary

Alldus International Consulting in San Francisco is seeking a founding-level Data Engineer to design and operate the backend data foundation for Agentic AI applications. You’ll own production-grade pipelines, connector frameworks, and graph-based models with strong governance, observability, and secure data access.

Collaborate with ML/LLM teams to ensure high-quality data for training and AI features, and ship scalable systems that handle schema evolution, telemetry, and auditable data flows in

Qualifications

  • 5+ years building large-scale data infrastructure in production.
  • Experience with ingestion frameworks (Kafka, Airbyte, Meltano, Fivetran) and orchestrators (Airflow, Dagster, Prefect).
  • Work with structured, semi-structured, and unstructured data.
  • Strong knowledge of graphs and semantic modelling.

Responsibilities

  • Build production-grade data pipelines and ingestion.
  • Develop connector frameworks for ERPs, CRMs, and APIs.
  • Build data fabric and knowledge graphs with governance.
  • Ensure observability, security, and data quality.
  • Collaborate with ML/LLM teams.

Skills

Data infrastructure design
Production pipelines
Governance & observability
Secure data access
Knowledge graphs
API design (GraphQL/REST)
Graph-based modelling
Data contracts & lineage
Vector databases
RAG pipelines
ML/LLM collaboration
Data ingestion & ETL

Tools

Kafka
Airbyte
Meltano
Fivetran
Airflow
Dagster
Prefect
Neo4j
Weaviate
Qdrant
Pinecone
Delta
Iceberg
Parquet

Job description

Alldus International Consulting is seeking a founding-level Data Engineer to help build the backend systems and data foundation behind Agentic AI applications. This onsite role in San Francisco, CA focuses on production-grade pipelines, connector frameworks, and graph-based knowledge models, with a strong emphasis on governance, observability, and secure data access. Compensation includes a $150,000 to $200,000 salary range plus equity.

What you'll build
  • Data ingestion and transformation pipelines across structured, semi-structured, and unstructured sources.
  • Connector frameworks to integrate enterprise systems such as ERPs, PLMs, CRMs, legacy platforms, email, Excel, documents, and web APIs.
  • Data Fabric and knowledge graphs, including enrichment with ontologies, metadata, and relationships.
  • Semantic data preparation for AI and LLM workloads, including vectorization for use cases such as RAG, summarization, and intelligent alerting.
  • Data contracts, access layers, lineage, governance, and quality processes to keep enterprise data reliable and auditable.
  • Secure APIs that allow services, AI agents, and users to access and query enriched semantic data.
  • Collaboration with ML and LLM teams to ensure high-quality enterprise data for training, tuning, and AI applications.
  • Production systems that handle schema evolution, observability, scalability, and dependable operations.
What you bring
  • At least 5 years of experience designing, building, and operating large-scale data infrastructure in production environments.
  • Hands-on experience with ingestion frameworks including Kafka, Airbyte, Meltano, or Fivetran, plus orchestration tools such as Airflow, Dagster, or Prefect.
  • Experience working with structured, semi-structured, and unstructured data, including PDFs, Excel, emails, logs, CSVs, and web APIs.
  • Knowledge of columnar data stores, object storage, and lakehouse technologies such as Iceberg, Delta, or Parquet.
  • Strong understanding of knowledge graphs and semantic modelling, with experience using Neo4j, RDF, Gremlin, or PuppyGraph.
  • Experience designing and developing GraphQL and REST APIs, including scalable, developer-friendly data access layers.
  • Strong data governance knowledge, including RBAC, ABAC, data contracts, lineage, and data quality.
  • Vector database and embedding pipeline experience, including Weaviate, Qdrant, or Pinecone (highly desirable).
  • Familiarity with enterprise connector ecosystems, ontology versioning, graph diffing, and semantic schema alignment (advantage).
  • Exposure to RAG pipelines, LLM fine-tuning, Linked Data, W3C standards, or modern data fabric architectures (plus).
Technologies you'll likely work with
  • Ingestion and orchestration: Kafka, Airbyte, Meltano, Fivetran, Airflow, Dagster, Prefect
  • Data and storage: Iceberg, Delta, Parquet
  • Graph and semantics: Neo4j, RDF, Gremlin, PuppyGraph
  • APIs and governance: GraphQL, REST APIs, RBAC, ABAC
  • Vector and AI data prep: Weaviate, Qdrant, Pinecone, RAG pipelines, LLM fine-tuning
  • Standards and related areas: Linked Data, W3C standards
Compensation
  • Salary: USD $150,000 to $200,000 per year
  • Equity
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Data Engineer — Equity & Production Data Pipelines
Founding Data Engineer — Equity & Production Data Pipelines

Alldus International Consulting • San Francisco (CA)

On-site
USD 150,000 - 200,000
Equity
Data Engineer (Founding Team)
Data Engineer (Founding Team)

Fabrion • San Francisco (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Early-stage equity
Senior AI Data Engineer
Senior AI Data Engineer

Huxley • Boston (MA)

Hybrid
USD 225,000 - 275,000
Senior Staff Forward Deployed Engineer
Senior Staff Forward Deployed Engineer

Alation, Inc. • United States

On-site
USD 152,000 - 205,000
Commuter benefits
Flexible time off
Health offerings
AI Data Engineer
AI Data Engineer

Robotics Technologies • Dallas (TX)

On-site
USD 91,000 - 129,000
Senior Data Engineer (AI-Native) — Data Layer
Senior Data Engineer (AI-Native) — Data Layer

protonai • United States

Remote
USD 150,000 - 210,000
Senior Data Engineer - Genai & Cloud Data Platforms
Senior Data Engineer - Genai & Cloud Data Platforms

Tata Consultancy Services Limited • Boston (MA)

On-site
USD 120,000 - 140,000
AI Data Engineer
AI Data Engineer

Aptlogica Technologies • United States

Remote
USD 120,000 - 180,000
Senior Data & AI Engineer | Scalable Pipelines & AI-First
Senior Data & AI Engineer | Scalable Pipelines & AI-First

Luxoft • Los Angeles (CA)

On-site
USD 150,000 - 210,000
Staff Forward Deployed Engineer
Staff Forward Deployed Engineer

Alation, Inc. • North Carolina

Remote
USD 125,000 - 168,000