Alldus International Consulting is seeking a founding-level Data Engineer to help build the backend systems and data foundation behind Agentic AI applications. This onsite role in San Francisco, CA focuses on production-grade pipelines, connector frameworks, and graph-based knowledge models, with a strong emphasis on governance, observability, and secure data access. Compensation includes a $150,000 to $200,000 salary range plus equity.
What you'll build
- Data ingestion and transformation pipelines across structured, semi-structured, and unstructured sources.
- Connector frameworks to integrate enterprise systems such as ERPs, PLMs, CRMs, legacy platforms, email, Excel, documents, and web APIs.
- Data Fabric and knowledge graphs, including enrichment with ontologies, metadata, and relationships.
- Semantic data preparation for AI and LLM workloads, including vectorization for use cases such as RAG, summarization, and intelligent alerting.
- Data contracts, access layers, lineage, governance, and quality processes to keep enterprise data reliable and auditable.
- Secure APIs that allow services, AI agents, and users to access and query enriched semantic data.
- Collaboration with ML and LLM teams to ensure high-quality enterprise data for training, tuning, and AI applications.
- Production systems that handle schema evolution, observability, scalability, and dependable operations.
What you bring
- At least 5 years of experience designing, building, and operating large-scale data infrastructure in production environments.
- Hands-on experience with ingestion frameworks including Kafka, Airbyte, Meltano, or Fivetran, plus orchestration tools such as Airflow, Dagster, or Prefect.
- Experience working with structured, semi-structured, and unstructured data, including PDFs, Excel, emails, logs, CSVs, and web APIs.
- Knowledge of columnar data stores, object storage, and lakehouse technologies such as Iceberg, Delta, or Parquet.
- Strong understanding of knowledge graphs and semantic modelling, with experience using Neo4j, RDF, Gremlin, or PuppyGraph.
- Experience designing and developing GraphQL and REST APIs, including scalable, developer-friendly data access layers.
- Strong data governance knowledge, including RBAC, ABAC, data contracts, lineage, and data quality.
- Vector database and embedding pipeline experience, including Weaviate, Qdrant, or Pinecone (highly desirable).
- Familiarity with enterprise connector ecosystems, ontology versioning, graph diffing, and semantic schema alignment (advantage).
- Exposure to RAG pipelines, LLM fine-tuning, Linked Data, W3C standards, or modern data fabric architectures (plus).
Technologies you'll likely work with
- Ingestion and orchestration: Kafka, Airbyte, Meltano, Fivetran, Airflow, Dagster, Prefect
- Data and storage: Iceberg, Delta, Parquet
- Graph and semantics: Neo4j, RDF, Gremlin, PuppyGraph
- APIs and governance: GraphQL, REST APIs, RBAC, ABAC
- Vector and AI data prep: Weaviate, Qdrant, Pinecone, RAG pipelines, LLM fine-tuning
- Standards and related areas: Linked Data, W3C standards
Compensation
- Salary: USD $150,000 to $200,000 per year
- Equity