Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Altimetrik is seeking an expert data engineering professional to design and deliver modular, production-ready pipelines using Python, Scala, PySpark, and Delta Lake on Databricks. You will optimize Spark workloads and contribute to large-scale batch and streaming data flows with robust data contracts.
You will build and evaluate LLM-based systems, including RAG pipelines and tool-calling workflows, leveraging LangChain or similar stacks and provider solutions like OpenAI or Azure OpenAI.
Expert - level proficiency in Python, Scala, and PySpark, with a strong track record of designing and delivering production-ready, modular, and well-tested solutions; developing and troubleshooting Spark workloads; and optimizing large-scale batch and streaming data pipelines using Delta Lake and Spark technologies.
Strong SQL and data modelling — dimensional and normalised; schema design and data contract definition.
Databricks expertise — Delta Lake, Unity Catalog, Jobs & Workflows, cluster and pool management, performance tuning, Model Serving.
3+ years designing and shipping LLM-based systems in production: RAG pipelines, agentic / tool-calling workflows, structured output, chunking and embedding strategy, vector and hybrid retrieval, and prompt engineering.
Evaluation discipline — golden datasets, regression suites, accuracy and hallucination tracking, human-in-the-loop feedback loops; you measure AI quality, not assert it.
Hands-on experience with LangChain, LlamaIndex, or LangGraph, plus at least one provider stack (Azure OpenAI, OpenAI, or Databricks Model Serving).
Metadata-driven thinking — schema inference, data profiling, lineage, catalogs, and configuration-driven frameworks that onboard the next source without new code.