Data Engineer

Pyramid Consulting, Inc; España; Presencial; EUR 85.000 - 120.000; Jornada completa

Descripción de la vacante

Pyramid Consulting, Inc. is seeking a Senior Data Engineer with advanced Python/SQL skills and strong experience in Agentic AI, ML, and BI. You will lead data engineering workstreams, mentor engineers, and drive best practices across client enterprise systems.

The role covers RAG/embeddings, modern frameworks like Spark, LangChain, Databricks, and Kedro, plus MLOps and LLMOps, with emphasis on security, governance, and scalable CI/CD pipelines. Strong English communication is required.

Formación

• Degree in Computer Science, Engineering, or equivalent professional experience.
• 5+ years of relevant professional experience in data engineering, leading technical workstreams, mentoring junior engineers, and driving software engineering best practices across teams.
• Expert-level proficiency in Python and SQL, with the ability to work effectively in polyglot environments, including Scala and Java, within client enterprise systems.
• Strong experience building Agentic AI, Generative AI, Machine Learning, and Business Intelligence solutions, including RAG and embeddings.
• Context construction, production output handling, and modern frameworks such as Spark, LangChain, Databricks, Dask, Airflow, Dagster, and Kedro.
• Proven ability to lead AI feature delivery end to end, with judgment on model behaviour, evaluation, reliability, guardrails, and trade-offs between quality, latency, and cost.
• Experience implementing data security and governance controls, including PII/PHI management, authentication, and RBAC.
• Deep knowledge of MLOps and LLMOps, including CI/CD for data workflows, automated agent evaluation using LangSmith, Opik, and Langfuse, and Infrastructure as Code using Terraform.
• Experience across AWS, Azure, and GCP.
• Excellent time management and autonomy, with the ability to independently own and deliver technical workstreams.
• Experience using AI coding agents such as Cursor, Claude Code, and Codex is an advantage.
• Strong written and verbal communication skills in English and the relevant local office language(s).

Conocimientos

Python

SQL

AI feature delivery

Data governance

ML Ops

LLMOps

CI/CD for data workflows

English communication

time management

data security

Model evaluation

Educación

Degree in Computer Science or Engineering

Herramientas

Spark

LangChain

Databricks

Dask

Airflow

Dagster

Kedro

Terraform

AWS

Azure

GCP

Cursor

Claude Code

Codex

Descripción del empleo

• Degree in Computer Science, Engineering, or equivalent professional experience.
• 5+ years of relevant professional experience in data engineering, including leading technical workstreams, mentoring junior engineers, and driving software engineering best practices across teams.
• Expert-level proficiency in Python and SQL, with the ability to work effectively in polyglot environments, including Scala and Java, within client enterprise systems.
• Strong experience building Agentic AI, Generative AI, Machine Learning, and Business Intelligence solutions, including:
• RAG and embeddings
• Context construction
• Production output handling
• Modern frameworks such as Spark, LangChain, Databricks, Dask, Airflow, Dagster, and Kedro
• Proven ability to lead AI feature delivery end to end, with strong judgment around model behaviour, evaluation, reliability, guardrails, and the trade-offs between quality, latency, and cost.
• Experience implementing data security and governance controls, including PII/PHI management, authentication, and Role-Based Access Control (RBAC).
• Deep knowledge of MLOps and LLMOps, including:
• CI/CD for data workflows
• Automated agent evaluation using LangSmith, Opik, and Langfuse
• Infrastructure as Code using Terraform
• Experience across AWS, Azure, and GCP
• Excellent time management and autonomy, with the ability to independently own and deliver technical workstreams.
• Experience using AI coding agents such as Cursor, Claude Code, and Codex is an advantage.
• Strong written and verbal communication skills in English and the relevant local office language(s).