AI-First Data Engineer Consultant

IBM Computing; Charlotte (NC); Remote; USD 120.000 - 180.000; Vollzeit

Zusammenfassung

IBM Consulting seeks a Consultant, AI and Data Engineer to join our growing team. You will build Snowflake-based data foundations and AI solutions for enterprise clients, spanning data ingestion, modeling, governance, and model-serving pipelines.

You will collaborate with solution architects, data scientists, and client teams in a fast-paced, consultancy setting, deploying scalable, secure, and observable AI-powered data platforms across cloud environments.

Qualifikationen

• Spanning data engineering and applied AI; consulting or professional services experience is highly desirable.
• Strong SQL and Python; experience with dbt, Spark, or Snowpark for transformation.
• Experience building ETL / ELT ingestion pipelines and developing data warehouses on a cloud data platform (Snowflake preferred; Redshift, BigQuery, Databricks also relevant).
• Hands-on experience building LLM-based applications: prompt engineering, retrieval-augmented generation, vector stores and embeddings, and orchestration frameworks (LangChain, LlamaIndex, or equivalent).
• Working knowledge of ML fundamentals and the trade-offs between LLM, classical ML, and rules-based approaches.
• Proficiency with cloud platform services for data and AI workloads (AWS, Azure, or GCP).
• Experience with software engineering practices: Git-based version control, automated testing, CI/CD, and code review.
• Understanding of data governance, security, and compliance best practices as applied to both data pipelines and AI systems.
• Strong communication skills with the ability to explain data and AI concepts to non-technical stakeholders and build client relationships.
• Ability to work in cross-functional, Agile teams in a dynamic environment.

Aufgaben

• Design, build, and operate ETL/ELT ingestion pipelines and data warehouse models on Snowflake.
• Build, evaluate, and deploy LLM-based applications (RAG, agents, document intelligence) and classical ML models for client problems.
• Prepare, chunk, embed, and govern data for AI consumption with vector search and semantic layers.
• Implement Snowflake Cortex, Snowpark and related services; integrate with external model providers and cloud AI services.
• Define evaluation datasets and metrics for AI outputs; iterate on prompts, retrieval, and model selection.
• Deploy solutions to cloud environments (AWS, Azure, GCP, Snowflake) with CI/CD and infrastructure-as-code.
• Understand client requirements and present technical options; enable handoff to client teams.
• Apply data governance, privacy, and responsible AI practices across data and AI components.
• Produce clear documentation for pipelines, models, prompts, and architectures.
• Track Snowflake and AI ecosystem developments and bring practical recommendations to engagements.

Kenntnisse

Data engineering

SQL

Python

dbt

Spark

Snowpark

LLM Apps

Prompt engineering

Embeddings

LangChain

LlamaIndex

ML Basics

Cloud platforms

CI/CD

Git

Data governance

Communication

Agile

Tools

Snowflake

Redshift

BigQuery

Databricks

LangChain

LlamaIndex

Jobbeschreibung

IBM Consulting seeks a Consultant, AI and Data Engineer to join our growing team. You will build Snowflake-based data foundations and AI solutions for enterprise clients, spanning data ingestion, modeling, governance, and model-serving pipelines.

You will collaborate with solution architects, data scientists, and client teams in a fast-paced, consultancy setting, deploying scalable, secure, and observable AI-powered data platforms across cloud environments.