Senior AI Data Engineer - Snowflake + GenAI (Remote)

Alpha Business Solutions; Chicago (IL); Remote; USD 180,000 - 240,000; Full time

Job summary

Alpha Business Solutions seeks a Senior AI Data Engineer to join the Data Engineering team. You will design, build, and operate scalable ingestion and transformation pipelines in Snowflake using AWS services and Python.

You will implement Snowflake Cortex AI workflows and develop Snowflake Native Apps to package data and AI capabilities. You will develop robust prompt versioning, response parsing, validation, and fallback logic, while tracking KPIs and ensuring data quality.

Qualifications

• 8+ years of experience with at least 5 years in Data Engineering.
• 2+ years hands-on with Generative AI applications.
• Strong Snowflake expertise including advanced SQL, Tasks/Streams, and performance tuning.
• Experience with Snowflake Cortex AI or equivalent.
• Experience building Snowflake Native Apps using Snowpark with Python/Scala.
• Strong AWS experience (S3, Lambda, Glue, Step Functions, DynamoDB, EC2, CloudFormation, Kinesis).
• CI/CD tools (GitHub Actions, Jenkins) and IaC (Terraform / CloudFormation).
• Experience building structured extraction pipelines from free-text inputs.
• Experience with ML/LLM observability (Arize or similar).
• Strong evaluation design, drift monitoring, and error analysis.
• Ability to work independently and communicate with stakeholders.

Responsibilities

• Design and implement ingestion pipelines from multiple sources into Snowflake using AWS and Python.
• Build and optimize SQL-based transformations for text cleansing, normalization, and deduplication.
• Implement Snowflake Cortex AI workflows for classification, extraction, and data generation.
• Develop prompt versioning, response parsing, validation, and fallback logic.
• Snowflake Native Apps development: packaging data/AI capabilities, manage objects, permissions, and release workflows; integrate Snowpark logic and CI/CD.
• Define and track data and model quality KPIs (precision, recall, coverage, drift, errors).
• Integrate Arize or comparable platform for observability and root-cause analysis of model behavior.
• Support production rollout: deployment automation, runbooks, documentation, and handoff to internal teams.

Skills

Snowflake expertise

AWS

Generative AI apps

SQL optimization

Snowflake Cortex AI

Snowflake Native Apps

CI/CD (GitHub Actions/Jenkins)

IaC (Terraform/CloudFormation)

Structured text extraction pipelines

ML/LLM observability (Arize)

Python/Scala (Snowpark)

Data quality and KPI tracking

Stakeholder communication

Education

Bachelor's degree in CS/Engineering/Data Science

AWS/Snowflake certifications

Tools

Snowflake

AWS

Snowpark (Python/Scala)

GitHub Actions

Jenkins

Terraform

CloudFormation

Arize

Job description

Alpha Business Solutions seeks a Senior AI Data Engineer to join the Data Engineering team. You will design, build, and operate scalable ingestion and transformation pipelines in Snowflake using AWS services and Python.

You will implement Snowflake Cortex AI workflows and develop Snowflake Native Apps to package data and AI capabilities. You will develop robust prompt versioning, response parsing, validation, and fallback logic, while tracking KPIs and ensuring data quality.