AI Data Engineer: Enterprise Pipelines & RAG AI

Green Key Resources; New York (NY); On-site; USD 150,000 - 190,000; Full time

Job summary

Green Key Resources is seeking a Data Engineer in New York to implement advanced data pipelines and AI systems enabling enterprise analytics. You will collaborate across domains to develop reusable data and AI patterns under architectural guidelines, operating within a federated data model for scalability.

The role emphasizes building AI-ready pipelines, semantic NL analytics, and contributing to architectural standards while mentoring engineers.

Qualifications

• 6+ years of technical experience with data engineering
• 1–2 years in AI/ML systems development preferred
• Expertise in Python, SQL, and distributed processing frameworks

Responsibilities

• Implement advanced data pipelines and AI systems to support enterprise analytics and automation
• Collaborate with domain teams to develop reusable data/AI patterns under architectural guidelines
• Operate within a federated data model to ensure scalability and consistency
• Build AI-ready data pipelines and retrieval systems for generative AI applications
• Contribute to semantic engineering for NL analytics and AI-driven insights
• Mentor junior engineers on modern data engineering practices
• Deliver foundational AI-ready pipelines and reusable patterns within the first year
• Participate in architectural reviews to evolve standards

Skills

Python

SQL

Spark

RAG pipelines

embedding workflows

Vector stores

AI/ML systems

Education

Bachelor's degree in computer science/data engineering

Master's degree preferred

Tools

dbt

Snowflake

Fivetran

Job description

Green Key Resources is seeking a Data Engineer in New York to implement advanced data pipelines and AI systems enabling enterprise analytics. You will collaborate across domains to develop reusable data and AI patterns under architectural guidelines, operating within a federated data model for scalability.

The role emphasizes building AI-ready pipelines, semantic NL analytics, and contributing to architectural standards while mentoring engineers.