Data Engineer - AI

Compunnel Inc.

Pennsylvania

On-site

USD 100,000 - 130,000

Full time

14 days+

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Compunnel, Inc. is seeking a skilled Data Engineer – AI located in Pennsylvania to design and build scalable data pipelines that support AI/ML workloads. The ideal candidate will have extensive experience in SQL and Python, as well as strong knowledge of Azure cloud technologies and AI-driven data platforms. This role involves developing robust storage solutions and optimizing workflows for performance and reliability in data processing.

Qualifications

  • 5+ years of strong experience in SQL and Python.
  • 5+ years of experience working in Azure cloud environments.
  • 5+ years of experience with AI-driven analytics or data platforms.

Responsibilities

  • Design and build scalable data pipelines for ingestion, transformation, and processing of AI/ML data.
  • Develop and manage data storage solutions, including vector databases.
  • Implement data lineage, validation, and security controls to ensure data quality.

Skills

SQL
Python
Azure cloud technologies
AI-driven analytics
ETL/ELT pipeline design
Data governance

Education

Bachelor’s degree in Computer Science or equivalent work experience

Tools

Pinecone
Milvus
Hugging Face
LangChain

Job description

We are seeking a Data Engineer – AI to design and build scalable data pipelines that support AI/ML workloads and advanced analytics. This role focuses on developing robust data ingestion, transformation, and storage solutions, including support for Retrieval-Augmented Generation (RAG) systems. The ideal candidate will have strong experience in Python, SQL, Azure cloud technologies, and AI-driven data platforms.

Key Responsibilities
  • Design and build scalable data pipelines for ingestion, transformation, and processing of AI/ML data
  • Develop and manage data storage solutions, including vector databases for RAG systems
  • Implement data lineage, validation, and security controls to ensure data quality and compliance
  • Clean, structure, and optimize complex datasets for analytical and operational use
  • Support AI-driven analytics and data mapping initiatives
  • Work extensively on Azure cloud platforms to deploy and manage data solutions
  • Collaborate with cross-functional teams to enable AI and data-driven capabilities
  • Optimize data workflows for performance, scalability, and reliability
Required Qualifications
  • 5+ years of strong experience in SQL and Python
  • 5+ years of experience working in Azure cloud environments
  • 5+ years of experience with AI-driven analytics or data platforms
  • Familiarity with AI tools and frameworks such as vector databases (e.g., Pinecone, Milvus) and frameworks like Hugging Face or LangChain
  • Strong expertise in ETL/ELT pipeline design and data warehousing
  • Bachelor’s degree in Computer Science or equivalent work experience
Preferred Qualifications
  • Experience with Retrieval-Augmented Generation (RAG) architectures
  • Strong understanding of data governance, lineage, and security best practices
  • Experience working with large-scale, enterprise data platforms
  • Strong problem-solving and analytical skills
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Data Engineer for Azure & RAG Pipelines
AI Data Engineer for Azure & RAG Pipelines

Compunnel Inc. • Pennsylvania

On-site
USD 100,000 - 130,000
Data AI Engineer
Data AI Engineer

Compunnel Inc. • Columbus (OH)

On-site
USD 100,000 - 130,000
Sr. Data Engineer - AI
Sr. Data Engineer - AI

Dairy Farmers of America • Kansas City (KS)

On-site
USD 120,000 - 180,000
Senior Engineer - Data Engineering
Senior Engineer - Data Engineering

Ingrain Systems Inc • San Francisco (CA)

On-site
USD 180,000 - 260,000
Data Engineer
Data Engineer

Compunnel Inc. • San Jose (CA)

On-site
USD 120,000 - 180,000
Senior Data Engineer (Agentic AI / RAG Platform)
Senior Data Engineer (Agentic AI / RAG Platform)

TechDigital Group • Dearborn (MI)

On-site
USD 120,000 - 180,000
AI Data Engineer
AI Data Engineer

Quantum Technologies LLC • Atlanta (GA)

On-site
USD 120,000 - 180,000
AI Data Engineer
AI Data Engineer

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 170,000
Data Engineer
Data Engineer

FutureTech Consultants, LLC • Alpharetta (GA)

On-site
USD 120,000 - 190,000
Data Engineer - Analytics & AI
Data Engineer - Analytics & AI

Spectraforce Technologies, Inc. • Los Angeles (CA)

Remote
USD 120,000 - 170,000