AI Data Engineer for Azure & RAG Pipelines

Compunnel, Inc.; Pennsylvania; On-site; USD 100,000 - 130,000; Full time

Job summary

Compunnel, Inc. is seeking a skilled Data Engineer – AI located in Pennsylvania to design and build scalable data pipelines that support AI/ML workloads. The ideal candidate will have extensive experience in SQL and Python, as well as strong knowledge of Azure cloud technologies and AI-driven data platforms. This role involves developing robust storage solutions and optimizing workflows for performance and reliability in data processing.

Qualifications

• 5+ years of strong experience in SQL and Python.
• 5+ years of experience working in Azure cloud environments.
• 5+ years of experience with AI-driven analytics or data platforms.

Responsibilities

• Design and build scalable data pipelines for ingestion, transformation, and processing of AI/ML data.
• Develop and manage data storage solutions, including vector databases.
• Implement data lineage, validation, and security controls to ensure data quality.

Skills

SQL

Python

Azure cloud technologies

AI-driven analytics

ETL/ELT pipeline design

Data governance

Education

Bachelor’s degree in Computer Science or equivalent work experience

Tools

Pinecone

Milvus

Hugging Face

LangChain

Job description

Compunnel, Inc. is seeking a skilled Data Engineer – AI located in Pennsylvania to design and build scalable data pipelines that support AI/ML workloads. The ideal candidate will have extensive experience in SQL and Python, as well as strong knowledge of Azure cloud technologies and AI-driven data platforms. This role involves developing robust storage solutions and optimizing workflows for performance and reliability in data processing.