Senior Data Engineer - AI-Powered Support Data Pipelines

Pegasus Knowledge Solutions, Inc.; New York (NY); On-site; USD 120,000 - 190,000; Full time

Job summary

Pegasus Knowledge Solutions, Inc. is seeking an experienced Data Engineer to build pipelines, storage, and logic powering our AI-driven support analytics. You will transform unstructured chats and tickets into clean, structured data our AI agents can reliably use.

You will ingest data from Bliss, Salesforce, Sprinklr, and JIRA; design vector-enabled storage; and deliver a centralized metrics layer. Collaboration with ops, product, and engineering is essential to improve data practices at the

Qualifications

• 5+ years in data engineering with big data tools and cloud data warehouses.
• Strong hands-on Python and PySpark experience.
• Experience using AI tools to accelerate development and parse text.
• Direct experience with vector databases and AI data pipelines.

Responsibilities

• Ingest and clean large volumes of unstructured support data from Bliss, Salesforce, Sprinklr, and JIRA.
• Design storage and retrieval systems including vector databases for AI context.
• Build a centralized metrics layer for AI-driven analytics.
• Collaborate with ops, product, and engineering; improve data practices at the source.

Skills

Big data tools

Python

PySpark

AI tools

Vector databases

Semantic layers

Tools

Pinecone

Milvus

Weaviate

pgvector

Job description

Pegasus Knowledge Solutions, Inc. is seeking an experienced Data Engineer to build pipelines, storage, and logic powering our AI-driven support analytics. You will transform unstructured chats and tickets into clean, structured data our AI agents can reliably use.

You will ingest data from Bliss, Salesforce, Sprinklr, and JIRA; design vector-enabled storage; and deliver a centralized metrics layer. Collaboration with ops, product, and engineering is essential to improve data practices at the