AI Data Engineer: Real-Time Pipelines & ML Infra

Insight Global; Philadelphia (Philadelphia County); On-site; USD 100,000 - 130,000; Full time

Job summary

Insight Global is looking for a Data Engineer (AI) based in Philadelphia, PA. This role is integral to the data and machine learning infrastructure behind our clients' pricing and inventory decision-support tool, ensuring it operates with real-time data and reliable predictions.

Responsibilities include building data pipelines, normalizing vendor data, and operationalizing ML models. Strong experience in production environments, batch and streaming data pipelines is essential. Join a diverse, inclusive environment where every employee is valued.

Qualifications

• Strong experience as a Data Engineer or AI/ML Engineer in production environments.
• Proven experience with batch and streaming data pipelines.
• Expertise in model deployment and serving through APIs and microservices.

Responsibilities

• Build and maintain batch and near real-time data pipelines.
• Normalize and integrate data from multiple vendors into a unified analytics foundation.
• Develop APIs and services to serve model outputs.

Skills

Data pipelines (batch and streaming)

Model deployment and serving

Monitoring and observability for ML systems

Working with IoT or telemetry data

Cloud-native technologies

Tools

Snowflake

Job description

Insight Global is looking for a Data Engineer (AI) based in Philadelphia, PA. This role is integral to the data and machine learning infrastructure behind our clients' pricing and inventory decision-support tool, ensuring it operates with real-time data and reliable predictions.

Responsibilities include building data pipelines, normalizing vendor data, and operationalizing ML models. Strong experience in production environments, batch and streaming data pipelines is essential. Join a diverse, inclusive environment where every employee is valued.