Data Engineer

Iprime Info; Overland Park (KS); On-site; USD 110,000 - 160,000; Full time

Job summary

Iprime Info in Overland Park, KS seeks a data engineering professional to design and manage scalable Dataflow jobs for historical and real-time data processing. You will develop Hadoop/Hive/PySpark solutions using Python, and build robust data pipelines with Pub/Sub, BigQuery and Cloud Functions.

The role emphasizes Agile collaboration, DevOps practices, and monitoring to ensure reliable data processing and analytics. Familiarity with logging and diagnostics is essential.

Qualifications

• Master’s degree in Computer Science, Engineering or related field.
• Experience designing and managing scalable batch and streaming Dataflow jobs.
• Strong knowledge of Hadoop, Hive, PySpark and Python.

Responsibilities

• Design and manage scalable batch and streaming Dataflow jobs for processing historical and real-time data.
• Develop Big Data applications using Hadoop, Hive, PySpark, and Python.
• Build centralized logging systems by integrating Dataflow logs with Cloud Logging for monitoring and troubleshooting.
• Use SQL and BigQuery for data transformation and analytics, and leverage Pub/Sub for reliable data ingestion.
• Automate data workflows with Cloud Functions and perform large-scale data analysis using Python and Pandas.
• Collaborate in Agile teams, following DevOps best practices for deployment and monitoring.

Skills

Agile methodologies

DevOps practices

Education

Master’s degree in Computer Science/Engineering/Technology/Management or related field

Tools

Hadoop

Hive

PySpark

Python

Dataflow

Cloud Logging

BigQuery

Pub/Sub

Cloud Functions

Pandas

Job description

Location: 10551 Barkley St Ste 405, Overland Park, KS 66212 United States

Posted Date: 04/20/2026

Role Description

• Master’s degree in Computer Science, Engineering any, Technology, Management orrelated to design and manage scalable batch and streaming Dataflow jobs for processing historical and real-time data.
• Develop Big Data applications using Hadoop, Hive, PySpark, and Python.
• Build centralized Logging systems by integrating Dataflow logs with Cloud Logging for monitoring and troubleshooting.
• Use SQL and Big Query for data transformation and analytics, and leverage Pub/Sub for reliable data ingestion.
• Automate data workflows with Cloud Functions and perform large-scale data analysis using Python and Pandas.
• Collaborate in Agile teams, following DevOps best practices for deployment and monitoring.

Qualifications: Master’s degree in Computer Science Engineering (any) Technology, Information Systems