Senior Data Engineer — Informatica, PySpark & Hadoop Specialist

Olik Global; Kentucky; On-site; USD 90,000 - 130,000; Full time

Job summary

Olik Global is seeking a Senior Data Engineer to join their team in Kentucky. The ideal candidate will have strong expertise in Informatica PowerCenter/IDQ and PySpark, tasked with designing and optimizing large-scale data pipelines.

With a background in the Hadoop ecosystem, you'll be expected to lead project delivery using Agile methodologies and collaborate with clients to ensure top-notch performance.

Qualifications

• 8-10 years in Data Engineering and Data Analysis.
• Proficiency in designing and optimizing data pipelines.
• Understanding of database concepts and ETL workflows.

Responsibilities

• Design and develop large-scale data pipelines using Informatica and PySpark.
• Coordinate client interactions and lead projects using Agile methodology.
• Analyze, design, and code ETL programs to ensure data quality.

Skills

Informatica PowerCenter/IDQ

PySpark

Hadoop ecosystem

Python

Kafka

Agile methodology

Data modeling

Education

Master's or Bachelor's degree in Computer Science or related field

Tools

Hadoop (HDFS, Hive, Sqoop, MapReduce)

ETL design tools (like Erwin)

Job description

Olik Global is seeking a Senior Data Engineer to join their team in Kentucky. The ideal candidate will have strong expertise in Informatica PowerCenter/IDQ and PySpark, tasked with designing and optimizing large-scale data pipelines.

With a background in the Hadoop ecosystem, you'll be expected to lead project delivery using Agile methodologies and collaborate with clients to ensure top-notch performance.