Data Engineer: Real-Time Pipelines & Big Data

Galent; Charlotte (NC); On-site; USD 110,000 - 160,000; Full time

Job summary

Galent in Charlotte, NC is seeking a Data Engineer to design and optimize scalable data pipelines and real-time streaming solutions using Python/Java. You will work with Spark, Flink, and integrate with Oracle databases and S3-compatible storage to enable analytics at scale.

Join a team focused on robust data architectures, data quality, and efficient processing of large volumes of logs and events, with hands-on development and production support.

Qualifications

• Proven ability to design and implement scalable data pipelines and distributed data processing systems.
• Strong experience with Python/Java development and data engineering concepts.
• Hands-on knowledge of real-time streaming architectures and REST APIs.

Responsibilities

• Optimize data pipelines reading from Kinesis and writing to Oracle; improve schema/data type error handling and implement data quality alerts.
• Build services to read/write data to NetApp object store using the S3 API.
• Create analytical datasets in Parquet or Iceberg formats.

Skills

Python

Java

Data engineering

Spark

Flink

Real-time streaming

REST APIs

Tools

Oracle

Amazon S3

NetApp

Job description

Galent in Charlotte, NC is seeking a Data Engineer to design and optimize scalable data pipelines and real-time streaming solutions using Python/Java. You will work with Spark, Flink, and integrate with Oracle databases and S3-compatible storage to enable analytics at scale.

Join a team focused on robust data architectures, data quality, and efficient processing of large volumes of logs and events, with hands-on development and production support.