Data Engineer - Real-Time Pipelines (Kinesis, Oracle, S3)

Quantum Technologies LLC

Charlotte (NC)

On-site

USD 96,000 - 131,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Quantum Technologies. LLC in Charlotte, NC is seeking a Data Engineer to optimize data pipelines from Kinesis to Oracle, with emphasis on real-time streaming and S3 data integration.

You will build services to access NetApp object stores via the S3 API, create analytical datasets in Parquet/Iceberg formats, and develop housekeeping scripts for logs and archives. Strong Python/Java and distributed data systems experience is required.

Qualifications

  • Strong Python/Java and data engineering expertise.
  • Experience building and deploying data pipelines using frameworks like Spark, Flink and understanding of distributed data systems.
  • Hands-on experience with real-time streaming architectures, REST APIs, and database connectors.
  • Proficient with and Relational Databases (e.g. Oracle).
  • Experience working with Amazon S3 APIs for data storage and integration.

Responsibilities

  • Optimize data pipelines that read from Kinesis and Write into Oracle improve exception handling for schema/data type mismatches and implement alerting for data quality issues.
  • Build services to read/write data to NetApp object store using the S3 API.
  • Create analytical datasets in Parquet or Iceberg format.
  • Develop housekeeping scripts for cleanup, archiving, and compression of logs, Object store files, etc.

Skills

Python
Java
Data engineering
Spark
Flink
REST APIs
Distributed data systems
Oracle
Amazon S3

Job description

Quantum Technologies. LLC in Charlotte, NC is seeking a Data Engineer to optimize data pipelines from Kinesis to Oracle, with emphasis on real-time streaming and S3 data integration.

You will build services to access NetApp object stores via the S3 API, create analytical datasets in Parquet/Iceberg formats, and develop housekeeping scripts for logs and archives. Strong Python/Java and distributed data systems experience is required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineering Lead: Cloud-Native Pipelines & Real-Time Data
Data Engineering Lead: Cloud-Native Pipelines & Real-Time Data

Quantum Technologies. LLC • Irving (TX)

On-site
USD 84,000 - 120,000
Real-Time Data Engineer – Kinesis, S3 & Oracle
Real-Time Data Engineer – Kinesis, S3 & Oracle

Datumtg • Charlotte (NC)

On-site
USD 110,000 - 150,000
Data Engineer: Python & AWS Data Pipelines
Data Engineer: Python & AWS Data Pipelines

Quantum Technologies LLC • Plano (TX)

On-site
USD 120,000 - 160,000
Senior Data Engineer: Scalable Pipelines & Warehouses
Senior Data Engineer: Scalable Pipelines & Warehouses

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 120,000 - 160,000
AWS Data Engineer: Scalable Pipelines & Lakes
AWS Data Engineer: Scalable Pipelines & Lakes

Quantum Technologies LLC • Chicago (IL)

On-site
USD 120,000 - 170,000
Data Engineer – Pipelines, ETL & Cloud (AWS/Azure)
Data Engineer – Pipelines, ETL & Cloud (AWS/Azure)

Quantum Technologies LLC • Atlanta (GA)

On-site
USD 100,000 - 150,000
Senior AWS Data Engineer — Data Lakes & Pipelines
Senior AWS Data Engineer — Data Lakes & Pipelines

Quantum Technologies. LLC • New Jersey

On-site
USD 120,000 - 180,000
Data Engineer _ Charlotte, NC (Local / W2)
Data Engineer _ Charlotte, NC (Local / W2)

Datum Technologies Group • Charlotte (NC)

On-site
USD 110,000 - 150,000
Senior AWS Data Engineer – ETL & Big Data Pipelines
Senior AWS Data Engineer – ETL & Big Data Pipelines

Quantum Technologies. LLC • Chicago (IL)

On-site
USD 110,000 - 170,000
Senior AWS Data Engineer - Lead Data Lake & Pipelines
Senior AWS Data Engineer - Lead Data Lake & Pipelines

Quantum Technologies LLC • Newark (NJ)

On-site
USD 140,000 - 170,000