Data Engineer

Saransh Inc; Charlotte (NC); Presencial; USD 120.000 - 160.000; Jornada completa

Descripción de la vacante

Saransh Inc is seeking a Data Engineer in Charlotte, NC, onsite from Day 1. The role requires 10+ years of experience in data engineering, with strong Python/Java and hands-on streaming experience.

You will optimize data pipelines, build S3-backed data services, and create analytical datasets, while maintaining data quality and efficient storage. Responsibilities include developing housekeeping scripts and integrating with Oracle and NetApp/object stores.

Formación

• Minimum 10+ years in data engineering or equivalent.
• Proficiency in Python/Java and building data pipelines.
• Experience with Spark/Flink and distributed data architectures.
• Hands-on with real-time streaming, REST APIs, and data/DB connectors.
• Experience with Oracle databases and AWS S3 for data storage.

Responsabilidades

• Optimize data pipelines reading from Kinesis and writing to Oracle with improved schema/data-type handling and data-quality alerts.
• Build services to read/write data to NetApp object store using the S3 API.
• Create analytical datasets in Parquet or Iceberg formats.
• Develop housekeeping scripts for cleanup, archiving, and compression of logs and object-store files.

Conocimientos

Python

Java

Data engineering

Spark

Flink

Real-time streaming

REST APIs

Oracle

Amazon S3

Distributed systems

Herramientas

Kinesis

Oracle DB

S3 API

NetApp S3

Iceberg (nice-to-have)

Descripción del empleo

Data Engineer

Location: Charlotte, NC - Onsite

Experience: 10+

Day 1 onsite

Key responsibilities for the Data Engineer:

• Optimize data pipelines that read from Kinesis and Write into Oracle improve exception handling for schema/data type mismatches and implement alerting for data quality issues.
• Build services to read/write data to NetApp object store using the S3 API.
• Create analytical datasets in Parquet or Iceberg format.
• Develop housekeeping scripts for cleanup, archiving, and compression of logs, Object store files, etc.

Core skill requirements:

• Strong Python/Java and data engineering expertise.
• Experience building and deploying data pipelines using frameworks like Spark, Flink and understanding of distributed data systems.
• Hands-on experience with real-time streaming architectures, REST APIs, and database connectors.
• Proficient with and Relational Databases (e.g. Oracle).
• Experience working with Amazon S3 APIs for data storage and integration.

Preferred (nice-to-have):

• Experience with Apache Iceberg.