Senior Data Engineer — Spark, Oracle & Cloud Analytics

Valiant Technologies LLC; Irving (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Valiant Technologies LLC is seeking an experienced Data Engineer to support large-scale data modernization and analytics initiatives. You will work with Oracle-based platforms, Apache Spark, and modern cloud analytics solutions to design high-performance data pipelines.

Responsibilities include building ETL/ELT pipelines, optimizing Spark jobs, and implementing data ingestion using Oracle GoldenGate, Kafka, and CDC frameworks.

Qualifications

• 8+ years of experience in Data Engineering or related roles.
• Strong hands-on experience with Apache Spark (PySpark and/or Scala) and Python.
• Deep understanding of Oracle databases supporting OLAP, data warehousing, and analytical workloads.
• Proven experience tuning and optimizing Spark applications and execution plans.
• Proven ability to optimize complex SQL queries and large-scale ETL/ELT processes.
• Strong SQL and data modeling skills.
• Experience with Oracle GoldenGate, CDC, or enterprise-scale data integration technologies.

Responsibilities

• Design, develop, and optimize large-scale data processing solutions using Apache Spark (PySpark/Scala) and Python.
• Build and maintain scalable ETL/ELT pipelines for analytical and reporting workloads.
• Optimize query performance, Spark jobs, and end-to-end data processing pipelines for high-volume batch and near real-time workloads.
• Design and implement data integration, replication, and ingestion solutions using Oracle GoldenGate, Kafka, and CDC frameworks.
• Collaborate with application, data, and analytics teams to develop scalable data models and processing frameworks.
• Drive performance tuning initiatives across Oracle, Spark, and distributed data processing environments.

Skills

Apache Spark (PySpark/Scala)

Python

SQL

Data modeling

ETL/ELT

Oracle databases

Oracle GoldenGate

CDC

Kafka

Tools

Spark (PySpark/Scala)

Python

Kafka

Oracle GoldenGate

Dataproc/BigQuery

Job description

Valiant Technologies LLC is seeking an experienced Data Engineer to support large-scale data modernization and analytics initiatives. You will work with Oracle-based platforms, Apache Spark, and modern cloud analytics solutions to design high-performance data pipelines.

Responsibilities include building ETL/ELT pipelines, optimizing Spark jobs, and implementing data ingestion using Oracle GoldenGate, Kafka, and CDC frameworks.