Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Irving (TX); On-site; USD 150,000 - 190,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Irving, TX seeks an experienced Data Engineer to drive modernization of Oracle-based analytical platforms and Spark-powered pipelines. You will design, build, and optimize large-scale data processing workloads to support analytics initiatives and enable near real-time insights.

The ideal candidate will bring 8+ years in data engineering, hands-on Apache Spark (PySpark/Scala) and Python, and deep Oracle data warehousing expertise.

Qualifications

• 8+ years of experience in Data Engineering or related roles.
• Strong hands-on experience with Apache Spark (PySpark and/or Scala) and Python.
• Deep understanding of Oracle databases supporting OLAP, data warehousing, and analytical workloads.
• Proven experience tuning and optimizing: Spark applications and execution plans, complex SQL queries, large-scale ETL/ELT processes, high-volume batch processing workloads.
• Strong SQL and data modeling skills.
• Experience with Oracle GoldenGate, CDC, or enterprise-scale data integration technologies.

Responsibilities

• Design, develop, and optimize large-scale data processing solutions using Apache Spark (PySpark/Scala) and Python.
• Build and maintain scalable ETL/ELT pipelines for analytical and reporting workloads.
• Optimize query performance, Spark jobs, and end-to-end data processing pipelines for high-volume batch and near real-time workloads.
• Design and implement data integration, replication, and ingestion solutions using technologies such as Oracle GoldenGate, Kafka, and CDC frameworks.
• Collaborate with application, data, and analytics teams to develop scalable data models and processing frameworks.
• Drive performance tuning initiatives across Oracle, Spark, and distributed data processing environments.

Skills

Spark

Python

PySpark

Scala

SQL

Oracle

Kafka

CDC

Oracle GoldenGate

Tools

Oracle GoldenGate

Kafka

CDC

Spark

Python

SQL

PySpark

Job description

Job Overview

• Job ID: J53672
• Job Title: Data Engineer
• Location: Irving, TX
• Duration: 24 Months + Extension
• Domain Exposure: Banking & Finance
• Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, L2-EAD, GC-EAD
• Client: To Be Discussed Later
• Employment Type: W-2, 1099, C2C

Job Description

We are seeking an experienced Data Engineer with deep expertise in Oracle-based analytical platforms and Apache Spark to support large-scale data modernization, migration, and analytics initiatives. The ideal candidate will have hand-on experience building high-performance data pipelines, optimizing large-scale data processing workloads, and integrating enterprise data platforms with modern cloud analytics solutions.

Key Responsibilities

• Design, develop, and optimize large-scale data processing solutions using Apache Spark (PySpark/Scala) and Python.
• Build and maintain scalable ETL/ELT pipelines for analytical and reporting workloads.
• Optimize query performance, Spark jobs, and end-to-end data processing pipelines for high-volume batch and near real-time workloads.
• Design and implement data integration, replication, and ingestion solutions using technologies such as Oracle GoldenGate, Kafka, and CDC frameworks.
• Collaborate with application, data, and analytics teams to develop scalable data models and processing frameworks.
• Drive performance tuning initiatives across Oracle, Spark, and distributed data processing environments.

Required Qualifications

• 8+ years of experience in Data Engineering or related roles.
• Strong hand-on experience with Apache Spark (PySpark and/or Scala) and Python.
• Deep understanding of Oracle databases supporting OLAP, data warehousing, and analytical workloads.
• Proven experience tuning and optimizing:
  • Spark applications and execution plans
  • Complex SQL queries
  • Large-scale ETL/ELT processes
  • High-volume batch processing workloads
• Strong SQL and data modeling skills.
• Experience with Oracle GoldenGate, CDC, or enterprise-scale data integration technologies.

Preferred Qualifications

• Experience with Oracle Exadata and large-scale Oracle analytics platforms.
• Experience with Google Cloud Platform (GCP) services such as BigQuery, Dataproc, Cloud Storage, Pub/Sub, and Dataflow.
• Experience integrating Oracle with cloud data platforms, data lakes, Kafka, Hadoop, or BigQuery.
• Experience with Azure, OCI, or multi-cloud data architectures.
• Experience supporting large-scale data migration and modernization programs.

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.