Data Engineer, Big Data — Spark/Scala, Hadoop & SQL

Computer Task; Piscataway Township (NJ); On-site; USD 143,270,000 - 171,924,000; Full time

Job summary

CTG is seeking a Data Engineer – Big Data (Spark/Scala, Hadoop, SQL, Python) for a 12‑month engagement in Piscataway, NJ. Responsibilities include designing and maintaining Spark+Scala data-processing apps, building ETL pipelines, and ensuring data quality in a collaborative Agile environment.

The role requires hands-on experience with Spark, Hadoop ecosystem, SQL, and Python, plus data engineering best practices and CI/CD familiarity. Banking/financial data experience is a plus.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• Excellent verbal and written English communication skills.
• Experience in enterprise Big Data environments and distributed data processing.
• Experience designing, developing, testing, and debugging complex code.

Responsibilities

• Design, develop, test, and maintain scalable data-processing applications using Spark and Scala.
• Develop and support Big Data pipelines with Hadoop, Hive, and Impala.
• Write complex SQL queries for data extraction, transformation, reconciliation, analysis, and performance optimization.
• Develop Python scripts for data processing and automation.
• Build and maintain ETL/data pipelines for large datasets.
• Analyze, troubleshoot, and debug data-processing code.
• Support data quality, validation, and data integrity across platforms.
• Collaborate with developers, analysts, and stakeholders in Agile environments.
• Contribute to API development and Big Data analytics solutions.

Skills

Apache Spark

Scala

SQL

Python

ETL/data pipelines

Data quality

Agile development

CI/CD

Education

Bachelor’s degree in CS/IT/Engineering

Tools

Apache Hadoop

Apache Hive

Apache Impala

Job description

CTG is seeking a Data Engineer – Big Data (Spark/Scala, Hadoop, SQL, Python) for a 12‑month engagement in Piscataway, NJ. Responsibilities include designing and maintaining Spark+Scala data-processing apps, building ETL pipelines, and ensuring data quality in a collaborative Agile environment.

The role requires hands-on experience with Spark, Hadoop ecosystem, SQL, and Python, plus data engineering best practices and CI/CD familiarity. Banking/financial data experience is a plus.