Hadoop & Spark Data Engineer — FinTech

Synechron; Pittsburgh (Allegheny County); On-site; USD 110,000 - 120,000; Full time

Benefits offered by this job

Competitive compensation

Global opportunities

Training opportunities

Udemy for Business access

Job summary

Synechron in Pittsburgh seeks an experienced Hadoop Developer to design, develop, and maintain scalable big-data solutions for financial services applications. The role requires hands-on work with Hadoop ecosystem (HDFS, Spark, Hive, MapReduce, YARN) and ETL/ELT pipelines, plus strong Java/Scala/Python skills and SQL proficiency.

Competitive compensation and global opportunities are offered. You'll collaborate with data engineers, analysts, and application teams to ensure data quality, security,

Qualifications

• Bachelor’s degree in computer science, information technology, engineering, or related field.
• Hands-on Hadoop/big-data development experience.
• Proficiency with HDFS, Spark, Hive, MapReduce, YARN, Sqoop, Kafka, Flume, and HBase or similar NoSQL.
• Strong programming skills in Java, Scala, or Python; strong SQL; experience with batch and real-time pipelines.
• Linux/Unix shell scripting and familiarity with Git, CI/CD, Oozie, Airflow, or Control-M.

Responsibilities

• Design, develop, and maintain robust data pipelines using Hadoop ecosystem.
• Develop distributed data-processing solutions with Spark, Hive, MapReduce, and HBase.
• Ingest, transform, and process data from multiple sources; optimize ETL/ELT workflows.
• Collaborate with analysts, data architects, and app teams on data requirements.
• Ensure data quality, security, and compliance; troubleshoot production issues.

Skills

Hadoop

HDFS

Apache Spark

Hive

MapReduce

YARN

Kafka

SQL

Python

Java/Scala

Education

Bachelor’s degree in CS/IT/Engineering

Tools

Git

CI/CD

Oozie

Airflow

Control-M

Job description

Synechron in Pittsburgh seeks an experienced Hadoop Developer to design, develop, and maintain scalable big-data solutions for financial services applications. The role requires hands-on work with Hadoop ecosystem (HDFS, Spark, Hive, MapReduce, YARN) and ETL/ELT pipelines, plus strong Java/Scala/Python skills and SQL proficiency.

Competitive compensation and global opportunities are offered. You'll collaborate with data engineers, analysts, and application teams to ensure data quality, security,