Big Data Engineer: ETL, Spark & Data Pipelines

Synechron; Charlotte (NC); On-site; USD 100,000 - 110,000; Full time

Benefits offered by this job

Highly competitive compensation and benefits package

10 days of paid annual leave

Comprehensive insurance plan

Retirement savings plans

Extensive training opportunities

Job summary

A global consulting firm is seeking a Big Data Engineer to design, develop, and optimize large-scale data processing systems. The ideal candidate will have expertise in ETL workflows and proficiency in big data technologies such as Apache Hadoop, Spark, and Hive. Responsibilities include maintaining ETL pipelines, collaborating with teams to solve data challenges, and creating PowerBI reports. This role offers competitive compensation and benefits in an inclusive work environment.

Qualifications

• Proven experience in software engineering with a focus on big data ETL development.
• Hands-on experience with Apache Hadoop, Spark, Hive, and Pyspark/Python.
• Strong programming skills in Scala and Python.

Responsibilities

• Design, develop, and maintain robust ETL pipelines using big data tools.
• Collaborate with data scientists, analysts, and business teams.
• Create and deliver insightful PowerBI reports and dashboards.

Skills

Big data ETL development

Apache Hadoop

Spark

Hive

Pyspark

Python

Scala

UNIX/Linux shell scripting

Data modeling

RDBMS

Tools

PowerBI

Docker

Kubernetes

Job description

A global consulting firm is seeking a Big Data Engineer to design, develop, and optimize large-scale data processing systems. The ideal candidate will have expertise in ETL workflows and proficiency in big data technologies such as Apache Hadoop, Spark, and Hive. Responsibilities include maintaining ETL pipelines, collaborating with teams to solve data challenges, and creating PowerBI reports. This role offers competitive compensation and benefits in an inclusive work environment.