Senior Big Data Engineer: Cloud Pipelines & ML

TechDigital Group; Jersey City (NJ); On-site; USD 90,000 - 150,000; Full time

Job summary

An innovative firm is looking for a talented Big Data Engineer to join their dynamic team. In this role, you will design and implement scalable data pipelines, develop machine learning models, and integrate complex big data systems. Your expertise in tools like Apache Spark, AWS Glue, and various databases will be crucial in optimizing data workflows and ensuring seamless data processing. This position offers the opportunity to work with cutting-edge technologies in cloud environments, contributing to impactful projects that drive data-driven decision-making. If you're passionate about big data and eager to make a difference, this is the perfect opportunity for you.

Qualifications

• Expertise in building scalable ETL pipelines and big data systems.
• Hands-on experience with machine learning frameworks and cloud platforms.

Responsibilities

• Build scalable ETL pipelines using Apache Spark and AWS Glue.
• Process large datasets with Hadoop and Kafka for real-time data streaming.

Skills

Apache Spark

AWS Glue

Google Dataflow

Hadoop

Kafka

MySQL

PostgreSQL

MongoDB

Cassandra

Machine Learning

Tools

Talend

Apache Flink

TensorFlow

PyTorch

Scikit-learn

Git

Job description

An innovative firm is looking for a talented Big Data Engineer to join their dynamic team. In this role, you will design and implement scalable data pipelines, develop machine learning models, and integrate complex big data systems. Your expertise in tools like Apache Spark, AWS Glue, and various databases will be crucial in optimizing data workflows and ensuring seamless data processing. This position offers the opportunity to work with cutting-edge technologies in cloud environments, contributing to impactful projects that drive data-driven decision-making. If you're passionate about big data and eager to make a difference, this is the perfect opportunity for you.