Big Data Solutions Engineer

Jobsbridge; Bridgewater (MA); On-site; USD 90,000 - 120,000; Full time

Job summary

A prominent IT staffing organization is seeking a candidate to build scalable data pipelines and collaborate on data tools development. Ideal candidates have a BS in Computer Science, at least 2 years of experience with Big Data platforms, and proficiency in technologies such as Java, Python, and Scala. Strong analytical and communication skills are required, along with knowledge of data visualization and ETL tools. This position offers opportunities for growth and development in an innovative environment.

Qualifications

• Minimum 2 Year Experience on Big Data Platform.
• Proficiency in big data related technologies.
• Understanding of various Visualization platforms.

Responsibilities

• Build distributed, scalable, and reliable data pipelines.
• Collaborate to design and develop data tools.
• Perform offline analysis of large data sets.
• Evaluate technical aspects of open work requests.
• Own product features from development to deployment.

Skills

Java

Python

Scala

HBase

Hive

MapReduce

ETL

Kafka

Mongo

Postgres

Data Visualization

Hadoop

Education

BS in Computer Science or related area

Tools

Tableau

D3JS

Apache Spark

Data Stage

Informatica

Job description

Jobs Bridge Inc is among the fastest growing IT staffing / professional services organization with its own job portal.

Jobs Bridge works extremely closely with a large number of IT organizations in the most in-demand technology skill sets.

Job Description

OPT and EAD can apply

Desired Skills and Experience

Job Responsibilities:

Build distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.

Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases.

Perform offline analysis of large data sets using components from the Hadoop ecosystem.

Evaluate and advise on technical aspects of open work requests in the product backlog with the project lead.

Own product features from the development phase through to production deployment.

Evaluate big data technologies and prototype solutions to improve our data processing architecture.

Candidate Profile:

BS in Computer Science or related area

Minimum 2 Year Experience on Big Data Platform

Proficiency with Java, Python, Scala, HBase, Hive, MapReduce, ETL, Kafka, Mongo, Postgres, Visualization technologies etc.

Flair for data, schema, data model, how to bring efficiency in big data related life cycle

Understanding of automated QA needs related to Big data

Understanding of various Visualization platform (Tableau, D3JS, others)

Proficiency with agile or lean development practices

Strong object‑oriented design and analysis skills

Excellent technical and organizational skills

Excellent written and verbal communication skills

Top skill sets / technologies in the ideal candidate:

• Batch processing – Hadoop MapReduce, Cascading/Scalding, Apache Spark
• Stream processing – Apache Storm, AKKA, Samza, Spark streaming
• ETL Tools – Data Stage, Informatica

Technologies that we use include:

• R
• Java
• Hadoop/MapReduce
• Flume
• Storm
• Kafka
• MemSQL
• Pig
• Hive
• ETL

Qualifications