Big Data Engineer / Sr. Engineer

Implify Inc; Jersey City (NJ); On-site; USD 100,000 - 130,000; Full time

Job summary

A tech company is seeking a Big Data Engineer/Sr. Engineer in Jersey City, NJ. The role involves evaluating and developing big data solutions for analytics projects, managing data workflows, and deploying machine learning models. Required qualifications include 3+ years of experience with Java, Python, or C++, and strong familiarity with AWS and Hadoop. Ideal candidates will demonstrate problem-solving skills and an ability to work in an agile team environment. This position is full-time and permanent.

Qualifications

• 3+ years of experience in developing technological solutions to complex data problems.
• Expert-level skills in Java, C++, or Python.
• Understanding of distributed computing frameworks like Hadoop and Spark.

Responsibilities

• Evaluate, develop, and maintain big data solutions for analytics projects.
• Manage big data pre-processing and reporting workflows.
• Test machine learning models on Big Data and deploy for ongoing prediction.

Skills

Java

Python

C++

Linux environment

Shell scripting

Hadoop

Spark

AWS

Education

B.E/B.Tech in Computer Science or related technical degree

Job description

Job Description

Job Title: Big Data Engineer / Sr. Engineer

Location: Jersey City, NJ

Full Time Permanent

If you are an exceptional developer with an aptitude to learn and implement using new technologies, and who loves to push the boundaries to solve complex business problems innovatively, then we would like to talk with you.

RESPONSIBILITIES

• Evaluating, developing, maintaining and testing big data solutions for advanced analytics projects.
• Managing big data pre-processing & reporting workflows, including collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into business insights.
• Testing various machine learning models on Big Data, and deploying learned models for ongoing scoring and prediction. Appreciation of the mechanics of complex machine learning algorithms would be a strong advantage.

QUALIFICATIONS & EXPERIENCE

• 3+ years of demonstrable experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.
• Expert-level proficiency in at least one of Java, C++ or Python (preferred). Scala knowledge is a strong advantage.
• Strong understanding and experience in distributed computing frameworks, particularly Apache Hadoop 2.0 (YARN, MR & HDFS) and associated technologies – one or more of Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, etc.
• Hands‑on experience with Apache Spark and its components (Streaming, SQL, MLLib) is a strong advantage.
• Operating knowledge of cloud computing platforms (AWS, especially EMR, EC2, S3, SWF services and the AWS CLI).
• Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common tasks.
• Ability to work in a team in an agile setting, familiarity with JIRA and clear understanding of how Git works.

In addition, the ideal candidate would have great problem‑solving skills, and the ability & confidence to hack their way out of tight corners.

MUST HAVE (hands‑on) experience

• Java, Python or C++ expertise.
• Linux environment and shell scripting.
• Distributed computing frameworks (Hadoop or Spark).
• Cloud computing platforms (AWS).

DESIRABLE (would be a plus)

• Statistical or machine learning DSL like R.
• Distributed and low latency (streaming) application architecture.
• Row store distributed DBMSs such as Cassandra.
• Familiarity with API design.

EDUCATION

• B.E/B.Tech in Computer Science or related technical degree.

Additional Information

All your information will be kept confidential according to EEO guidelines.