Hadoop Developer

Insight Global (United States)

Chicago (IL)

On-site

USD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical benefits
Dental benefits
Vision benefits
401k benefits

Job summary

An established industry player is seeking a talented Data Engineer to join their team. In this role, you will be responsible for developing and delivering innovative data solutions that drive business success. You will collaborate with cross-functional teams to implement data requirements and troubleshoot complex data issues. This position offers the chance to work with cutting-edge technologies, including Hadoop, Spark, and Kafka, while contributing to the design and build of both near-real-time and batch data pipelines. If you have a passion for data and a desire to solve challenging problems, this opportunity is perfect for you.

Qualifications

  • 5-10+ years of experience as a Data Engineer with Big Data technologies.
  • Strong SQL skills and experience with data formats like JSON and CSV.
  • Experience in end-to-end design of data pipelines.

Responsibilities

  • Develop and deliver data solutions to meet business goals.
  • Work with stakeholders to implement data requirements and troubleshoot issues.
  • Perform code design and delivery tasks for data integration and transformation.

Skills

Big Data Engineering
Hadoop
Kafka
SQL
Data Ingestion
Spark
Linux
Agile Development
Performance Tuning
Analytical Skills

Education

Bachelor's Degree in Computer Science or related field

Tools

Elasticsearch
HBase
Kibana
Jenkins
Git

Job description

Direct message the job poster from Insight Global

Technical Professional Recruiter @ Insight Global | Connecting Talent to Opportunity | 3x Recruiting Contest & Million Dollar Club

Details:

• 1-year W2 contract with extensions up to 2 years.

• Fully on-site 5 days a week in either Charlotte NC or Chicago IL.

• Set rate of $66/hr with optional medical, dental, vision, and 401k benefits.

We are seeking a skilled Data Engineer responsible for developing and delivering data solutions to accomplish technology and business goals and initiatives. Key responsibilities include performing code design and delivery tasks associated with the integration, cleaning, transformation, and control of data in operational and analytical data systems. Job expectations include working with stakeholders and Product and Software Engineering teams to aid with implementing data requirements, analyzing performance, and researching and troubleshooting data problems within system engineering domains.

Desired Experience & Qualifications:

  • 5-10+ years of Senior-Level experience as a Big Data and/or Data Engineer
  • Experience working with Hadoop/Big Data and Distributed Systems
  • Experience with Kafka, Batch, Elasticsearch
  • Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL
  • Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
  • Experience working with SPARK Structured streaming
  • Experience working with admin/prod support/debugging
  • Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
  • Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting, to name a few
  • Performance tuning experience with spark /MapReduce and/or SQL jobs
  • Experience and proficiency with Linux operating system are a must
  • Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
  • Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
  • Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.
  • Experience working with Jenkins and Jar management
  • Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
  • Strong analytical mind to help take on complicated problems
  • Desire to resolve issues and dive into potential issues
  • Ability to adapt and continue to learn new technologies is important
Seniority level

Mid-Senior level

Employment type

Contract

Job function

Information Technology

Industries

Banking and Financial Services

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Big Data & Hadoop Architect
Senior Big Data & Hadoop Architect

Avance Consulting Services • New Jersey

On-site
USD 100,000 - 130,000
Senior Hadoop Developer - Lead Big Data, Spark & ML
Senior Hadoop Developer - Lead Big Data, Spark & ML

360 IT Professionals Inc. • Bloomington (IL)

On-site
USD 100,000 - 130,000
Engineer
Engineer

Tata Consultancy Services Limited • Newark (DE)

On-site
USD 80,000 - 90,000
Data Engineer
Data Engineer

Visionaire Partners • Atlanta (GA)

Remote
USD 80,000 - 110,000
401k with up to 4% match
Medical Insurance
Dental Insurance
+7
Senior Big Data Developer
Senior Big Data Developer

360 IT Professionals • Santa Clara (CA)

On-site
USD 120,000 - 180,000
Relocation expenses
Benefits
Hadoop Java Developer
Hadoop Java Developer

Tata Consultancy Services Limited • Charlotte (NC)

On-site
USD 100,000 - 120,000
Discretionary Annual Incentive
Medical Coverage (Health)
Vacation & Holidays
+2
Big Data Solution Engineer
Big Data Solution Engineer

Summitworks • Durham (NC)

On-site
USD 90,000 - 120,000
BigData Engineer / Architect
BigData Engineer / Architect

Nitor Infotech • Portland (OR)

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Ghr • United States

On-site
USD 140,000 - 190,000
Data Engineer Sr
Data Engineer Sr

Sequoia Connect • United States

Remote
USD 120,000 - 160,000