Hadoop Developer
Insight Global
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
Qualifications
- 5-10+ years of experience as a Data Engineer with Big Data technologies.
- Strong SQL skills and experience with data formats like JSON and CSV.
- Experience in end-to-end design of data pipelines.
Responsibilities
- Develop and deliver data solutions to meet business goals.
- Work with stakeholders to implement data requirements and troubleshoot issues.
- Perform code design and delivery tasks for data integration and transformation.
Skills
Education
Tools
Job description
Direct message the job poster from Insight Global
Details:
• 1-year W2 contract with extensions up to 2 years.
• Fully on-site 5 days a week in either Charlotte NC or Chicago IL.
• Set rate of $66/hr with optional medical, dental, vision, and 401k benefits.
We are seeking a skilled Data Engineer responsible for developing and delivering data solutions to accomplish technology and business goals and initiatives. Key responsibilities include performing code design and delivery tasks associated with the integration, cleaning, transformation, and control of data in operational and analytical data systems. Job expectations include working with stakeholders and Product and Software Engineering teams to aid with implementing data requirements, analyzing performance, and researching and troubleshooting data problems within system engineering domains.
Desired Experience & Qualifications:
- 5-10+ years of Senior-Level experience as a Big Data and/or Data Engineer
- Experience working with Hadoop/Big Data and Distributed Systems
- Experience with Kafka, Batch, Elasticsearch
- Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL
- Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
- Experience working with SPARK Structured streaming
- Experience working with admin/prod support/debugging
- Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
- Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting, to name a few
- Performance tuning experience with spark /MapReduce and/or SQL jobs
- Experience and proficiency with Linux operating system are a must
- Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
- Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
- Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.
- Experience working with Jenkins and Jar management
- Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
- Strong analytical mind to help take on complicated problems
- Desire to resolve issues and dive into potential issues
- Ability to adapt and continue to learn new technologies is important
Mid-Senior level
Contract
Information Technology
Banking and Financial Services
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
