Hadoop Data Engineer — Big Data Platform

BinTech Group; Atlanta (GA); Hybrid; USD 110,000 - 160,000; Full time

Job summary

BinTech Group seeks a Data Engineer to support the Data and Analytics Platform, information management, and solution delivery. You will ensure consistent design across data flows and systems, build data transformation processes, metadata handling, data quality controls, and workload management.

You may mentor junior engineers and collaborate with Architects, Developers, Analysts, QA, and stakeholders to drive delivery and release activities.

Qualifications

• 3–6 years' experience with Hadoop stack and storage technologies
• Extensive knowledge on Bigdata Enterprise architecture (Cloudera preferred)
• Experience with NoSQL technologies (Cassandra/MongoDB) and SQL/ETL
• Strong analytical skills and interest in algorithms; capable of team delivery
• Experience with distributed computing principles and data analysis across multiple systems
• Experience with scripting (Unix/Linux) and scheduling (Autosys)
• Ability to mentor junior engineers and collaborate with architects, developers and analysts

Responsibilities

• Support Data and Analytics Platform, Information Management and Solution Delivery
• Ensure design/engineering approach for data solutions is consistent across flows and systems
• Define data management controls, identify gaps, and implement plans to close them
• Lead experimentation and testing to validate solutions and document deployment requirements

Skills

Analytical mindset

Team player

Self-starter

Communication skills

Education

Degree in Computer Science or equivalent

Tools

Hadoop stack

HDFS

MapReduce

Yarn

HIVE

Sqoop

Impala

Spark

Flume

Kafka

Oozie

HBase

RDBMS

SQL

NoSQL (Cassandra/MongoDB)

Unix/Linux scripting

Autosys

Python (Django/Flask)

Tableau

Kerberos

Job description

BinTech Group seeks a Data Engineer to support the Data and Analytics Platform, information management, and solution delivery. You will ensure consistent design across data flows and systems, build data transformation processes, metadata handling, data quality controls, and workload management.

You may mentor junior engineers and collaborate with Architects, Developers, Analysts, QA, and stakeholders to drive delivery and release activities.