Senior Hadoop & Big Data Engineer

Realign Llc; Addison (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Realign Llc in Addison, Texas is seeking a Senior Hadoop Developer with 4+ years in data warehousing and big data. You will design and optimize analytical environments and collaborate with a data solution delivery team to ingest data from multiple sources.

Candidates should be proficient in Hadoop ecosystem (Hadoop, Hive, Spark), Python/Scala, SQL, and ETL processes. Experience with Autosys and Unix shell scripting is a plus, and a strong client-service orientation is required.

Qualifications

• Bachelor's degree in a technical or business-related field or equivalent working experience.
• 4+ years of experience in data warehousing architectural approaches.
• Minimum of 4 years in big data with Hadoop ecosystem (Cloudera).
• Experience with Hadoop, Hive, Spark; Python and Scala.
• Experience in Python and Unix shell scripting; scheduling tool like Autosys.

Responsibilities

• Ingest data from multiple sources using big data tools.
• Design and optimize analytical environments and BI solutions.
• Collaborate with delivery teams to implement data pipelines.
• Perform query optimization and performance tuning of complex SQL.

Skills

Hadoop

Hive

Spark

Python

Scala

Unix Shell Scripting

SQL

ETL

Big Data

Data Warehousing

Agile Methodologies

Distributed Systems

Query Optimization

Education

Bachelor's degree or equivalent

Tools

Autosys

Job description

Realign Llc in Addison, Texas is seeking a Senior Hadoop Developer with 4+ years in data warehousing and big data. You will design and optimize analytical environments and collaborate with a data solution delivery team to ingest data from multiple sources.

Candidates should be proficient in Hadoop ecosystem (Hadoop, Hive, Spark), Python/Scala, SQL, and ETL processes. Experience with Autosys and Unix shell scripting is a plus, and a strong client-service orientation is required.