Senior Hadoop & Spark Data Engineer

Veridian Tech Solutions, Inc.; Addison (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Veridian Tech Solutions, Inc. in Addison, TX is seeking a Hadoop Developer to design and implement scalable big data solutions in production. You will work with the Hadoop ecosystem, build data pipelines, and optimize performance in a collaborative, Agile environment.

The role requires 4+ years in data warehousing and big data, with expertise in Hadoop, Hive, Spark, Python, Scala, and SQL. Strong scripting and coordination with cross-functional teams are essential.

Qualifications

• Bachelor's degree in a technical or business-related field or equivalent working experience.
• 4+ years of experience in data warehousing architectural approaches.
• Minimum of 4 years in big data and Hadoop ecosystem (Cloudera).
• Experience with Big Data technologies like Hadoop, Hive, Spark, Python, Scala.
• Experience in Python and Unix shell scripting.
• Experience with scheduling tools like Autosys.
• Understanding of Agile methodologies and technologies.
• Strong knowledge of SQL and large SQL-based systems.

Responsibilities

• Excellent understanding of client-service models and customer orientation in service delivery.
• Ability to grasp the 'big picture' for a solution by considering all potential options.
• Aptitude to understand and adapt to newer technologies.
• Collaborate with teammates to achieve the mission.
• Experience in query optimization and performance tuning of complex SQL queries.
• Benchmark and debug critical issues with algorithms and software.

Skills

Analytical thinking

Customer service orientation

Big picture thinking

Team collaboration

Education

Bachelor's degree in a technical or business-related field

Tools

Hadoop ecosystem

Hive

Spark

Python

Scala

Unix shell scripting

Autosys

SQL

Distributed systems

Job description

Veridian Tech Solutions, Inc. in Addison, TX is seeking a Hadoop Developer to design and implement scalable big data solutions in production. You will work with the Hadoop ecosystem, build data pipelines, and optimize performance in a collaborative, Agile environment.

The role requires 4+ years in data warehousing and big data, with expertise in Hadoop, Hive, Spark, Python, Scala, and SQL. Strong scripting and coordination with cross-functional teams are essential.