Big Data Architect

ZipRecruiter; London; On-site; GBP 50,000 - 80,000; Full time

Job summary

A leading technology company is seeking a skilled Big Data Developer to create and optimize solutions using Spark, Scala, and Hive within a Hadoop ecosystem. Ideal candidates will demonstrate proficiency in real-time data processing and effective communication skills, ensuring project deadlines are met while managing multiple priorities.

Qualifications

• Experience developing with Spark and Scala.
• Proficiency with Hive/SQL.
• Ability to work in a Linux-based Hadoop environment.

Responsibilities

• Develop and optimize Big Data solutions using Spark, Scala, Hive, and HDFS.
• Work within a Linux-based Hadoop ecosystem.
• Deliver objectives within deadlines and multi-task efficiently.

Skills

Spark

Scala

Hive/SQL

Job description

Job Description

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered on digital, engineering, and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues are over $13 billion.

Job Description:

Must Have Skills:

• Spark
• Scala
• Hive/SQL

Responsibilities:

• Develop and optimize Big Data solutions using Spark, Scala, Hive, and HDFS.
• Work within a Linux-based Hadoop ecosystem, including HDFS, Impala, Hive, HBase, etc.
• Experience with real-time data processing platforms like Spark Streaming is an advantage.
• Communicate effectively in both written and verbal forms.
• Deliver objectives within deadlines and multi-task efficiently.
• Apply problem-solving and decision-making skills to technical challenges.
• Create process flow diagrams, business models, and functional designs.