Data & AI Consultant in London - Infosys Consulting - Europe

WorksHub; City Of London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading tech company in London seeks a Data Architect responsible for building robust data pipelines using modern data stacks. Candidates must have strong experience with containerization tools like Docker and Kubernetes, as well as proficiency in technologies such as Spark, Databricks, Python, and SQL. This role offers an opportunity to work in a dynamic tech environment with a focus on cloud and hybrid platforms.

Skills

Experience with modern data stacks

Proficiency in containerization tools

Strong understanding of orchestration workflows

Familiarity with Spark

Knowledge of Databricks

Proficiency in Python/Scala

Strong SQL skills

Experience with Delta Lake

Knowledge of Airflow

Tools

Docker

Kubernetes

Job description

Building Robust Data Pipelines

Experience with modern data stacks is essential for building robust, scalable data pipelines across cloud and hybrid platforms. Key technologies include:

• Spark
• Databricks
• Python/Scala
• SQL
• Delta Lake
• Airflow

Experience with Containerization and Orchestration

Proficiency in containerization tools like Docker and Kubernetes, as well as understanding orchestration workflows, is highly beneficial for Data Architects.