Big Data Architect

Lykora Consulting Services Private Limited; Bengaluru; On-site; INR 2,400,000 - 4,200,000; Full time

Job summary

Lykora Consulting Services Private Limited in Bengaluru seeks an experienced Big Data Architect to design and lead end-to-end data platform architectures, covering ingestion, storage, processing, analytics and consumption. Strong expertise in Big Data, Data Lake, Data Lakehouse, and Medallion Architecture with cloud experience is required.

The role demands client-facing solutioning capabilities, hands-on experience with Spark, Kafka, and modern data tools, and proficiency in Python.

Qualifications

• Experience in designing large-scale data platforms spanning ingestion, storage, processing and consumption.
• Strong understanding of Data Warehouse, Data Lake, and Data Lakehouse architectures.
• Hands-on with Medallion Architecture and cloud platforms (GCP preferred, AWS acceptable).
• Proficient in Python and distributed processing with Spark and Kafka.

Responsibilities

• Design and lead end-to-end data platform architectures for petabyte-scale data.
• Guide ingestion, storage, processing, analytics and data consumption layers.
• Collaborate with clients to solution and deliver scalable data architectures.

Skills

Big Data Architecture

End-to-end data platform design

Data Lakehouse

Medallion Architecture

Cloud platforms (GCP/AWS)

BigQuery

Trino

Amazon Redshift

Databricks

Apache Spark

Kafka

Python

Data modeling

ETL/ELT

RBAC / Data governance

SQL/NoSQL

Tools

BigQuery

Trino

Amazon Redshift

Databricks

Job description

We are looking for an experienced Big Data Architect to design and lead large-scale, end-to-end data platform architectures covering data ingestion, storage, processing, analytics, and consumption. The ideal candidate should have strong expertise in Big Data, Data Lake, Data Lakehouse, Data Warehouse, Cloud, and Medallion Architecture along with strong client-facing and solutioning capabilities.

Required Skills & Technologies

• . Strong expertise in Big Data Architecture and end-to-end data platform design
• . Strong understanding of Data Warehouse, Data Lakehouse, and Data Lake architectures
• . Hands-on experience with Medallion Architecture
• . Experience with one or more BigQuery
• . Trino
• . Amazon Redshift
• . Databricks
• . Extensive experience with Apache Spark and Kafka
• . Strong programming experience with Python
• . Strong knowledge of data modeling, ETL/ELT, data warehousing, and distributed data processing
• . Proven experience designing scalable data pipelines and platforms capable of handling petabyte- scale data
• . Mandatory hands-on experience with at least one cloud platform:
• . GCP – strongly preferred
• . AWS
• and consumption
• . Working knowledge of RBAC, data access management, data governance, and data marketplace concepts
• . Familiarity with SQL, NoSQL, and data lake technologies