Senior Big Data Architect

NTT America, Inc.; Bengaluru; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Niveus is seeking a Senior Big Data Architect to design and implement scalable data solutions that empower analytics and data-driven decisions. You will collaborate with data engineers and scientists to build robust data architectures spanning ingestion, storage, processing, and consumption layers.

The role emphasizes Medallion architecture, data governance, security, and cloud-native technologies (GCP preferred; AWS/Azure also considered).

Qualifications

• Experience designing scalable data platforms (warehouse, lakehouse, lake)
• Strong understanding of Medallion architecture and data warehousing concepts
• Proficiency with cloud-native data tools and platforms
• Excellent analytical and problem-solving skills
• Effective communication and collaboration with cross-functional teams

Responsibilities

• Design and develop large-scale end-to-end data platform architectures (ingestion, storage, processing, analytics)
• Architect and implement Data Warehouse, Data Lakehouse, and Data Lake using Medallion patterns
• Collaborate with data engineers, scientists and stakeholders to translate requirements into scalable solutions
• Evaluate and adopt big data and cloud-native technologies and tools
• Design the consumption layer with data access management, RBAC, and data marketplace enablement
• Ensure data quality, governance, and security across the data lifecycle
• Optimize architectures for performance and cost-efficiency
• Engage in client conversations, technical demos, and solutioning discussions
• Stay updated on industry trends in big data, cloud, and analytics

Skills

Big Data Architecture

Cloud platforms (GCP)

Data modeling

ETL/ELT

RBAC / Data access control

Data governance

Python

Spark

Kafka

SQL/NoSQL

Medallion architecture

Databricks

Tools

BigQuery

Trino

Redshift

Databricks

Spark

Kafka

Job description

Job Description for Senior Big Data Architect at Niveus:

Niveus is seeking a highly skilled and experienced Senior Big Data Architect to join our dynamic team. In this role, you will be responsible for designing and implementing scalable big data solutions that meet our clients' business needs. You will work closely with data engineers, data scientists, and other stakeholders to create robust data architectures that support advanced analytics and data-driven decision-making.

Key responsibilities:

• Design and develop large-scale, end-to-end data platform architectures: covering ingestion, storage, processing, and analytics/consumption layers.
• Architect and implement Data Warehouse, Data Lakehouse, and Data Lake solutions following Medallion architecture best practices.
• Collaborate with cross-functional teams to gather requirements and translate them into scalable, secure data solutions.
• Evaluate and implement appropriate big data and cloud-native technologies and tools.
• Design and manage the consumption layer, including data access management, Role-Based Access Control (RBAC), and data marketplace enablement.
• Ensure data quality, integrity, governance, and security across the entire data lifecycle.
• Optimize existing data architectures and workflows for performance and cost-efficiency.
• Proactive in client conversations, technical demos, presentations, and solutioning discussions, representing the technical/architecture point of view.
• Stay updated on industry trends and emerging technologies in big data, cloud, and analytics.

Skills and Tools Required

• Strong architectural understanding of the complete data platform: Data Warehouse, Data Lakehouse, and Data Lake (Medallion architecture) - BigQuery /Trino / Redshift / Databricks
• Extensive experience with big data technologies such as, Spark, and Kafka.
• Proficiency in programming languages such as Python.
• Proven experience designing scalable, secure data pipelines, data warehouses, and data lakes capable of processing petabytes of data.
• Strong knowledge of data modeling, ETL/ELT processes, Medallion architecture, and data warehousing concepts.
• Mandatory hands-on experience with at least one cloud platform - GCP strongly preferred (AWS or Azure also considered).
• Architectural experience designing data platforms end-to-end: ingestion, storage, and analytics/consumption layers.
• Working knowledge of the consumption layer - data access management, RBAC, and data marketplace concepts.
• Familiarity with database technologies including NoSQL, SQL, and data lakes.
• Excellent problem-solving and analytical skills.
• Effective communication and teamwork abilities.
• Value add: Experience in client-facing technical conversations, demos, presentations, and solutioning.
• Relevant certifications in big data or cloud technologies are a plus.