Data & Analytics Solutions Architect (Hadoop + Big Data)

Tata Consultancy Services; New York (NY); On-site; USD 130,000 - 170,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage

401K Plan

Training Reimbursement

Job summary

Tata Consultancy Services Limited is seeking a Senior Solution Architect in New York City to lead enterprise data architecture efforts, modernize data platforms, and guide large-scale Hadoop-based ecosystems. You will collaborate with data engineers, platform teams, and stakeholders to deliver secure, scalable solutions for analytics, reporting, and AI workloads.

The role emphasizes architectural governance, performance optimization, and cloud-adoption initiatives within BFSI-compliant contexts.

Qualifications

• 14+ years of experience in Enterprise Data Architecture and Big Data technologies.
• Experience designing large-scale Big Data and Data Lake architectures.

Responsibilities

• Define end-to-end architecture for Hadoop and Big Data platforms.
• Lead modernization and migration projects to improve performance and scalability.
• Provide technical leadership across design, implementation, and production support.

Skills

Enterprise Data Architecture

Hadoop Ecosystem

Big Data Engineering

Data Platform Modernization

HDFS

YARN

Hive

Spark

PySpark

Kafka

SQL

Python

Java

Scala

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, Data Management, or a related discipline

Job description

Job Description

Loaction: NJ/NYC/Dallas TX/Charlotte, NC

Must Have Technical/Functional Skills

• 14+ years of experience in Enterprise Data Architecture, Hadoop Ecosystem, Big Data Engineering, and Data Platform Modernization.
• Strong hands-on expertise in Hadoop, HDFS, YARN, Hive, Spark, PySpark, Kafka, SQL, Python, Java, and Scala.
• Experience designing and implementing large-scale Big Data and Data Lake architectures supporting analytics, reporting, and AI workloads.
• Strong understanding of Hadoop platform architecture, including HDFS, YARN, high availability, cluster management, workload optimization, and scalability.
• Expertise in batch and distributed data processing using Spark, Hive, HBase, and MapReduce frameworks.
• Experience building data ingestion and streaming solutions using Kafka and Hadoop ecosystem tools.
• Strong knowledge of Data Engineering practices, including ETL/ELT, data integration, data quality, metadata management, lineage, observability, and DataOps.
• Experience with Data Lake, Data Warehousing, Enterprise Data Models, Master Data, and Data Governance frameworks.
• Strong understanding of security and governance controls, including Kerberos, Ranger, encryption, privacy, auditability, compliance, and controlled data access.
• Proven experience in architecture definition, HLD/LLD creation, migration planning, technical governance, production readiness, and performance optimization.
• Experience supporting platform modernization, cloud adoption, solutioning, effort estimation, and client-facing technical discussions.
• Good understanding of BFSI regulatory, security, privacy, resilience, and audit requirements.
• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Management, or a related discipline.
• Preferred certifications in Hadoop, Spark, Cloud Data Engineering, Enterprise Architecture, Data Management, Security, or Big Data Platforms.

Roles & Responsibilities

• Engage with business and technology stakeholders to understand business objectives, data platform requirements, and modernization goals.
• Define end-to-end architecture for Hadoop and Big Data platforms supporting analytics, reporting, and AI workloads.
• Design scalable, secure, and high-performance Hadoop ecosystems using HDFS, YARN, Spark, Kafka, Hive, and related technologies.
• Architect data ingestion, batch processing, streaming, and data lake solutions for enterprise-scale environments.
• Define data models, data lake zones, governance frameworks, metadata management, lineage, and security standards.
• Lead Hadoop modernization, migration, and platform optimization initiatives to improve performance, scalability, and operational efficiency.
• Establish architecture standards, reusable frameworks, engineering best practices, and DataOps operating models.
• Provide technical leadership across solution design, implementation, testing, migration, deployment, and production support activities.
• Conduct architecture reviews, identify risks and dependencies, and guide teams on mitigation strategies and best practices.
• Drive performance tuning, capacity planning, reliability improvements, and infrastructure cost optimization.
• Collaborate with data en gineers, platform teams, architects, vendors, and client stakeholders to deliver enterprise data solutions.
• Support solutioning, RFP responses, effort estimation, technical presentations, and client workshops.
• Mentor architects and engineers and contribute to hiring, capability development, and knowledge-sharing initiatives.
• Develop reusable accelerators, reference architectures, implementation frameworks, and technical best practices for Big Data platforms.

Generic Managerial Skills, If any

• Strong leadership and stakeholder management skills with the ability to work effectively across business, engineering, architecture, and delivery teams.
• Excellent communication and presentation skills for technical, business, and executive audiences.
• Strong problem-solving and consulting mindset with the ability to evaluate options and recommend practical solutions.
• Ability to lead cross-functional and distributed teams in a collaborative environment.
• High ownership, accountability, and attention to detail with a focus on quality delivery.
• Strong planning, prioritization, and decision‑making skills while managing multiple initiatives and stakeholders.
• Experience mentoring architects and engineers and driving adoption of best practices.
• Ability to proactively manage risks, dependencies, and escalations to ensure successful project delivery.
• Strong client‑facing experience supporting workshops, architecture reviews, solution presentations, and executive discussions.
• Adaptability to work in fast‑paced environments with evolving business and technology priorities.

TCS Employee Benefits Summary:

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
• Salary Range: $130,000 - $170,000 a year

Location

new york city, NY

Function

TECHNOLOGY

Role

Solution Architect

ID

435693

Skills

Big Data | Hadoop

Salary Range

$130,000 - $170,000

Desired Candidate Profile

Qualifications

BACHELOR OF COMPUTER SCIENCE