Senior Data Solution Architect

EPAM Systems; Hyderabad; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

EPAM Systems seeks a Senior Data Solution Architect to lead design and implementation of scalable data solutions across cloud platforms. You will provide strategic direction, guide cross-functional teams and drive advanced data initiatives including AI/ML and Generative AI, data governance, and secure architectures.

You will define architectures for ingestion, processing and quality, ensuring performance, scalability and cost-efficiency while mentoring teams and advancing DevOps practices.

Qualifications

• 15–20 years of software engineering experience with data solutions focus.
• 2+ production-grade architecture designs or reviews in last 2–3 years.
• Knowledge of DWH, Data Lake, Lambda, Kappa, Data Mesh patterns.
• Background in centralized, distributed, decentralized and federated data systems.
• Experience with Azure, AWS, GCP or Snowflake cloud platforms.
• Hands-on with Spark, Spark Streaming, Hadoop and Hive.
• Proficiency with NoSQL (HBase, Cassandra) and orchestration (Oozie, Airflow).
• Strong skills in Data Integration, MLOps, Generative AI, Governance or Modeling.
• Programming experience in Python, R, Scala, Java or .NET for PoCs.
• DevOps/CI-CD tools like GitLab, GitHub, Azure DevOps; containerization with Docker/Podman.
• BI and visualization tools such as Power BI or Tableau.

Responsibilities

• Define, develop and implement architecture for cloud-based big data analytics solutions.
• Provide technical leadership across multiple teams and align on architectural decisions.
• Design and oversee ingestion, processing, security, governance and quality management.
• Evaluate best practices in data management and BI solutions.
• Ensure performance, scalability and cost-effectiveness of data systems.
• Review production designs for alignment with business requirements.
• Drive adoption of AI/ML and Generative AI tech stacks.
• Lead data management initiatives like MDM, MLOps and data security.
• Build and maintain CI/CD pipelines and DevOps practices with development teams.
• Stay updated on data architecture trends and drive continuous improvement.

Skills

Python

R

Scala

Java

.NET

Tools

Spark

Spark Streaming

Hadoop

Hive

Oozie

Airflow

GitLab

GitHub

Azure DevOps

Docker

Podman

Power BI

Tableau

Job description

Job Description

We are seeking a highly experienced Senior Data Solution Architect to lead the design and implementation of innovative, scalable and secure data solutions, providing strategic direction and collaborating with cross-functional teams to drive advanced data initiatives.

Responsibilities

• Define, develop and implement architecture for cloud-based big data analytics solutions
• Provide technical leadership across multiple teams, fostering collaboration and alignment on architectural decisions
• Design and oversee systems for data ingestion, processing, security, governance and quality management
• Evaluate, recommend and apply best practices in data management domains such as integration, modeling, governance and BI solutions
• Ensure optimal performance, scalability and cost-effectiveness for data systems
• Review and validate production architecture designs and solutions to ensure alignment with business requirements
• Drive adoption of cutting-edge technologies including AI/ML and Generative AI tech stacks
• Lead initiatives in data management domains such as master data management, MLOps and data security
• Build and maintain robust CI/CD pipelines and DevOps practices in collaboration with development teams
• Stay informed about emerging data architecture trends and ensure continuous improvement of solutions

Requirements

• 15 to 20 years of experience in software engineering with deep expertise in data solutions
• At least 2 production-grade architecture designs or solution reviews in the past 2-3 years
• Knowledge of architecture patterns such as DWH, Data Lake, Lambda, Kappa, Virtualization and Data Mesh
• Background in centralized, distributed, decentralized and federated data systems
• Experience with at least one cloud platform: Azure, AWS, GCP or Snowflake
• Practical expertise with Big Data stack including Spark, Spark Streaming, Hadoop and Hive
• Capability to work with NoSQL technologies like HBase or Cassandra and orchestration tools such as Oozie, Falcon or Airflow
• Strong understanding of at least 2 data management domains: Data Integration, MLOps, Generative AI, Data Governance or Data Modeling
• Hands-on skills in programming with Python, R, Scala, Java or .NET for PoCs or prototypes
• Proficiency in DevOps and CI/CD tools such as GitLab, GitHub, Azure DevOps and containerization with Docker or Podman
• Expertise in BI and data visualization tools like Power BI or Tableau