Data Solution Architect

EPAM Systems; Coimbatore District; On-site; INR 3,000,000 - 5,400,000; Full time

Job summary

EPAM Systems seeks a Data Solution Architect to design scalable data solutions, drive innovation, and guide strategy in big data and analytics. The role collaborates across teams to deliver cloud-based, cost-effective data solutions with governance and security at the core.

The ideal candidate brings extensive IT architecture experience, expertise in modern data platforms, AI/ML, and hands-on development with Python/Scala/Java, plus strong leadership in DevOps practices.

Qualifications

• 12–16 years of IT experience with 2+ production architecture designs or solution reviews in the last 2–3 years.
• Knowledge of DWH, Data Lake, Virtualization, Lambda, Kappa or Data Mesh.
• Expertise in centralized, distributed, decentralized or federated data management.
• Background in AI/ML and Gen AI technologies.
• Proficiency in at least one cloud platform (Azure, AWS, GCP or Snowflake).
• Understanding of Spark, Spark Streaming, Hadoop, Kafka, Hive, NoSQL (HBase, Cassandra) and orchestration tools (Airflow, Oozie).
• Experience across 2+ Data Management domains (BI/Visualization, Data Integration, Data Engineering, Generative AI, Data Governance, Data Quality, Security, Storage).
• Familiarity with DevOps and CI/CD tools (GitLab, Jenkins, Azure DevOps) and containerization.

Responsibilities

• Architect and design scalable solutions for big data analytics on cloud platforms
• Provide strategic vision for data ingestion, processing, security, governance and analytics scalability
• Serve as a technical leader, offering guidance across engineering and development teams
• Define and implement architectures for data warehouses and lakes based on business needs
• Evaluate and introduce architecture patterns such as Lambda, Kappa or Data Mesh into projects
• Optimize and monitor architecture for centralized, distributed, federated or decentralized data management
• Implement solutions leveraging AI/ML and Generative AI technologies for data-driven automation
• Collaborate with multi-disciplinary teams to ensure seamless integration of new technologies
• Develop prototypes using programming languages such as Python, Scala or Java for concept validation
• Implement and ensure DevOps and CI/CD best practices are followed throughout development
• Lead efforts around data security, protection and governance compliance

Skills

Leadership

Communication

Strategic thinking

Tools

Python

Scala

Java

.NET

Azure

AWS

GCP

Snowflake

Spark

Hadoop

Kafka

Hive

NoSQL (HBase/Cassandra)

Airflow

Oozie

GitLab

Jenkins

Azure DevOps

Docker

Kubernetes

Job description

We are seeking a skilled and experienced Data Solution Architect to architect and design scalable data solutions, drive technical innovation and provide strategic direction in big data and analytics. The role involves collaborating with multiple teams to deliver robust, cloud-based, cost-effective data solutions.

Responsibilities

• Architect and design scalable solutions for big data analytics on cloud platforms
• Provide strategic vision for data ingestion, processing, security, governance and analytics scalability
• Serve as a technical leader, offering guidance across engineering and development teams
• Define and implement architectures for data warehouses and lakes based on business needs
• Evaluate and introduce architecture patterns such as Lambda, Kappa or Data Mesh into projects
• Optimize and monitor architecture for centralized, distributed, federated or decentralized data management
• Implement solutions leveraging AI/ML and Generative AI technologies for data-driven automation
• Collaborate with multi-disciplinary teams to ensure seamless integration of new technologies
• Develop prototypes using programming languages such as Python, Scala or Java for concept validation
• Implement and ensure DevOps and CI/CD best practices are followed throughout development
• Lead efforts around data security, protection and governance compliance

Requirements

• 12-16 years of experience in IT, including 2 or more production architecture designs or solution review activities over the past 2 to 3 years
• Knowledge of multiple architecture patterns such as DWH, Data Lake, Virtualization, Lambda, Kappa or Data Mesh
• Expertise in centralized, distributed, decentralized or federated data management approaches
• Background in AI/ML and Gen AI-related technologies
• Proficiency in at least one cloud platform such as Azure, AWS, GCP or Snowflake
• Understanding of Big Data technologies including Spark, Spark Streaming, Hadoop, Kafka, Hive, NoSQL databases like HBase or Cassandra and orchestration tools (Airflow, Oozie)
• Competency in at least 2 Data Management domains such as BI & Visualization, Data Integration, Data Engineering, Generative AI, Data Governance, Data Quality, Security and Storage
• Familiarity with DevOps and CI/CD tools like GitLab, Jenkins, Azure DevOps and containerization technologies
• Hands-on skills in Python, R, Scala, Java or .NET for prototype and PoC development