Solutions Architect

Cloudera Data Platform India Private Limited; Bengaluru; Hybrid; INR 4,000,000 - 8,000,000; Full time

Benefits offered by this job

Generous PTO

Unplugged days

Flexible WFH policy

Wellness programs

Phone/internet reimbursement

Career development

Competitive packages

Volunteer time

Job summary

Cloudera, a leader in data platforms, seeks a Solutions Architect to join APAC Professional Services in Mumbai onsite. The role combines consulting with deep technical design on Hadoop, NiFi, and Spark to deliver massively scalable data solutions across industries.

You will travel across Asia Pacific, work with customer teams to design, document, and implement scalable data pipelines and architectures, and collaborate with Cloudera specialists to ensure project success.

Qualifications

• 12+ years IT experience, with 4+ years in production Hadoop/NiFi or data engineering.
• Hands-on in building, testing and deploying low-latency data pipelines.
• Experience in data engineering, data management, cluster management or analytics domains.
• Experience with data queries on HDFS using Hive.
• Experience implementing MapReduce or Spark jobs.
• Experience multi-node Hadoop clusters setup.
• Experience with DW design, ETL and data integration.
• Experience with operational best practices like monitoring and alerting.
• Knowledge of LDAP/Kerberos security and enterprise security practices.
• Experience with configuration management tools (Ansible/Puppet/Chef).
• Familiarity with scripting (bash, Python, Perl).
• Experience with Apache NiFi is desired.

Responsibilities

• Collaborate with customer business and technical teams to translate requirements into scalable data architectures.
• Design scalable data pipelines to ingest, integrate, and analyze large data volumes.
• Document architectures and present to customer technical teams.
• Work with Cloudera teams to ensure project and customer success.
• Create data models for efficient storage and retrieval and implement data quality checks.
• Build, tune, and maintain Hadoop/NiFi pipelines and data integration tools.
• Install and manage large Hadoop clusters and related infrastructure.
• Produce technical documentation and customer status reports.
• Keep up-to-date with Hadoop, NiFi and Big Data ecosystem.

Skills

Big Data engineering

Hadoop

NiFi

Spark

Data pipelines

HDFS/Hive

MapReduce/Spark jobs

DevOps

Python/Shell

REST/JSON

Java JVM

Tools

Ansible

Puppet

Chef

Job description

Business Area: Professional Services Seniority Level: Mid-Senior level Job Description:

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we’re the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises. Cloudera is seeking a Solutions Architect to join its APAC Professional Services team. In this role you’ll have the opportunity to develop massively scalable solutions to solve complex data problems using Hadoop, NiFi, Spark and related Big Data technology. This role is a client facing opportunity that combines consulting skills with deep technical design and development in the Big Data space. This role will present the successful candidate the opportunity to travel across Asia Pacific and across multiple industries and large customer organisations, This position is based onsite in Mumbai.

As the Solutions Architect you will:

• Work directly with customer business and technical teams to understand requirements and develop high quality solutions
• Design highly scalable and reliable data pipelines to consume, integrate, and analyze large amounts of data from various sources.
• Able to understand big data use-cases and recommend standard design, implementation patterns used in Hadoop-based deployments
• Able to document and present complex architectures for the customer’s technical teams
• Work closely with Cloudera teams at all levels to ensure project and customer success
• Design effective data models for optimal storage and retrieval, deploy inclusive data quality checks to ensure high quality of data
• Design, build, tune and maintain data pipelines using Hadoop, NiFi or related data integration technologies
• Install, deploy, augment, upgrade, manage and operate large Hadoop clusters
• Write and produce technical documentation, customer status reports and knowledge-base articles
• Keep up with current Hadoop, NiFi, Big Data ecosystem / technologies.

We’re excited about you if you have:

• Overall 12+ years IT experience, with at least 4+ years of production experience working with Hadoop and/or NiFi, data engineering.
• Hands-on experience with all aspects of developing, testing and implementing low-latency big data pipelines.
• Demonstrated production experience in data engineering, data management, cluster management and/or analytics domains.
• Experience designing data queries against data in the HDFS environment using tools such as Apache Hive
• Experience implementing MapReduce, Spark jobs
• Experience setting up multi-node Hadoop clusters
• Experience in systems administration or DevOps experience with one or more open‑source operating systems [Big Data Developers interested in Administration and consulting can also apply]
• Experience with Data Warehouse design, ETL (Extraction, Transformation & Load), architecting efficient software designs for DW platform.
• Experience implementing operational best practices such as alerting, monitoring, and metadata management.
• Strong understanding with various enterprise security practices and solutions such as LDAP and/or Kerberos
• Experience using configuration management tools such as Ansible, Puppet or Chef
• Familiarity with scripting tools such as bash shell scripts, Python and/or Perl
• Experience with Apache NiFi is desired
• Significant previous work writing to network-based APIs, preferably REST/JSON or XML/SOAP
• Understanding of the Java ecosystem and enterprise offerings, including debugging and profiling tools (e.g. jstack, jmap, jconsole), logging and monitoring tools (log4j, JMX)
• Ability to understand and translate customer requirements into technical requirements
• Excellent verbal and written communications

You may also have:

• Site Reliability Engineering concepts and practices
• Knowledge of the data management eco‑system including: Concepts of data warehousing, ETL, data integration, etc.
• Experience using a compiled programming language, preferably one that runs on the JVM (Java, Scala, etc)
• Experience coding with streaming/micro-batch compute frameworks, preferably Kafka, Spark

What you can expect from us:

• Generous PTO Policy
• Support work life balance with Unplugged Days
• Flexible WFH Policy
• Mental & Physical Wellness programs
• Phone and Internet Reimbursement program
• Access to Continued Career Development
• Comprehensive Benefits and Competitive Packages
• Paid Volunteer Time
• Employee Resource Groups

EEO/VEVRAA #LI-VG1

If you have any questions about our privacy practices, please contact us at [e-mail].