Big Data Administrator & Development Engineer

SMA Solar Technology AG; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

SMA Solar India Pvt. Ltd. is seeking a seasoned Big Data Administrator & Development Engineer to ensure stability, security, and efficiency of on-premises Big Data environments. You will manage clusters based on Hadoop, Kafka, and Druid, while driving automation, optimization, and architectural decisions.

The role combines admin and development work, enabling you to shape scalable data infrastructure that powers critical business insights and decision-making across our Bengaluru operations.

Qualifications

• 8+ years hands-on experience administering on-premise Hadoop, Kafka and Druid clusters.
• Proven expertise with HDFS, Hive, Spark, Hue and NiFi in enterprise data environments.
• Strong SQL proficiency with query tuning and performance optimization.
• Solid Linux system administration and cluster maintenance practices.
• Experience with automation and scripting tools such as Ansible, Python or Bash.

Responsibilities

• Manage and optimize Big Data clusters including Hadoop, Kafka and Druid for reliability and performance.
• Implement and maintain monitoring tools (e.g., Cloudera Manager, Splunk) to track availability and detect anomalies.
• Administer RBAC, encryption, and security controls to safeguard data integrity.
• Develop and automate ETL workflows using SQL, NiFi, Python or Spark to support evolving needs.
• Collaborate with cross-functional teams on architecture, upgrades, and tech evaluations.

Skills

Strong SQL proficiency

English communication

Linux administration

Automation & scripting

Agile teamwork

Education

Bachelor's or Master's in CS/Engineering or related

Tools

Hadoop

Kafka

Druid

HDFS

Hive

Spark

Hue

NiFi

Ansible

Python

Bash

Job description

Location: Bangalore, KA, IN

Job Type: Permanent

ENERGY THAT CHANGES:Innovative and sustainable key technologies are prerequisites for renewable energy supply. More than 3,000 employees from 18 countries work to ensure that SMA is actively helping to promote the production and development of PV system technology worldwide.

Would you like to play a part in shaping the energy supply of the future?Welcome to SMA.

be energy.Your energy can thrive with us. Respond to changes in an active, bold and targeted way.

be flexible.Conditions can change, so our work schedule models offer you a solution.

be family.A sense of community and camaraderie is important to us. We offer work-life-balance.

Description

Are you passionate about data platforms, high-performance systems, and large-scale data processing? Join our innovative team as a Big Data Administrator & Development Engineer, where you’ll be responsible for ensuring the stability, security, and efficiency of on-premise Big Data environments. You will manage and enhance clusters based on Hadoop, Kafka, and Druid, while also contributing to automation, system optimization, and strategic architectural decisions.

This role combines deep technical administration with development responsibilities, offering the opportunity to work on cutting-edge data infrastructure that powers critical business insights and decision-making.

Key Responsibilities

• Manage and Optimize Big Data Clusters
  Ensure the reliable, secure, and high-performance operation of on-premise Hadoop, Kafka, and Druid clusters, proactively monitoring performance and system health.
• Implement and Maintain Monitoring Solutions
  Deploy and maintain monitoring and alerting tools such as Cloudera Manager and Splunk to track system availability, detect anomalies, and ensure proactive issue resolution.
• Administer Access and Security Controls
  Manage role-based access control (RBAC), encryption, and compliance policies to safeguard data integrity and meet security standards.
• Develop and Automate Data Workflows
  Design and implement ETL processes, data transfers, and analysis pipelines using SQL, NiFi, Python, or Spark to support evolving business requirements.
• Support Architectural and Technical Evolution
  Collaborate with cross-functional teams on architecture design, system upgrades, and technology evaluations to improve scalability, reliability, and performance.

Required Qualifications

• Minimum 8 years of hands-on experience in administering on-premise Hadoop, Kafka, and Druid clusters.
• Proven expertise with HDFS, Hive, Spark, Hue, and NiFi in enterprise data environments.
• Strong SQL proficiency, including query tuning and performance optimization.
• Solid understanding of Linux system administration and cluster maintenance best practices.
• Experience with automation and scripting tools such as Ansible, Python, or Bash.

Preferred Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Experience developing ETL pipelines and integrating diverse data sources.
• Familiarity with cloud-based Big Data platforms (Azure preferred).
• Knowledge of disaster recovery, high-availability architectures, and runbook creation.
• Excellent English communication skills and ability to collaborate effectively in agile, cross-functional teams.

Ready for your next career move?

We look forward to receiving your application!

Interested in this position but don’t meet every requirement? We’d still love to hear from you –

Anita Virnave | SMA Solar India Pvt. Ltd.

∗ SMA is committed to equal opportunity and diversity – regardless of gender, age, origin, religion, disability, or sexual orientation.