Lead Data Engineer (Java/Scala, Python, Spark, Kafka, SQL) – 12+ Years Experience

Cisco Systems; Bengaluru; On-site; INR 15,00,000 - 25,00,000; Full time

Job summary

A leading technology company in India is seeking an experienced Data Engineer to join its dynamic data engineering team. The role involves enhancing big data technologies, writing high-quality code, and working with Apache Spark and Kafka. Ideal candidates will have over 12 years of experience, strong SQL skills, and familiarity with open-source ecosystems. Join us to revolutionize how data and infrastructure connect in the AI era.

Qualifications

• 12+ years of experience in data engineering and software development.
• Ability to write high-quality code in Java/Scala, Python, or equivalent languages.
• Practical experience with Apache Spark and Apache Flink.

Responsibilities

• Enhance big data related open source technologies.
• Build and operate Kafka-based streaming applications.
• Develop data processing jobs following established patterns.

Skills

Data engineering

Software development

Apache Spark

Kafka

SQL

Tools

Apache Flink

Data governance tools

Kafka-based applications

Job description

Please note this posting is to advertise potential job opportunities. This exact role may not be open today but could open in the near future. When you apply, a Cisco representative may contact you directly if a relevant position opens.

Meet the Team

Webex Data Analytics Platform (WAP) engineering organization is responsible for developing the big data platform at Webex. The platform forms the base on which other teams, including the WAP team, develop their analytics and data pipelines.

We are looking for a hands-on Data Engineer to join a high-impact data engineering team with a focus on developing the data platform and working with the product team to develop data and analytics pipeline.

Your Impact

• Work and enhance big data related opensource technologies.


• Build and operate Kafka-based streaming applications, including ingestion, filtering, enrichment, and replication use cases.


• Develop data processing jobs using Apache Spark and/or Apache Flink, following established patterns and platform guidelines.


• Work with data lake technologies (Apache Iceberg) to manage large analytical datasets.


• Tune jobs for performance, scalability, and cost efficiency.


• Write clean, testable code and participate actively in code reviews.

Minimum Qualifications

• At least 12+ years of experience in data engineering and software development.


• Ability to work with opensource ecosystem.


• Ability to write high-quality code in Java/Scala, Python, or equivalent languages.


• Practical experience with Apache Spark and Apache Flink.


• Practical experience with query engines like Trino/Presto.


• Experience working with Kafka and scaling for high volume workloads.


• Strong SQL skills and understanding of data modeling for analytical workloads

Preferred Qualifications

• Hands-on experience with real-time analytics stores like Apache Pinot/Clickhouse for low-latency analytical queries.


• Familiarity using AI Tools for debugging and development (CoPilot, Cursor, Codex).


• Familiarity with data lake table formats such as Apache Iceberg.


• Familiarity with data governance tools like DataHub.


• Experience working with tools like DolphinScheduler or Airflow.


• Experience working with Lakehouse management systems like Apache Amoro.

Why Cisco?

At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint.

Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere.

We are Cisco, and our power starts with you.

Cisco is an affirmative Action and Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.

Cisco will consider for employment, on a case by case basis, qualified applicants with arrest and conviction records.