Senior Software Engineer

EDYODA; Bengaluru; Remote; INR 11,289,000 - 16,933,000; Full time

Benefits offered by this job

Competitive compensation

India R&D Center

Job summary

Cognite in Bengaluru is seeking a Senior Software Engineer to build high-performance distributed data systems. You will work on Spark, Flink, Kafka pipelines, low-latency APIs, and scalable data lake architectures in a fast-paced environment.

You will contribute to production-grade systems handling large-scale industrial data, with emphasis on performance tuning, JVM optimization, and observability using Prometheus, Grafana, and OpenTelemetry.

Qualifications

• 6–12 years of experience in distributed data systems.
• Strong programming skills in Scala, Java, or Python.
• Experience with cloud platforms (AWS/GCP/Azure).
• Prior experience with large-scale data or industrial/IoT data is a plus.
• Contributions to open-source or industrial data/AI platforms is an added advantage.

Responsibilities

• Build high-performance data pipelines using Spark, Flink, and Kafka to process terabyte-scale industrial datasets.
• Develop low-latency REST/gRPC APIs and services for thousands of concurrent users.
• Optimize time-series, sensor, and operational data storage and retrieval for massive scale.
• Engineer distributed processing solutions including real-time streaming.
• Design cost-efficient data lake architectures (S3/GCS) and optimize OLAP queries across systems.
• Build fault-tolerant, highly-available systems with monitoring and tracing.

Skills

Distributed data systems

Scala/Java/Python

Spark internals

REST/gRPC

Performance tuning

Tools

Spark

Flink

Kafka

Redis

Prometheus Grafana OpenTelemetry

Job description

# Senior Software EngineerCogniteBengaluruSoftware & ITApplications go directly to Cognite — EdYoda does not collect your application.Apply now## Job descriptionWhat Cognite is: Relentless to achieveCognite operates at the forefront of industrial digitalization, building AI , and data solutions that solve the world’s hardest, highest-impact problems. With unmatched industrial heritage and a comprehensive suite of AI capabilities, including low-code AI agents, Cognite accelerates the digital transformation to drive operational improvements.We thrive in challenges. We challenge assumptions. We execute with speed and ownership. If you view obstacles as signals to step forward - not backwards - you’ll feel right at home here.Our Moonshot is bold: Unlock $100B in customer value by 2035, and redefine how global industry works. Join us in this venture where AI and data meet ingenuity, and together, we will forge the path to a smarter, more connected industrial future.About The RoleWe're seeking a Senior Software Engineer who excels at building high-performance distributed systems and thrives in a fast-paced startup environment. You'll be working on cutting-edge data infrastructure challenges that directly impact how Fortune 500 industrial companies manage their most critical operational data.How you’ll demonstrate OwnershipBuild high-performance data pipelines using Spark, Flink, and Kafka to process terabyte-scale industrial datasets.Develop low-latency APIs and services supporting thousands of concurrent users with sub-second response times.Optimize time-series, sensor, and operational data storage and retrieval for massive scale.Engineer distributed processing solutions, including real-time streaming that handles millions of events per second.Design and evolve cost-efficient data lake architectures (S3/GCS) using modern formats like Parquet/ORC.Optimize OLAP query performance across systems such as ClickHouse, Pinot, or Druid.Build fault-tolerant, highly-available systems with circuit breakers, retries, and distributed tracing.Drive technical innovation through research, prototyping, and contributions to open-source.Collaborate with product and architecture teams to translate complex industrial data problems into scalable, production-grade solutions.The Impact you bring to CogniteDeep expertise in Spark internals, including Catalyst optimizer, partitioning, and performance tuning.Strong hands-on experience with Flink/Kafka for both streaming and batch workloads.Proven ability to scale systems to 10K+ QPS with strong foundations in JVM performance, GC tuning, and memory management.Experience building high-throughput REST/gRPC services and advanced caching with Redis/in-memory data structures.Strong understanding of monitoring and observability (Prometheus, Grafana, OpenTelemetry).Solid architectural thinking with an ability to design distributed, secure, and resilient platforms.Collaborative mindset with the ability to work across engineering, product, and platform teams.Required Qualifications6–12 years of experience in distributed data systems, backend engineering, or platform engineering.Strong programming skills in Scala, Java, or Python.Experience with cloud platforms (AWS/GCP/Azure) and data lake/object storage.Prior experience with large-scale data, OLAP systems, or industrial/IoT data is a plus.Contributions to open-source or experience in industrial data/AI platforms is an added advantage.What we offer:Opportunity to build world-class Industrial DataOps systems powering global energy, manufacturing, and industrial AI customers.A fast-growing, high-ownership environment in Cognite’s India R&D Center.Work on cutting-edge distributed systems, streaming architectures, AI-ready data platforms, and industrial-scale challenges.A culture that rewards innovation, autonomy, continuous learning, and open-source contribution.Competitive compensation, equity, and benefits aligned with Cognite’s global standards.Learn more about usImpact 2025Cognite's Industrial AI: MoonshotWe’re globally recognized domain experts with an international presence that spans Phoenix, Houston, Oslo Tokyo, Bengaluru, and Abu Dhabi.Equal OpportunityCognite is committed to creating a diverse and inclusive environment at work and is proud to be an equal opportunity employer. All qualified applicants will receive the same level of consideration for employment.