Data Engineer 4.0

Kcyber Experts; Bengaluru; On-site; INR 2,800,000 - 4,000,000; Full time

Job summary

Kcyber Experts is seeking an experienced Data Engineer specialized in Industrial IoT and Manufacturing 4.0 to build scalable data platforms. You will integrate machine and sensor data from industrial environments, design data lakes, and create end-to-end data pipelines for real-time and batch analytics.

You should have strong PySpark skills, experience with time-series databases, and hands-on work with IIoT data, MQTT, Kafka, and data governance practices.

Qualifications

• 8–9 years of Data Engineering / Data Pipeline experience.
• Strong experience with Industrial IoT data for manufacturing environments.
• Hands-on with Data Lake / Lakehouse architecture and data pipelines.
• Proficient in PySpark / Apache Spark.
• Hands-on with Apache Camel K.
• Strong SQL skills (PostgreSQL, InfluxDB or time-series DBs).
• Experience with Kafka / Redpanda and MQTT messaging.
• Experience in data transformation, validation, quality, governance, and lineage.
• Experience with machine/sensor data or MES systems.

Responsibilities

• Design, deploy, and operate Industrial Data Lake / Lakehouse platforms.
• Build end-to-end data pipelines for ingestion, transformation, and governance.
• Develop IoT/IIoT data bridges for sensor and machine connectivity.
• Work with real-time data using Kafka/Redpanda and MQTT.
• Develop data processing using PySpark and Apache Camel K.
• Work with SQL-based and time-series databases for analytics.
• Collaborate with DevOps and applications teams to optimize data infra.
• Integrate data from machines, sensors, MES and manufacturing systems.
• Implement data quality, validation, governance, and data lineage practices.
• Support modern data platforms for industrial analytics.

Skills

Data Engineering / Data Pipeline

Industrial IoT / IIoT / Manufacturing

Data Lake / Lakehouse

PySpark / Apache Spark

Apache Camel K

SQL

Time-Series DBs (PostgreSQL / InfluxDB

Kafka / Redpanda / MQTT

Data quality / governance

MES / manufacturing data

Education

Bachelor’s degree in Engineering (Industrial / Manufacturing)

Tools

Apache Iceberg

MinIO

Trino

EMQX / MQTT-to-Kafka

OpenMetadata

Collibra

Docker

Kubernetes

CI/CD

DevOps

Qdrant

Neo4j

Braincube

Job description

Data Engineer Industrial IoT / Manufacturing 4.0

Location: Bangalore
Experience: 8–9 Years

Industry: Manufacturing / Industrial IoT

Job Overview

We are looking for an experienced Data Engineer with strong expertise in Industrial IoT (IIoT), Manufacturing 4.0, Data Lakes/Lakehouses, and data pipelines. The candidate will be responsible for building and managing scalable data platforms and integrating machine/sensor data from industrial environments.

Key Responsibilities

• Design, deploy, and operate Industrial Data Lake / Lakehouse platforms.
• Build end-to-end data pipelines covering ingestion, transformation, validation, quality, and governance.
• Develop and maintain IoT/IIoT data bridges for sensor and machine connectivity.
• Work with real-time data using Kafka/Redpanda and MQTT.
• Develop data processing solutions using PySpark and Apache Camel K.
• Work with SQL, PostgreSQL, InfluxDB and other time-series databases.
• Optimize data infrastructure in collaboration with DevOps and Application teams.
• Integrate data from machines, sensors, MES and manufacturing systems.
• Implement data quality, validation, governance, and data lineage practices.
• Support modern data and analytics platforms used for industrial applications.

Mandatory Skills

• 8–9 years of relevant Data Engineering / Data Pipeline experience.
• Strong experience with Industrial IoT / IIoT / Manufacturing data.
• Hands‑on experience with Data Lake / Lakehouse architecture.
• Strong PySpark / Apache Spark experience.
• Hands‑on experience with Apache Camel K.
• Strong SQL skills.
• Experience with PostgreSQL, InfluxDB or other Time-Series databases.
• Experience with Kafka / Redpanda and MQTT.li>
• Experience in data transformation, validation, quality, and governance.
• Experience working with machine/sensor data or manufacturing/MES systems.

Good to Have

• Apache Iceberg, MinIO, Trino
• EMQX / MQTT-to-Kafka integration
• OpenMetadata, Collibra or similar data cataloguing tools
• Docker, Kubernetes, CI/CD and DevOps
• Experience with Qdrant, Neo4j, Braincube or similar AI/analytics platforms
• Strong understanding of Industry 4.0 / Smart Manufacturing

Education

Bachelor’s degree in Engineering, preferably Industrial Engineering / Manufacturing Engineering.

Ideal Candidate

Candidates from Manufacturing, Industrial Automation, Automotive, Industrial IoT, Smart Manufacturing, MES, or Industrial Technology backgrounds will be preferred.