Aws Data Engineer

Kairos Technologies Inc.; Bengaluru; On-site; INR 600,000 - 1,200,000; Full time

Job summary

Kairos Technologies Inc. is seeking a data engineer to develop, implement, and maintain scalable data solutions across ingestion, transformation, and storage pipelines.

You will collaborate with cross-functional teams to translate business requirements into robust data architectures and support real-time ML inference on edge devices. The role emphasizes building data warehouses and lakes, optimizing workflows for high performance, and ensuring data quality and reliability for analytics and

Qualifications

• 1–2 years of experience as a Data Engineer.
• Experience developing scalable data solutions.
• Experience in data ingestion, transformation, storage, and pipelines.
• Proficiency in Python, Java, and SQL.

Responsibilities

• Develop, implement, and maintain efficient and scalable data engineering solutions to support the company's data initiatives.
• Collaborate with cross-functional teams to translate business requirements into technical data engineering solutions.
• Build and maintain data pipelines to ingest, transform, and store data from various sources, ensuring data quality, integrity, and reliability.
• Deploy and operationalize machine learning models for real-time inference and prediction on edge devices.
• Optimize data processing workflows to achieve high performance and low latency in handling large volumes of data.
• Design and implement data warehouse and data lake solutions to support data analytics and reporting needs.
• Collaborate with data scientists and data analysts to understand data requirements and assist in design and implementation of data solutions.
• Monitor and troubleshoot data pipelines, addressing performance issues and failures to ensure uninterrupted data flow.
• Stay updated with industry trends and emerging technologies in data engineering, edge computing, cloud services, data warehousing, and data lakes.
• Continuously improve data engineering processes and systems through best practices and innovative approaches.

Skills

Data ingestion

Data transformation

Data storage

Pipeline optimization

Python

Java

SQL

Education

Bachelors or Masters in CS/Data Eng

Job description

Responsibilities:

• Develop, implement, and maintain efficient and scalable data engineering solutions to support the company's data initiatives.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical data engineering solutions.
• Build and maintain data pipelines to ingest, transform, and store data from various sources, ensuring data quality, integrity, and reliability.
• Deploy and operationalize machine learning models for real-time inference and prediction on edge devices.
• Optimize data processing workflows to achieve high performance and low latency in handling large volumes of data.
• Design and implement data warehouse and data lake solutions to support data analytics and reporting needs.
• Collaborate with data scientists and data analysts to understand their data requirements and assist in the design and implementation of data solutions.
• Monitor and troubleshoot data pipelines, proactively addressing any performance issues, bottlenecks, or failures to ensure uninterrupted data flow.
• Stay updated with industry trends and emerging technologies in data engineering, edge computing, cloud services, data warehousing, and data lakes, and evaluate their potential for improving existing systems and processes.
• Continuously improve data engineering processes and systems through the adoption of best practices and innovative approaches.

Skills and Qualifications:

Mandatory

• Bachelors or masters degree in computer science, Data Engineering, or a related field.
• 1-2 years of experience as a Data Engineer, with expertise in developing scalable data solutions.
• Strong experience in data engineering, including data ingestion, transformation, storage, and data pipeline optimization.
• Proficiency in programming languages such as Python, Java, SQL for data engineering and analytics tasks.