Data Engineer - Vinay

Acldigital; Bengaluru; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

A technology company in Bengaluru is seeking a skilled Data Engineer to support the AI Solutions team. This role focuses on designing and maintaining scalable, reliable data pipelines for advanced machine learning and AI applications in the Electrification domain. Key responsibilities include collaborating with developers and data scientists, ensuring high-quality data is available, and optimizing data infrastructures. Candidates should have a bachelor's degree and at least 4 years of experience.

Qualifications

• 4+ years of experience designing and deploying scalable data pipelines in cloud environments.
• Practical experience with data lakes and data warehouses.
• Strong understanding of data transformation patterns.

Responsibilities

• Design, build, and maintain data pipelines for various stakeholders.
• Ensure data pipelines are modular and optimized for performance.
• Collaborate with AI/ML teams to support training and monitoring needs.

Skills

Python

SQL

Data manipulation tools

Apache Airflow

Data modeling

Schema design

AWS

Azure

Education

Bachelor’s degree in Computer Science or related field

Tools

Redshift

Snowflake

BigQuery

Kafka

Kinesis

Terraform

CloudFormation

Job description

We are hiring a Data Engineer to support our AI Solutions team in building scalable, reliable, and low-maintenance data pipelines to fuel advanced ML, Deep Learning, and Generative AI applications in the Electrification domain. This role focuses on working closely with developers, data scientists, and business stakeholders to design efficient, production-grade data infrastructure.

You will play a crucial role in making high-quality, structured data available for downstream AI/ML.

Responsibilities

1. Design, build, and maintain data pipelines that serve the needs of multiple stakeholders including software developers, data scientists, analysts, and business teams.
2. Ensure data pipelines are modular, resilient, and optimized for performance and low maintenance.
3. Collaborate with AI/ML teams to support training, inference, and monitoring needs through
4. Implement ETL/ELT workflows for structured, semi-structured, and unstructured data using cloud-native tools.
5. Work with large-scale data lakes, streaming platforms, and batch processing systems to ingest and transform data.
6. Establish robust data validation, logging, and monitoring strategies to maintain data quality and
7. Optimize data infrastructure for scalability, cost-evaluation, and observability in cloud-based
8. Ensure compliance with governance policies and data access controls across projects.

Required Qualifications

• Bachelor’s degree in Computer Science, Information Systems, or a related field.
• 4+ years of experience designing and deploying scalable data pipelines in cloud environments.
• Proficiency in Python, SQL, and data manipulation tools and frameworks (e.g., Apache Airflow, Practical experience with data lakes, data warehouses (e.g., Redshift, Snowflake, BigQuery), and streaming platforms (e.g., Kafka, Kinesis)).
• Strong understanding of data modeling, schema design, and data transformation patterns.
• Experience working with AWS (Glue, S3, Redshift, Sagemaker) or Azure (Data Factory, Azure Familiarity with CI/CD for data pipelines and infrastructure-as-code (e.g., Terraform, CloudFormation)).

Preferred Qualifications

• Exposure to building data solutions that serve AI/ML pipelines, including feature stores and
• Familiarity with observability, data versioning, and pipeline testing tools.
• Experience engaging with diverse stakeholders, gathering data requirements, and supporting
• Background or familiarity with the Power, Energy, or Electrification sector is a strong plus.
• Knowledge of security best practices and data compliance policies for enterprise-grade