Data Engineer

Aditi India; Bengaluru; On-site; INR 800,000 - 1,200,000; Part time

Job summary

A leading technology company in Bengaluru seeks a skilled Data Engineer to join its Emerging Tech team. This role involves designing scalable data architectures and optimizing data processes utilizing AI and big data technologies. The ideal candidate should have experience with modern data frameworks and a passion for innovation and collaboration in a fast-paced environment.

Qualifications

• 3-6 years of experience in data engineering, data science, or similar analytical role.
• Proficiency with big data frameworks.
• Solid skills in Python and SQL.

Responsibilities

• Design and build scalable data architectures and pipelines.
• Develop and optimize data models and algorithms.
• Implement data governance and compliance measures.

Skills

SQL

Python

GCP Big Query

Apache Spark-PySpark

DBT

Airflow

Education

Bachelor’s or master’s degree in data science, Computer Science, Engineering, Statistics

Tools

Hadoop

Spark

Kafka

AWS

Azure

GCP

Tableau

Power BI

D3.js

Job description

Overview

We are seeking a skilled and forward-thinking Data Engineer to join our Emerging Tech team. This role is designed for someone passionate about working with cutting-edge technologies such as AI, machine learning, IoT, and big data to turn complex data sets into actionable insights.

As the Data Engineer in Emerging Tech, you will be responsible for designing, implementing, and optimizing data architectures and processes that support the integration of next-generation technologies. Your role will involve working with large-scale datasets, building predictive models, and utilizing emerging tools to enable data-driven decision-making across the business. You’ll collaborate with technical and business teams to uncover insights, streamline data pipelines, and ensure the best use of advanced analytics technologies.

Key Responsibilities

• Design and build scalable data architectures and pipelines that support machine learning, analytics, and IoT initiatives.
• Develop and optimize data models and algorithms to process and analyse large-scale, complex data sets.
• Implement data governance, security, and compliance measures to ensure high-quality data.
• Collaborate with cross-functional teams (engineering, product, and business) to translate business requirements into data-driven solutions.
• Evaluate, integrate, and optimize new data technologies to enhance analytics capabilities and drive business outcomes.
• Apply statistical methods, machine learning models, and data visualization techniques to deliver actionable insights.
• Establish best practices for data management, including data quality, consistency, and scalability.
• Conduct analysis to identify trends, patterns, and correlations within data to support strategic business initiatives.
• Stay updated on the latest trends and innovations in data technologies and emerging data management practices.

Qualifications

• Bachelor’s or master’s degree in data science, Computer Science, Engineering, Statistics, or a related field.
• 3-6 years of experience in data engineering, data science, or a similar analytical role, with a focus on emerging technologies.
• Proficiency with big data frameworks (e.g., Hadoop, Spark, Kafka) and experience with modern cloud platforms (AWS, Azure, or GCP).
• Solid skills in Python, SQL, and optionally R, along with experience using machine learning libraries such as Scikit-learn, TensorFlow, or PyTorch.
• Experience with data visualization tools (e.g., Tableau, Power BI, D3.js) to communicate insights effectively.
• Familiarity with IoT and edge computing data architectures is a plus.
• Understanding of data governance, compliance, and privacy standards.
• Ability to work with both structured and unstructured data.
• Excellent problem-solving, communication, and collaboration skills, with the ability to work in a fast-paced, cross-functional team environment.
• A passion for emerging technologies and a continuous desire to learn and innovate.

Top Skills

• SQL / Python
• GCP Big Query, Apache Spark-PySpark
• DBT / Airflow

Seniority level

• Associate

Employment type

• Contract

Job function

• Information Technology

Industries

• IT Services and IT Consulting