Data Engineer - Reports & Dashboarding

Forward Eye Technologies; Pune District; On-site; INR 2,400,000 - 3,600,000; Full time

Job summary

Forward Eye Technologies is hiring a Data Engineer to design and implement scalable data pipelines supporting BI and analytics initiatives. You will collaborate with analysts and stakeholders to define data models and ensure data quality across the lifecycle.

Responsibilities include building pipelines, optimizing performance, and maintaining data documentation. Familiarity with Looker Studio and Power BI is a plus, with Cloud and streaming tech experience desired.

Qualifications

• 5+ years of experience in data engineering or a related field.
• Strong proficiency in SQL and at least one programming language (Python, Scala, Java, etc.).
• Hands-on experience with data warehousing technologies like Snowflake, BigQuery, or Redshift.
• Familiarity with data streaming and batch processing frameworks like Apache Kafka, Spark, or Flink.
• Knowledge of cloud computing platforms (AWS, Azure, or GCP) and their data engineering services.
• Experience with data orchestration tools like Apache Airflow, Luigi, or Prefect.
• Understanding of data modeling techniques and best practices for dimensional modeling or data vault.
• Familiarity with Looker Studio and Power BI is a plus.

Responsibilities

• Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake.
• Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models.
• Optimize data pipelines for performance, scalability, and reliability using tools like Apache Airflow, Kafka, or AWS Glue.
• Ensure data quality, consistency, and security throughout the data lifecycle.
• Develop and maintain data documentation, including data dictionaries, metadata, and data lineage.
• Provide technical support and troubleshooting for data-related issues in Looker Studio and Power BI reports.
• Stay up-to-date with the latest data engineering technologies and best practices.

Skills

SQL

Python

Java

Data Modelling

Data Visualization

data API

Tools

Snowflake

BigQuery

Redshift

Apache Airflow

Kafka

Spark

Flink

Looker Studio

Power BI

Luigi

Prefect

Job description

Role Description :

As a Data Engineer, you will play a crucial role in designing and implementing data pipelines to support business intelligence and analytics initiatives. You will work closely with data analysts, data scientists, and business stakeholders to understand data requirements and create efficient data models.

Key Responsibilities :

• Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake
• Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models
• Optimize data pipelines for performance, scalability, and reliability using tools like Apache Airflow, Kafka, or AWS Glue
• Ensure data quality, consistency, and security throughout the data lifecycle
• Develop and maintain data documentation, including data dictionaries, metadata, and data lineage
• Provide technical support and troubleshooting for data-related issues in Looker Studio and Power BI reports
• Stay up-to-date with the latest data engineering technologies and best practices

Qualifications

• 5+ years of experience in data engineering or a related field
• Strong proficiency in SQL and at least one programming language (Python, Scala, Java, etc.)
• Hands-on experience with data warehousing technologies like Snowflake, BigQuery, or Redshift- Familiarity with data streaming and batch processing frameworks like Apache Kafka, Spark, or Flink
• Knowledge of cloud computing platforms (AWS, Azure, or GCP) and their data engineering services
• Experience with data orchestration tools like Apache Airflow, Luigi, or Prefect
• Understanding of data modeling techniques and best practices for dimensional modeling or data vault
• Familiarity with Looker Studio and Power BI is a plus
• Strong problem-solving skills and the ability to work collaboratively in a team environment

Skills Applicable

• SQL
• Python
• Java
• Data Modelling
• Data Visualization
• data API