Data Engineer - Reports & Dashboarding

Forward Eye Technologies; Pune District; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Forward Eye Technologies in Pune, India is seeking an experienced Data Engineer to design and implement robust data pipelines that enable business intelligence and analytics. You will work closely with data analysts, data scientists, and business stakeholders to translate data requirements into reliable data models and scalable data architectures.

You will collaborate with BI teams to optimize Looker Studio and Power BI reporting, implement streaming and batch processing with Airflow, Kafka, and

Qualifications

• 5+ years of experience in data engineering or a related field.
• Strong proficiency in SQL and at least one programming language (Python, Scala, Java, etc.).
• Hands-on experience with data warehousing technologies like Snowflake, BigQuery, or Redshift.
• Familiarity with data streaming and batch processing frameworks like Kafka, Spark, or Flink.
• Knowledge of cloud computing platforms (AWS, Azure, or GCP) and their data engineering services.
• Experience with data orchestration tools like Apache Airflow, Luigi, or Prefect.
• Understanding of data modeling techniques and best practices for dimensional modeling or data vault.
• Familiarity with Looker Studio and Power BI is a plus.
• Strong problem-solving skills and the ability to work collaboratively in a team environment.

Responsibilities

• Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake.
• Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models.
• Optimize data pipelines for performance, scalability, and reliability using tools like Apache Airflow, Kafka, or AWS Glue.
• Ensure data quality, consistency, and security throughout the data lifecycle.
• Develop and maintain data documentation, including data dictionaries, metadata, and data lineage.
• Provide technical support and troubleshooting for data-related issues in Looker Studio and Power BI reports.
• Stay up-to-date with the latest data engineering technologies and best practices.

Skills

SQL

Python

Java

Data Modeling

Data Visualization

Data API

Collaborative work

Tools

Snowflake

BigQuery

Redshift

Apache Airflow

Luigi

Prefect

Kafka

Spark

Flink

Looker Studio

Power BI

AWS

Azure

GCP

Job description

Role Description

As a Data Engineer, you will play a crucial role in designing and implementing data pipelines to support business intelligence and analytics initiatives. You will work closely with data analysts, data scientists, and business stakeholders to understand data requirements and create efficient data models.

Key Responsibilities

• Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake
• Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models
• Optimize data pipelines for performance, scalability, and reliability using tools like Apache Airflow, Kafka, or AWS Glue
• Ensure data quality, consistency, and security throughout the data lifecycle
• Develop and maintain data documentation, including data dictionaries, metadata, and data lineage
• Provide technical support and troubleshooting for data-related issues in Looker Studio and Power BI reports
• Stay up-to-date with the latest data engineering technologies and best practices

Qualifications

• 5+ years of experience in data engineering or a related field
• Strong proficiency in SQL and at least one programming language (Python, Scala, Java, etc.)
• Hands-on experience with data warehousing technologies like Snowflake, BigQuery, or Redshift- Familiarity with data streaming and batch processing frameworks like Apache Kafka, Spark, or Flink
• Knowledge of cloud computing platforms (AWS, Azure, or GCP) and their data engineering services
• Experience with data orchestration tools like Apache Airflow, Luigi, or Prefect
• Understanding of data modeling techniques and best practices for dimensional modeling or data vault
• Familiarity with Looker Studio and Power BI is a plus
• Strong problem-solving skills and the ability to work collaboratively in a team environment

Skills Applicable

SQL, Python, Java, Data Modelling, Data Visualization, data API