Data Engineer - Reports & Dashboarding

Forward Eye Technologies; Dadri; On-site; INR 1,400,000 - 2,600,000; Full time

Job summary

Forward Eye Technologies is seeking a Data Engineer to design and implement robust data pipelines in support of BI and analytics initiatives. You'll work with analysts, data scientists and stakeholders to translate data requirements into scalable data models.

You will optimize pipelines for performance and reliability, ensure data quality and security, and maintain comprehensive data documentation. Familiarity with Looker Studio and Power BI is advantageous.

Qualifications

• 5+ years of experience in data engineering or a related field.

Responsibilities

• Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake.
• Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models.
• Optimize data pipelines for performance, scalability, and reliability using tools like Apache Airflow, Kafka, or AWS Glue.
• Ensure data quality, consistency, and security throughout the data lifecycle.
• Develop and maintain data documentation, including data dictionaries, metadata, and data lineage.
• Provide technical support and troubleshooting for data-related issues in Looker Studio and Power BI reports.
• Stay up-to-date with the latest data engineering technologies and best practices.

Skills

SQL

Python

Java

Data Modelling

Data Visualization

Data API

Tools

Snowflake

BigQuery

Redshift

Apache Airflow

Kafka

Spark

Flink

AWS

Azure

GCP

Looker Studio

Power BI

Job description

Role Description :

As a Data Engineer, you will play a crucial role in designing and implementing data pipelines to support business intelligence and analytics initiatives. You will work closely with data analysts, data scientists, and business stakeholders to understand data requirements and create efficient data models.

Key Responsibilities :

• Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake
• Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models
• Optimize data pipelines for performance, scalability, and reliability using tools like Apache Airflow, Kafka, or AWS Glue
• Ensure data quality, consistency, and security throughout the data lifecycle
• Develop and maintain data documentation, including data dictionaries, metadata, and data lineage
• Provide technical support and troubleshooting for data-related issues in Looker Studio and Power BI reports
• Stay up-to-date with the latest data engineering technologies and best practices

Qualifications

• 5+ years of experience in data engineering or a related field
• Strong proficiency in SQL and at least one programming language (Python, Scala, Java, etc.)
• Hands-on experience with data warehousing technologies like Snowflake, BigQuery, or Redshift- Familiarity with data streaming and batch processing frameworks like Apache Kafka, Spark, or Flink
• Knowledge of cloud computing platforms (AWS, Azure, or GCP) and their data engineering services
• Experience with data orchestration tools like Apache Airflow, Luigi, or Prefect
• Understanding of data modeling techniques and best practices for dimensional modeling or data vault
• Familiarity with Looker Studio and Power BI is a plus
• Strong problem-solving skills and the ability to work collaboratively in a team environment

Skills Applicable

• SQL
• Python
• Java
• Data Modelling
• Data Visualization
• data API