Data Engineer

Mployee.me; Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Mployee.me is seeking a Data Engineer in Bengaluru to design, develop, and maintain scalable data pipelines and platforms enabling reliable ingestion, transformation, storage, and analytics. You will work with Snowflake, Databricks, and other cloud tools to build batch and real-time integrations.

The role requires expertise in modern data stack technologies, data governance, and observability, with a focus on robust, scalable data architectures for business stakeholders and data scientists.

Qualifications

• Bachelor's degree required with at least 4 years of professional experience.
• Experience with Snowflake, Databricks, Redshift, BigQuery, or Synapse.
• Knowledge of Apache Kafka or other streaming technologies.
• Experience with dbt and modern data stack tools.
• Familiarity with DataOps and MLOps practices.
• Understanding of data governance, metadata management, and data quality frameworks.
• Cloud certifications (AWS, Azure, or GCP) are preferred.

Responsibilities

• Design and develop scalable data ingestion and processing pipelines.
• Build and maintain batch and real-time data integration solutions.
• Develop ETL/ELT workflows to transform and load data from various source systems.
• Design and optimize data models for analytics and reporting.
• Ensure data quality, integrity, governance, and security standards are maintained.
• Monitor, troubleshoot, and optimize data pipelines and workloads.
• Collaborate with product owners, business stakeholders, architects, and data scientists to deliver data solutions.
• Implement data observability, monitoring, and alerting mechanisms.
• Support cloud migration and modernization initiatives.
• Create and maintain technical documentation, data lineage, and operational runbooks.

Skills

Python

SQL

Scala

Java

Spark

Airflow

Education

Bachelor's degree in a relevant field

Tools

Snowflake

Databricks

Redshift

BigQuery

Synapse

Kafka

dbt

AWS

Azure

GCP

Airflow

Spark

Job description

Job Purpose and Impact

We are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and platforms that enable reliable data ingestion, transformation, storage, and analytics. The ideal candidate will have strong expertise in cloud-based data engineering, ETL/ELT frameworks, data warehousing, and modern big data technologies

Key Accountabilities

• Design and develop scalable data ingestion and processing pipelines.
• Build and maintain batch and real-time data integration solutions.
• Develop ETL/ELT workflows to transform and load data from various source systems.
• Design and optimize data models for analytics and reporting.
• Ensure data quality, integrity, governance, and security standards are maintained.
• Monitor, troubleshoot, and optimize data pipelines and workloads.
• Collaborate with product owners, business stakeholders, architects, and data scientists to deliver data solutions.
• Implement data observability, monitoring, and alerting mechanisms.
• Support cloud migration and modernization initiatives.
• Create and maintain technical documentation, data lineage, and operational runbooks.

Qualifications

• • Have a Bachelor's degree with minimum 4 years of professional experience.
  • Experience with Snowflake, Databricks, Redshift, BigQuery, or Synapse.
  • Knowledge of Apache Kafka or other streaming technologies.
  • Experience with dbt and modern data stack tools.
  • Familiarity with DataOps and MLOps practices.
  • Understanding of data governance, metadata management, and data quality frameworks.
  • Cloud certifications (AWS, Azure, or GCP) are preferred

• Technical Skills

  • Programming: Python, SQL, Scala, Java
  • Data Processing: Spark, Hive, Airflow
  • Cloud: AWS (S3, Glue, Lambda, EMR), Azure, GCP
  • Databases: SQL Server, Oracle, PostgreSQL, Snowflake
  • Streaming: Kafka, Kinesis
  • DevOps: Git, Jenkins, CI/CD
  • Data Modeling: Star Schema, Snowflake Schema, Data Vault