Data Engineer

Mindpool Technologies

Bengaluru

Hybrid

INR 2,600,000 - 3,800,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mindpool Technologies in Bengaluru invites an experienced data engineer to design and implement scalable data pipelines using PySpark, Python and Spark, ensuring data quality and delivery across cloud platforms.

The role emphasizes Snowflake/Databricks implementations, ETL/ELT development, and collaboration with BI teams to enable robust analytics using modern tools and cloud services.

Qualifications

  • Hands-on experience with PySpark, Python, Spark and Scala for data validation, quality and delivery.
  • Snowflake and/or Databricks Cloud Data Warehouse implementations.
  • Experience with XML, JSON, Avro, Parquet data formats.
  • Strong ETL/ELT development across multiple data sources.
  • Knowledge of modern data platform concepts and cloud services.
  • Experience with Airflow, Matillion or similar orchestration tools.
  • Experience with Hadoop, Spark, Kafka and streaming frameworks.
  • BI/Analytics delivery using Power BI or Tableau.
  • AWS technologies including EC2, S3, Lambda, SQS, SNS.
  • SQL/PLSQL with advanced objects and indexing strategies.
  • Data warehousing concepts including fact/dimension modeling.
  • Big Data processing with Python and Spark.
  • CI/CD and DevOps using Jenkins, Terraform, Docker, AWS, Git, Kubernetes.
  • Awareness of AI-assisted development tools and AI-DLC practices.
  • Familiarity with GenAI tools (GitHub Copilot, ChatGPT, etc.).
  • Strong analytical, problem-solving and communication skills.

Skills

PySpark
Python
Spark
Scala
Data validation
Data quality
ETL/ELT
Snowflake
Databricks
Airflow
Matillion
Hadoop
Kafka
Power BI/Tableau
AWS

Tools

Jenkins
Terraform
Docker
Kubernetes
Git

Job description

Required Skills

  • At least 3 years of hands-on experience with PySpark, Python, Spark, and Scala, including data validation, data quality, and data delivery practices.
  • At least 3 years of Snowflake and/or Databricks Cloud Data Warehouse implementation experience.
  • Experience working with structured, semi-structured, and unstructured data formats including XML, JSON, Avro, and Parquet.
  • Strong experience developing ETL/ELT solutions across multiple enterprise data sources.
  • Strong understanding of modern data engineering and cloud data platform concepts.
  • Experience working with modern schedulers and orchestration tools such as Airflow, Matillion, or similar platforms.
  • Experience working with distributed data processing technologies including Hadoop, Spark, Kafka, and streaming frameworks.
  • Experience supporting business intelligence, reporting, and analytics solutions using Power BI, Tableau, or similar visualization platforms.
  • Good working knowledge of AWS technologies including EC2, S3, Lambda, SQS, and SNS.
  • Strong programming experience using SQL and PL/SQL, including packages, stored procedures, views, materialized views, triggers, and indexing strategies.
  • Strong understanding of Data Warehousing concepts including Fact and Dimension modeling, Star Schemas, and data loading methodologies.
  • Hands-on experience implementing Big Data processing solutions using Python and Spark.
  • Experience with CI/CD and DevOps practices using Jenkins, Terraform, Docker, AWS, Git, and Kubernetes.
  • Experience applying AI-assisted development tools and AI-Driven Development Lifecycle (AI-DLC) practices to improve development productivity and solution delivery.
  • Familiarity with Generative AI tools such as GitHub Copilot, Microsoft Copilot, ChatGPT, or equivalent AI-assisted engineering platforms.
  • Ability to leverage AI for code generation, test automation, documentation creation, troubleshooting, and engineering process optimization.
  • Strong analytical, problem-solving, and troubleshooting skills.
  • Excellent communication, collaboration, and stakeholder management skills.
  • Experience in the Pharma, Healthcare, Diagnostics, or Life Sciences industry is a plus.Role & responsibilities


Preferred candidate profile



Perks and benefits



Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Staples India • Chennai District

On-site
INR 800,000 - 1,200,000
Data Engineering Consultant - ADB, ADF, Azure, Spark and SQL
Data Engineering Consultant - ADB, ADF, Azure, Spark and SQL

Optum • Bengaluru

On-site
INR 2,500,000 - 6,000,000
Data Engineer - SQL/PySpark
Data Engineer - SQL/PySpark

Forward Eye Technologies • Pune District

On-site
INR 1,200,000 - 1,800,000
Data Engineer - SQL/PySpark
Data Engineer - SQL/PySpark

Forward Eye Technologies • Dadri

On-site
INR 1,200,000 - 1,800,000
Data Engineer - ETL/PySpark
Data Engineer - ETL/PySpark

Forward Eye Technologies • Pune District

On-site
INR 900,000 - 1,300,000
Data Engineer - ETL/PySpark
Data Engineer - ETL/PySpark

Forward Eye Technologies • Dadri

On-site
INR 1,500,000 - 2,400,000
Data Engineer
Data Engineer

Bacancy Technology Inc • Ahmedabad District

On-site
INR 1,500,000 - 3,000,000
Senior Data Engineer - Pharma
Senior Data Engineer - Pharma

TheMathCompany Inc. • India

On-site
INR 4,000,000 - 5,200,000
Senior Data Engineer
Senior Data Engineer

Creole Studios INC • Ahmedabad District

On-site
INR 900,000 - 1,500,000
Data Engineer
Data Engineer

Bayer • Bengaluru

On-site
INR 1,800,000 - 3,200,000