ENGINEER - DATA ANALYTICS

Hirewand-Technologies; Bengaluru; Presencial; INR 600.000 - 1.200.000; Jornada completa

Descripción de la vacante

Hirewand is seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and data models. You will work closely with data scientists and analysts to enable data-driven decision-making, ensuring data reliability and accessibility for analytics.

You will leverage PySpark, SQL, and cloud platforms (AWS/Azure/GCP) to optimize performance and data quality. Join a growing data team in Bangalore to empower data-driven insights across the organization.

Formación

• Bachelor’s degree in Computer Science, Engineering, or related field.
• Strong SQL skills and experience with relational databases, preferably PostgreSQL.
• Hands-on experience with Python for data processing.
• Experience with Apache Spark or similar big data processing frameworks.
• Experience with data pipelines, ETL, and data warehousing.
• Familiarity with cloud data platforms (AWS, Azure, GCP).
• Strong problem-solving, analytical, and communication skills.

Responsabilidades

• Design, develop, and maintain robust data pipelines using Python and modern ETL tools.
• Hands-on experience with PySpark framework.
• Build and optimize data models in PostgreSQL or other relational databases.
• Write complex SQL queries for data extraction, transformation, and loading.
• Optimize queries for performance.
• Implement and manage data lakes and storage solutions.
• Utilize distributed SQL engines like Trino for cross-source queries.
• Develop Python scripts for data processing, automation, and API integration.
• Ensure data quality, consistency, and accuracy through monitoring and checks.
• Collaborate with data scientists and analysts to fulfill data requirements.
• Maintain data documentation and dictionaries.
• Automate repetitive tasks and improve efficiency of data processes.
• Troubleshoot and resolve data-related issues.
• Manage and optimize cloud-based data infrastructure (AWS, Azure, GCP).

Conocimientos

SQL

Python

PySpark

Data pipelines

ETL

Data modeling

PostgreSQL

Cloud platforms

Educación

Bachelor’s degree (CS/Engineering)

Herramientas

PostgreSQL

Trino/Presto

Apache Spark

Iceberg

Delta Lake

Apache Hudi

APIs

Airflow

Descripción del empleo

About the Role:We are looking for a skilled Data Engineer to join our growing data team. In this role, you will design, build, and maintain scalable data pipelines, manage databases, and ensure data is reliable and accessible for analytics and reporting. You will work closely with data scientists, analysts, and other engineers to enable data-driven decision-making across the organization.Key Responsibilities:• Design, develop, and maintain robust data pipelines using Python and modern ETL tools.• Better understanding and hands-on experience in PySpark Framework• Build and optimize data models in PostgreSQL or other relational databases.• Write Complex SQL queries for data extraction, transformation, and loading.• Have good experience in Optimizing the Queries for better performance.• Implement and manage data lakes and related storage solutions.• Utilize distributed SQL engines such as Trino (PrestoSQL) for querying across data sources.• Develop Python scripts for data processing, automation, and API integration.• Ensure data quality, consistency, and accuracy through monitoring and checks.• Collaborate with data scientists and analysts to fulfill data requirements.• Maintain data documentation and dictionaries.• Automate repetitive tasks and improve the efficiency of data processes.• • Troubleshoot and resolve data-related issues.• • Manage and optimize cloud-based data infrastructure (AWS, Azure, GCP).Qualifications:• Bachelor’s degree in Computer Science, Engineering, or related field.• Strong SQL skills and experience with relational databases preferably PostgreSQL• Hands-on experience with Python for data processing.• Experience with Apache Spark or similar big data processing frameworks.• Experience with data pipelines, ETL, and data warehousing.• • Familiarity with cloud data platforms (AWS, Azure, GCP).• • Strong problem-solving, analytical, and communication skills.Preferred / Bonus Skills:• Experience with Apache Iceberg• Knowledge of distributed query engines like Trino/Presto.• Experience with data modeling and schema design for large-scale data platforms.• Familiarity with data security and governance policies.Must Have SkillsStrong SQL skills with experience in writing complex queriesQuery optimization and performance tuningHands-on experience with Python for data processing and automationExperience with PySpark / Apache Spark frameworkExperience in designing and maintaining ETL/data pipelinesExperience with relational databases, especially PostgreSQLUnderstanding of data warehousing conceptsExperience with cloud platforms (AWS / Azure / GCP)Data modeling and schema design basicsTroubleshooting and debugging data-related issuesGood analytical and problem-solving skillsGood to Have SkillsExperience with Data Lake technologiesApache Iceberg / Delta Lake / Apache HudiTrino / Presto distributed SQL enginesAPI integration using PythonData quality monitoring and validation frameworksAutomation of data workflows/processesExperience with large-scale distributed data platformsKnowledge of data governance and security policiesDocumentation and data dictionary maintenanceCollaboration experience with data scientists and analytics teamsExperience: 0-3 YearsLocation: BangaloreSkillssql, pyspark / spark, python, postgresql, trino, apache iceberg, delta lake, apache hudi, presto, api