Azure Data engineer

Recro; Bengaluru; Sur place; INR 1 800 000 - 3 200 000; Plein temps

Résumé du poste

Recro is seeking a seasoned Data Engineer in Bengaluru to design and maintain scalable data pipelines on Hadoop or cloud platforms. You will develop end-to-end ETL/ELT workflows, optimize data flows for analytics, and implement DataOps, governance, and CI/CD practices.

Collaboration with Enterprise Architecture and cross-functional teams is essential to select the right technologies. You will build dimensional models, write optimized SQL, and work with Python/PySpark on large-scale data while

Qualifications

• Experience designing scalable data pipelines.
• Strong proficiency in SQL and Python.
• Experience with PySpark and distributed computing.
• Knowledge of data governance and CI/CD practices.

Responsabilités

• Design, build, and maintain scalable data pipelines and modern data platforms on Hadoop or cloud environments.
• Develop and optimize end-to-end ETL/ELT workflows for structured and unstructured data using modern data engineering frameworks.
• Architect robust data flows that improve scalability, reliability, and operational efficiency.
• Drive DataOps best practices by automating data provisioning, testing, monitoring, and deployment processes.
• Establish data governance standards, CI/CD pipelines, automated testing, and monitoring for production-grade data solutions.
• Collaborate with Enterprise Architecture and cross-functional teams to evaluate and implement the right data technologies and platform strategies.
• Build and maintain dimensional data models to support analytics and business intelligence initiatives.
• Develop highly optimized SQL queries to process and analyze large-scale datasets.
• Work with Python/PySpark and distributed computing technologies to process high-volume data efficiently.
• Lead data engineering work streams with a product mindset, ensuring high-quality and scalable data solutions.
• Continuously improve platform performance, deployment frequency, and data reliability through engineering best practices.

Connaissances

Data engineering

ETL/ELT

Python

SQL

PySpark

Hadoop/Cloud

CI/CD

Formation

Bachelor's degree in Computer Science or related field

Outils

Hadoop

Spark

PySpark

SQL

Cloud platforms (AWS/Azure/GCP)

Description du poste

• Design, build, and maintain scalable data pipelines and modern data platforms on Hadoop or cloud environments.
• Develop and optimize end-to-end ETL/ELT workflows for structured and unstructured data using modern data engineering frameworks.
• Architect robust data flows that improve scalability, reliability, and operational efficiency.
• Drive DataOps best practices by automating data provisioning, testing, monitoring, and deployment processes.
• Establish data governance standards, CI/CD pipelines, automated testing, and monitoring for production-grade data solutions.
• Collaborate with Enterprise Architecture and cross-functional teams to evaluate and implement the right data technologies and platform strategies.
• Build and maintain dimensional data models to support analytics and business intelligence initiatives.
• Develop highly optimized SQL queries to process and analyze large-scale datasets.
• Work with Python/PySpark and distributed computing technologies to process high-volume data efficiently.
• Lead data engineering work streams with a product mindset, ensuring high-quality and scalable data solutions.
• Continuously improve platform performance, deployment frequency, and data reliability through engineering best practices.