Azure Data Engineer

Hexaware Technologies; Nashik District, Pune District, Mumbai; On-site; INR 900,000 - 1,400,000; Full time

Job summary

Hexaware Technologies in Nashik is seeking a data engineer to design, develop and maintain large-scale data pipelines using Azure Databricks, PySpark and Spark. You will collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.

Develop complex SQL queries to optimize database performance and troubleshoot issues, and ensure seamless data-system integration through effective communication.

Qualifications

• Proven experience designing and building large-scale data pipelines using Azure Databricks, PySpark, and Spark.
• Strong SQL skills with ability to optimize complex queries and troubleshoot performance.
• Experience collaborating with cross-functional teams and participating in code reviews.

Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Databricks, PySpark, and Spark.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
• Develop complex SQL queries to optimize database performance and troubleshoot issues.
• Ensure seamless integration of data systems through effective communication and coordination.
• Participate in code reviews to ensure adherence to coding standards and best practices.

Skills

SQL

Data pipelines

Azure Databricks

PySpark

Spark

Tools

Azure Databricks

PySpark

Spark

Job description

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Databricks, Pyspark, and Spark
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions
• Develop complex SQL queries to optimize database performance and troubleshoot issues
• Ensure seamless integration of data systems through effective communication and coordination
• Participate in code reviews to ensure adherence to coding standards and best practices