Data Engineer

HiFX IT & Media Services; Ernakulam; Sur place; INR 900 000 - 1 300 000; Plein temps

Résumé du poste

HiFX IT & Media Services designs and maintains scalable data pipelines to support business decisions. The role involves collaborating with cross-functional teams to identify priorities and ensure systems meet evolving needs.

You will work to optimize performance and uphold data quality across large data environments. We expect hands-on experience with Spark, Snowflake, and Databricks, plus strong skills in data modeling, testing, and validation to deliver robust data platforms for the

Qualifications

• Experience with Spark, Snowflake and Databricks.
• Develop and maintain large-scale data systems.
• Ensure data quality through testing and validation.

Responsabilités

• Design and build scalable data pipelines using Spark, Snowflake and Databricks.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain large-scale data systems that meet business needs.
• Ensure data quality and integrity by implementing robust testing and validation procedures.
• Optimize data processing workflows for performance and efficiency.

Connaissances

Data pipelines

Big data

SQL

Outils

Spark

Snowflake

Databricks

Description du poste

• Design and develop scalable data pipelines using Spark, Snowflake, and Databricks.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain large-scale data systems that meet business needs.
• Ensure data quality and integrity by implementing robust testing and validation procedures.
• Optimize data processing workflows for performance and efficiency.
• Stay up-to-date with industry trends and emerging technologies in data engineering.