Data Engineer | GCP + Airflow + Spark + Java + SQL | Any UST Location | 6+ Yrs | Immediate Joiners

UST; Bengaluru; On-site; INR 1,500,000 - 1,900,000; Full time

Job summary

UST in Bengaluru is seeking a highly skilled data engineer to design and optimize large-scale data pipelines using Java and Apache Spark, leveraging strong SQL skills and cloud experience.

The role emphasizes building cloud-native architectures on GCP, using BigQuery and Cloud Storage, and implementing workflow orchestration with Apache Airflow to automate complex data workflows.

Qualifications

• Hands-on experience with Java and Apache Spark for distributed data processing.
• Proficiency in Apache Airflow DAG authoring, workflow orchestration, and data pipeline automation.
• Experience with GCP services such as BigQuery and Cloud Storage, with strong SQL fundamentals.
• Good understanding of cloud-native data engineering principles, pipeline orchestration, and scalable distributed systems.

Skills

Java

Apache Spark

SQL

Cloud-native data engineering

Data pipelines

Tools

Apache Airflow

BigQuery

Cloud Storage

GCP

Job description

• Strong hands-on experience in Java and Apache Spark for distributed data processing and large-scale data applications.
• Proficiency in Apache Airflow, including DAG authoring, workflow orchestration, and data pipeline automation.
• Experience with GCP services such as BigQuery, Cloud Storage/Datasets, along with strong SQL fundamentals.
• Good understanding of cloud-native data engineering principles, pipeline orchestration, and scalable distributed systems.