Big Data Developer

Objectways; Chennai District; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Objectways is seeking a Big Data Engineer to design and develop scalable data solutions on Google Cloud Platform. You will be involved in working with large-scale datasets, data lakes, and implementing data warehousing solutions. This role requires a solid 4+ years of software development experience, expertise in Scala, Spark, and Hive, along with a strong understanding of ETL processes.

Collaboration with product and business teams is key, as well as ensuring data quality and governance standards. If you have a passion for developing innovative data solutions, we encourage you to apply.

Qualifications

• 4+ years of software development experience.
• Hands-on experience with Google Cloud Platform (GCP).
• Strong expertise in Scala, Spark, and Hive.
• Experience with ETL and Data Warehousing concepts.
• Strong SQL and database skills.

Responsibilities

• Design, develop, and maintain scalable Big Data solutions.
• Build and optimize ETL pipelines and data processing frameworks.
• Implement and maintain data models and data warehousing solutions.
• Develop applications using Scala, Spark, and Hive.
• Collaborate with product and business teams to deliver data-driven solutions.

Skills

GCP (BigQuery, Cloud Storage)

Scala

Spark

Hive

SQL

ETL

Data Warehousing

Jenkins

Maven

Git

CI/CD

Unix/Linux

Job description

We are looking for a Big Data Engineer to design and develop scalable data solutions on Google Cloud Platform. The role involves working with large-scale datasets, data lakes, ETL processes, and business intelligence solutions.

Key Responsibilities

• Design, develop, and maintain scalable Big Data solutions.
• Build and optimize ETL pipelines and data processing frameworks.
• Develop applications using Scala, Spark, and Hive.
• Implement and maintain data models and data warehousing solutions.
• Collaborate with product and business teams to deliver data-driven solutions.
• Design and develop Power BI dashboards and reports.
• Ensure data quality, performance, and governance standards.
• Participate in architecture design, code reviews, and Agile development processes.

Required Qualifications

• 4+ years of software development experience.
• Hands‑on experience with GCP (BigQuery, Cloud Storage).
• Strong expertise in Scala, Spark, and Hive.
• Experience with ETL and Data Warehousing concepts.
• Strong SQL and database skills.
• Experience with Jenkins, Maven, Git, and CI/CD pipelines.
• Knowledge of Unix/Linux and web technologies.
• Strong analytical and problem‑solving skills.

Preferred Qualifications

• Power BI Development.
• DAX, Power Query, and Data Modeling.
• Experience with Business Intelligence and Reporting Solutions.