GCP Data Engineer

Artech L.L.C.; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Artech L.L.C. in Bengaluru seeks a hands-on Data Engineer with 3–7 years of experience to design, build, and operate large-scale enterprise data solutions on Google Cloud Platform.

You will implement ETL/ELT pipelines from ingestion to consumption, work with Terraform, Spark/Scala, and modern data lake/warehouse technologies, and collaborate across teams to deliver production-grade data platforms.

Qualifications

• 3-7 years of relevant work experience.
• Hands-on experience building and operating large-scale enterprise data solutions on GCP (Dataflow, Dataproc, Pub/Sub, BigQuery, Cloud Functions, Composer, GCS).
• Must have hands-on experience with Terraform.
• Proficient in Spark/Scala (Python/Java).
• Experience building production-grade ETL/ELT data pipelines from ingestion to consumption.

Skills

Data engineering

ETL/ELT pipelines

Spark/Scala

Communication

Teamwork

Problem solving

Multitasking

Tools

Terraform

Git/Bitbucket

Job description

• Relevant work experience between 3 to 7 years.
• Proficient Experience on designing, building and operationalizing large-scale enterprise data solutions using at least four GCP services among Data Flow, Data Proc, Pub Sub, BigQuery, Cloud Functions, Composer, GCS
• Must have hands on experience in Terraform
• Proficient hands-on programming experience in Spark/Scala (python/java)
• Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption
• Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration)
• Excellent communicator (written and verbal formal and informal)
• Experience using software version control tools (Git/Bitbucket/code commit).
• Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
• Ability to multi-task under pressure and work independently with minimal supervision.
• Must be a team player and enjoy working in a cooperative and collaborative team environment.

Desired Skills and Experience (Good to Have):

• GCP Certification preferred.

Additional Cloud experience in AWS or Azure preferred