Data Engineer with GCP

iOPEX; Bengaluru; On-site; INR 900,000 - 1,200,000; Full time

Job summary

iOPEX in Bengaluru is seeking a Data Engineer to design and operate data pipelines, leveraging BigQuery and SQL to drive client insights and efficiency.

The role includes converting on-prem SAS/Netizza/EDW scripts to cloud-native BigQuery standards, validating pipelines, and collaborating with data catalog tools and CI/CD workflows in Terraform. You will engage with clients to assess requirements, implement scalable data solutions, and ensure reliability across platforms.

Qualifications

• Experience building data pipelines using cloud-native technologies.
• Knowledge of data governance tools (Collibra) is a plus.
• Ability to translate business needs into scalable data solutions.

Responsibilities

• Implement BigQuery SQL data pipelines.
• Convert on-prem SAS/Netizza/EDW scripts to BigQuery Standard SQL compliant scripts.
• Run, test, validate and maintain data pipelines.
• Explore data sources with data catalog tools (Collibra etc.).
• Build and maintain CI/CD pipelines in Terraform.

Skills

BigQuery

SQL

Data pipelines

Terraform

CI/CD

Collibra

Job description

Job Description: DataEngineer

We are looking for a qualifiedDataEngineer to help our clients reform their operations and support their business by providing intuitive guidance. You will be an important ally to every organization who wants to invest in change and improvement and needs help as to where and how. You will also undertake projects on behalf of the client business when it lacks resources or motive to perform them in-house. A successful business consultant has first and foremost a broad knowledge of the many facets of business and market forces. The ideal candidate will also possess great problem-solving skills to provide solutions and recommendations that will increase profitability and efficiency. The goal is to contribute to the clients long lasting success so that our reputation can expand along with our clientele. Organize and execute assigned business projects on behalf of clients (recruiting, payroll, promotional campaigns etc.) according to client requirements Meet with assigned clients when needed and perform an initial assessment of a problematic situation Collect information about the client's business through a variety of methods (shadowing, interviews, surveys, reading reports etc.)

Roles & Responsibilities

• Implement Big Query SQLDatapipelines
• Convert on-prem SAS /Netizza/ EDW scripts to Big Query Standard SQL compliant scripts
• Run, test, validate and maintaindatapipelines
• Ability to exploredatasources withdatacatalogue, collibra etc
• Build and maintain CI/CD pipelines in terraform