Sr. GCP Cloud/ Data Engineer

Rapinno Tech; Irving (TX); Hybrid; USD 100,000 - 130,000; Full time

Job summary

A technology company is seeking a Sr. GCP Cloud/Data Engineer to migrate data platforms from SQL Server to GCP Big Query while utilizing tools such as Talend ETL and Apache Airflow. The successful candidate will work closely with various engineering teams, requiring skills in GCP, SQL, and data analysis. This role offers long-term contract opportunities with minimal onsite requirements in Irving, TX or Ashburn, VA.

Qualifications

• Experience with various ETL tools including SSIS, Teradata BTQ, and Talend.
• Familiarity with data platforms like GCP Big Query, Teradata, and SQL Server.
• Ability to analyze SQL server stored procedures and migrate logic to Big Query.

Responsibilities

• Migrate ETL jobs from SQL server, Teradata to GCP Big Query.
• Schedule various platform processes and jobs in Apache Airflow.
• Monitor execution of processes and provide support.

Skills

GCP cloud

Big Query

Data Engineering

SQL Server

Apache Airflow

Python

Tools

Talend ETL

SSIS

Teradata

AWS

Job description

About the job Sr. GCP Cloud/ Data Engineer

Location: Only 2 days onsite in a month (Any Location - Irving, TX or Ashburn, VA)

Duration: Long Term Contract

on C2C

JOB DESCRIPTION:

Required Skills: GCP cloud, Big Query, Data, SQL Server

As part of COE BI strategic initiatives, we are migrating the data platform from SQL server to GCP Big Query. The consultant will work with the GCP Platform lead and will be responsible for migrating ETL jobs from SQL server, Teradata to GCP Big Query using Talend ETL. Also responsible for scheduling of various platform processes, jobs in Apache Airflow and providing support in monitoring execution of them. Work with the Data Engineering and Reporting teams, analyze the SQL server stored procedures and migrate the business logic to Big Query.

Skills Required:

• Primary Experience with working with various ETL tools including SSIS, Teradata BTQ, Talend
• Experience with data platforms: GCP Big Query, Teradata, AWS, SQL server
• Experience in GCP Platform, services including Big Query, Cloud storage, IAM
• Experience in data set creation in Big Query and optimize them
• Expertise in understanding, analyzing SQL server stored procedures and packages, Python based ETL, Teradata batch scripts
• Knowledge in cloud database operations, tools and technologies that are required for on-prem to cloud migration.
• Experience programming/scripting/coding (SQL, Python, etc.) and knowledge of relational databases.