Senior GCP Data Engineer with Datastage or Snaplogic_Remote_GC and USC Needed_Only on W2

Chelsoft Solutions Co.; Eagan (MN); Remote; USD 97,000 - 120,000; Full time

Job summary

A leading IT company is seeking a Senior GCP Data Engineer to focus on migrating legacy ETL pipelines and developing data ingestion processes. Candidates should have strong skills in Datastage, SnapLogic, and Google BigQuery, along with an understanding of data modeling. This remote role requires proactive problem-solving skills and a collaborative mindset.

Qualifications

• Experience in Datastage for ETL pipeline migration.
• Knowledge of Airflow or Cloud Composer for job orchestration.
• Familiarity with Google BigQuery for data warehousing.

Responsibilities

• Analyze and migrate existing ETL pipelines to SnapLogic.
• Develop new data ingestion and ETL pipelines from scratch.
• Support data modeling and data warehousing efforts.

Skills

Datastage

Airflow

Cloud Composer

ETL Pipelines

Google BigQuery

Python

SQL

Spark

Dataflow

Data Modeling

Job description

Senior GCP Data Engineer with Datastage or Snaplogic_Remote_GC and USC Needed_Only on W2

Senior GCP Data Engineer with Datastage or Snaplogic_Remote_GC and USC Needed_Only on W2

1 week ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Required Skills : Will need experience in Datastage--have legacy ETL pipelines in Datastage which they are migrating. Needs experience in Airflow or Cloud Composer orchestration, development of new DAGs from scratch. Development of data ingestion and ETL pipelines from scratch. Needs experience in data warehousing - Google BigQuery.

• Need experience in Datastage--have legacy ETL pipelines which they are migrating. This role will analyze the existing ETL pipelines, jobs, and replace in their modern stack: SnapLogic, Python, some Spark, some Dataflow.
• These 2 Developers need experience in DataStage (they have not been successful in upskilling from Informatica, Talend, etc.).
• Experience in SnapLogic is strongly preferred; they have found this to be more amenable to upskilling.
• Needs experience in Airflow or Cloud Composer orchestration, development of new DAGs from scratch.
• Development of data ingestion and ETL pipelines from scratch. Using SnapLogic primarily for data pipelines and integrations, but also Python, SQL, Dataflow, Spark.
• Needs experience in data warehousing, Google BigQuery.
• Not responsible for building out visualizations; another team handles
• Will be supporting data modeling, but not owning. Should have some experience in data modeling, data warehousing fundamentals.
• Understanding of analytics as a whole, how data moves from source, warehouse, semantic or reporting layer, models, and reporting/BI, but their hands-on focus will be around building data pipelines and orchestration.
• Proactive communicators, inquisitive people, problem-solvers, unafraid to make suggestions, ask questions. "Order taker" and "heads down" types of Engineers will not be a culture fit for the team.
• They have a list of other technologies in their environment in smaller amounts/more dispersed--any would be a "nice to have": i.e. Kafka, Java, Apache Beam, Alteryx, etc.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Chelsoft Solutions Co. by 2x

Get notified about new Senior Data Engineer jobs in Eagan, MN.

Minneapolis, MN $97,500.00-$120,000.00 1 week ago

Hopkins, MN $98,400.00-$168,600.00 21 hours ago

Minneapolis, MN $105,000.00-$110,000.00 1 month ago

Senior Digital Marketing Data Analyst- Remote

Data Solutions Architect – Federal Program

Hopkins, MN $119,765.00-$154,990.00 1 hour ago

Minneapolis, MN $84,000.00-$149,400.00 15 hours ago

Minneapolis, MN $130,000.00-$170,000.00 2 weeks ago

Senior Software Manufacturing Process Engineer

Minneapolis, MN $99,000.00-$123,000.00 2 weeks ago

Minneapolis, MN $110,000.00-$258,000.00 1 week ago

Data Channel and Recording Subsystem Architect

Shakopee, MN $180,003.20-$267,307.03 3 days ago

Brooklyn Park, MN $86,500.00-$135,960.00 5 hours ago

Minneapolis, MN $84,000.00-$149,400.00 1 week ago

Minneapolis, MN $110,000.00-$130,000.00 3 months ago

Wayzata, MN $130,000.00-$170,000.00 2 weeks ago

Minneapolis, MN $152,000.00-$263,000.00 1 week ago

Minneapolis, MN $111,000.00-$152,000.00 1 day ago

Minneapolis, MN $150,000.00-$170,000.00 2 weeks ago

Minneapolis, MN $90,000.00-$100,000.00 8 hours ago

Greater Minneapolis-St. Paul Area $130,000.00-$150,000.00 2 weeks ago

Greater Minneapolis-St. Paul Area $70.00-$80.00 4 weeks ago

Minneapolis, MN $100,000.00-$145,000.00 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.