Data Engineer II: Big Data Pipelines & Analytics

Western Governors University; United States; On-site; USD 119,000 - 179,000; Full time

Benefits offered by this job

Bonuses

Health benefits

Tuition discount

Flexible PTO

Parental leave

Telehealth

Job summary

Western Governors University is seeking a Big Data Developer to design data flow across hybrid environments, focusing on OLAP/OLTP data modeling and data quality. You will help establish data standards and serve as the go-to for query performance and profiling in a fast-paced agile team.

Responsibilities include building ETL/ELT pipelines, securing data across cloud platforms, and delivering timely analytics reports.

Qualifications

• Bachelor’s degree in MIS/CS or related field.
• 4 years of experience in Data Engineering, Data Integration, Big Data, BI, or Software Engineering.
• Equivalent relevant experience may substitute for education requirements.
• 1 year of experience per 1 year of education in related fields is common practice.

Responsibilities

• Develops and builds ETL/ELT data pipelines for data analysis.
• Creates and maintains optimal data pipeline architecture.
• Keeps data separated and secure across multiple cloud environments.
• Assembles large, complex data sets meeting business requirements.
• Delivers ad-hoc and analytical reports to internal users and teams.
• Monitors and maintains ETL/ELT jobs and troubleshoots load issues.
• Performs data/technology discovery from new sources and third-party apps.
• Creates complex reports and dashboards in Cognos and Tableau.
• Transforms data from SQL, NoSQL, APIs, JSON, XML and delimited files.

Skills

SQL

NoSQL

Python

Java

Scala

Big data tools

Cognos/Tableau

Education

Bachelor’s Degree in MIS/CS

Tools

Jira

Confluence

GitHub

Hadoop

Spark

Kafka

Databricks

Cloudera/Horton

Impala/Hive

AngularJS/HTML5/CSS

Job description

Western Governors University is seeking a Big Data Developer to design data flow across hybrid environments, focusing on OLAP/OLTP data modeling and data quality. You will help establish data standards and serve as the go-to for query performance and profiling in a fast-paced agile team.

Responsibilities include building ETL/ELT pipelines, securing data across cloud platforms, and delivering timely analytics reports.