Data Engineer-(Remote)

Shuvel Digital; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

A leading company is seeking a Senior Data Engineer to join their data warehousing team. The ideal candidate will have over 7 years of experience in data engineering, particularly in ETL and SQL, and will be adept at transforming complex data for analytics. This role also requires strong communication skills and the ability to quickly master new tools, ensuring effective collaboration with clients and technical staff.

Qualifications

• At least 7 years in a data engineering role.
• Strong experience developing and maintaining complex SQL.
• Ability to learn new tools quickly.

Responsibilities

• Transform transactional data into datasets for reporting and analytics.
• Work with data warehousing team on data integration tasks.
• Learn new data domains as data warehouse grows.

Skills

ETL development

SQL

data integration

data mining

big data

database administration

software administration

communication skills

Education

Bachelor's degree

Tools

Python

Scala

Spark

Hive

DB2

Oracle

SAP

Postgres

Elastic Search

Hadoop

Job description

Clearance: Active DHS Public Trust or similar clearance that will gain reciprocity

What You'll Be Doing

The Senior Data Engineer will work with our data warehousing team to transform transactional data into datasets that are consumable by a variety of consumers, for reporting and analytics. The successful candidate will be flexible and forward-leaning, able to learn new tools and skills, and able to learn new data domains as the data warehouse grows.

Required Skills and Experience:

• Bachelor’s degree plus at least 7 years in a data engineering role including ETL development, database development, data integration, data mining, big data
• Strong experience developing and maintaining complex SQL for ETL and reporting
• Strong experience with large complex data systems
• Experience performing database administration tasks (manage scheduled jobs, cluster configurations)
• Experience performing software administration tasks (deploy applications, manage scheduled tasks)
• Ability to learn new tools quickly as needed to provide new ideas for solving problems
• Ability and desire to work with other program staff and customers to reach design decisions within given constraints
• Excellent diplomacy and communication skills with both clients and technical staff

Preferred Skills and Experience:

• Proficiency in Python and Scala
• Experience using Spark and Hive
• Experience with Qlik or other data visualization administration
• Experience completing Databricks development and/or administrative tasks
• Familiarity with some of these tools: DB2, Oracle, SAP, Postgres, Elastic Search, Glacier, Cassandra, DynamoDB, Hadoop, Splunk, SAP HANA, Databricks
• Experience working with federal government clients