Data Engineer: Real-Time ETL & Data Lake Solutions

ContractStaffingRecruiters.com; Stamford (CT); Remote; USD 90,000 - 130,000; Full time

Job summary

ContractStaffingRecruiters.com is seeking a Data Engineer to build complex data solutions, transform data, and enable real-time and batch data movement across systems. You will collaborate with BI and operations teams to design the data presentation layer for user communities and ensure scalable delivery of data products.

You will work with Python, SQL, PLSQL, and DBT on databases such as Oracle, SQL Server, and MySQL, with cloud exposure to AWS and Azure.

Qualifications

• Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT
• Database platforms such as: Oracle, SQL Server, MySQL
• Big data concepts and technologies such as Synapse & Databricks
• AWS and Azure cloud computing

Responsibilities

• Supporting data transformation and distribution to end consumers
• Assist with requirements analysis, design/develop process flow, and unit/integration testing
• Work with BI team and stakeholders to design and implement data presentation layer
• Develop scalable data solutions to move data across systems in real time and batch modes
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL processes transforming raw data, flat files, spreadsheets
• Understand Data Marts and Data lakes; migrate legacy systems to data marts/lake
• Maintain comprehensive project documentation
• Learn new technologies and perform continuous research and process improvement
• Strong interpersonal and communication skills for team collaboration

Skills

Python

SQL

PLSQL

DBT

Tools

Oracle

SQL Server

MySQL

Synapse

Databricks

Job description

ContractStaffingRecruiters.com is seeking a Data Engineer to build complex data solutions, transform data, and enable real-time and batch data movement across systems. You will collaborate with BI and operations teams to design the data presentation layer for user communities and ensure scalable delivery of data products.

You will work with Python, SQL, PLSQL, and DBT on databases such as Oracle, SQL Server, and MySQL, with cloud exposure to AWS and Azure.