Data Engineer - Databricks - Hybrid - 60/hr

ContractStaffingRecruiters.com; Hartford (CT); On-site; USD 90,000 - 120,000; Full time

Job summary

ContractStaffingRecruiters.com is looking for a Data Engineer in Hartford, Connecticut. The successful candidate will develop scalable solutions for complex data projects, focusing on data ingestion, transformation, and distribution. You will collaborate with the Business Intelligence team to design technical architecture for data warehousing.

Ideal candidates will have strong skills in Python, SQL, and cloud technologies such as AWS and Azure. Excellent communication skills and the ability to manage multiple projects are essential.

Qualifications

• Experience in data ingestion, transformation, and distribution.
• Ability to develop ETL processes transforming raw data into SQL databases.
• Familiarity with cloud services like Azure SQL server.

Responsibilities

• Develop scalable and reliable data solutions.
• Design and develop database objects and ETL processes.
• Maintain comprehensive project documentation.

Skills

Python

SQL

PLSQL

DBT

Oracle

SQL Server

MySQL

AWS

Azure

Big Data

Job description

We are seeking a Data Engineer with experience in projects emphasizing complex data solutions. This person will be responsible for supporting the data ingestion, transformation, and distribution to end consumers. Candidate will perform requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products. Work with the Business Intelligence team and operational stakeholders to design and implement both the data presentation layer available to the user community, as well as the underlying technical architecture of the data warehousing environment.

• Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes.
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL databases.
• Understands the concept of data marts and data lakes and experience with migrating legacy systems to data marts/lake.
• Uses additional cloud technologies (e.g., understands concept of cloud services like Azure SQL server).
• Maintain comprehensive project documentation.
• Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.
• Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members.
• Manage multiple projects, responsibilities and competing priorities.

Experience Needed

Programming languages, frameworks, and file formats such as Python, SQL, PLSQL, DBT. Database platforms such as Oracle, SQL Server, MySQL. Big data concepts and technologies such as Synapse & Databricks. AWS and Azure cloud computing.