Data Engineer - (Databricks) - Hybrid - 60/hr

ContractStaffingRecruiters.com; Farmington (CT); On-site; USD 90,000 - 120,000; Full time

Job summary

ContractStaffingRecruiters.com is looking for a Data Engineer located in Farmington, Connecticut. This role will focus on developing scalable data solutions and transforming data from various sources into structured databases.

The ideal candidate will have experience with programming languages like Python and SQL, along with knowledge of database platforms such as Oracle and SQL Server. Familiarity with cloud services and big data technologies is essential for success in this role.

Qualifications

• Experience with programming languages such as Python and SQL.
• Knowledge in database platforms including Oracle and SQL Server.
• Ability to work with big data technologies like Synapse and Databricks.

Responsibilities

• Support data ingestion, transformation, and distribution to end consumers.
• Design and develop ETL processes for various data sources.
• Manage multiple projects and priorities while maintaining documentation.

Skills

Python

SQL

PLSQL

DBT

AWS

Azure

Big Data Concepts

Data Lakes

Data Marts

Strong communication skills

Tools

Oracle

SQL Server

MySQL

Databricks

Azure SQL Server

Job description

We are seeking a Data Engineer with experience in projects emphasizing complex data solutions. This person will be responsible for supporting the data ingestion, transformation, and distribution to end consumers. Candidate will perform requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products. Work with the Business Intelligence team and operational stakeholders to design and implement both the data presentation layer available to the user community, as well as the underlying technical architecture of the data warehousing environment.

• Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes.
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL databases.
• Understands the concept of data marts and data lakes and experience with migrating legacy systems to data marts/lake.
• Uses additional cloud technologies (e.g., understands concept of cloud services like Azure SQL server).
• Maintain comprehensive project documentation.
• Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.
• Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members.
• Manage multiple projects, responsibilities and competing priorities.

Experience Needed

Programming languages, frameworks, and file formats such as Python, SQL, PLSQL, DBT. Database platforms such as Oracle, SQL Server, MySQL. Big data concepts and technologies such as Synapse & Databricks. AWS and Azure cloud computing.