Data Engineer - Databricks - 65/hr - 1 year contract

ContractStaffingRecruiters.com; Stamford (CT); On-site; USD 100,000 - 130,000; Full time

Job summary

ContractStaffingRecruiters.com is seeking a Data Engineer in Stamford, Connecticut. This role involves designing scalable data solutions and developing ETL processes for transforming various data sources into structured databases. Strong experience with Python, SQL, and cloud technologies such as AWS and Azure is essential.

The ideal candidate will collaborate with the Business Intelligence team to enhance data presentation and maintain project documentation. Excellent interpersonal and communication skills are necessary to manage multiple responsibilities effectively.

Qualifications

• Experience with programming languages such as Python, SQL, PLSQL, and DBT.
• Familiarity with database platforms including Oracle, SQL Server, and MySQL.
• Knowledge of big data concepts and technologies.

Responsibilities

• Design and implement data presentation layers and technical architecture.
• Develop scalable data solutions for real-time and batch data movement.
• Create ETL processes for transforming raw data into SQL databases.

Skills

Python

SQL

PLSQL

DBT

Data lakes

Azure

AWS

Communication skills

Tools

Oracle

SQL Server

MySQL

Synapse

Databricks

Job description

Opportunity

We are seeking a Data Engineer with experience in projects emphasizing complex data solutions. This person will be responsible for supporting the data ingestion, transformation, and distribution to end consumers. Candidate will perform requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products.

Responsibilities

Work with the Business Intelligence team and operational stakeholders to design and implement both the data presentation layer available to the user community, as well as the underlying technical architecture of the data warehousing environment.

• Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes.
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases.
• Understand the concept of Data marts and Data lakes and experience with migrating legacy systems to data marts/lake.
• Use additional cloud technologies (e.g., understand concept of Cloud services like Azure SQL server).
• Maintain comprehensive project documentation.
• Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.
• Strong interpersonal and communication skills to work in a team environment with customer and contractor technical, end users, and management team members.
• Manage multiple projects, responsibilities and competing priorities.

Experience Needed

• Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT.
• Database platforms such as: Oracle, SQL Server, MySQL.
• Big data concepts and technologies such as Synapse & Databricks.
• AWS and Azure cloud computing.