DATA ENGINEER - DATABRICKS - REMOTE 65/HR 1 YEAR CONTRACT

ContractStaffingRecruiters.com; Hartford (CT); Remote; USD 110,000 - 165,000; Full time

Job summary

ContractStaffingRecruiters.com is seeking a Data Engineer to support two critical applications for clients in supply chain and planning operations. The role emphasizes building complex data solutions, Databricks activities, and data pipeline improvements.

You will analyze requirements, design data flows, and implement unit/integration tests to deliver robust data products. Collaboration with cross-functional teams and ongoing learning are key parts of the role.

Qualifications

• Proficient in Python and SQL with strong analytical skills.
• Experience with data modeling and ETL development.
• Experience with Databricks and cloud data platforms.

Responsibilities

• Work with technology teams and stakeholders to support and enhance two applications.
• Lead the Queue Management System to ensure timely processing and continuity of operations.
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL processes to transform raw data into SQL databases.
• Understand Data Marts and Data Lakes; migrate legacy systems to data marts/lake.
• Utilize cloud services such as Azure SQL Server; maintain project documentation.
• Learn new technologies and perform research for process improvement.
• Communicate effectively with team members and stakeholders.
• Manage multiple projects and priorities.

Skills

Python

SQL

PL/SQL

DBT

Tools

Databricks

Synapse

Azure

AWS

Job description

The Opportunity

We are seeking a Data Engineer with experience in projects emphasizing complex data solutions. This person will be responsible for supporting the continued performance, reliability, and availability of two critical applications, which are essential to our clients supply chain and planning operations. This Data Engineer will help support Databricks activities that minimize disruptions, maintain stable daily operations, and deliver approved fixes or enhancements as required. The Data Engineer will assist with requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products.

Responsibilities

• Work with the various technology teams and operational stakeholders to support and enhance two applications.
• Lead the Queue Management System to ensure timely processing, issue resolution, and continuity of business operations within the applications.
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases.
• Understands the concept of Data Marts and Data lakes and experience with migrating legacy systems to data marts/lake.
• Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server).
• Maintain comprehensive project documentation.
• Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.
• Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical end users, and management team members.
• Manage multiple projects, responsibilities and competing priorities.

Experience Needed

• Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT.
• Database platforms such as: Oracle, SQL Server, MySQL.
• Big data concepts and technologies such as Synapse and Databricks.
• AWS and Azure cloud computing.