Data Engineer - REMOTE

Contract Staffing Recruiters; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Contract Staffing Recruiters seeks a Data Engineer to support complex data solutions and ensure the uptime of two critical applications used in clients’ supply chain and planning operations.

You will assist with Databricks activities, design ETL processes, and collaborate with technology teams to deliver reliable data products and improvements across cloud environments.

Qualifications

• Proficient in Python and SQL programming.
• Experience with data modeling and ETL development.
• Ability to analyze requirements and design data solutions.
• Knowledge of cloud data services (Azure/AWS).

Responsibilities

• Support two critical applications to ensure performance, reliability, and availability.
• Lead the Queue Management System for timely processing and continuity.
• Design and develop database objects, tables, stored procedures, and views.
• Build ETL processes transforming raw data into SQL databases.
• Work with Databricks activities to minimize disruptions and implement fixes.
• Maintain project documentation and collaborate with stakeholders.

Skills

Python

SQL

PL/SQL

DBT

Tools

Databricks

Synapse

AWS

Azure

DBT

Job description

We are seeking a Data Engineer with experience in projects emphasizing complex data solutions. This person will be responsible for supporting the continued performance, reliability, and availability of two critical applications, which are essential to our clients supply chain and planning operations. This Data Engineer will help support Databricks activities that minimize disruptions, maintain stable daily operations, and deliver approved fixes or enhancements as required. The Data Engineer will assist with requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products.

• Work with the various technology teams and operational stakeholders to support and enhance two applications
• Lead the Queue Management System to ensure timely processing, issue resolution, and continuity of business operations within the applications.
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
• Understands the concept of Data Marts and Data lakes and experience with migrating legacy systems to data marts/lake
• Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
• Maintain comprehensive project documentation

Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.
Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members.

• Manage multiple projects, responsibilities and competing priorities.

Experience Needed:

• Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT
• Database platforms such as: Oracle, SQL Server, MySQL
• Big data concepts and technologies such as Synapse & Databricks
• AWS and Azure cloud computing