Senior Data Engineer

Data Based Development Systems, Inc; United States; Presencial; USD 90.000 - 140.000; Jornada completa

Descripción de la vacante

Data Based Development Systems, Inc. seeks a Data Engineer to support two critical applications that shape clients' supply chain and planning operations. You will collaborate with Databricks activities, minimize disruptions, and deliver fixes or enhancements as required.

The role involves designing ETL processes, building data marts and data lakes, and migrating legacy systems to modern data platforms. Strong teamwork and continuous improvement mindset are essential.

Formación

• Proficient in modern data engineering languages and frameworks.
• Experience with relational and big data platforms is required.
• Knowledge of cloud data services including AWS/Azure.
• Understanding of data lakes, data marts, and ETL processes.

Responsabilidades

• Support two critical applications for clients' supply chain and planning operations.
• Lead the Queue Management System to ensure timely processing and continuity.
• Design and develop database objects, tables, stored procedures, and views.
• Create ETL processes transforming raw data into SQL databases.
• Migrate legacy systems to data marts/lake and manage documentation.

Conocimientos

Python

SQL

PLSQL

Herramientas

DBT

Azure

AWS

Databricks

Synapse

Descripción del empleo

The Opportunity

We are seeking a Data Engineer with experience in projects emphasizing complex data solutions. This person will be responsible for supporting the continued performance, reliability, and availability of two critical applications, which are essential to our clients supply chain and planning operations. This Data Engineer will help support Databricks activities that minimize disruptions, maintain stable daily operations, and deliver approved fixes or enhancements as required. The Data Engineer will assist with requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products.

• Work with the various technology teams and operational stakeholders to support and enhance two applications
• Lead the Queue Management System to ensure timely processing, issue resolution, and continuity of business operations within the applications.
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
• Understands the concept of Data Marts and Data lakes and experience with migrating legacy systems to data marts/lake
• Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
• Maintain comprehensive project documentation
• Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.
• Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members.
• Manage multiple projects, responsibilities and competing priorities.

Requirements Experience Needed

• Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT
• Database platforms such as: Oracle, SQL Server, MySQL
• Big data concepts and technologies such as Synapse & Databricks
• AWS and Azure cloud computing