data engineer

Data Smart Solutions; United States; Remote; USD 110,000 - 160,000; Full time

Benefits offered by this job

Бонус по результативности

Возможности профессионального роста

Job summary

Data Smart Solutions ищет инженера по данным для поддержки потоковой и пакетной обработки. Вы будете загружать hourly данные из SQL Server и 24/7 OLTP систем, импортировать файлы с NAS и API в Azure Blob Storage, а также строить и поддерживать модели dbt в Snowflake.

Кандидат должен иметь 2+ года опыта data engineering, продвинутый SQL, Python и PySpark, Git и процессы pull-request. Будут плюсом Azure Function Apps, Databricks и инструменты оркестрации; ожидается участие в онлайн-ассессментах и

Qualifications

• 2+ года опыта в data engineering
• Продвинутые навыки SQL
• Опыт работы с dbt и Snowflake
• Опыт Azure Data Factory/Synapse
• Python и PySpark
• Git и PR
• Будут плюсом: Databricks, Azure Functions/Logic Apps, Defender

Responsibilities

• Ingest hourly data from SQL Server and 24/7 OLTP systems
• Ingest files from customer NAS shares and APIs into Azure Blob Storage
• Build and maintain dbt models in Snowflake
• Handle production issues, including schema changes, failed hooks, missing files, and jobs that fail halfway

Skills

SQL

Python

PySpark

Git

Tools

Snowflake

dbt

Azure Data Factory

Azure Synapse

Job description

Описание: Описания нет

Задачи

• Ingest hourly data from SQL Server and 24/7 OLTP systems
• Ingest files from customer NAS shares and APIs into Azure Blob Storage
• Build and maintain dbt models in Snowflake
• Handle production issues, including schema changes, failed hooks, missing files, and jobs that fail halfway

Требования

• 2+ Years of data engineering experience
• Hands-on experience with Snowflake streams, Time Travel, data sharing, and standard, transient, hybrid, and Iceberg tables
• Advanced SQL skills
• Experience with dbt macros shared across projects, pre- and post-hooks, and SCD Type 2
• Experience with Azure Data Factory or Azure Synapse Pipelines, including self-hosted integration runtimes
• Python and PySpark skills
• Git and pull-request workflows, code review, and automated testing
• Будет плюсом: Azure Function Apps and Logic Apps, Microsoft Defender for scanning incoming files, Databricks, orchestration tools such as Airflow

Условия

• Performance-based bonus
• Professional growth opportunities
• Online coding assessment, technical interview, and final discussion with the manager
• AI tools and outside help are not allowed during interviews; sessions are recorded