Azure Data Engineer: Pipelines, Databricks & Data Platforms

Tiger Analytics Inc.

United States

Remote

USD 100,000 - 160,000

Full time

7 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Tiger Analytics Inc. is seeking an Azure Data Engineer to design and implement advanced analytics capabilities. The role focuses on building data platforms on the Azure stack, ingesting data via Azure Data Factory, and leveraging Spark SQL and Azure Databricks to harmonize data for analytics.

Ideal candidates have a strong Python background, experience with large-scale data, and familiarity with Azure storage Gen1/Gen2 and Snowflake. Excellent communication and organizational skills are required.

Qualifications

Bachelor’s degree in Computer Science or similar field.
Strong in Python scripting.
Experience extracting/querying/joining large data sets at scale.
Experience building data platforms using Azure stack and Spark SQL.
Experience building data ingestion pipelines using Azure Data Factory to ingest structured and unstructured data.
Strong knowledge on Azure storage schematics such as Gen1 and Gen2.
Experience in harmonizing raw data into a consumer-friendly format using Azure Databricks.
Knowledge of Azure networking, security, key vaults, etc.
Experience utilizing Snowflake to build data marts with the data residing in Azure storage is a plus.
Good to have exposure to Big data applications.
Strong communication and organizational skills.