Data Engineer - Azure (Scala/Kafka)

Tiger Analytics; United States; Remote; USD 110,000 - 160,000; Full time

Job summary

Tiger Analytics is expanding its Data Engineering practice and seeks a Sr. Azure Data Engineer. This remote role involves building efficient data pipelines, harmonizing data from different sources, and aligning data systems with organizational goals. Candidates should possess strong analytical skills and extensive experience in data engineering, analytics, and Azure technologies.

Benefits

Significant career development opportunities

Fast-growing entrepreneurial environment

Qualifications

• 8+ years experience in Data Engineering and Analytics.
• Experience building data pipelines using Azure stack.
• Experience in data wrangling and advanced analytic modeling preferred.

Responsibilities

• Combine data from different sources to align with business goals.
• Build and maintain data ingestion pipelines for structured and unstructured data.
• Develop data pipelines using Azure Data Factory and integrate APIs.

Skills

Proficiency in Scala

Proficiency in Python programming

Proficiency in SQL queries

Experience with Kafka

Experience with PySpark

Experience in harmonizing raw data

Strong communication skills

Education

Bachelor's degree in Computer Science

Tools

Azure Data Factory

Apache Spark

Azure Databricks

Delta Lake

Job description

Description

Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce.

We are expanding our Data Engineering practice and looking for Sr. Azure Data Engineers to join our growing team of analytics experts. The right candidate will have strong analytical skills and the ability to combine data from different sources, striving for efficiency by aligning data systems with business goals.

This is a remote role for applicants based in the USA.

Requirements

• Bachelor's degree in Computer Science or a similar field
• 8+ years experience in Data Engineering and several years in Analytics
• Proficiency in Scala and coding experience is required
• Experience with Kafka and Azure Data Factory for data pipelines and migration (Azure Synapses)
• Experience with real-time streaming, Kafka, and API integration
• Experience with PySpark
• Proficiency in Python programming
• Proficiency in SQL queries
• Experience building data pipelines using Azure stack
• Experience with Apache Spark
• Experience with Delta Lake and ETL processing
• Experience working in a Unix environment
• Experience in harmonizing raw data into consumer-friendly formats using Azure Databricks
• Experience querying and joining large data sets at scale
• Experience building data ingestion pipelines with Azure Data Factory for structured and unstructured data
• Experience in data wrangling and advanced analytic modeling (preferred)
• Strong communication and organizational skills

Benefits

This position offers significant career development opportunities in a fast-growing, entrepreneurial environment with high individual responsibility.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Other

Industries

• IT Services and IT Consulting