Senior Data Engineer

Tiger Analytics Inc.; Chicago (IL); On-site; USD 100,000 - 150,000; Full time

Job summary

Tiger Analytics is seeking an experienced Data Engineer in Chicago to design, build, and maintain scalable ETL/ELT pipelines on the Azure data stack. You will work with data scientists and BI teams to support analytics, ML/Generative AI initiatives, and data infrastructure.

This role emphasizes governance, security, and efficient cloud data processing. You'll collaborate across teams to optimize performance, enable reporting via dimensional data marts, and implement end-to-end data lineage with

Qualifications

• Experience designing scalable ETL/ELT pipelines on Azure data services.
• Strong data modeling for data lakes and marts (Star/Snowflake).
• Proficiency with PySpark, SQL/NoSQL, and streaming workloads.
• Experience implementing data governance, lineage, and data quality controls.
• Knowledge of security controls (RBAC, key vaults, encryption) for data pipelines.

Responsibilities

• Design, build, and maintain scalable data pipelines on Azure cloud.
• Collaborate with data scientists and analysts to support analytics and AI initiatives.
• Model dimensional data marts to enable reporting and BI.
• Implement data governance, quality checks, and lineage tracking.
• Automate deployments and CI/CD for data infrastructure.

Skills

Data engineering

ETL/ELT design

PySpark

Data modeling

Streaming data processing

Data governance

Security best practices

CI/CD

Tools

Azure Data Factory

Azure Synapse

Azure Databricks

ADLS Gen2

Delta Lake

Microsoft Purview

Azure DevOps

GitHub Actions

Job description

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.

We are seeking an experienced Data Engineer to join our data team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines, data integration processes, and data infrastructure on AWS cloud. You will collaborate closely with data scientists, analysts, and AI teams to support analytics, machine learning, and Generative AI initiatives across the organization.

Requirements

• Design, build, and maintain scalable ETL/ELT pipelines usingAzure Data Factory,Azure Synapse, andAzure Databricks.
• Architect and manage secure enterprise cloud storage, includingADLSGen2, Delta Lake, and relational/NoSQL databases.
• Ingest and process both high-volume batch data and real-time streaming workloads.
• Optimize database queries, PySpark jobs, and data pipeline performance to minimize execution time and cloud costs.
• Collaborate with BI and analytics teams to model dimensional data marts (Star/Snowflake schemas) for reporting.
• Implement data governance, automated data quality validation, and end-to-end lineage tracking (e.g., viaMicrosoft Purview).
• Secure data pipelines and storage using Azure Role-Based Access Control (RBAC), Key Vaults, and encryption standards.
• Automate infrastructure deployments and code releases usingAzure DevOps, GitHub Actions, and CI/CD best practices

Benefits

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.