Senior Data Engineer

Tiger Analytics Inc.; United States; Remote; USD 110,000 - 150,000; Full time

Job summary

Tiger Analytics Inc. is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure on AWS cloud. You will collaborate with data scientists, analysts, and AI teams to support analytics and Generative AI initiatives.

You will work with Azure data services and control data governance, security, and automated deployments, while optimizing performance and costs. Join a fast-growing analytics partner recognized by market leaders.

Qualifications

• Design, build, and maintain scalable ETL/ELT pipelines on Azure.
• Ingest and process high-volume batch and real-time streaming data.
• Collaborate with BI/analytics teams to model star/snowflake schemas for reporting.
• Implement data governance, automated data quality validation, and end-to-end lineage tracking.
• Secure data pipelines and storage using RBAC, Key Vaults, and encryption standards.
• Automate infrastructure deployments and code releases with Azure DevOps and GitHub Actions.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines usingAzure Data Factory,Azure Synapse, andAzure Databricks.
• Architect and manage secure enterprise cloud storage, includingADLSGen2, Delta Lake, and relational/NoSQL databases.
• Ingest and process both high-volume batch data and real-time streaming workloads.
• Optimize database queries, PySpark jobs, and data pipeline performance to minimize execution time and cloud costs.
• Collaborate with BI and analytics teams to model dimensional data marts (Star/Snowflake schemas) for reporting.
• Implement data governance, automated data quality validation, and end-to-end lineage tracking (e.g., viaMicrosoft Purview).
• Secure data pipelines and storage using Azure Role-Based Access Control (RBAC), Key Vaults, and encryption standards.
• Automate infrastructure deployments and code releases usingAzure DevOps, GitHub Actions, and CI/CD best practices

Tools

Azure Data Factory

Azure Synapse

Azure Databricks

ADLS Gen2

Delta Lake

Microsoft Purview

Azure DevOps

GitHub Actions

CI/CD

PySpark

Job description

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.

We are seeking an experienced Data Engineer to join our data team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines, data integration processes, and data infrastructure on AWS cloud. You will collaborate closely with data scientists, analysts, and AI teams to support analytics, machine learning, and Generative AI initiatives across the organization.

Key Responsibilities:

• Design, build, and maintain scalable ETL/ELT pipelines usingAzure Data Factory,Azure Synapse, andAzure Databricks.
• Architect and manage secure enterprise cloud storage, includingADLSGen2, Delta Lake, and relational/NoSQL databases.
• Ingest and process both high-volume batch data and real-time streaming workloads.
• Optimize database queries, PySpark jobs, and data pipeline performance to minimize execution time and cloud costs.
• Collaborate with BI and analytics teams to model dimensional data marts (Star/Snowflake schemas) for reporting.
• Implement data governance, automated data quality validation, and end-to-end lineage tracking (e.g., viaMicrosoft Purview).
• Secure data pipelines and storage using Azure Role-Based Access Control (RBAC), Key Vaults, and encryption standards.
• Automate infrastructure deployments and code releases usingAzure DevOps, GitHub Actions, and CI/CD best practices

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.