Principal Architect - Databricks

Tiger Analytics; Town of Texas (WI); On-site; USD 130,000 - 160,000; Full time

Job summary

Tiger Analytics is seeking a highly skilled Principal Data Architect to lead the technical strategy for our next-generation data ecosystem. This role involves designing enterprise data warehousing and building scalable IoT ingestion pipelines using cloud platforms such as Azure and AWS.

The ideal candidate will exhibit strong expertise in Databricks and data governance, ensuring robust end-to-end data management practices. Join us at Tiger Analytics for a unique opportunity to grow and innovate in a dynamic environment.

Qualifications

• Must have strong proficiency in building optimized Spark pipelines, delta lakes, and lakehouses.
• Experience with Azure and AWS cloud platforms focused on IoT infrastructure.
• Ability to manage both structured and unstructured data assets.

Responsibilities

• Design enterprise data warehousing (EDW), lakehouse, and business intelligence systems.
• Build scalable pipelines using Azure Hub and Stream Analytics.
• Implement information lifecycle management from data ingestion to archiving.
• Define and enforce global data governance and master data management practices.
• Extract unstructured data into connected datasets for analytics.

Skills

Databricks

Azure Hub

AWS IoT Core

Data Modeling

Business Intelligence Tools

Communication

Collaboration

Job description

Job Summary

We are seeking a highly skilled Principal Data Architect to design and implement our next-generation data ecosystem. You will lead the technical strategy for end-to-end data management, data warehousing, and IoT ingestion pipelines. The ideal candidate brings mastery in cloud data platforms (Azure or AWS) and advanced data governance.

Key Responsibilities

Data Architecture: Design Databricks-driven enterprise data warehousing (EDW), lakehouse, and business intelligence (BI) systems.

IoT & Stream Ingestion: Build scalable pipelines using Azure Hub, Device SDK, DPS, and Stream Analytics.

Data Management: Implement information lifecycle management (ILM) from data ingestion to archiving.

Data Strategy: Define, build, and enforce global data governance and master data management practices.

Dataset Creation: Extract and manipulate unstructured data into connected datasets for advanced analytics.

Required Skills

• Core Cloud Data Platform (Must Have)
  • Databricks: Strong proficiency in building optimized spark pipelines, delta lakes, and lakehouses.
• Cloud Ecosystem (Option A: Azure Suite)
  • IoT Infrastructure: Azure Hub, Device SDK, Device Provisioning Services (DPS), and Device Twins.
  • Compute & Storage: Azure Functions, Cosmos DB, and Azure Stream Analytics.
• Cloud Ecosystem (Option B: AWS Alternative)
  • IoT Infrastructure: AWS IoT Core, IoT Device Management, and IoT Device Defender.
  • Compute & Storage: AWS Lambda, DynamoDB, Amazon Kinesis, and EMR.
• Data Engineering & Governance
  • BI & EDW: Deep expertise in enterprise data warehousing and business intelligence tools.
  • Data Modeling: Proven ability to manage both structured and unstructured data assets.
• Qualifications & Soft Skills
  • Communication: Ability to translate complex technical concepts clearly to diverse technical teams.
  • Collaboration: Demonstrated teamwork skills with a proven track record in cross‑functional environments.
  • Experience: Extensive background in end-to-end data management principles and data lifecycle execution.

Good to have-Experience in architecting and building Azure IoT platforms/apps with good exposure to containerization and server less architecture.

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.