Principal Architect - Databricks

Tiger Analytics, LLC; Dallas (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

Tiger Analytics, LLC is looking for a skilled Principal Data Architect in Dallas, Texas. The successful candidate will design and implement scalable data ecosystems, oversee end-to-end data management, and construction of data ingestion pipelines using cloud platforms like Azure and AWS.

Ideal candidates will possess strong expertise in data architecture and governance while being comfortable in making substantial contributions within a collaborative environment. Potential for significant career growth is offered as the company evolves.

Qualifications

• Strong proficiency in building optimized spark pipelines, delta lakes, and lakehouses.
• Experience with IoT Infrastructure such as Azure Hub and AWS IoT Core.
• Deep expertise in enterprise data warehousing and business intelligence tools.

Responsibilities

• Design Databricks-driven enterprise data warehousing and BI systems.
• Build scalable Azure and AWS pipelines for data ingestion.
• Implement information lifecycle management from ingestion to archiving.

Skills

Databricks

Azure Hub

AWS IoT Core

Data Engineering

Communication

Collaboration

Tools

Azure Functions

Cosmos DB

Amazon Kinesis

Job description

Job Summary

We are seeking a highly skilled Principal Data Architect to design and implement our next-generation data ecosystem. You will lead the technical strategy for end-to-end data management, data warehousing, and IoT ingestion pipelines. The ideal candidate brings mastery in cloud data platforms (Azure or AWS) and advanced data governance.

Key Responsibilities

Data Architecture: Design Databricks-driven enterprise data warehousing (EDW), lakehouse, and business intelligence (BI) systems.

IoT & Stream Ingestion: Build scalable pipelines using Azure Hub, Device SDK, DPS, and Stream Analytics.

Data Management: Implement information lifecycle management (ILM) from data ingestion to archiving.

Data Strategy: Define, build, and enforce global data governance and master data management practices.

Dataset Creation: Extract and manipulate unstructured data into connected datasets for advanced analytics.

Required Skills

• Core Cloud Data Platform (Must Have)
  • Databricks: Strong proficiency in building optimized spark pipelines, delta lakes, and lakehouses.
• Cloud Ecosystem (Option A: Azure Suite)
  • IoT Infrastructure: Azure Hub, Device SDK, Device Provisioning Services (DPS), and Device Twins.
  • Compute & Storage: Azure Functions, Cosmos DB, and Azure Stream Analytics.
• Cloud Ecosystem (Option B: AWS Alternative)
  • IoT Infrastructure: AWS IoT Core, IoT Device Management, and IoT Device Defender.
  • Compute & Storage: AWS Lambda, DynamoDB, Amazon Kinesis, and EMR.
• Data Engineering & Governance
  • BI & EDW: Deep expertise in enterprise data warehousing and business intelligence tools.
  • Data Modeling: Proven ability to manage both structured and unstructured data assets.
• Qualifications & Soft Skills
  • Communication: Ability to translate complex technical concepts clearly to diverse technical teams.
  • Collaboration: Demonstrated teamwork skills with a proven track record in cross‑functional environments.
  • Experience: Extensive background in end-to-end data management principles and data lifecycle execution.

Good to have-Experience in architecting and building Azure IoT platforms/apps with good exposure to containerization and server less architecture.

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.