Lead Data Architect

Luxoft; Chicago, Northern (IL, KY); Hybrid; USD 130,000 - 185,000; Full time

Job summary

Luxoft seeks a Data Architect to design and implement scalable data solutions for a major US retail platform. You will lead architecture efforts across multiple domains, building robust ETL/ELT pipelines using Azure Data Factory, Synapse, and Databricks.

The role requires deep data modeling, governance, and collaboration with cross-functional teams to onboard brands and migrate to a cloud-native stack. You will mentor engineers, define technical strategy, and ensure efficient data storage,

Qualifications

• Readiness to work until 8.00 pm CET (no overtime).
• Total experience minimum 8+ years, with at least 1+ year in an Architect role.
• Strong hands-on expertise with Azure Data Factory and Synapse (3+ years).
• Deep knowledge of data modeling (conceptual, logical, physical) to support storage and retrieval.
• Extensive Azure experience including Azure Data Lake Storage, Synapse, Data Factory, and Databricks; pySpark for scalable data solutions.
• Experience building robust ETL/ELT pipelines from diverse sources into data lakes/warehouses.
• Ability to integrate data from APIs and other sources using appropriate methods.
• Proficiency in designing data warehousing solutions (Dimensional modeling, Star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault).
• SQL proficiency for complex queries and performance tuning on cloud storage.
• Experience with metadata and governance on cloud platforms.
• Azure/Databricks certifications are an added advantage.
• Experience with cloud-based analytical databases and Azure services like Azure MI, Postgres, Cosmos DB, Analysis Services, and Informix.
• Experience with Python and Python-based ETL tools; shell scripting ( Bash/Unix/Windows ).
• Proven ability to lead cross-functional teams, define technical strategy, drive delivery, mentor engineers, and communicate with stakeholders.

Responsibilities

• Design a solution for processing large data volumes and integrate with current architecture.
• Lead data architecture efforts for a big retail platform with multiple domains.
• Collaborate across Product Teams focused on Customer, Loyalty, Search and Browse, Data Integration, and Cart.

Skills

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage

Azure Databricks

pySpark

ETL/ELT pipelines

SQL

Data Modeling

Data Warehousing

APIs & data integration

Data Governance

Python

Shell scripting

Leadership

Education

Azure/Databricks certifications

Tools

Docker

Kubernetes

Elasticsearch

Azure MI

Azure Database for Postgres

Job description

Project description

The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.

Responsibilities

• We are looking for Data Architect who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.

SKILLS

Must have

• Readiness to work until 8.00 pm CET (no need to do overtimes)
• Overall years of experience required 8+ (at least 1+ year in an Architect position)
• Strong, recent hands‑on expertise with Azure Data Factory and Synapse is a must (3+ years).
• Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.
• Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.
• Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.
• Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.
• Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)
• Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.
• Experience integrating metadata and governance processes into cloud-based data platforms
• Certification in Azure, Databricks, or other relevant technologies is an added advantage
• Experience with cloud-based analytical databases.
• Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.
• Experience with Python and Python-based ETL tools.
• Experience with shell scripting in Bash, Unix or windows shell is preferable.
• Demonstrated ability to lead cross-functional engineering teams, define technical strategy and architecture, drive delivery of complex data platforms, mentor engineers, and effectively communicate with stakeholders at all organizational levels.

Nice to have

• Experience with Elasticsearch
• Familiarity with containerization and orchestration technologies (Docker, Kubernetes)
• Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis
• Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams
• Ability to plan, estimate and track progress of implementing features
• Computer Science and data science academic and education credentials