Data and Analytics Architect

Elfonze Technologies Pvt. Ltd.; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

Elfonze Technologies is seeking a senior data and analytics architect to lead the design of our data platform for a carve-out. You will define the target-state architecture, including data lake, data warehouse and lakehouse components, and oversee migration of application and user data.

The role requires hands-on expertise in observability, data pipelines, governance and cloud-based data services, with strong collaboration with client architects and cross-functional teams in the UK/EU time zones.

Qualifications

• 10+ years of experience in data and analytics architecture.
• Strong observability experience: logs, metrics, traces.
• Experience with data lakes and data warehouses on multiple vendors.
• Experience with batch processing, ETL/ELT, and data migration.

Responsibilities

• Design observability architecture for logs, metrics, and traces.
• Define ingestion, retention and analysis for logs and events.
• Build data pipelines and ETL/ELT processes for batch and streaming workloads.
• Design data lake, data warehouse and lakehouse architectures.

Skills

SQL

Python

Data governance

Communication

Travel

Tools

Power BI

Tableau

Azure Data Factory

Airflow

Kafka

Job description

Designs the data, observability and analytics architecture for a carve-out. Owns the target-state data platform and the technical approach for separating and moving application, user and enterprise data. Builds new platforms from the ground up where the separated entity needs them.

Job Responsibilities

• Design observability architecture covering logs, metrics and traces
• Define collection of application events and infrastructure events
• Design log ingestion, retention and analysis
• Design data pipelines and ETL for batch and streaming workloads
• Design data models and data lake, data warehouse and lakehouse architectures
• Design a greenfield data lake from the ground up
• Define ingestion and deduplication for structured and unstructured data
• Design the technical approach for application data and user data moves
• Design analytics, custom dashboards and reporting with Power BI or Tableau
• Define data security, access control, lineage and quality controls
• Produce high-level and low-level designs and review them with client architects

Required Experience

• 10+ years of relevant experience in data and analytics architecture
• Strong experience in observability: logs, metrics and traces for applications and infrastructure
• Experience with log ingestion, retention and analysis at scale
• Experience building data pipelines, ETL and ELT
• 3 to 5 years of working experience with data lakes and data warehouses, on at least two vendors
• Experience with data lakehouse architectures
• Experience handling structured and unstructured data
• Experience with batch processing and batch operations
• Experience with ingestion and deduplication
• Experience with data migration, including application data and user data
• Experience with enterprise master data management
• Experience building a greenfield data lake from the ground up
• Experience with at least two analytics tools, such as Power BI and Tableau, including custom dashboards
• Knowledge of data governance: cataloguing, lineage, quality, masking and access control
• Knowledge of orchestration and streaming tools such as Azure Data Factory, Airflow or Kafka
• Strong SQL skills and working knowledge of Python
• Experience with at least two cloud providers (Azure and AWS)
• Exposure to at least two OEMs or two vendors in each technology area
• Strong communication skills, with prior experience working with UK and EU clients
• Willingness to travel as required and to work in the client time zone
• Prior infrastructure background alongside the specialism above
• Prior experience in IT consolidations, mergers, demergers and carve-outs (mandatory)
• Relevant professional certifications strongly recommended