AI Architect

Aroha Technologies Inc; Deutschland; Vor Ort; EUR 60.000 - 90.000; Vollzeit

Zusammenfassung

Aroha Technologies Inc in Germany is seeking a talented individual to drive AI/ML and data engineering initiatives. The role involves developing and optimizing ML models, architecting scalable ETL/ELT pipelines, and integrating services within the AWS ecosystem. Candidates should have expertise in Python, PySpark, and Databricks. This position will require collaboration with various teams, providing design leadership while also being hands-on with execution. Join Aroha to impact data-driven projects in a dynamic environment.

Qualifikationen

• Experience with developing, training, and optimizing ML models.
• Strong knowledge of ETL/ELT pipeline architecture.
• Capability to integrate data solutions with cloud services.

Aufgaben

• Develop ML models using Python and PySpark.
• Architect scalable data processing pipelines.
• Collaborate with stakeholders on data initiatives.

Kenntnisse

Python

PySpark

MLflow

Databricks Machine Learning

Data Engineering

SQL

AWS Integration

Data Analysis

Tools

Databricks

AWS

Jobbeschreibung

AI/ML & Advanced Analytics

Develop, train, and optimize ML models using Python, PySpark, MLflow, and Databricks Machine Learning.

Conduct exploratory data analysis (EDA) to identify patterns, trends, and insights in large datasets.

Deploy ML models into production using MLflow, Databricks Workflows, or other MLOps pipelines.

Build analytics solutions such as forecasting, anomaly detection, segmentation, or recommendation systems.

Design ML architectures aligned with Databricks Lakehouse on Azure.

Data Engineering & Lakehouse Architecture

Architect and build scalable ETL/ELT pipelines using PySpark, SQL, and Databricks Workflows.

Implement Delta Lake best practices, including OPTIMIZE, ZORDER, partitioning, and schema evolution.

Design lakehouse layers (Bronze/Silver/Gold) with strong separation of compute and serving layers.

Optimize cluster performance and jobs using Spark tuning, caching, and shuffle minimization.

Work with multi-terabyte, time-series, high‑velocity data in a distributed environment.

Ensure robust data availability for downstream ML and analytics workloads.

AWS Cloud Integration

Architect end-to-end data and ML solutions using Azure services, including:

• S3 for storage
• IAM for identity & access
• Glue Catalog for metadata management
• Networking for secure, high‑throughput data movement

Integrate Databricks with AWS-native compute, API layers, and low-latency endpoints.

Business Collaboration & Leadership

Translate business problems into scalable analytical or ML architectures.

Communicate complex statistical and architectural concepts to non‑technical stakeholders.

Collaborate with product, engineering, and business leaders to drive data-informed initiatives.

Provide design leadership while remaining hands‑on in execution.