Data Engineer: Azure Lakehouse & Client-Facing Analytics

Valorem Reply; Detroit (MI); Vor Ort; USD 130.000 - 150.000; Vollzeit

Zusammenfassung

Valorem Reply seeks a Data Engineer to design and optimize modern data platforms for clients using Azure, Fabric, Power BI, and Databricks. You will engage directly with clients, translate requirements into scalable solutions, and communicate clearly with both technical and non-technical stakeholders.

The role involves architecture delivery, lakehouse design, and hands-on development of batch and streaming pipelines, with emphasis on governance, security, and DevOps.

Qualifikationen

• Bachelor's degree in computer science or related field.
• 6+ years of experience in data engineering, data platform development, or cloud data solutions.
• 3+ years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies.
• Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB, and Azure Database for PostgreSQL.
• Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI.
• DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.).
• Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies.

Aufgaben

• Work directly with clients to understand business goals, data challenges, and technical requirements.
• Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews.
• Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
• Implement medallion/lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases.
• Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks.
• Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security.

Kenntnisse

Azure Databricks

Apache Spark

Python

SQL

Delta Lake

Power BI

DevOps

GitHub

Data modeling

Communication

Ausbildung

Bachelor’s degree in computer science or related field

Tools

Power BI

Azure

Databricks

Azure Data Factory

Jobbeschreibung

Valorem Reply seeks a Data Engineer to design and optimize modern data platforms for clients using Azure, Fabric, Power BI, and Databricks. You will engage directly with clients, translate requirements into scalable solutions, and communicate clearly with both technical and non-technical stakeholders.

The role involves architecture delivery, lakehouse design, and hands-on development of batch and streaming pipelines, with emphasis on governance, security, and DevOps.