GenAI-Driven Azure Databricks Engineer

BlackCube Labs; Minneapolis (MN); In loco; USD 120.000 - 180.000; Tempo pieno

Descrizione del lavoro

BlackCube Labs in Hartford, CT / Minnetonka, MN is seeking an AI Builder / Senior Software Engineer specializing in Databricks and GenAI. You will design, build, and maintain scalable data pipelines and AI-powered enterprise applications using .NET, Azure, and Generative AI technologies.

Lead modernization of data platforms, ensuring governance, security, and reliable ingestion/transformation. Collaborate with cross-functional teams to enable AI use cases, analytics, and actionable insights for

Competenze

• Design, build, and maintain scalable, secure, and high performance batch and streaming data pipelines using modern data engineering practices.
• Lead the modernization and migration of on premise data platforms to cloud native architectures, owning infrastructure, networking, security, and deployment pipelines.
• Develop and maintain core data platform components that support reliable ingestion, transformation, enrichment, and consumption of enterprise data assets.
• Collaborate with data domain experts across Operations, Product, Finance, Value Analytics, and other domains to understand data sources and design efficient, connected data models.
• Ensure data accuracy, quality, relevance, and governance by implementing validation, monitoring, documentation, and security controls.
• Analyze large datasets to identify trends, patterns, and actionable insights; perform data analysis to support analytics, AI use cases, and business strategy.
• Enable reporting and analytics by making curated, trusted datasets available to BI and downstream consumers.
• Partner with AI/ML Engineers and Leads to design, build, and improve machine learning models from scratch or enhance existing models.
• Contribute to experimentation with novel ML and Generative AI architectures.
• Help design and implement AI powered enterprise applications
• Analyzes and investigates

Mansioni

• Design, develop, and maintain scalable enterprise applications and AI-powered solutions using .NET, Azure, and Generative AI technologies.
• Build and integrate AI capabilities such as conversational assistants, intelligent search, summarization, content generation, and workflow automation into business applications.
• Implement secure, reliable, and high-performing software solutions while adhering to enterprise architecture, compliance, and governance standards.
• Drive continuous improvement through automation, AI-assisted development practices, code quality enhancements, and operational excellence initiatives

Conoscenze

Azure Databricks

GenAI technologies

LLMs

RAG

AI Agents

Vector Databases

Prompt Engineering

Strumenti

.NET

Python

PySpark

Descrizione del lavoro

BlackCube Labs in Hartford, CT / Minnetonka, MN is seeking an AI Builder / Senior Software Engineer specializing in Databricks and GenAI. You will design, build, and maintain scalable data pipelines and AI-powered enterprise applications using .NET, Azure, and Generative AI technologies.

Lead modernization of data platforms, ensuring governance, security, and reliable ingestion/transformation. Collaborate with cross-functional teams to enable AI use cases, analytics, and actionable insights for