Senior Cloud Data Engineer: Azure Databricks & Lakehouse

Rosen's Diversified, Inc.; Green Bay (WI); Presencial; USD 120 000 - 170 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health and welfare benefits

401(k) with company match

Career and Learning Paths

Resumo da oferta

Rosen's Diversified, Inc. is seeking a Senior Cloud Data Engineer to design, build, and optimize cloud-based data solutions supporting manufacturing operations, BI, and analytics.

You will develop scalable ETL/ELT pipelines using Azure Databricks, PySpark, Python, and SQL, integrating ERP, MES, and OT/IT data to enable data-driven decisions. The role emphasizes collaboration with stakeholders, governance and security, and hands-on work across Azure services to deliver reliable data products and

Qualificações

• Bachelor's degree in computer science, information systems, data engineering, or a related field; an equivalent combination of education and experience may be considered.
• 3-5 years of experience in data engineering, cloud engineering, or analytics platform development.
• Minimum 2 years of hands-on experience developing solutions with Azure Databricks.
• Experience supporting enterprise data solutions in a manufacturing or industrial environment.
• Strong knowledge of Azure Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, lakehouse architecture, data modeling, and data warehousing concepts.
• Experience with Azure Data Lake Storage Gen2, Azure Data Factory, Azure DevOps, Git source control, and CI/CD practices for data platforms.
• Experience with data quality, security, monitoring, troubleshooting, and performance tuning.
• Knowledge of manufacturing data domains such as ERP, MES, production planning, inventory, supply chain, quality management, maintenance, or Industrial IoT.
• Ability to work with operational stakeholders and translate manufacturing processes into reliable data requirements and solutions.

Responsabilidades

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks, PySpark, Python, and SQL.
• Build and optimize ingestion frameworks for ERP, MES, Industrial IoT, quality, supply chain, inventory, finance, and related operational systems.
• Develop reusable engineering patterns and standards that improve delivery speed, supportability, and reliability.
• Implement and support lakehouse solutions using Delta Lake and Medallion Architecture across Bronze, Silver, and Gold layers.
• Design and optimize data models for reporting, analytics, AI, and machine learning use cases.
• Maintain data lineage, metadata, technical documentation, and operational runbooks.
• Integrate Azure Databricks with Azure Data Factory, Azure Data Lake Storage Gen2, Azure Key Vault, Microsoft Fabric, Power BI, and Azure DevOps.
• Support orchestration and movement of data between enterprise applications and cloud platforms.
• Monitor and optimize Databricks clusters, jobs, notebooks, and workflows for performance, scalability, and cost efficiency.
• Troubleshoot production issues, identify root causes, and implement sustainable corrective actions.
• Contribute to monitoring, alerting, testing, and operational support practices.
• Apply organizational standards for data quality, governance, privacy, security, and compliance.
• Implement role-based access controls and governed data access using Unity Catalog and Azure security services.
• Build automated validation, auditing, and data quality controls into engineering workflows.
• Partner with business users, analysts, architects, and IT teams to translate requirements into maintainable technical solutions.
• Participate in Agile ceremonies, sprint planning, code reviews, and technical design reviews.
• Mentor junior engineers and promote coding, testing, documentation, and deployment best practices.

Conhecimentos

Azure Databricks

PySpark

Python

SQL

Delta Lake

Lakehouse architecture

Data modeling

Azure Data Factory

CI/CD

Data governance

Formação académica

Bachelor's degree in CS/IS/Data Engineering or related field

Ferramentas

Unity Catalog

Power BI

Microsoft Fabric

Terraform

Bicep

ARM templates

Git

Azure DevOps

Azure Data Lake Storage Gen2

Descrição da oferta de emprego

Rosen's Diversified, Inc. is seeking a Senior Cloud Data Engineer to design, build, and optimize cloud-based data solutions supporting manufacturing operations, BI, and analytics.

You will develop scalable ETL/ELT pipelines using Azure Databricks, PySpark, Python, and SQL, integrating ERP, MES, and OT/IT data to enable data-driven decisions. The role emphasizes collaboration with stakeholders, governance and security, and hands-on work across Azure services to deliver reliable data products and