Data Engineer

Machine Learning Technologies, LLC; Columbia Township (MO); On-site; USD 90,000 - 120,000; Full time

Job summary

Machine Learning Technologies, LLC is seeking a data engineer to design and manage scalable data pipelines in a cloud-first environment, focusing on Azure Data Factory and Databricks. You will build ETL processes, create Power BI dashboards, and collaborate with stakeholders to translate reporting needs into actionable insights while maintaining data quality and governance across systems.

You will work cross-functionally with analytics teams to optimize data models and deliver timely, reliable

Qualifications

• Hands-on experience with Azure-based data pipelines and cloud analytics.
• Strong Python skills for data manipulation and automation.
• Experience creating dashboards and reports with Power BI.
• Solid SQL and relational database concepts.
• Experience with data modeling and performance tuning.
• Excellent communication with technical and non-technical stakeholders.

Responsibilities

• Design and develop data pipelines using Azure Data Factory, Databricks, and cloud-native tools.
• Implement ETL processes for data ingestion, transformation and storage.
• Collaborate with stakeholders to understand reporting needs and deliver insights.
• Develop and maintain Power BI dashboards to support decision-making.
• Optimize data workflows for performance, scalability and reliability.
• Ensure data quality and governance across systems.
• Troubleshoot and resolve data pipeline and reporting issues.

Skills

Azure Data Factory

Databricks

Python

Power BI

SQL

Data modeling

Communication

Tools

Azure Synapse

Azure Storage

Job description

Key Responsibilities:

• Design and develop data pipelines using Azure Data Factory, Databricks, and other cloud-native tools.
• Implement ETL processes to ensure efficient data ingestion, transformation, and storage.
• Collaborate with business stakeholders to understand reporting needs and deliver actionable insights.
• Develop and maintain dashboards in Power BI to support decision-making across teams.
• Optimize data workflows for performance, scalability, and reliability.
• Ensure data quality and governance standards are met across all systems.
• Troubleshoot and resolve issues related to data pipelines, integrations, and reporting.

Required Skills & Qualifications:

• Hands-on experience with Microsoft Azure (Data Factory, Synapse, Storage, etc.).
• Proficiency in Databricks for big data processing and analytics.
• Strong Python programming skills for data manipulation, automation, and integration.
• Expertise in Power BI for dashboard creation and data visualization.
• Solid understanding of SQL and relational database concepts.
• Experience with data modeling and performance tuning.
• Excellent communication skills to work effectively with technical and non-technical stakeholders.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.