Data Engineer

Valiant Technologies LLC; Columbia Township (MO); On-site; USD 90,000 - 130,000; Full time

Job summary

Valiant Technologies LLC is seeking a data engineering professional to design and build robust data pipelines using Azure Data Factory and Databricks, delivering scalable ETL processes and insightful Power BI dashboards.

You will collaborate with stakeholders to translate reporting needs into reliable data solutions, while ensuring data quality and governance across systems.

Qualifications

• Hands-on experience with Microsoft Azure (Data Factory, Synapse, Storage).
• Proficiency in Databricks for big data processing and analytics.
• Strong Python programming skills for data manipulation, automation, and integration.
• Expertise in Power BI for dashboard creation and data visualization.
• Solid understanding of SQL and relational database concepts.
• Experience with data modeling and performance tuning.

Responsibilities

• Design and develop data pipelines using Azure Data Factory, Databricks, and other cloud-native tools.
• Implement ETL processes to ensure efficient data ingestion, transformation, and storage.
• Collaborate with business stakeholders to understand reporting needs and deliver actionable insights.
• Develop and maintain dashboards in Power BI to support decision-making across teams.
• Optimize data workflows for performance, scalability, and reliability.
• Ensure data quality and governance standards are met across all systems.
• Troubleshoot and resolve issues related to data pipelines, integrations, and reporting.

Skills

Python programming

Power BI

SQL

Data modeling

Communication

Tools

Azure Data Factory

Azure Synapse

Azure Storage

Databricks

Job description

Key Responsibilities:

• Design and develop data pipelines using Azure Data Factory, Databricks, and other cloud-native tools.
• Implement ETL processes to ensure efficient data ingestion, transformation, and storage.
• Collaborate with business stakeholders to understand reporting needs and deliver actionable insights.
• Develop and maintain dashboards in Power BI to support decision-making across teams.
• Optimize data workflows for performance, scalability, and reliability.
• Ensure data quality and governance standards are met across all systems.
• Troubleshoot and resolve issues related to data pipelines, integrations, and reporting.

Required Skills & Qualifications:

• Hands-on experience with Microsoft Azure (Data Factory, Synapse, Storage, etc.).
• Proficiency in Databricks for big data processing and analytics.
• Strong Python programming skills for data manipulation, automation, and integration.
• Expertise in Power BI for dashboard creation and data visualization.
• Solid understanding of SQL and relational database concepts.
• Experience with data modeling and performance tuning.
• Excellent communication skills to work effectively with technical and non-technical stakeholders.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.