Remote Data Engineer – Databricks & Fabric Pipelines

Diacto Technologies; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Diacto Technologies is seeking a highly skilled Data Engineer specialized in Databricks and Microsoft Fabric to join our remote team. You will design and implement robust data pipelines and data solutions that drive insights and decision-making, ensuring scalability and performance.

In this role you will collaborate with data scientists and analysts, optimize storage and processing for large datasets, monitor pipelines, document engineering processes, and mentor junior engineers to promote

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of data engineering experience with Databricks and Fabric.
• Strong proficiency in SQL, Python, and Spark.
• Experience with data modeling and ETL best practices.
• Familiarity with cloud data platforms (Azure, AWS).
• Ability to work independently and remotely in a team.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and Fabric.
• Implement data transformation processes that ensure data quality and integrity.
• Collaborate with data scientists and analysts to understand data needs and deliver reliable data solutions.
• Optimize data storage and processing performance for large datasets.
• Monitor and troubleshoot data pipeline performance issues, ensuring minimal downtime.
• Documentation of data engineering processes and best practices.
• Mentor junior data engineers and promote knowledge sharing within the team.

Skills

SQL

Python

Spark

Data Modeling

ETL

Cloud Platforms

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Microsoft Fabric

Apache Spark

Job description

Diacto Technologies is seeking a highly skilled Data Engineer specialized in Databricks and Microsoft Fabric to join our remote team. You will design and implement robust data pipelines and data solutions that drive insights and decision-making, ensuring scalability and performance.

In this role you will collaborate with data scientists and analysts, optimize storage and processing for large datasets, monitor pipelines, document engineering processes, and mentor junior engineers to promote