Data Engineer

Helio Insights; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Helio Insights is seeking a Data Engineer to design, build, and maintain large-scale data pipelines using Databricks in a US-based setting. You will collaborate with cross-functional teams to translate requirements into efficient ETL processes and generate actionable insights through complex SQL queries.

The ideal candidate has 3–6 years in data engineering, hands-on Databricks experience for big data analytics, and strong knowledge of Spark and Azure Synapse.

Qualifications

• 3–6 years of experience in Data Engineering or a related field.
• Experience with the Databricks platform for big data analytics.
• Proficiency in Microsoft Azure services including Synapse Analytics.
• Excellent understanding of Spark programming language.

Responsibilities

• Design, develop, test, deploy, and maintain large-scale data pipelines using Databricks.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions.
• Develop complex SQL queries to extract insights and transform them into BI.
• Ensure seamless integration of data warehousing systems with other applications through effective communication.
• Troubleshoot issues related to data processing, storage, and retrieval.

Skills

Databricks

Azure Synapse

Spark

SQL

Job description

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data pipelines using Databricks Engineer.


• Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions.


• Develop complex SQL queries to extract insights from various databases and transform them into actionable business intelligence.


• Ensure seamless integration of data warehousing systems with other applications through effective communication.


• Troubleshoot issues related to data processing, storage, and retrieval.

Desired Candidate Profile

• 3-6 years of experience in Data Engineering or a related field.


• Experience working with Databricks platform for big data analytics.


• Proficiency in Microsoft Azure services including Synapse Analytics (formerly known as Azure Analysis Services).


• Excellent understanding of Spark programming language.