Data Engineer

Experience: 5 to 9 years

Skills: Azure (Cloud), ADF, ADL, Kafka, Python, Pyspark, Scala, SQL

Job Description:

• Azure skills highly preferred, including provisioning, configuring, and developing solutions in ADL, ADF, ADW, etc.
• In-depth understanding of database structure principles.
• Experience in DevOps, Azure DevOps, Jenkins, Airflow, Azure Monitor is good to have.
• Hands-on experience using MS SQL Server, Oracle, or similar RDBMS platforms.
• Distributed data processing of big data batch or streaming pipelines (Kafka or similar).
• Familiarity with data visualization tools (e.g., PowerBI, Tableau, etc.).
• Data modeling, data structure & strong analytics skills.
• Problem-solving attitude.
• Highly self-motivated, self-directed, and attentive to detail.
• Ability to effectively prioritize and execute tasks.

Additional Information:

• We would like to see a blend of the following skills; not all of these are required, however, Databricks and Spark are highly desirable:
• Azure SQL Data Warehouse
• Azure Data Factory
• Azure Data Lake
• Azure Analysis Services
• Databricks/Spark
• Python
• Data Modeling