Data Engineer – Databricks / Python / SQL

Avensys Consulting Pte Ltd; Singapore; On-site; SGD 78,000 - 100,000; Full time

Job summary

Avensys Consulting Pte Ltd in Singapore seeks a Databricks Engineer on a 6 months contract to transform data, build dashboards, and deliver actionable insights.

You will query, clean, and transform datasets using SQL and Python on the Databricks platform, ensure data quality per IM8 standards, and collaborate with business stakeholders.

The role involves documenting analytics processes and dashboards in Confluence and supporting automation tasks with Jira, QA, and testing activities.

Qualifications

• Proficiency in SQL and Python for data processing and automation.
• Hands-on experience in dashboard tools such as Tableau, Power BI, or equivalent visualisation tools.
• Familiarity with Databricks or similar big data/analytics platforms.
• Ability to produce high-quality technical documentation.

Responsibilities

• Data Transformation: Query, clean, and transform datasets using SQL and Python on the Databricks platform.
• Ensure data quality and consistency across systems in accordance with IM8 standards.
• Build, enhance, and maintain dashboards for data monitoring, performance reporting, and user behaviour analytics.
• Partner with business stakeholders to understand data requirements and translate them into insights.
• Documentation & Knowledge Management: Develop user guides for dashboards and data workflows in Databricks.
• Maintain technical documentation (e.g., on Confluence) for analytics processes and best practices.

Skills

SQL

Python

Tools

Databricks

Tableau

Power BI

Git

Job description

Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation, and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail, and supply chain.

We are currently looking to hire a Databricks Engineer. This is an exciting opportunity to expand your skill set, achieve job satisfaction, and enjoy a healthy work-life balance. More details are below.

JOB TYPE

6 Months Contract

ROLES AND RESPONSIBILITIES

Data Transformation

• Query, clean, and transform datasets using SQL and Python on the Databricks platform.
• Ensure data quality and consistency across systems in accordance with government Instruction Manual (IM8) standards.
• Build, enhance, and maintain dashboards for data monitoring, performance reporting, and user behaviour analytics.
• Partner with business stakeholders to understand data requirements and translate them into impactful visual insights.
• Documentation & Knowledge Management
• Develop clear and comprehensive user guides for dashboards, charts, and data workflows in Databricks
• Maintain technical documentation (e.g., on Confluence) for analytics processes, standards, and best practices.

Additional Opportunities

• Explore and prototype automation solutions to streamline repetitive or manual workflows.
• Creating user stories and acceptance criteria
• Managing JIRA tickets and sprint tasks
• Writing and executing QA test cases

REQUIREMENTS

• Proficiency in SQL and Python for data processing and automation.
• Hands-on experience in dashboard tools such as Tableau, Power BI, or equivalent visualisation tools.
• Familiarity with Databricks or similar big data/analytics platforms.
• Ability to produce high-quality technical documentation.

Additional Skills Preferred

• Experience in system testing, SIT/UAT, or quality assurance processes.
• Knowledge of Spark for distributed data processing.
• Understanding of Git or other version control systems.

Soft Skills

• Strong analytical mindset and problem-solving abilities.
• Good communication skills, especially in explaining technical concepts to non-technical users.
• Ability to work independently as well as collaboratively in cross-functional teams.
• Attention to detail and commitment to delivering high-quality work.

WHAT'S ON OFFER

You will be remunerated with an excellent salary and be entitled to attractive company benefits. Additionally, you will have the opportunity to work in a fun and collaborative environment with excellent career growth prospects.