Data Engineer (Pyspark)

INFOCEPTS PTE. LTD.; Singapore; On-site; SGD 70,000 - 120,000; Full time

Job summary

InfoCepts is hiring aspiring / proven data engineers to join us. The role involves designing, building, and maintaining scalable ETL pipelines using Python, extracting data from multiple sources, transforming it into clean formats, and optimizing pipelines for performance and scalability.

You will design data models that support business reporting needs and collaborate with business users to deliver insightful dashboards.

Qualifications

• Bachelor's degree in CS/Engineering or related field.
• Proven experience with Python in data engineering.
• Experience with ETL tools and data integration.

Responsibilities

• Design, build, and maintain scalable ETL pipelines using Python.
• Extract data from various sources and transform it into clean, usable formats.
• Optimize data pipelines for performance and scalability.
• Design logical and physical data models that support business reporting needs.
• Perform data profiling and cleansing to ensure high data quality.
• Create and manage reusable data transformation scripts and workflows.
• Work with stakeholders to understand reporting requirements and deliver insightful dashboards.
• Collaborate with business users to understand data needs.
• Support ad-hoc data requests, troubleshooting, and performance tuning of dashboards and Python-based scripts.
• Document data pipelines, transformations, and dashboard designs for maintenance and audit purposes.

Skills

Python

ETL

Data integration

Data modeling

Communication

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

ETL tools

Job description

InfoCepts is a global leader of end-to-end data & analytics solutions with nearly 20 years of experience, also named as Gartner’s 2020, 2021 and 2022 customers’ choice for Data & Analytics providers. We continue to grow rapidly year over year, now employing more than 1,200 people in offices across the globe. As we have grown, we have stayed true to our mission—to always help our customers stay modern that help them make smart, data-driven decisions. Since 2004, we have deployed hundreds of high performance analytics applications over web and mobile platforms, built several advanced analytics models, processed petabytes of data using Big Data technologies and delivered several high impact business solutions. Driven by our vision of delivering great customer experiences, we are looking for professionals who are passionate about making the world a better place by leveraging the power of data.

We are hiring aspiring / proven data engineers to join us.

Roles and Responsibilities:

• Design, build, and maintain scalable ETL pipelines using Python.
• Extract data from various sources and transform it into clean, usable formats.
• Optimize data pipelines for performance and scalability.
• Design logical and physical data models that support business reporting needs.
  Perform data profiling and cleansing to ensure high data quality.
  Create and manage reusable data transformation scripts and workflows.
• Work with stakeholders to understand reporting requirements and deliver insightful, interactive dashboards.
• Collaborate with business users to understand data needs.
• Support ad-hoc data requests, troubleshooting, and performance tuning of dashboards and Python-based scripts.
• Document data pipelines, transformations, and dashboard designs for maintenance and audit purposes.

Skills Required:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer with a strong focus in Python
• Experience with ETL tools and data integration processes.
• Excellent communication skills with the ability to explain complex concepts to business users.
• Experience in providing user support and training is highly desirable.