Senior Data Engineer

Bounteous; Hinoba-an; On-site; PHP 800,000 - 1,200,000; Full time

Job summary

Bounteous is seeking a data engineer with 4–6 years of experience to design and build scalable data pipelines.

You will work with Python, PySpark, Kafka, Redis, REST APIs, and distributed file systems to enable batch and real-time analytics.

Join a team delivering transformative digital experiences across data platforms and dashboards.

Qualifications

• 4–6 years of experience in data engineering.
• Strong Python and PySpark expertise.
• Experience with real-time streaming and distributed data platforms.
• Familiarity with Redis, REST APIs, and distributed file systems.

Responsibilities

• Design, develop, and maintain robust data pipelines.
• Build real-time streaming apps with Kafka.
• Develop RESTful APIs for data ingestion and access.
• Implement caching with Redis for fast data access.
• Work with distributed file systems for large-scale storage.
• Design ETL/ELT processes from multiple sources.
• Optimize jobs for performance and scalability.
• Monitor pipelines and resolve bottlenecks.
• Collaborate with data teams to deliver data solutions.
• Ensure data quality, security, and governance.

Skills

Data Engineer

Python

PySpark

Apache Kafka

REST APIs

Redis

Distributed File Systems

Tools

PostgreSQL

MySQL

SQL Server

NoSQL

Job description

4 to 7 years of experience
Skills: Data Engineer, Python, Pyspark, Apache Kafka

Job Summary

We are looking for a highly skilled Data Engineer with 4–6 years of experience in designing and developing large-scale data processing systems, real-time streaming solutions, and distributed data platforms. The ideal candidate should possess strong expertise in Python, PySpark, Apache Kafka, Redis, REST APIs, and Distributed File Systems. The role involves building scalable, high-performance data pipelines that support both batch and real-time analytics workloads.

Key Responsibilities

• Design, develop, and maintain robust data pipelines using Python and PySpark.
• Build and manage real-time data streaming applications using Apache Kafka.
• Develop and integrate RESTful APIs for data ingestion, processing, and retrieval.
• Implement caching and high-speed data access solutions using Redis.
• Work with distributed file systems and large-scale storage frameworks to manage structured and unstructured data.
• Design ETL/ELT processes for ingesting, transforming, and loading data from multiple sources.
• Optimize data processing jobs for performance, scalability, and reliability.
• Monitor production data pipelines and resolve performance bottlenecks.
• Collaborate with Data Architects, Data Scientists, Analysts, and Business teams to deliver data-driven solutions.
• Ensure data quality, security, governance, and compliance standards are met.

Required Technical Skills

Programming & Data Processing

• Strong hands-on experience in Python.
• Advanced knowledge of PySpark.
• Experience in distributed data processing and optimization.
• Strong understanding of data structures and algorithms.
• Strong experience in designing and consuming REST APIs.
• API authentication (OAuth, JWT, token-based authentication).
• API performance monitoring and troubleshooting.

Databases

• Query optimization.
• Relational databases (PostgreSQL, MySQL, SQL Server).
• Exposure to NoSQL databases is an advantage.

We understand technologists. We know what gets them excited. There's plenty of opportunity here and lots of new technology that we're exploring. Over time your interests will change, the things that excite you will change, and the technology will change, but what stays the same for Bounteous is creating growth opportunities for our team and our relentless pursuit to create transformative digital experiences.