Big Data Developer

At Wakeb Data, we are looking for a big data engineer who loves solving complex problems across a full spectrum of technologies. The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. The big data engineer will help ensure that the organization’s technological infrastructure operates seamlessly in support of business objectives.

Objectives of this role

• Develop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic goals.
• Focus on ingesting, storing, processing, and analyzing large datasets.
• Create scalable, high-performance web services for tracking data.
• Translate complex technical and functional requirements into detailed designs.
• Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions.
• Serve as a mentor for junior staff members by conducting technical training sessions and reviewing project outputs.

Responsibilities

• Develop and maintain data pipelines using ETL processes.
• Take responsibility for Apache Hadoop/Spark development and implementation.
• Work closely with the AI/data science team to implement data analytics.
• Help define data governance policies and support data-versioning processes.
• Maintain security and data privacy, working closely with the Big Data architect.
• Analyze vast numbers of data stores to uncover insights.
• Follow internal agile/SCRUM company practices to organize work.

Required skills and qualifications

• A minimum of 1-2 years experience with Python/Scala/Java.
• Understanding of data warehousing and data modeling techniques.
• Knowledge of industry-wide visualization and analytics tools (e.g., Tableau, Power BI).
• Strong data engineering skills with cloud platforms.
• Experience with streaming frameworks such as Kafka, Storm, etc.
• Knowledge of Linux, SQL, and NoSQL data structures.
• Experience with version control systems (Git).
• Good interpersonal skills and a positive attitude.

Preferred skills and qualifications

• Degree in computer science, mathematics, or engineering.
• Expertise in ETL methodology for corporate-wide big data solution design.