Data Engineer

TheHiveCareers; United States; Remote; USD 30,000 - 60,000; Full time

Job summary

TheHiveCareers is seeking a Data Engineer to design, build, and maintain robust data infrastructure that supports analytics and BI initiatives.

Responsibilities include ETL pipeline development, database design, and handling large data sets with Hadoop, Spark, and Kafka on AWS, Azure, or GCP. Collaboration with data scientists and business teams is essential for data-driven decision making.

Qualifications

• Bachelor's degree in CS, software engineering, or a related field.
• Masters degree beneficial for senior roles.
• Certifications like AWS Certified Data Analytics Specialty or IBM Certified Data Engineer Big Data can enhance qualifications.

Responsibilities

• Build and optimize data pipelines for ETL workflows.
• Design and maintain scalable databases.
• Process big data with Hadoop, Spark, and Kafka.
• Implement data solutions on AWS, Azure, or GCP.
• Ensure data integrity, security, and governance.
• Collaborate with data scientists, analysts, and business teams.

Skills

SQL

Python/Scala/Java

Data modeling

ETL processes

Performance tuning

Data governance

Banking industry

Collaboration

Education

Bachelor's degree

Master's degree beneficial

Certifications (AWS, IBM)

Tools

Hadoop

Spark

Kafka

AWS

Azure

GCP

Job description

Job Type: Full-Time

Location: Barbados (Remote)

Job Summary:A Data Engineer is responsible for designing, building, and maintaining data infrastructure to support analytics, reporting, and business intelligence.

Job Description

Data Pipeline Development Build and optimize data pipelines for efficient extraction, transformation, and loading (ETL).

Database Management Design and maintain databases, ensuring scalability and reliability.

Big Data Processing Work with large datasets using tools like Hadoop, Spark, and Kafka.

Cloud Integration Implement data solutions on cloud platforms like AWS, Azure, or Google Cloud.

Data Governance & Security Ensure data integrity, compliance, and security best practices.

Collaboration Work with data scientists, analysts, and business teams to support data-driven decision-making.

Required Skills

• Proficiency in SQL, Python, Scala, or Java for data manipulation.
• Experience with big data technologies (Hadoop, Spark, Kafka).
• Knowledge of cloud computing platforms (AWS, Azure, GCP).
• Strong understanding of data modeling and database design.
• Expertise in ETL processes and workflow automation.
• Ability to optimize data infrastructure for performance and scalability.
• Familiarity with data governance and security protocols.
• Experience within banking industry is an asset.

Educational Requirements

• A bachelors degree in computer science, software engineering, or a related technical field.
• A masters degree can be beneficial for senior roles.
• Certifications like AWS Certified Data Analytics Specialty or IBM Certified Data Engineer Big Data can enhance qualifications.