Remote Data Engineer: Cloud & Big Data Pipelines

TheHiveCareers; United States; Remote; USD 30,000 - 60,000; Full time

Job summary

TheHiveCareers is seeking a Data Engineer to design, build, and maintain robust data infrastructure that supports analytics and BI initiatives.

Responsibilities include ETL pipeline development, database design, and handling large data sets with Hadoop, Spark, and Kafka on AWS, Azure, or GCP. Collaboration with data scientists and business teams is essential for data-driven decision making.

Qualifications

• Bachelor's degree in CS, software engineering, or a related field.
• Masters degree beneficial for senior roles.
• Certifications like AWS Certified Data Analytics Specialty or IBM Certified Data Engineer Big Data can enhance qualifications.

Responsibilities

• Build and optimize data pipelines for ETL workflows.
• Design and maintain scalable databases.
• Process big data with Hadoop, Spark, and Kafka.
• Implement data solutions on AWS, Azure, or GCP.
• Ensure data integrity, security, and governance.
• Collaborate with data scientists, analysts, and business teams.

Skills

SQL

Python/Scala/Java

Data modeling

ETL processes

Performance tuning

Data governance

Banking industry

Collaboration

Education

Bachelor's degree

Master's degree beneficial

Certifications (AWS, IBM)

Tools

Hadoop

Spark

Kafka

AWS

Azure

GCP

Job description

TheHiveCareers is seeking a Data Engineer to design, build, and maintain robust data infrastructure that supports analytics and BI initiatives.

Responsibilities include ETL pipeline development, database design, and handling large data sets with Hadoop, Spark, and Kafka on AWS, Azure, or GCP. Collaboration with data scientists and business teams is essential for data-driven decision making.