Big Data Engineer

myBridge Corporation; Austin (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

myBridge Corporation in Austin, TX, is seeking a Big Data Engineer to design and maintain scalable data platforms, processing large volumes of data from diverse sources.

You will build data pipelines, optimize distributed storage, and collaborate with data scientists on ML initiatives across cloud environments.

Qualifications

• Experience building and maintaining large-scale data pipelines.
• Expertise in distributed systems and cloud integrations.
• Ability to ensure data accuracy, availability, and security.

Responsibilities

• Design and maintain high-performance data platforms for structured and unstructured data.
• Create scalable ETL pipelines and optimize storage.
• Collaborate with data scientists on ML projects and cloud integrations.

Skills

Hadoop

Kafka

SQL

Python

Java

Scala

Data Warehousing

Docker

ETL Development

Education

Bachelor's degree in Computer Science, Data Engineering, Information Technology, or related field.

Big Data certifications are beneficial.

Job description

A Big Data Engineer develops and manages large-scale data processing systems that enable organizations to analyze massive datasets efficiently. They build data pipelines, optimize storage systems, and support advanced analytics initiatives.

Skills Required

• Hadoop
• Kafka
• SQL
• Python
• Java
• Scala
• Data Warehousing
• Docker
• ETL Development

Education

• Bachelor's degree in Computer Science, Data Engineering, Information Technology, or related field.
• Big Data certifications are beneficial.

Description

Big Data Engineers design and maintain high-performance data platforms capable of processing structured and unstructured data from multiple sources. They create scalable ETL pipelines, integrate cloud technologies, optimize distributed computing environments, and collaborate with data scientists to support machine learning projects. The role requires expertise in distributed systems, database technologies, and cloud platforms while ensuring data accuracy, availability, and security. Career progression includes Senior Data Engineer, Data Platform Architect, and Director of Data Engineering.

Atlanta, Georgia, USA, Atlanta, Georgia, United States