Big Data Engineer

SaidGig; New York (NY); Remote; USD 41,000 - 110,000; Full time

Job summary

SaidGig is seeking a remote independent contractor to design and scale data pipelines for AI systems. You will implement data integration, processing workflows, and storage architectures while collaborating with cross-functional teams to meet business objectives.

The role emphasizes advanced Python, distributed data processing, and strong communication to ensure high availability, data quality, and governance across solutions. Remote engagement with global teams is expected.

Qualifications

• Demonstrated big data engineering experience building and maintaining large-scale data pipelines.
• Advanced Python skills for data processing, automation, and integration.
• Deep knowledge of relational and NoSQL databases, including optimization and management practices.
• Experience with distributed data-processing frameworks such as Hadoop, Spark, or Flink.
• Strong understanding of data modeling, ETL processes, and data warehousing principles.
• Excellent written and verbal communication skills for stakeholders.

Responsibilities

• Design, build, and maintain scalable big data pipelines and architectures.
• Partner with cross-functional teams to translate data requirements and business objectives into effective solutions.
• Implement data integration, transformation, and processing workflows using Python and big data technologies.
• Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
• Monitor, troubleshoot, and improve data systems to maintain high availability and performance.
• Apply data quality, security, and governance standards across solutions.
• Document technical solutions and explain complex concepts clearly in writing and conversation.

Skills

Big data engineering

Python

Databases (Relational & NoSQL)

Distributed data-processing (Hadoop/SF

Tools

Hadoop

Spark

Flink

AWS/GCP/Azure

Job description

Role Overview

Build the data foundations that help train and evaluate next-generation AI systems. As a remote independent contractor, you will contribute real-world engineering expertise through scalable data solutions that improve how AI models learn, reason, and perform.

Key Responsibilities

• Design, build, and maintain scalable big data pipelines and architectures.
• Partner with cross-functional teams to translate data requirements and business objectives into effective solutions.
• Implement data integration, transformation, and processing workflows using Python and relevant big data technologies.
• Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
• Monitor, troubleshoot, and improve data systems to maintain high availability and performance.
• Apply data quality, security, and governance standards across solutions.
• Document technical solutions and explain complex concepts clearly in writing and conversation.

Qualifications

• Demonstrated big data engineering experience, including building and maintaining large-scale data pipelines.
• Advanced Python skills for data processing, automation, and integration.
• Deep knowledge of relational and NoSQL databases, including optimization and management practices.
• Experience with distributed data-processing frameworks such as Hadoop, Spark, or Flink.
• Strong understanding of data modeling, ETL processes, and data warehousing principles.
• Excellent written and verbal communication skills, including the ability to communicate with technical and non-technical stakeholders.
• A detail-oriented, proactive, self-motivated approach suited to autonomous remote work.

Preferred Qualifications

• Experience in fast-paced or startup-like environments supporting global teams.
• Experience with cloud big data platforms, including AWS, GCP, or Azure.
• Familiarity with machine learning operations and data science workflows.

Work Terms

Remote contract engagement.

Compensation

$30 to $80 per hour.