Remote Data Engineer: Scalable AI Data Pipelines

SaidGig; New York (NY); Remote; USD 100,000 - 150,000; Full time

Benefits offered by this job

Equity compensation

Remote-friendly work model

Health insurance stipend

Job summary

SaidGig is hiring for a remote Senior Data Engineer to build and scale data infrastructure for AI-driven products and research. You will design pipelines that ingest, process, and transform large datasets, while optimizing distributed workflows with Spark and cloud-native tech.

You will implement robust data storage, ensure data quality, and collaborate with researchers and engineers on data-intensive experiments. A focus on Python and SQL is essential for ETL, validation, and analytics.

Qualifications

• Proficient in Python, SQL, and Spark for data processing and analytics.
• Hands-on experience with AWS data services and cloud-native data architecture.
• Experience with large-scale distributed data processing and both SQL/NoSQL databases.

Responsibilities

• Design, build, and maintain scalable pipelines that ingest and transform large datasets from multiple sources.
• Develop distributed processing workflows with Spark and cloud-native technologies.
• Build scalable, high-performing SQL and NoSQL data storage solutions.

Skills

Python

SQL

Apache Spark

AWS

Tools

Matplotlib

Seaborn

Plotly

Job description

SaidGig is hiring for a remote Senior Data Engineer to build and scale data infrastructure for AI-driven products and research. You will design pipelines that ingest, process, and transform large datasets, while optimizing distributed workflows with Spark and cloud-native tech.

You will implement robust data storage, ensure data quality, and collaborate with researchers and engineers on data-intensive experiments. A focus on Python and SQL is essential for ETL, validation, and analytics.