Remote Part-Time Big Data Architect for AI Pipelines

24-Mag Llc; New York (NY); Remote; USD 41,000 - 110,000; Part time

Job summary

24-MAG LLC is offering a part-time consulting opportunity for experienced Big Data Engineers to contribute technical expertise to an advanced AI development project involving large-scale data pipelines, distributed systems, databases, and modern data-engineering workflows.

Selected professionals will apply practical big-data engineering experience to complex data problems involving pipeline architecture, integration, transformation, distributed processing, storage, and system reliability.

Qualifications

• Experience in big-data engineering with large-scale pipelines and architectures.
• Strong Python skills for data processing, automation, and integration.
• Deep understanding of relational and NoSQL databases and performance tuning.
• Experience with distributed data-processing frameworks such as Hadoop, Spark, or Flink.

Responsibilities

• Design, build, and maintain scalable data pipelines and big-data architectures
• Develop workflows for ingesting, transforming, processing, and delivering large data volumes
• Translate requirements into robust data-engineering solutions
• Apply architectural patterns for distributed, high-volume data systems
• Ensure workflows are scalable, maintainable, and production-ready

Skills

Python

Big data

Distributed systems

ETL

SQL/NoSQL

Tools

Hadoop

Spark

Flink

Job description

24-MAG LLC is offering a part-time consulting opportunity for experienced Big Data Engineers to contribute technical expertise to an advanced AI development project involving large-scale data pipelines, distributed systems, databases, and modern data-engineering workflows.

Selected professionals will apply practical big-data engineering experience to complex data problems involving pipeline architecture, integration, transformation, distributed processing, storage, and system reliability.