Platform Engineer: Data Pipelines & Cloud-Scale (Remote)

Carbon Arc, Inc.; New York, Northern (NY, KY); Hybrid; USD 120,000 - 190,000; Full time

Benefits offered by this job

Fully paid healthcare benefits

Remote work options

401(k) plan with employer contribution

Paid time off

Parental and family leave policies

Challenging problems in a supportive,快

Job summary

Carbon Arc, Inc. is seeking a Platform Engineer to design, build, and maintain the data platform powering our analytics products. You will develop large-scale ETL pipelines, orchestrate workflows with Airflow, and write clean Python code to keep the platform reliable and scalable.

The role emphasizes building internal tooling, implementing data quality controls, and collaborating on architecture decisions. Remote-first with onsite travel, strong emphasis on reliability and performance in a

Qualifications

• 3–5+ years of software engineering experience with a focus on data systems or platform engineering.
• Experience with Spark or other distributed data processing frameworks.
• Strong proficiency in Python, with an emphasis on testing and code quality.
• Deep experience building and operating ETL pipelines, data quality controls, and workflow orchestration systems (Airflow, Dagster, Prefect).
• Hands-on experience with AWS services such as S3, IAM, Glue, EMR, and RDS.
• Familiarity with data lake architectures, Apache Iceberg, and data catalogs.
• Strong SQL skills, including query optimization and partitioning strategies.
• Comfort integrating AI-assisted development tools into daily workflows to accelerate productivity.
• Strong written and verbal technical communication skills.
• A proactive mindset with the ability to adapt quickly and drive change in evolving systems.

Responsibilities

• Design and build performant ETL/ELT pipelines for massive data sources, including terabytes of structured and unstructured data
• Develop and maintain workflow orchestration using Airflow or similar DAG-based systems
• Write clean, well-tested Python code to solve data and infrastructure challenges
• Build internal tooling and automation to improve developer productivity and pipeline reliability
• Implement data quality monitoring with traceability back to source systems
• Define schemas, partitions, and indexes aligned to usage patterns and performance needs
• Create, optimize, and maintain queries against analytical databases
• Collaborate on platform architecture decisions and help establish engineering best practices
• Debug complex issues across distributed data systems and services
• Document systems, pipelines, and operational procedures to support long-term scalability

Skills

Python

Data engineering

SQL

Technical communication

AI tools integration

Tools

Spark

Airflow

Dagster

Prefect

AWS (S3, IAM, Glue, EMR, RDS)

Iceberg

Data catalogs

Job description

Carbon Arc, Inc. is seeking a Platform Engineer to design, build, and maintain the data platform powering our analytics products. You will develop large-scale ETL pipelines, orchestrate workflows with Airflow, and write clean Python code to keep the platform reliable and scalable.

The role emphasizes building internal tooling, implementing data quality controls, and collaborating on architecture decisions. Remote-first with onsite travel, strong emphasis on reliability and performance in a