Senior Data Pipeline Engineer

Jobgether; United States; Remote; USD 100,000 - 130,000; Full time

Benefits offered by this job

Fully remote

35‑hour workweek

Health insurance

Retirement contributions

Life insurance

Disability insurance

Paid time off

PSLF eligibility

All‑staff summits travel

Job summary

Jobgether is seeking a Senior Data Pipeline Engineer in the United States to own the development and optimization of critical data pipelines in a cloud data environment. You will design scalable ETL/ELT solutions and lead data quality efforts while mentoring junior engineers and collaborating with data operations leadership.

The role emphasizes production reliability, data governance, and end-to-end pipeline delivery in a remote setting for a nonprofit-focused organization.

Qualifications

• 5+ years of experience in database engineering, data engineering, or ETL development with production data pipelines.
• Expert-level proficiency in Transact-SQL (T-SQL).
• Hands-on development experience with C#/NET.
• Experience designing ETL with SSIS.
• Familiarity with Apache Airflow and cloud services (AWS).
• Experience with Iceberg, Parquet and DynamoDB is a plus.
• Understanding of CI/CD, source control, and release workflows.
• Ability to mentor engineers and collaborate in a remote team.

Responsibilities

• Architect, develop, and maintain ETL/ELT pipelines and services using SSIS, Airflow, and AWS components.
• Support cloud data platform evolution including Iceberg ingestion pipelines and performance optimizations.
• Monitor data quality and troubleshoot production incidents; perform root-cause analysis.
• Onboard external and regulatory data sources; coordinate ingestion and transformation layers.
• Contribute to data schema design and platform architectural decisions.
• Maintain documentation and engineering best practices.
• Mentor junior engineers and conduct technical reviews.
• Participate in release management across development, QA, and production.
• Collaborate with Data Operations leadership on platform strategy and roadmap.
• Provide escalation support for critical data pipeline incidents.

Skills

Mentor junior engineers

Communication skills

Troubleshooting production incidents

Data quality management

Remote collaboration

Tools

SSIS

Apache Airflow

AWS Lambda

DynamoDB

Trino/Starburst

Apache Iceberg

Parquet

SQL Server

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Pipeline Engineer based in the United States.

As a Senior Data Pipeline Engineer, you will take ownership of the development, optimization, and delivery of critical data pipelines within a modern cloud data environment. You will combine advanced SQL and ETL engineering expertise with hands‑on experience in cloud technologies to ensure reliable data integration across warehouse and lakehouse platforms. Working with diverse internal and external data sources, you will design scalable solutions, strengthen data quality, and improve pipeline performance. You will also play an important role in troubleshooting production incidents, coordinating data architecture decisions, and maintaining robust engineering practices. In addition to your technical contributions, you will mentor junior engineers and collaborate closely with data operations leadership. This remote opportunity offers the chance to contribute your expertise within a mission‑driven nonprofit organization focused on making data more accessible and impactful.

Responsibilities

• Architect, develop, and maintain ETL/ELT pipelines and C#/NET pipeline services using technologies such as SSIS, Apache Airflow, AWS Lambda, data enhancement services, and message‑processing solutions.
• Support the evolution of the cloud data platform, including Apache Iceberg ingestion and transformation pipelines, DynamoDB integrations, and query performance optimization using Trino/Starburst.
• Monitor end‑to‑end data quality, investigate production pipeline incidents, identify root causes, document findings, and implement corrective actions through to successful data reprocessing.
• Lead the onboarding of new external and regulatory data sources, coordinating requirements and ensuring seamless integration across ingestion and transformation layers.
• Contribute to data schema design, architecture decisions, and technical improvements across the data platform.
• Maintain standard operating procedures, technical documentation, and engineering best practices.
• Mentor Associate‑level engineers, review their work, and support their technical development.
• Participate in release management, deployment activities, and processes across development, QA, and production environments.
• Partner with the Data Operations Manager on technical architecture, platform strategy, and roadmap decisions.
• Provide escalation‑level support for business‑critical data pipeline incidents, including after‑hours assistance when required.

Requirements

• 5+ years of experience in database engineering, data engineering, or ETL development, with demonstrated ownership of production data pipelines.
• Expert‑level proficiency in Transact‑SQL, including stored procedures, views, and database indexing.
• Hands‑on development experience with C#/NET.
• Proven experience designing and implementing ETL processes using SQL Server Integration Services (SSIS).
• Familiarity with orchestration platforms such as Apache Airflow is preferred.
• Experience working with AWS cloud services and open table formats such as Apache Iceberg and Parquet.
• Familiarity with AWS Lambda, DynamoDB, and Trino/Starburst is an advantage.
• Strong data quality management, troubleshooting, and root‑cause analysis capabilities, particularly in production environments.
• Understanding of source control, CI/CD practices, and release and deployment workflows across Dev, QA, and Production environments.
• Ability to mentor other engineers, conduct technical reviews, and communicate complex technical concepts effectively.
• Excellent written and verbal communication skills.
• Strong business judgment, independent prioritization, and the ability to manage competing responsibilities.
• Ability to collaborate effectively within a remote and distributed team.
• Willingness to take on additional responsibilities and special projects as required.
• Demonstrated sensitivity and respect for racial, gender, sexual orientation, and cultural differences.
• Commitment to inclusive values, curiosity, accessibility, transparency, and a collaborative approach to work.
• Must be legally authorized to work in the United States without current or future employer sponsorship.

Benefits

• Annual salary ranging from $100,000 to $130,000 for the New York City area, with adjustments based on location, skills, and experience.
• Fully remote working arrangement.
• 35‑hour workweek, Monday through Friday.
• Comprehensive health insurance, including medical, dental, and vision coverage.
• Employer retirement contributions, with an additional matching option.
• Employer‑paid life insurance and Accidental Death and Dismemberment (AD&D) coverage.
• Short‑term and long‑term disability insurance.
• Generous paid leave options, including paid time off, compassionate leave, volunteer leave, holidays, and parental leave.
• Flexible Spending Accounts (FSA) and supplemental insurance options.
• Pre‑tax commuter and transit benefits.
• Summer working hours.
• Eligibility for the Public Service Loan Forgiveness (PSLF) program.
• Opportunities to participate in annual, weeklong all‑staff summits, with additional in‑person meetings depending on leadership responsibilities. Travel is expected for employees based outside the New York City area.

Data Privacy Notice

By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre‑contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.