Sr. Data Engineer

Largeton Group; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

A leading company is seeking a Senior Data Engineer for a 100% remote role focused on ERP modernization. The successful candidate will work on data integration, workflow optimization, and collaborate within a dynamic team. Key technologies include Python, AWS services, and data pipelines. This 14-month contract offers competitive pay and a chance to work on significant projects that leverage advanced data engineering practices.

Qualifications

• Mid-Senior level experience required.
• Experience with remote data engineering practices.
• Familiarity with capital markets preferred.

Responsibilities

• Participate in an ERP modernization project focusing on Enterprise Supplier Management.
• Build and maintain data pipelines and workflows using AWS services.
• Develop APIs and data integration processes.

Skills

Python

Streaming/API Development

Jenkins

AWS

SQL

PySpark

Test Automation

Job description

• Participate in an ongoing ERP modernization project focused on Enterprise Supplier Management (ESM) integrations.
• Build and maintain data pipelines connecting systems such as Coupa, Beeline, PeopleSoft, and Workday.
• Develop and enhance data streaming solutions using Kafka or OneStream for real-time data processing and integration.
• Design, implement, and optimize data workflows using AWS services (Lambda, S3, Airflow, AWS Batch, Fargate).
• Work with Python (DataFrames, Pandas) and PySpark for data transformation and processing.
• Develop, test, and automate APIs and data integration processes.
• Publish and manage data in Snowflake data warehouse via streaming pipelines.
• Utilize Jenkins for CI/CD automation of data engineering workflows.
• Collaborate within a small, agile contractor team operating in 2-week sprints, with production delivery targeted for mid-June next year.
• Contribute to the creation of enterprise tools around AWS Airflow.
• Ensure test automation and quality control in all data engineering deliverables.
• Adapt to evolving integration needs as PeopleSoft migrates to Workday and other system changes occur.
  
  

Job Summary: Sr. Data Engineer

(Based On The Provided Job Description)

Location: 100% Remote

• Participate in an ongoing ERP modernization project focused on Enterprise Supplier Management (ESM) integrations.
• Build and maintain data pipelines connecting systems such as Coupa, Beeline, PeopleSoft, and Workday.
• Develop and enhance data streaming solutions using Kafka or OneStream for real-time data processing and integration.
• Design, implement, and optimize data workflows using AWS services (Lambda, S3, Airflow, AWS Batch, Fargate).
• Work with Python (DataFrames, Pandas) and PySpark for data transformation and processing.
• Develop, test, and automate APIs and data integration processes.
• Publish and manage data in Snowflake data warehouse via streaming pipelines.
• Utilize Jenkins for CI/CD automation of data engineering workflows.
• Collaborate within a small, agile contractor team operating in 2-week sprints, with production delivery targeted for mid-June next year.
• Contribute to the creation of enterprise tools around AWS Airflow.
• Ensure test automation and quality control in all data engineering deliverables.
• Adapt to evolving integration needs as PeopleSoft migrates to Workday and other system changes occur.
  
  

Required Skills

• Python (DataFrames & Pandas)
• Streaming/API Development (Kafka/OneStream)
• Jenkins
• AWS (Lambda, S3, Airflow, AWS Batch, Fargate)
• SQL (Snowflake)
• PySpark
• Test Automation
  
  

Additional Information

• 100% Remote, 14-month contract (possible extension), Capital One prior candidates preferred.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Largeton Group by 2x

Get notified about new Senior Data Engineer jobs in United States.

Data Architect – Databricks, ADF in Property and Casualty domain exp and guidewire

New York, NY $153,000.00-$210,000.00 6 months ago

San Francisco, CA $153,000.00-$210,000.00 6 months ago

Data Architect – Databricks, ADF in Property and Casualty domain exp and guidewire

Senior Workforce Management Data Analyst

United States $136,400.00-$178,300.00 1 week ago

Senior Software Engineer (Consumer - Growth & App Infra, Growth Foundations)

United States $135,900.00-$153,000.00 4 days ago

Engineering Manager - Data Developer Experience

Solutions Architect, Data Processing - New College Graduate 2025

United States $120,000.00-$235,750.00 2 days ago

Senior Software Engineer, Marketing Enablement

Senior Data Analyst, Growth and Lifecycle Marketing

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.