API Data Engineer

Incedo Inc.; New York (NY); Hybrid; USD 140,000 - 200,000; Full time

Job summary

Incedo Inc. is a leading Digital, Data and AI Transformation specialist. We are seeking a senior engineer to design and deliver scalable data and API solutions, leveraging AWS, Spark, and modern DevOps practices.

The role involves building data pipelines, REST APIs, and infrastructure using Terraform, Dynamo, and orchestration tools in a hybrid setting across New York, NY or Fort Mill, SC.

Qualifications

• 10+ years of experience in software/data engineering, API development, or cloud platform engineering.
• Ability to design and implement data solutions at scale with big data technologies.
• Experience building data pipelines on AWS and deploying APIs.
• Strong collaboration with stakeholders to deliver technical solutions.

Responsibilities

• Lead data and API engineering initiatives to enable business capabilities.
• Design and develop data applications using big data technologies (AWS, Spark) to ingest, process, and analyze large datasets.
• Build robust data pipelines on the cloud using AWS Glue, Kafka, Aurora Postgres, EKS, PySpark, Lambda, and Snowflake.
• Create REST-based data APIs using Python/C#, EKS, and Lambda.
• Develop infrastructure for ETL using SQL and AWS big data tools.
• Implement Terraform-based infrastructure with modular patterns and multi-environment state management.
• Establish CI/CD pipelines with GitHub Actions, Octopus, Liquibase for API, data, and infra delivery.
• Instrument services with Dynatrace for observability and performance tuning.

Skills

Data engineering

API development

Cloud platform engineering

Tools

AWS

Spark

PySpark

Lambda

Snowflake

Confluent Kafka

Aurora Postgres

EKS

Terraform

GitHub Actions

Liquibase

Dynatrace

Job description

Incedo Inc. is a high-growth Digital, Data and AI Transformation Specialist firm headquartered in New Jersey. We

are a long-term strategy execution partner for Fortune 500 enterprises, operating at the intersection of business

and technology across Banking & Payments, Wealth Management, Telecom, Hi-Tech, and Life Sciences.

We are building Incedo 4.0 - an AI-native, execution-focused, founder-led organization designed for scale, speed,

and long-term impact.

Incedo delivers ROI from AI @ Scale through the “Power of 3”:

• Engineering & Operations excellence.

Location : New York, NY or Fort Mill, SC (Hybrid)

Job Responsibilities:

• 10+ years of experience in software/data engineering, API development, or cloud platform engineering
• Work with development teams and stakeholders to deliver technical solutions that enable business capabilities
• Design and develop data applications using big data technologies (AWS, Spark) to ingest, process, and analyze large disparate datasets
• Build robust data pipelines on the cloud using AWS Glue, Confluent Kafka, Aurora Postgres, EKS, PySpark, Lambda, and Snowflake
• Build REST-based data APIs using Python/C#, EKS, and Lambda
• Build infrastructure for optimal ETL from various data sources using SQL and AWS big data technologies
• Work with data and analytics experts to improve functionality in data systems
• Implement architectures to handle large-scale data and its organization
• Execute data design and architecture strategies aligned with enterprise standards
• Deliver reference architectures outlining principles and best practices for technology advancement
• Design and maintain Terraform-based infrastructure using modular patterns, private module registries, and multi-environment state management
• Build and maintain GitHub Actions, Octopus , Liquibase CI/CD pipelines for API, data, and infrastructure delivery — including PR validation, Terraform plan gates, and environment promotion
• Implement reusable GitHub workflow patterns and integrate with enterprise DevSecOps shared workflows for build, test, deploy, and rollback
• Instrument services with Dynatrace for distributed tracing, metrics, and production observability on Lambda and containerized workloads
• Define monitoring, alerting, and SLOs in Dynatrace; use APM data for performance tuning, incident response, and reliability improvements