Senior API Data Engineer - Scale Big Data & Cloud APIs

Incedo Inc.; New York (NY); Hybrid; USD 140,000 - 200,000; Full time

Job summary

Incedo Inc. is a leading Digital, Data and AI Transformation specialist. We are seeking a senior engineer to design and deliver scalable data and API solutions, leveraging AWS, Spark, and modern DevOps practices.

The role involves building data pipelines, REST APIs, and infrastructure using Terraform, Dynamo, and orchestration tools in a hybrid setting across New York, NY or Fort Mill, SC.

Qualifications

• 10+ years of experience in software/data engineering, API development, or cloud platform engineering.
• Ability to design and implement data solutions at scale with big data technologies.
• Experience building data pipelines on AWS and deploying APIs.
• Strong collaboration with stakeholders to deliver technical solutions.

Responsibilities

• Lead data and API engineering initiatives to enable business capabilities.
• Design and develop data applications using big data technologies (AWS, Spark) to ingest, process, and analyze large datasets.
• Build robust data pipelines on the cloud using AWS Glue, Kafka, Aurora Postgres, EKS, PySpark, Lambda, and Snowflake.
• Create REST-based data APIs using Python/C#, EKS, and Lambda.
• Develop infrastructure for ETL using SQL and AWS big data tools.
• Implement Terraform-based infrastructure with modular patterns and multi-environment state management.
• Establish CI/CD pipelines with GitHub Actions, Octopus, Liquibase for API, data, and infra delivery.
• Instrument services with Dynatrace for observability and performance tuning.

Skills

Data engineering

API development

Cloud platform engineering

Tools

AWS

Spark

PySpark

Lambda

Snowflake

Confluent Kafka

Aurora Postgres

EKS

Terraform

GitHub Actions

Liquibase

Dynatrace

Job description

Incedo Inc. is a leading Digital, Data and AI Transformation specialist. We are seeking a senior engineer to design and deliver scalable data and API solutions, leveraging AWS, Spark, and modern DevOps practices.

The role involves building data pipelines, REST APIs, and infrastructure using Terraform, Dynamo, and orchestration tools in a hybrid setting across New York, NY or Fort Mill, SC.