AWS Data Engineer

Siri InfoSolutions Inc; Jersey City (NJ); On-site; USD 140,000 - 210,000; Full time

Job summary

Siri InfoSolutions Inc is seeking a Senior Data Engineer to design and implement data pipelines using Python and AWS native services. You will build REST/Flask APIs for real-time integrations and implement secure authentication/authorization (SSO, OAuth). Strong Python and AWS experience, including Lambda, S3, RDS PostgreSQL, API Gateway, and event-driven architecture is required.

Experience with vector databases and embeddings for RAG is highly valued in this role.

Qualifications

• Senior Data Engineer with Python and AWS experience.
• Design and implement data pipelines using AWS native services and Python.
• Build REST/Flask APIs for real-time data integrations.
• Design and implement authentication/authorization (SSO, OAuth, Entra..).
• Strong Python programming skills are required.
• Experience with vector databases and embeddings for RAG.
• AWS services experience (Lambda, S3, API Gateway, etc.).
• Experience with Amazon RDS PostgreSQL and event-driven architectures.

Skills

Senior Data Engineer

Data Pipelines

REST APIs

Authentication & Authorization

Python

Vector databases

AWS

Amazon RDS PostgreSQL

API Gateway

Event-driven architecture

Job description

Must Have Technical/Functional Skills:

• Senior Data Engineer (Python with AWS) 10+ year experience
• Experience designing and building Data Pipelines using AWS Native services and Python
• Experience in building API's(REST/Flask) for real-time data integrations
• Experience designing and building authentication and authorization(SSO, OAuth, Entra..)
• Strong Experience in Python programming
• Proven experience in building and implementing in below tech stack:
• Experience working on vector database and embeddings for RAG
• AWS Cloud Experience (Terraforms, Lambda, Stepfunctions, Textract, AWS Bedrock for AI LLM's, S3, SQS, SNS)
• Amazon RDS PostGres
• Amazon API Gateway
• Events driven architecture