We are looking for an experienced Senior AWS Engineer to design, develop, and maintain an event-driven, serverless financial data platform. The ideal candidate will have strong expertise in Python, Node.js, AWS Glue, AWS Lambda, Step Functions, and microservices architecture.
The role involves developing scalable serverless applications, building ETL pipelines, integrating AWS services, and ensuring data accuracy, reliability, security, and operational efficiency within financial transaction processing systems.
Key Responsibilities
- Design, develop, and maintain independently deployable microservices using AWS Lambda.
- Develop Node.js (ES6+, async/await) and Python-based serverless applications.
- Build event-driven solutions using Amazon S3, EventBridge, SQS, and API Gateway.
- Develop and maintain AWS Glue ETL pipelines using Python, PySpark, and Oracle JDBC.
- Implement and manage AWS Step Functions for workflow orchestration.
- Integrate AWS services including S3, DynamoDB, SNS, SES, Secrets Manager, and Lambda.
- Design and optimize DynamoDB data models, including GSIs, conditional writes, and TTL.
- Write and optimize complex Oracle SQL queries for financial data processing.
- Implement error handling, retries, idempotency, duplicate detection, and transactional integrity.
- Build and maintain CI/CD pipelines using Jenkins, AWS SAM, and CloudFormation.
- Develop unit, integration, and smoke tests using PyTest, unittest, Jest, and Mocha.
- Implement monitoring and observability using CloudWatch and Grafana.
- Ensure security best practices, including IAM policies, KMS encryption, and dependency vulnerability management.
- Maintain technical documentation, deployment guides, and operational runbooks.
Mandatory Technical Skills
- AWS Glue ETL: Strong experience with AWS Glue, PySpark, DynamicFrames, and ETL development.
- Microservices: Strong proficiency in Node.js and/or Python, AWS Lambda, and event-driven microservices architecture.
- CI/CD & Deployment: Experience with Jenkins, AWS SAM, and CloudFormation.
- ETL & Workflow Orchestration: Hands-on experience with AWS Glue Jobs and Step Functions.
- AWS Serverless Integration: Experience with API Gateway, AWS Lambda, and DynamoDB.
Required Skills & Experience
- Strong Python programming experience (Python 3.12+).
- Hands-on experience with AWS Lambda (Python and Node.js).
- Expertise in AWS Glue and PySpark-based ETL development.
- Experience with AWS Step Functions and Amazon States Language.
- Knowledge of Oracle SQL, complex joins, and transactional databases.
- Strong understanding of DynamoDB data modeling and indexing.
- Experience with S3 event-driven architectures and data lake patterns.
- Knowledge of automated testing and AWS service mocking.
- Experience handling financial or transactional data with high accuracy and auditability requirements.
- Familiarity with CloudWatch, Grafana, and production monitoring.
Good-to-Have Skills
- AWS security best practices and SOC 2 compliance.
- KMS encryption and least-privilege IAM implementation.
- AWS Secrets Manager and SNS/SES integrations.
- Parquet and data lake architecture.
- Experience with AWS SAM and multi-environment deployments.
Work Location & Requirements
- Work Mode: Onsite
- Onsite Requirement: Yes
- Office Location: Malvern, PA
Ideal Candidate Profile
The ideal candidate should be a hands-on Senior AWS Engineer with strong experience in serverless architecture, Python/Node.js development, AWS Glue ETL pipelines, and microservices. Experience working with financial transaction processing systems, data reconciliation, and highly reliable event-driven applications will be highly valued.