Location: Hartford, CT
Work Arrangement: Hybrid – 3 days onsite per week (Mandatory)
Visa: USC | GC | H4 EAD
Work Type: 1099 || W2 || Fulltime
Experience: 13–15 years
Job Summary
We are looking for a highly experienced Senior Data Engineer with strong expertise in AWS, Python-based application development, and enterprise application integration. The ideal candidate should have a strong background in designing and developing scalable applications, implementing data engineering solutions, and working with different integration architectures and patterns.
This position requires hands-on expertise in REST API-based, event-driven, file-based, and batch integration approaches, along with a deep understanding of AWS core services and DevOps practices. The candidate should be capable of translating business requirements into scalable, secure, and production-ready technical solutions.
Key Technical Expectations
- Strong understanding of application development and application integration within the data engineering landscape.
- Hands-on experience with AWS services, including Glue, Lambda, and EKS for compute, along with S3, DynamoDB, and DocumentDB for storage.
- Solid understanding of multiple integration approaches, including RESTful APIs, event-driven, file-based, and batch processing patterns.
- Practical knowledge of event-based architecture and integration design. Experience using Kafka or another event bus alone is not sufficient; candidates must understand the underlying event-driven integration patterns.
- Strong application development skills using Python as the primary programming language.
- Good knowledge of AWS platform administration, security, IAM, DNS, and Route 53.
- Hands-on DevOps experience with Terraform for infrastructure provisioning and management, along with application CI/CD tools such as Jenkins and Git.
Core Responsibilities
- Architect, develop, and maintain scalable Python-based applications, REST APIs, and distributed data processing solutions.
- Design and implement reliable integration workflows using REST, event-driven, file-based, and batch processing patterns.
- Provision, configure, and optimize AWS infrastructure using Terraform and Infrastructure as Code practices.
- Convert business and architectural requirements into detailed Low-Level Designs (LLDs), focusing on performance, scalability, and database efficiency.
- Work closely with clients and external stakeholders to understand business requirements, clarify technical expectations, and provide appropriate solutions.
- Ensure application performance, reliability, security, and scalability across AWS environments.
- Provide technical leadership, conduct regular code reviews, and mentor engineering team members.
- Promote engineering best practices and maintain high standards for application design, development, and delivery.
Required Technical Skills
- Python: Strong production-level programming experience, including advanced programming concepts, application architecture, and software design patterns.
- AWS: Extensive hands-on experience with core AWS services such as S3, EC2, Lambda, Glue, EKS, RDS, DynamoDB, and DocumentDB, including containerized application deployments.
- Application Integration: Strong knowledge of REST API, event-driven, file-based, and batch integration patterns.
- Event-Driven Architecture: Understanding of event-based integration principles, including practical implementation using Kafka or other event-bus technologies.
- Infrastructure as Code: Hands-on expertise with Terraform for provisioning and managing resources across multiple environments.
- Databases: Strong understanding of relational and non-relational databases, including schema design, query optimization, and database management.
- Distributed Systems: Experience designing and developing distributed applications and high-throughput data processing workflows.
- DevOps & CI/CD: Practical experience with Jenkins, Git, application deployment pipelines, and infrastructure automation.
- AWS Platform & Security: Knowledge of IAM, DNS, Route 53, cloud security, and platform management.
Leadership & Communication
- Strong client-facing and stakeholder management capabilities, with the ability to communicate technical concepts to business and non-technical teams.
- Experience leading technical discussions, managing development activities, and coordinating with cross-functional teams.
- Ability to conduct daily standups, mentor junior engineers, provide technical direction, and establish code quality standards.
- Strong analytical and problem-solving skills with a focus on delivering reliable, production-ready solutions.