AWS Data Engineer Golang - Python

SP Staffing; Hyderabad, Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

SP Staffing is seeking an experienced backend/data engineer with 7-11 years of hands-on experience in Golang and Python for cloud-native backend and data engineering use cases. The role requires strong AWS expertise (Lambda, S3, API Gateway, RDS, Glue, SQS, SNS, EC2, ECS, IAM, CloudWatch) and proficiency with relational databases (PostgreSQL, MS SQL) and NoSQL stores (DynamoDB).

You will work with Kafka/RabbitMQ, RESTful APIs, and CI/CD tooling in a distributed system on AWS.

Qualifications

• Strong hands-on experience in backend and data engineering using Golang and Python.
• Extensive experience with AWS cloud services including Lambda, S3, API Gateway, RDS, Glue, SQS, SNS, EC2, ECS, IAM and CloudWatch.
• Proficient with relational databases (PostgreSQL, MS SQL) and NoSQL stores (DynamoDB).
• Hands-on with message brokers and event-driven architectures (Kafka, RabbitMQ).
• Design and implement RESTful APIs and data services.
• Experience with CI/CD tools (Jenkins, GitLab CI) and Git.
• Experience building distributed systems on AWS with Docker containerization.
• Familiar with observability platforms such as Datadog or Prometheus.
• Strong understanding of cloud security best practices including IAM, encryption, secrets management, vulnerability scanning and compliance controls.

Responsibilities

• Develop backend and data pipelines using Golang and Python.
• Execute and optimize cloud-native architectures on AWS.
• Work with relational and NoSQL databases, and implement data services.
• Utilize Kafka or RabbitMQ for event-driven processing.
• Design RESTful APIs and robust data services.
• Implement and maintain CI/CD pipelines with Jenkins/GitLab CI and Git.
• Build highly available distributed systems with Docker on AWS.
• Incorporate observability with Datadog/Prometheus.
• Apply cloud security best practices across IAM, encryption, and secrets management.

Skills

Golang

Python

RESTful APIs

CI/CD

Docker

Observability

Cloud security

Tools

AWS

Jenkins

GitLab CI

Git

Datadog

Prometheus

S3

API Gateway

RDS

DynamoDB

Kafka

RabbitMQ

Docker

CloudWatch

Job description

Experience:7-11yrs

Work Location : Bangalore/Hyderabad

Job Description:

• Strong hands-on experience in Golang and Python for backend and data engineering use cases.
• Strong hands-on experience with AWS cloud services AWS Lambda, S3, API Gateway, RDS, Glue, SQS, SNS, EC2, ECS, IAM, CloudWatch and cloud-native architecture patterns.
• Strong experience with relational databases (e.g., PostgreSQL, MS SQL) and NoSQL stores (e.g., DynamoDB).
• Strong hands-on experience with message brokers and event-driven architectures (e.g., Kafka, RabbitMQ).
• Hands-on experience designing and implementing RESTful APIs and data services.
• Hands-on experience with CI/CD tools (e.g., Jenkins, GitLab CI), distributed version control system like Git.
• Experience building highly available, distributed systems on AWS, including containerization using Docker.
• Hands on experience building highly available distributed systems in AWS and containerization using Docker.
• Experience with observability platforms such as Datadog, Prometheus, or equivalent.
• Strong understanding of cloud security best practices including IAM, encryption, secrets management, vulnerability scanning, and compliance controls.