AWS data engineer

Siri InfoSolutions Inc; Houston (TX); On-site; USD 165,000 - 248,000; Full time

Job summary

Siri InfoSolutions Inc. is seeking an AWS Data Engineer in Houston, TX for a contract engagement. The candidate will design and implement cloud-based data solutions, leveraging AWS services, Spark processing, and Python development.

Strong focus on data quality, scalability, and observability is required. Preferred background includes experience with data warehousing, REST APIs, microservices, and DevOps practices.

Qualifications

• Experience with AWS cloud services and data engineering
• Strong Python and SQL/NoSQL skills
• Hands-on with Spark and big data tooling
• Proficiency in containers and microservices architecture
• Familiarity with observability and DevOps practices

Skills

AWS

Python

SQL

NoSQL

Spark

Docker

Kubernetes

REST API

Microservices

MLOps

DevOps

Monitoring

Tools

Snowflake

S3

CloudWatch

CI/CD

Job description

AWS data engineer

Houston, TX 77002

Hire Type: contract

Knowledge, Skills and Abilities:

• Cloud Technologies: AWS Services such as Lambda, IAM, S3, EFS, SQS, SNS, API Gateway, CLI, Kinesis, Glue, Elasticache (Redis), CloudWatch, CloudFormation, EC2
• Experience working with Databases: Oracle, SQL, Server, PostgreSQL and NoSQL databases such as Cassandra and Dynamo DB
• Experience with Big Data Technologies like Spark, Glue
• Containers : Docker/Kubernetes/ECS
• Integrations : REST, API , Synch, Asynch , Realtime, Batch
• Network : VPC, Subnet, SG, IP ( CIDR )
• Security : WAF, Encryption , Access Control, Identity , SSO, MFA
• Performance/reliability: Auto-scale, ASG, ALB, NLB
• Storage/Datawarehouese : EFS, S3, Snowflake, SQL
• Proficiency in Python
• Good to Have- Shell (Unix) /Batch Script
• Angular, Node JS
• Knowledge of Service Oriented, Microservices and Event-driven design patterns
• Knowledge of Machine Learning foundations : Performance /Accuracy Metrics, Hyper-parameters, Training, Feedback, Inference
• Experience working on complex cloud-based software projects, web application development, security and open-source technologies
• Knowledge of enterprise coding standards
• Ability to perform code reviews
• Knowledge of software methodologies and agile development methodologies
• Observability CloudWatch/CloudTrail, Event Bridge, Data Dog or any industry standard tools
• Ensure reusability using framework, Domain Driven Approach, Modular Coding, Analytical, Data Driven Approach
• Ability to estimate effort.
• Be able to translate Business needs into technology goals
• Be able to troubleshoot issues using services/resources/platforms/logs
• Strategic thinker, innovative, responsible, confident, clear in thoughts, collaborative and has good communication skills
• Understanding of MLOps.
• Good understanding of Enterprise DevOps practice