AWS Data Engineer

Capgemini; Newark (NJ); On-site; USD 47,000 - 73,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

Retirement benefits

Job summary

Tundra Technical Solutions is seeking a data engineering professional to design, build and maintain scalable AWS-based data lake and data warehouse solutions for large enterprises. You will architect end-to-end data ingestion pipelines, work with AWS services (S3, Redshift, Glue, EMR/Spark) and implement CI/CD for EDP projects.

Responsibilities include collaborating with cross-functional teams, migrating data from on-prem to AWS, and evaluating new tools.

Qualifications

• Bachelor's degree in computer science, software engineering, MIS, or equivalent.
• Experience implementing and supporting data lakes, data warehouses and data applications on AWS for large enterprises.
• Knowledge of ETL/ELT and data ingestion pipelines in AWS.
• End-to-end data solutions on AWS (ingest, storage, integration, processing, access).
• Architect and implement CI/CD strategy for EDP.
• AWS Solutions Architect or AWS Developer Certification preferred.

Responsibilities

• Design, build and maintain efficient, reusable, and reliable architecture and code.
• Build reliable and robust Data ingestion pipelines within AWS and on-prem to AWS.
• Ensure the best possible performance and quality of high-scale data engineering projects.
• Participate in architecture and system design discussions.
• Independently perform hands-on development and unit testing of the applications.
• Collaborate with the development team and build components into complex enterprise web systems.
• Work in a team environment with product, production operation, QE/QA and cross-functional teams.
• Identify and resolve performance issues.
• Keep up to date with new technology developments and implementation.
• Participate in code reviews to ensure standards and best practices.

Skills

Python

Shell scripting

SQL

ETL/ELT

Data ingestion

Education

Bachelor’s degree in CS/Software Engineering/MIS or equivalent

Tools

AWS

CloudFormation

S3

Athena

Glue

EMR/Spark

RDS

Redshift

DynamoDB

Lambda

Step Functions

IAM

KMS

Kafka

Kinesis

SQS

Elasticsearch

Job description

Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience

Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises

Programming experience with Python, Shell scripting and SQL

Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.

Solid experience implementing solutions on AWS based data lakes.

Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch

Experience in AWS data lake/data warehouse/business analytics

Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS

Knowledge of ETL/ELT

End-to-end data solutions (ingest, storage, integration, processing, access) on AWS

Architect and implement CI/CD strategy for EDP

Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)

Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift

Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift

Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case

AWS Solutions Architect or AWS Developer Certification preferred

Good understanding of Lakehouse/data cloud architecture

Responsibilities

Designing, building and maintaining efficient, reusable, and reliable architecture and code.

Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc.)

Ensure the best possible performance and quality of high scale data engineering project

Participate in the architecture and system design discussions

Independently perform hands on development and unit testing of the applications.

Collaborate with the development team and build individual components into complex enterprise web systems.

Work in a team environment with product, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle.

Responsible to identify and resolve any performance issues

Keep up to date with new technology development and implementation

Participate in code review to make sure standards and best practices are met.

The pay range that the employer in good faith reasonably expects to pay for this position is $33.98/hour - $53.09/hour. Our benefits include medical, dental, vision and retirement benefits. Applications will be accepted on an ongoing basis.

Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.