AWS data engineer

LA International; United States; Remote; USD 90,000 - 140,000; Full time

Job summary

Join a leading global ICT Recruitment and Project Solutions Consultancy as an AWS Data Engineer. This role focuses on implementing and managing cloud-based data architecture solutions, requiring strong skills in data ingestion, transformation, and database management. A successful candidate will work collaboratively to deliver high-quality data solutions.

Qualifications

• Strong experience in SQL, Python, and Spark.
• AWS focused with relevant certifications (e.g., AWS Certified Data Engineer).
• Understanding of Infrastructure as Code and GIS data models.

Responsibilities

• Design and implement data ingestion pipelines.
• Transform and clean raw data for quality assurance.
• Monitor data quality to ensure accuracy and completeness.

Skills

SQL

Python

Spark

AWS Glue

Databrew

S3

AWS Lambda

PostgreSQL

Quicksight

Education

AWS Certified Data Engineer

Tools

Gitlab

Job description

Systems Architecture - AWS data engineer

Job Description
Location: UK - Will require travel to customer site as and when required (Belfast)

Job Summary: We are seeking a skilled and experienced AWS Data Engineer to join our team. The successful candidate will be responsible for implementing, and managing data architecture solutions for our customers, with a strong emphasis on Cloud technologies (Preferably AWS) and tooling. This role requires understanding of data modelling, database design, and data integration techniques.


Key Responsibilities


-Data Ingestion and Extraction: Design and implement efficient data ingestion pipelines to and from databases and file storage services.
-Data Transformation and Cleaning: Transform and clean raw data to ensure data quality and consistency.
-Data Pipelines: Build, maintain, and optimise data pipelines to automate data flows and enable real-time data processing.
-Data Quality Assurance: Monitor data quality and implement measures to ensure data accuracy and completeness.
-Database Administration: Manage and maintain databases (e.g., SQL, NoSQL) to ensure optimal performance and security.
-Cloud Infrastructure: Deploy and manage data infrastructure on cloud platforms - Primarily AWS
-Collaboration: Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.


Key Skills

-Strong proficiency in SQL, Python, and Spark. Experience with metadata-driven ETL/ELT.
-Experience with AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight
-Version Control (Gitlab) and CI/CD
-Familiar with security and networking principles, especially in an AWS deployment.
-Understanding and experience handling both structured and unstructured data.
-AWS focused with working experience and/or relevant certifications such as AWS Certified Data Engineer.
-Experience with complex data migrations.
-Strong problem-solving and analytical skills.
-Excellent communication and collaboration skills.
-Understanding of Infrastructure as Code
-Understanding of GIS data models



LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.

Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.