AWS Data Architect

MSRcosmos LLC; Torrance (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

MSRcosmos LLC in Torrance, CA is seeking an AWS Data Architect to design and implement a scalable data hub on AWS. The role focuses on data ingestion, transformation, storage, and access control, with emphasis on data governance, lineage, and quality.

The candidate will select AWS services (S3, Glue, Redshift, Athena, Lambda) and design for AI/ML readiness, BI dashboards in Power BI, and cost optimization. The position is onsite four days a week, long-term engagement, requiring strong data

Qualifications

• Experience designing data hubs on AWS and data lake/warehouse architectures.
• Strong skills in data modeling, lineage, and quality frameworks.
• Hands-on ETL/ELT with Python/SQL and AWS services.
• Knowledge of data governance, security, and IAM controls.

Responsibilities

• Architect and implement a scalable AWS data hub with ingestion, transformation, storage and access control.
• Define data models, lineage and quality standards for the Datahub.
• Select AWS services (S3, Glue, Redshift, Athena, Lambda) based on data needs.
• Design for AI/ML readiness in future phases.
• Build data pipelines for ingesting data from databases, APIs and files.
• Implement data cleansing and normalization and manage ingestion schedules.
• Establish governance, security policies and IAM-based access control.
• Create data catalogs and dashboards using Power BI and develop data warehouses/marts.
• Monitor pipeline performance and optimize costs on AWS.

Skills

AWS data services

Data modeling

Data engineering

Python/SQL

Data governance

Tools

Informatica IICS

Power BI

Job description

Role: AWS Data Architect

Location: Torrance CA Onsite-4 days a week

Duration: Long Term

• Architect and implement a scalable data hub solution on AWS using best practices for data ingestion, transformation, storage, and access control.
• Define data models, data lineage, and data quality standards for the Datahub.
• Select appropriate AWS services (S3, Glue, Redshift, Athena, Lambda) based on data volume, access patterns, and performance requirements.
• Come up with a design that accommodates AI/ML applications in the next phase
• Data Ingestion and Integration:
• Design and build data pipelines to extract, transform, and load data from various sources (databases, APIs, flat files) into the Datahub using AWS Glue, AWS Batch, or custom ETL processes.
• Implement data cleansing and normalization techniques to ensure data quality.
• Manage data ingestion schedules and error handling mechanisms.
• Data Governance and Access Control:
• Establish data access controls and security policies to protect sensitive data within the Datahub using IAM roles and policies.
• Develop data governance frameworks including data quality checks, data lineage tracking, and data retention policies.
• Data Analytics Enablement:
• Create data catalogs and metadata management systems to facilitate data discovery and understanding by business users and data analysts.
• Design and implement data views and dashboards using Power BI to enable data exploration and visualization.
• Create data warehouses and data marts to meet the needs of the business
• Monitoring and Optimization:
• Monitor data pipeline performance, data quality, and system health to identify and resolve issues proactively.
• Optimize data storage and processing costs by leveraging AWS cost optimization features.
• Data Exchange
• Develop the required governance, security, monitoring and guard rails to enable efficient data exchange between internal application and their external vendors, partners, and SaaS providers
• Develop intake process, SLAs, and usage rules for internal and external data set producers and consumers

Role: AWS Data Architect

Location: Torrance CA Onsite-4 days a week

Duration: Long Term

Key Responsibilities

• Architect and implement a scalable data hub solution on AWS using best practices for data ingestion, transformation, storage, and access control.
• Define data models, data lineage, and data quality standards for the Datahub.
• Select appropriate AWS services (S3, Glue, Redshift, Athena, Lambda) based on data volume, access patterns, and performance requirements.
• Come up with a design that accommodates AI/ML applications in the next phase
• Data Ingestion and Integration:
• Design and build data pipelines to extract, transform, and load data from various sources (databases, APIs, flat files) into the Datahub using AWS Glue, AWS Batch, or custom ETL processes.
• Implement data cleansing and normalization techniques to ensure data quality.
• Manage data ingestion schedules and error handling mechanisms.
• Data Governance and Access Control:
• Establish data access controls and security policies to protect sensitive data within the Datahub using IAM roles and policies.
• Develop data governance frameworks including data quality checks, data lineage tracking, and data retention policies.
• Data Analytics Enablement:
• Create data catalogs and metadata management systems to facilitate data discovery and understanding by business users and data analysts.
• Design and implement data views and dashboards using Power BI to enable data exploration and visualization.
• Create data warehouses and data marts to meet the needs of the business
• Monitoring and Optimization:
• Monitor data pipeline performance, data quality, and system health to identify and resolve issues proactively.
• Optimize data storage and processing costs by leveraging AWS cost optimization features.
• Data Exchange
• Develop the required governance, security, monitoring and guard rails to enable efficient data exchange between internal application and their external vendors, partners, and SaaS providers
• Develop intake process, SLAs, and usage rules for internal and external data set producers and consumers

Required Skills And Experience

• AWS Expertise: Deep understanding of AWS data services including S3, Glue, Redshift, Athena, Lake Formation, Sep Functions, CloudWatch and EventBridge.
• Data Modeling: Proficiency in designing dimensional and snowflake data models for data warehousing and data lakes.
• Data Engineering Skills: Experience with ETL/ELT processes, data cleansing, data transformation, and data quality checks. Experience with Informatica IICS and ICDQ is a plus.
• Programming Languages: Proficiency in Python, SQL, and potentially Pyspark for data processing and manipulation.
• Data Governance: Knowledge of data governance best practices including data classification, access control, and data lineage tracking.

Preferred Qualifications

• Experience with data lake house architectures and the ability to leverage both structured and unstructured data.
• Familiarity with data visualization tools like Tableau or Power BI.
• Strong communication and collaboration skills to work with stakeholders across business and technical teams.
• AWS certifications related to data analytics and architecture.

Thanks Ramesh