Senior AWS Data Lake Architect

Semtech Corporation; Khordha, Hyderabad, Pune District; Presencial; INR 4.200.000 - 6.400.000; Jornada completa

Descripción de la vacante

Semtech Corporation is seeking a Senior AWS Data Lake Architect to design, build, and scale an AWS-based data lake platform aligned with AI/ML deployment. You will own end-to-end architecture from ingestion to governance and consumption, collaborating with data science and AI engineering teams to operationalize AI models in production.

You will provide technical leadership and mentorship across the data engineering function, implementing scalable and secure data lake solutions and driving cost

Formación

• Bachelor’s degree or higher in Computer Science, Information Systems, Engineering, or related field.
• 8+ years’ experience in data engineering/architecture; 5+ years on AWS.
• Hands-on experience with AWS data lake tech: S3, Lake Formation, Glue, EMR, Redshift, Athena, Kinesis/MSK.
• Experience deploying AI/ML in production; SageMaker/Bedrock integration.
• Proficiency in Python and/or Scala/Spark for large-scale data processing.
• Strong data governance, security, and compliance knowledge.

Responsabilidades

• Architect, design, and implement scalable AWS data lake solutions (S3, Lake Formation, Glue, EMR, Redshift, Athena, Kinesis/MSK).
• Lead AI/ML-ready data pipelines, feature stores, and model training pipelines with SageMaker/Bedrock.
• Partner with data science teams to productionize AI solutions, including MLOps integration.
• Establish governance, security (IAM, KMS), and audit logging; ensure compliance.
• Drive cost optimization and performance tuning across storage, compute, and query layers.
• Provide leadership and mentorship to data engineers, maintain architecture docs and ADRs.

Conocimientos

AWS data lake architecture

Python

Scala/Spark

Data governance

Security & compliance

Leadership & mentoring

Educación

Bachelor’s degree in CS/IS/Engineering

Master’s degree preferred

Herramientas

Amazon S3

AWS Lake Formation

AWS Glue

Amazon EMR

Amazon Redshift

Amazon Athena

Amazon Kinesis/MSK

SageMaker

Bedrock

Terraform / CloudFormation / CDK

Descripción del empleo

Job Summary:

The Senior AWS Data Lake Architect is responsible for designing, building, and scaling the organizations AWS-based data lake platform, with a strong focus on enabling AI and machine learning solution deployment. This role owns the end-to-end architecture of the data lake ecosystem — from ingestion and storage through governance and consumption — and partners closely with data science and AI engineering teams to operationalize AI models in production. The role also provides technical leadership and mentorship across the data engineering function.

Responsibilities:

• Architect, design, and implement scalable, secure AWS data lake solutions (Amazon S3, AWS Lake Formation, AWS Glue, Amazon EMR, Amazon Redshift, Amazon Athena, Amazon Kinesis/MSK), including reference architecture, data zoning, partitioning strategy, and schema/catalog management (25%).
• Lead the design and deployment of AI/ML-ready data pipelines, including feature stores and model training pipelines, and integrate with Amazon SageMaker and Amazon Bedrock to support generative AI and machine learning use cases (20%).
• Partner with data science and AI engineering teams to operationalize AI solutions in production, including model deployment pipelines, MLOps integration, and inference data flows (15%).
• Establish and enforce data governance, security, and compliance standards, including IAM, KMS encryption, Lake Formation permissions, and audit logging (15%).
• Drive cost optimization and performance tuning across storage, compute, and query layers, and evaluate new AWS services and architectural patterns (15%).
• Provide technical leadership and mentorship to data engineers, own technical documentation and architecture decision records, and support operational handoffs for production issues (10%).

Minimum Qualifications:

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field required; Master’s degree preferred
• 8+ years’ experience in data engineering or data architecture required; 5+ years specifically architecting solutions on AWS required
• Hands‑on experience designing and operating AWS data lake architectures, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon EMR, Amazon Redshift, Amazon Athena, and Amazon Kinesis/MSK
• Demonstrated experience deploying or supporting AI/ML solutions in production, including integration with Amazon SageMaker and Amazon Bedrock
• Proficiency in Python and/or Scala/Spark for large-scale data processing
• Strong understanding of data governance, security, and compliance best practices in cloud environments

Desired Qualifications

• AWS Certified Data Engineer – Associate (DEA-C01) or equivalent AWS certification (e.g., AWS Certified Solutions Architect – Professional)
• Experience with modern lakehouse formats such as Apache Iceberg, Delta Lake, or Apache Hudi
• Experience architecting generative AI solutions on AWS using Amazon Bedrock, including foundation model access, agents, and knowledge bases
• Exposure to infrastructure‑as‑code (Terraform, AWS CloudFormation, or AWS CDK) for provisioning data platform resources
• Experience operating in regulated or large‑scale enterprise environments with strict data governance requirements