Cloud Data Engineer: ETL/ELT Pipelines & Data Quality

Capgemini; Whippany (NJ); On-site; USD 110,000 - 150,000; Full time

Job summary

Capgemini in Whippany, NJ seeks a Data Engineer to design, develop and optimize scalable ETL/ELT pipelines across structured and unstructured data. You will build and maintain data ingestion frameworks, data lakes, data warehouses and data marts while ensuring data quality, governance and security.

The role requires cloud-based data solutions with Azure, AWS or GCP, along with strong collaboration with data scientists and BI teams.

Qualifications

• Design, develop and optimize scalable ETL/ELT pipelines.
• Build and maintain data ingestion frameworks for structured and unstructured data.
• Develop and manage data lakes, data warehouses, and data marts.
• Ensure data quality, integrity, governance and security across data platforms.
• Implement data validation, monitoring and observability processes.
• Develop and maintain cloud-based data solutions using Azure, AWS or GCP.
• Optimize storage and compute resources for cost and performance.
• Support real-time and batch data processing architectures.

Responsibilities

• Design, develop and optimize scalable ETL/ELT pipelines.
• Build and maintain data ingestion frameworks for structured and unstructured data.
• Develop and manage data lakes, data warehouses, and data marts.
• Ensure data quality, integrity, governance and security across data platforms.
• Implement data validation, monitoring and observability processes.
• Develop and maintain cloud-based data solutions using Azure, AWS or GCP.
• Optimize storage and compute resources for cost and performance.
• Support real-time and batch data processing architectures.
• Design and optimize relational and NoSQL databases.
• Create efficient data models to support business requirements.
• Perform query optimization and database performance tuning.
• Work closely with Data Scientists, BI Developers, Business Analysts and Product Teams.
• Translate business requirements into scalable data solutions.
• Provide technical guidance and mentoring to junior team members.
• Implement data governance policies and standards.
• Ensure compliance with organizational and regulatory requirements.
• Maintain metadata lineage and documentation.

Skills

ETL/ELT design

Data ingestion

Cloud platforms

Data governance

Data quality

Monitoring & observability

Relational/NoSQL databases

Mentoring

Tools

Azure

AWS

GCP

Job description

Capgemini in Whippany, NJ seeks a Data Engineer to design, develop and optimize scalable ETL/ELT pipelines across structured and unstructured data. You will build and maintain data ingestion frameworks, data lakes, data warehouses and data marts while ensuring data quality, governance and security.

The role requires cloud-based data solutions with Azure, AWS or GCP, along with strong collaboration with data scientists and BI teams.