A technology company based in San Jose is looking for a skilled data engineer to design scalable ETL processes and maintain data pipelines. You will build data warehouses, implement data quality checks, and work with large datasets while using tools such as GCP and BigQuery. Ideal candidates should be proficient in Python and SQL and have a strong grasp of data engineering concepts.
Qualifications
Proficiency in Python, SQL and data engineering concepts.
Responsibilities
Design, develop, and maintain scalable and robust ETL/ELT processes and data pipelines.
Build and optimize data warehouses and data lakes.
Implement data quality checks and monitoring.
Skills
Python
SQL
Data engineering concepts
Tools
Google internal tools
GCP
BigQuery
Job description
Design, develop, and maintain scalable and robust ETL/ELT processes and data pipelines using various tools and technologies.
Build and optimize data warehouses, data lakes, and other data storage solutions to support analytical and operational needs.
Implement data quality checks and monitoring to ensure the accuracy, completeness, and consistency of data.
Work with large datasets, performing data modeling, schema design, and performance tuning.
Create data models that are easy for BI tools to consume and build dashboard.
Qualifications needed:
Proficiency in Python, SQL and data engineering concepts.