Role & responsibilities
We are seeking a GCP Data Engineer to design, build and maintain data systems on Google Cloud Platform. The role focuses on building pipelines with BigQuery, Dataflow and Pub/Sub, managing cloud storage, and enabling real-time data processing for fast, reliable analytics.
Key Responsibilities
- Design, develop and maintain scalable batch and real-time data pipelines on GCP.
- Build ETL/ELT pipelines with rollback strategies, bad-record handling and performance optimization.
- Design end-to-end data integration flows across systems.
- Design scalable fact/dimension schemas in cloud data warehouses.
- Handle structured, semi-structured and unstructured data at scale.
- Implement data quality checks, security and compliance policies; protect sensitive information.
- Optimize data systems by identifying bottlenecks, tuning queries and adopting new technologies.
- Collaborate with data scientists, analysts and business stakeholders to deliver tailored data solutions.
Technical Skills
- GCP Services: Cloud Run functions, Cloud Scheduler, Workflows, Pub/Sub, GCS, Dataflow, BigQuery, Cloud Build.
- Programming: Strong SQL / PL-SQL, Python and object-oriented languages (Java, Python); API development.
- CI/CD: Deployment using GitHub Actions and Jenkins.
- Data Modelling: Top-down and bottom-up database design, data masking, normalization, denormalization, dimensional modeling.
- Big Data & Streaming: Streaming architectures, NoSQL stores and key-value databases under high concurrency and volume.
Qualifications
- Bachelor's degree in Computer Science, IT, Engineering or a related field.
- 4-10 years of data engineering experience with hands-on GCP delivery.
- Strong problem-solving, communication and stakeholder management skills.
- GCP Professional Data Engineer certification preferred.