The GCP Data Engineer willdesign, build, deploy, and optimize scalable data pipelines and analyticssolutions on Google Cloud. The role is primarily focused on data integration,transformation, orchestration, modeling, quality, governance, performance, andreliable production delivery, supported by practical DevOps automation. Therole requires 4+ years of relevant data engineering experience
Key Responsibilities
- Datapipeline engineering: Design andimplement scalable batch and streaming ETL/ELT pipelines using Dataflow,Apache Beam or Spark, BigQuery, and Cloud Storage.
- Dataintegration: Integrate data fromSQL Server, Couchbase, APIs, files, and event-driven sources into governeddata warehouses, data lakes, or lakehouse platforms.
- Datatransformation and modeling: Transformraw data into trusted, analytics-ready datasets using SQL, Python, dbt,and Dataflow; apply sound dimensional and analytical modeling practices.
- Orchestration: Build, schedule, monitor, andsupport workflows using Cloud Composer and appropriate Google Cloudservices.
- Performanceand cost optimization: Monitor andtune pipelines, queries, storage patterns, and compute usage forreliability, throughput, scalability, and cost efficiency.
- Dataquality and governance: Implementvalidation rules, reconciliation controls, observability, lineage,metadata, anomaly detection, and data-quality standards using Dataplex andrelated capabilities.
- Securityand compliance: Applyleast-privilege access, secure data handling, encryption, auditability,retention, and privacy controls in alignment with organizational andregulatory requirements.
- DevOps andautomation: Provision and manageGoogle Cloud resources with Terraform; create automated build, test,deployment, and release workflows using Cloud Build and source-controlpractices.
- Event-drivensolutions: Use Pub/Sub, CloudFunctions, and Datastream where applicable for near-real-time ingestion,change data capture, and event-driven processing.
- Collaborationand delivery: Partner with datascientists, analysts, application teams, security, platform engineering,and business stakeholders to translate requirements into dependable datasolutions.
- Documentationand standards: Maintainarchitecture diagrams, data mappings, runbooks, operational procedures,deployment documentation, and coding standards.
- Innovation: Track relevant Google Cloud data,DevOps, and AI platform developments and assess their practicalapplication to enterprise data-engineering use cases.
Required Qualifications
- 4+ years of relevant experience in data engineering,including production delivery on Google Cloud.
- Strong proficiency in Python and SQL for dataprocessing, automation, testing, and analytical querying.
- Hands‑on experience with BigQuery, Cloud Storage,Dataflow, Dataplex, and Cloud Composer.
- Experience with Apache Beam or Spark and distributeddata-processing patterns.
- Practical knowledge of Terraform for reusable,version-controlled infrastructure as code.
- Experience building CI/CD pipelines with CloudBuild, including automated validation, testing, packaging, and deployment.
- Understanding of data warehouse, data lake, andlakehouse principles, including distributed data architectures and datamodeling.
- Experience integrating SQL Server, Couchbase, RESTAPIs, and file or object-storage sources.
- Knowledge of data security, privacy, governance,observability, and compliance best practices.
- Strong troubleshooting, problem-solving,documentation, stakeholder communication, and delivery skills for complexprojects and tight timelines.
- Google Cloud Professional Data Engineercertification.
Disclaimer: The following job description serves as an informative reference for the tasks you may be required to perform. However, it does not constitute an integral component of your employment agreement and is subject to periodic modifications to align with evolving circumstances .
Please Note : We appreciate the accuracy and authenticity of the information you provide, as it plays a key role in your candidacy. As part of the Background Verification Process, we may verify your employment, education, and other details. Please ensure all information is factual and submitted on time. For any assistance, your recruiter is available to support you.