GCP Data Engineer

Rivago Infotech Inc; Charlotte (NC); On-site; USD 110,000 - 150,000; Full time

Job summary

Rivago Infotech Inc. is seeking a skilled GCP Data Engineer in Charlotte, NC, to design, build, and optimize robust data pipelines bridging MongoDB sources with BigQuery analytics.

You will implement end-to-end data integration, performance tuning, and provide production support for data quality and availability. Responsibilities include ETL/ELT pipeline development with Python and GCP services, data integration into Google Cloud Storage and BigQuery, and collaboration with data scientists and

Qualifications

• Bachelor’s degree in computer science, engineering, or a related technical field.
• Hands-on experience with core GCP data services (BigQuery, Dataflow, Cloud Composer, Cloud Storage).
• Strong proficiency in MongoDB and data warehousing concepts.
• Advanced Python and SQL programming.
• Experience with CI/CD and Cloud Logging/Monitoring for debugging.

Responsibilities

• Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP services.
• Integrate data from MongoDB into Google Cloud Storage and load/transform it in BigQuery.
• Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.
• Optimize BigQuery queries, Dataflow jobs, and MongoDB indexing for cost-efficiency and performance.
• Collaborate with data scientists, software engineers, and stakeholders to translate requirements into data models.

Education

Bachelor’s degree in computer science, Engineering, or a related technical field

Tools

BigQuery

Dataflow

Cloud Composer

Cloud Storage

MongoDB

Job description

We are seeking a highly skilled GCP Data Engineer to design, build, and optimize robust data pipelines. In this role, you will bridge the gap between our NoSQL data sources (MongoDB) and our analytical data warehouse (Big Query). You will be responsible for end-to-end data integration, performance tuning, and providing production support and debugging to ensure high availability and data quality.

Key Responsibilities

• Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.
• Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in Big Query for analytics.
• Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.
• Performance Tuning: Optimize Big Query queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.
• Collaboration: Partner with Data Scientists, Software Engineers, and business stakeholders to translate requirements into reliable data models.

Required Qualifications & Skills

• Education: Bachelor’s degree in computer science, Engineering, or a related technical field.
• Core GCP: Hands-on experience with core gcp data services: Big Query, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage.
• Databases: Strong proficiency in NoSQL databases (specifically MongoDB) and data warehousing concepts.
• Programming: Advanced programming and scripting skills in Python and complex SQL.
• Support & CI/CD: Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.

Preferred Qualifications

• Certifications such as the Google Cloud Professional Data Engineer.
• Familiarity with the BigQuery Data Engineering Agent to aid in pipeline troubleshooting and generation