GCP Data Engineer

Arkhya Tech. Inc.; Charlotte (NC); On-site; USD 100,000 - 140,000; Full time

Job summary

Arkhya Tech. Inc. in Charlotte, NC is seeking a GCP Data Engineer to design and optimize end-to-end data pipelines. You will bridge MongoDB sources with a BigQuery analytics warehouse and ensure robust data integration and quality.

You will build ETL/ELT processes using Python and GCP services, tune queries and Dataflow jobs, and collaborate with data scientists and engineers to meet business requirements. This role offers on-site work in Charlotte with competitive compensation.

Qualifications

• Bachelor's degree in computer science, engineering, or a related technical field.
• Hands-on experience with core GCP data services: BigQuery, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage.
• Strong proficiency in NoSQL databases (MongoDB) and data warehousing concepts.
• Advanced programming and scripting in Python and SQL.
• Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.

Responsibilities

• Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.
• Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in BigQuery for analytics.
• Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.
• Performance Tuning: Optimize BigQuery queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.
• Collaboration: Partner with Data Scientists, Software Engineers, and business stakeholders to translate requirements into reliable data models.

Skills

Python

BigQuery

Dataflow

Cloud Composer

SQL

MongoDB

Education

Bachelor’s degree in Computer Science/Engineering

Tools

Cloud Logging/Monitoring

CI/CD

Job description

We are seeking a highly skilled GCP Data Engineer to design, build, and optimize robust data pipelines. In this role, you will bridge the gap between our NoSQL data sources (MongoDB) and our analytical data warehouse (Big Query). You will be responsible for end-to-end data integration, performance tuning, and providing production support and debugging to ensure high availability and data quality.

Key Responsibilities

Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.

Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in Big Query for analytics.

Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.

Performance Tuning: Optimize Big Query queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.

Collaboration: Partner with Data Scientists, Software Engineers, and business stakeholders to translate requirements into reliable data models.

Required Qualifications & Skills

Education: Bachelor’s degree in computer science, Engineering, or a related technical field.

Core GCP: Hands-on experience with core gcp data services: Big Query, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage.

Databases: Strong proficiency in NoSQL databases (specifically MongoDB) and data warehousing concepts.

Programming: Advanced programming and scripting skills in Python and complex SQL.

Support & CI/CD: Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.

Preferred Qualifications

Certifications such as the Google Cloud Professional Data Engineer.

Familiarity with the BigQuery Data Engineering Agent to aid in pipeline troubleshooting and generation