Data Engineer

Arkhya Tech. Inc.; Charlotte (NC); On-site; USD 110,000 - 140,000; Full time

Job summary

Arkhya Tech. Inc. is seeking a data engineering professional to design, build, and deploy scalable ETL/ELT pipelines on Google Cloud Platform using Python.

You will integrate data from MongoDB into Google Cloud Storage and load/transform it in BigQuery for analytics, optimize performance of queries and Dataflow jobs, and collaborate with data scientists, software engineers, and business stakeholders to translate requirements into reliable data models.

Responsibilities

• Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.
• Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in Big Query for analytics.
• Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.
• Performance Tuning: Optimize Big Query queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.
• Collaboration: Partner with Data Scientists, Software Engineers, and business stakeholders to translate requirements into reliable data models.

Job description

• Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.
• Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in Big Query for analytics.
• Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.
• Performance Tuning: Optimize Big Query queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.
• Collaboration: Partner with Data Scientists, Software Engineers, and business stakeholders to translate requirements into reliable data models.