Gcp Data Engineer

Tech Vedika Software; Hyderabad; Presencial; INR 4.000.000 - 7.000.000; Jornada completa

Descripción de la vacante

Tech Vedika Software seeks a Data Engineer Lead to guide an offshore team in Viet Nam and India, building and operating data pipelines for reports and analytics. You will design scalable data models, coordinate with Data Architects, Data Scientists and BI Engineers, and ensure quality delivery.

The role blends leadership with hands-on development of ETL/ELT processes and data integrations using cloud-based tools to accelerate data products.

Formación

• ,Google Data Cloud certifications.
• Experience with Git/Azure DevOps.
• Experience delivering data solutions through agile software development methodologies.
• Exposure to the retail industry.
• Excellent verbal and written communication skills.
• Proficient in Google Workspace applications, including Sheets, Docs, Slides, and Gmail

Responsabilidades

• Lead DE team with offshore member and ramp-up
• Bridge between customer and offshore team
• Present solution to customer and incorporate feedback
• Lead technical design activity from project team
• Build data models and develop data pipelines to store data in defined data models and structures
• Identify ways to improve data reliability, efficiency and quality of data management
• Assess the integrity of data from multiple sources
• Collaborate with Data Architects, Data Stewards and Data Quality Engineers

Conocimientos

Advanced SQL

Relational databases

Data modeling

Educación

Google data cloud certifications

Herramientas

Dbt

Informatica

IICS

Google Cloud

Dataflow

Dataproc

BigQuery

Pub/Sub

Cloud Storage

Azure DevOps

Descripción del empleo

Job Description

Data Engineers lead is responsible for leading a team in offshore (Viet Nam, India) to developing and operationalizing data pipelines to make data available for consumption (reports and advanced analytics). The role requires leading skills and grounding in programming and SQL, followed by expertise in data storage, modeling, cloud, data warehousing, and data lakes, ETL tools. The Data Engineer Lead will work closely with customer Data Architects, Data Scientists and BI Engineers to design and maintain scalable data models and pipelines. Data engineer lead will transfer requirements to the offshore team, lead the team to ensure the project delivers high quality products to customers. The Data Engineer Lead also spends time developing data pipelines and/or data integrations stack.

Job Duties/Essential Functions

Leads DE team with one offshore member but can ramp-up sooner. This includes providing guidelines for team members, reviewing output, and the quality of team members. Work as bridge between customer and offshore team. Present solution to customer, get feedback work with team to update accordingly, as well as transfer requirement, feedback from customer in a clear manner. Lead technical design activity from project team, ensure the output, quality meet, exceed customers expectation. Build data models and develop data pipelines to store data in defined data models and structures. Identifies ways to improve data reliability, efficiency and quality of data management. Assesses the integrity of data from multiple sources. Works in tandem with Data Architects, Data Stewards and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.

• Azure experience is a plus and Experience with Dataflow, Apache Beam, and Dataproc
• Designs, develops, & implements ETL/ELT processes using Dbt (Data build tool), Informatica
• Intelligent Cloud Services (IICS).
• Uses Google Cloud Google cloud services such as Google Cloud Storage, Cloud Pub/Sub, Cloud
• Data Fusion, Dataflow, Dataproc to improve and speed up delivery of data products and services.
• Experience, Skills, Education & Licenses/Certifications
• Required:
• 10+ years experience engineering and operationalizing data pipelines with large and complex
• 10+ years hands-on experience with DBT and IICS.
• 9+ years experience working with Cloud technologies such as Data flow, Data Fusion, Pub/Sub,
• Dataform, dbt, Bigquery, Cloud SQL
• Advanced SQL skills required. Solid understanding of relational databases and business data; ability
• to write complex SQL queries against a variety of data sources.
• 9+ years experience with Data Modeling, ETL, and Data Warehousing.
• Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph,
• data warehousing).

Qualifications

• Recommendation:
• Google data cloud certifications.
• Experience with Git/Azure DevOps.
• Experience delivering data solutions through agile software development methodologies.
• Exposure to the retail industry.
• Excellent verbal and written communication skills.
• Proficient in Google Workspace applications, including Sheets, Docs, Slides, and Gmail