Google Data Engineer

Tech Vedika Inc.; Hyderabad; In loco; INR 3.500.000 - 6.000.000; Tempo pieno

Vantaggi offerti da questo lavoro

Growth opportunities

Health Insurance

Life Insurance

Parental Health Insurance

Learning sponsorships

Global projects

Latest tools & technologies

Descrizione del lavoro

Tech Vedika Inc. in Hyderabad seeks a seasoned Data Engineer Lead to guide offshore teams in Viet Nam and India. You will design and operationalize scalable data pipelines, data models and warehouses for analytics, collaborating with data architects, scientists and BI engineers.

You will drive ETL/ELT processes, enforce data quality, and ensure timely delivery of data products while working closely with customers and the offshore team to translate requirements into robust solutions.

Competenze

• 10+ years engineering and operationalizing data pipelines with large datasets.
• 10+ years hands-on experience with DBT and IICS.
• 9+ years with cloud technologies such as Dataflow, Data Fusion, Pub/Sub, BigQuery.
• Advanced SQL skills; ability to write complex queries across sources.
• 9+ years in data modeling, ETL, and data warehousing.

Mansioni

• Lead DE team with offshore members; provide guidelines and ensure output quality.
• Bridge between customer and offshore team; present solutions and transfer requirements.
• Lead technical design activities to meet customer expectations and quality standards.
• Build data models and pipelines to store data per defined structures.
• Improve data reliability, efficiency, and quality; assess data integrity across sources.

Conoscenze

Data pipeline design

SQL proficiency

Cloud technologies (GCP)

DBT

IICS

ETL/ELT design

Data modeling

Data warehousing

Team leadership

Communication skills

Strumenti

Dataproc

Google Cloud Dataflow

Informatica IICS

Git/Azure DevOps

Descrizione del lavoro

We are an Artificial Intelligence (AI) focused product engineering company, providing our customers in healthcare, retail & e-commerce, manufacturing and hospitality sectors with cutting edge products & solutions, harnessing Big Data Analytics, Vision Analytics, and IoT.

Ever since our inception in March 2010, Tech Vedika has been

• Top 10 Most Disruptive Face & Image Recognition Solution Providers'2020 - Analytics Insights

We strive for simple, elegant tech solutions to perform complex tasks. As a scalable technology partner, we enable organisations to improve operational efficiency and unleash new business potential.

Job Description

Data Engineers lead is responsible for leading a team in offshore (Viet Nam, India) to developing and operationalizing data pipelines to make data available for consumption (reports and advanced analytics). This includes data ingestion, data transformation, data validation/quality, data pipeline optimization, orchestration; and engaging with DevOps Engineer during CI/CD. The role requires leading skills and grounding in programming and SQL, followed by expertise in data storage, modeling, cloud, data warehousing, and data lakes, ETL tools. The Data Engineer Lead will work closely with customer Data Architects, Data Scientists and BI Engineers to design and maintain scalable data models and pipelines. Data engineer lead will transfer requirements to the offshore team, lead the team to ensure the project delivers high quality products to customers. The Data Engineer Lead also spends time developing data pipelines and/or data integrations stack.

Job Duties/Essential Functions

• Leads DE team with one offshore member but can ramp-up sooner. This includes providing guidelines for team members, reviewing output, and the quality of team members.
• Work as bridge between customer and offshore team. Present solution to customer, get feedback work with team to update accordingly, as well as transfer requirement, feedback from customer in a clear manner.
• Lead technical design activity from project team, ensure the output, quality meet, exceed customer's expectation.
• Build data models and develop data pipelines to store data in defined data models and structures.
• Identifies ways to improve data reliability, efficiency and quality of data management.
• Assesses the integrity of data from multiple sources.
• Works in tandem with Data Architects, Data Stewards and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.

• Azure experience is a plus and Experience with Dataflow, Apache Beam, and Dataproc
• Designs, develops, & implements ETL/ELT processes using Dbt (Data build tool), Informatica Intelligent Cloud Services (IICS).
• Uses Google Cloud Google cloud services such as Google Cloud Storage, Cloud Pub/Sub, Cloud Data Fusion, Dataflow, Dataproc… to improve and speed up delivery of data products and services.

Experience, Skills, Education & Licenses/Certifications

• 10+ years experience engineering and operationalizing data pipelines with large and complex datasets.
• 10+ years hands-on experience with DBT and IICS.
• 9+ years experience working with Cloud technologies such as Data flow, Data Fusion, Pub/Sub, Dataform, dbt, Bigquery, Cloud SQL
• Advanced SQL skills required. Solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.
• 9+ years experience with Data Modeling, ETL, and Data Warehousing.
• Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).

Qualifications

Recommendation:

• Google data cloud certifications.
• Experience with Git/Azure DevOps.
• Experience delivering data solutions through agile software development methodologies.
• Exposure to the retail industry.
• Excellent verbal and written communication skills.
• Proficient in Google Workspace applications, including Sheets, Docs, Slides, and Gmail

Additional Information

At Tech Vedika, we are looking for talented individuals who want to work with driven people. Attain success while working on interesting projects with a culturally diverse group of individuals.

Perks & Benefits of joining TechVedika:

• Growth driven - an opportunity to learn new skills, and certifications sponsored by the company
• Group Insurance
  • Health Insurance (Including spouse and children)
  • Accidental Life Insurance
  • Group Life Insurance
  • Parental Health Insurance (Optional)
• Learning Aids
• Work on projects that have a huge impact - work with clients all over the world.
• Latest tools and technology - always driven by the latest, most efficient ways of working
• Process-driven, quality-oriented work

If you want an exciting and dynamic career with unlimited growth potential, then Tech Vedika is the place for you!