Project Role
Data Engineer
Project Role Description
Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems.
Summary
Seeking a forward‑thinking professional with an AI‑first mindset to design, develop, and deploy enterprise‑grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.
Skills
- Must have: Google BigQuery
- Good to have: Microsoft SQL Server, Google Cloud Data Services
Minimum Experience
5 years of experience required.
Educational Qualification
15 years of full‑time education.
Key Responsibilities & Technical Requirements
- Experience with DataProc, Pub/Sub, Dataflow, Kafka Streaming, Looker, and SQL (No FLEX).
- Proven track record of delivering data integration and data warehousing solutions.
- Strong SQL and hands‑on experience (No FLEX).
- Experience with data integration and migration projects.
- Proficient in BigQuery SQL language (No FLEX).
- Understanding of cloud native services: bucket storage, BigQuery, Cloud Function, Pub/Sub, Composer, and Kubernetes.
- Experience in cloud solutions, mainly data platform services, GCP Certifications (preferred).
- Experience in Shell Scripting, Python (NO FLEX), Oracle, SQL.
- Strong grasp of Generative and Agentic AI, prompt engineering, and AI evaluation frameworks.
- Expert in Python, strong knowledge of SQL and Python programming using Pandas, NumPy, deep understanding of data structures.
- Proficiency with tools to automate AZDO CI/CD pipelines like Control‑M, GitHub, JIRA, Confluence, CI/CD Pipeline.
- Performance tuning of BigQuery SQL scripts.
- Working in agile environment.
Professional Attributes
- Good communication skills.
- Ability to collaborate with different teams and suggest solutions.
- Can work independently with little supervision or as part of a team.
- Good analytical problem‑solving skills.
- Good team‑handling skills.
Additional Information
Candidate should be ready for Shift B and work as an individual contributor.
Seniority Level
Mid‑Senior level
Employment Type
Full‑time
Job Function
Information Technology
Industry
IT Services and IT Consulting