Data Engineer Manager

Randstad Enterprise; Hyderabad; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Randstad Enterprise in Hyderabad, India, seeks an Data Engineering Manager to lead a team of data engineers. You will design, build, and maintain cloud-based data ingestion pipelines and integrations, ensuring reliability, scalability, and performance of data solutions.

You will guide a global team, align initiatives with a strategic roadmap, and lead adoption of modern technologies including data warehouses, ETL, and Gen AI capabilities. Strong leadership and cloud expertise are essential.

Qualifications

• Strong data engineering background with cloud experience.
• Experience designing scalable data pipelines and ETL.
• Proven leadership and cross-functional collaboration.
• Knowledge of Gen AI concepts is a plus.

Responsibilities

• Lead, mentor, and inspire a team of data engineers to deliver scalable data solutions.
• Develop and contribute to a strategic data engineering roadmap aligned with business goals.
• Collaborate with cross-functional teams to understand needs and deliver impactful data infrastructure.
• Provide technical leadership in designing data pipelines, ETL processes, and data warehouses.
• Ensure reliability, performance, and scalability of data infrastructure and systems.
• Foster learning culture and professional growth within the team.

Skills

Leadership

Strategy

Collaboration

Data pipelines

ETL processes

Data modeling

GCP

BigQuery

Gen AI concepts

Tools

Looker

DOMO

Tableau

Airflow

Kafka

Spark

Google Cloud Composer

Job description

As the Data Engineering Manager, you will be responsible for leading a team of data engineers in designing, building, and maintaining our cloud-based data ingestion pipelines and integrations. You will play a pivotal role in ensuring the reliability, scalability, and performance of our data solutions, as well as staying at the forefront of data technology trends and contributing to our data strategy. This is a hands-on leadership role that requires a strong

technical background and proven expertise in cloud services. You will also lead and work with global resources and teams.

• Leadership: Lead, mentor, and inspire a team of data engineers, fostering a culture of collaboration, innovation, and excellence. Provide guidance and support to ensure the team delivers high-quality, scalable, and reliable data solutions.
• Strategy and Vision: Support and contribute to development of a strategic roadmap for data engineering initiatives aligned with organizational objectives. Drive innovation by identifying opportunities for improvement and implementing cutting-edge technologies and methodologies.
• Cross-functional Collaboration: Collaborate closely with cross-functional teams to understand business needs, provide data infrastructure support, and deliver impactful solutions.
• Technical Expertise: Maintain a deep understanding of data engineering principles, best practices, and emerging technologies. Provide technical leadership and guidance in designing, building, and optimizing data pipelines, ETL processes, and data warehouses.
• Performance and Scalability: Ensure the reliability, performance, and scalability of data infrastructure and systems. Implement robust monitoring and optimization strategies to maintain high data quality and availability.
• Team Development: Cultivate a learning culture within the team, encouraging skill development, knowledge sharing, and continuous improvement. Identify training needs and provide opportunities for growth to enhance team capabilities.

Knowledge, Skills, and Abilities -

• Strong knowledge of relational databases, data warehouse principles, data architecture, etc.
• Extensive experience with data analysis, modeling, and data pipelining including data cleaning, standardizing, scaling, tuning, scheduling and deployment
• Experience working with Looker, DOMO, Tableau or other data visualization tools
• Advanced experience with Google cloud platform (GCP) is preferred. But experience with Microsoft Azure/ Amazon will be considered.
• Good understanding of Google BigQuery, Google Dataform, Google Cloud Composer (Airflow), Cloud functions, etc.
• Good understanding and experience of Gen AI concepts like Agentic frameworks, RAG and LLM.
• Any exposure to Gemini LLM models, ADK (Agent development Kit) and Vertex AI will be an added advantage
• Support the creation of Gen AI products within our cloud environments.
• Experience managing and working with global teams.
• Any exposure to Kafka, Spark, and Scala will be an added advantage.
• Should demonstrate a strong understanding of software and data engineering best practices
• Intrinsic motivation and problem-solving
• Proactive leadership, project management, time management, and problem-solving skills
• Demonstrated continuous improvement, process documentation, and workflow skills
• Experience composing detailed technical documentation and procedures for data models
• Ability to prioritize and manage multiple projects, tasks, and meeting deadlines while maintaining quality
• Strong drive and commitment for delivering outstanding results
• Strong follow up and service orientation