About the role
The position plays a pivotal role within our evolving Data Engineering team, leading the strategic implementation of data solutions on AWS. You will be responsible for driving the technical vision and execution of cloud-based data architectures, ensuring the platform's scalability, security, and performance while addressing both business and technical requirements. This role demands a hands-on leader role with deep technical expertise who can also steer strategic initiatives to success.
Key responsibilities
- Spearhead the implementation, performance fine-tuning, development, and delivery of data solutions using AWS core data services, driving innovation in Data Engineering, Governance and Integration.
- Oversee all technical aspects of AWS-based data systems, ensuring end-to-end delivery.
- Coordinate with multiple stakeholders to ensure timely implementation and effective value realization.
- Continuously enhance the D&A platform to improve performance, resiliency, scalability, and security while incorporating new data technologies and methodologies.
- Work closely with business partners, data architects, and cross-functional teams to translate complex business requirements into technical solutions.
- Develop and implement data management strategies, including Data Lakehouse, Data Warehousing, Master Data Management, and Advanced Analytics solutions.
- Combine technical solutioning with hands-on work as needed, actively contributing to the architecture, coding, and deployment of critical data systems.
- Ensure system health by monitoring platform performance, identifying potential issues, and taking preventive or corrective measures as needed.
- Be accountable for the accuracy, consistency, and overall quality of the data used in various applications and analytical processes.
- Advocate for the use of best practices in data engineering, governance, and AWS cloud technologies, advising on the latest tools and standards.
About you
- 10+ years of hands-on experience in data engineering, solution design, and enterprise data architecture with deep AWS expertise and demonstrated leadership in large-scale data initiatives.
- Proven experience designing and implementing AWS data services (such as S3, Redshift, Athena, Glue, Lambda, etc.) and a solid understanding of data service design patterns.
- Expertise in building large-scale data platforms, including Data Lakehouse, Data Warehouse, Master Data Management, and Advanced Analytics systems.
- Ability to effectively communicate complex technical solutions to both technical and non-technical stakeholders.
- Experience working with multi-disciplinary teams and aligning data strategies with business objectives.
- Demonstrated expertise and hands-on proficiency in PySpark for designing, building, and optimizing large-scale batch and streaming data pipelines on AWS.
- Proficiency in workflow orchestration platforms for designing the scheduling, monitoring, and managing complex data pipelines and dependencies.
- Ability to optimize cloud costs and resource utilization in large-scale data environments without compromising performance.
- Proficiency in CI/CD-driven deployment and management of AWS data infrastructure.
- Lead, mentor, and develop data engineering teams, fostering technical excellence, knowledge sharing, and career growth within the organization.