Data Engineer, Data Quality and Governance(VP)

We are looking for a Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud-based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects, and business leadership to develop and execute the technology product roadmap in driving Data Governance policy implementation.

What you will be responsible for

1. End-to-end Cloud Data Lake design & development including data ingestion, data modeling, and data distribution.
2. Build data integrations and hand-offs between on-premises and cloud-based systems.
3. Develop and implement cloud infrastructure to support current and future business needs.
4. Participate in technical design, application build, configuration, unit testing, and production deployment.
5. Ensure all cloud solutions exhibit high levels of cost efficiency, performance, security, scalability, and reliability.
6. Manage offshore and onshore teams spread globally.

What we value

These skills will help you succeed in this role:

• Full stack cloud developer skills: Data (Delta Lake/Databricks), PL/SQL, Java/J2EE, React, CI/CD pipeline, and release management.
• Strong experience in Python, Scala/PySpark, PERL/scripting.
• Experience as a Data Engineer for Cloud Data Lake activities, especially in high-volume data processing frameworks, ETL development using distributed computing frameworks like Apache Spark, Hadoop, Hive.
• Experience optimizing database performance, scalability, data security, and compliance.
• Experience with event-based, micro-batch, and batched high-volume, high-velocity transaction and data processing systems.
• Proficiency with CI/CD and DevOps practices.

Education & Preferred Qualifications

• Bachelor’s or Master’s Degree in Computer Science, Engineering, Math, or equivalent experience.
• 12+ years of professional software design and development experience.
• Strong analytical skills with the ability to quickly analyze and work with information independently.
• Proven ability to develop and collaborate across cross-functional processes and project timelines.
• Excellent follow-through, attention to detail, and time management skills.
• Ability to manage multiple tasks in a high-pressure, deadline-driven environment.

State Street's Speak Up Line