Manager Data Engineer
This role requires working closely with others, frequently in a matrixed environment, and with little supervision. As a Principal Data Engineer/Architect level, the role requires “self‑starters” who are proficient in problem solving and capable of bringing clarity to complex situations. It requires contributing to strategic technical direction and system architecture approaches for individual projects and platform migrations. The culture of the organization places an emphasis on teamwork, so social and interpersonal skills are equally important as technical capability. Due to the emerging and fast‑evolving nature of Google Cloud Platform (GCP) technology and practice, the position requires that one stay well‑informed of technological advancements and be proficient at putting new innovations into effective practice.
Responsible for leading development efforts, driving adoption and appropriate use of technology and consulting on internal and external development efforts to ensure code quality and sound architecture. This position assumes the responsibility for project success and the upward development of team members’ technical skills. They are the development team's point of contact that must interface with business partners of varying roles ranging from technical staff to executive leadership. In addition, the candidate will have a history of increasing responsibility in a small multi‑role team. The position requires a candidate who can analyze business requirements, perform design tasks, construct, test, and implement cutting‑edge technical data solutions with minimal supervision.
As a Principal Data Engineer/Architect, you will work closely with all team members to create a modular, scalable solution that addresses current needs, but will also serve as a foundation for future success. The position will be critical in building the team’s engineering practices in test‑driven development, continuous integration, and automated deployment and is a hands‑on team member who actively coaches the team to solve complex problems. She / he will be responsible for the design, development, performance, and support of the GCP Platform components.
This candidate will have a record of accomplishment of participation in successful projects in a fast‑paced, mixed team (consultant and employee) environment. In addition, the applicant must be willing to train and mentor other developers to prepare them for assuming their responsibilities.
As the Principal Engineer, you will be responsible for architecting and delivering next‑generation GenAI/LLM‑based solutions that will revolutionize the software development lifecycle. You will dive into the development process, from writing code using common developer tools, through the build, test, deploy process, and iterating with CI/CD systems. You will build the technical vision and roadmap for how we can evolve these tools and accelerate software development and delivery for all Google Cloud Platform users.
Our Purpose
Applied to this position, your skills will help transform healthcare through technology and solutions that dramatically improve patient care and business operations.
Major Responsibilities
- Develop and lead design, build, and support of GCP-based ecosystems for enterprise‑wide analysis of structured, semi‑structured and unstructured data.
- Bring new data sources into GCP, transform and load to databases.
- Provide technical leadership across GCP teams to lead the design and delivery of next‑generation GenAI/LLM‑based solutions.
- Identify, design, and implement internal process improvements, automate manual processes, optimize data delivery, and re‑design infrastructure for greater scalability.
- Develop and review data management plans, architecture plans, data transfer plans, and data security and privacy plans, including event monitoring and auditing guidelines, to ensure that systems meet security and technical requirements.
- Develop and review standard operating procedures to meet high standards for data organization, quality, and security.
- Provide leadership in developing standards and best practices.
- Build analytics tools to provide actionable insights into operational efficiency, service delivery, and policy evaluation.
- Deliver consistent and reliable processes and high‑quality output on independent and team projects.
- Collaborate with team members to successfully execute development initiatives using Agile practices and principles.
- Participate in large‑scale development projects involving multiple areas outside of core teams.
- Design fit‑for‑purpose products to ensure alignment with customer strategic plans and technology road maps.
- Share knowledge and experience to contribute to growth of overall team capabilities.
- Participate in the deployment, change, configuration, management, administration and maintenance of deployment process and systems.
- Work closely with management, architects, and other teams to develop and implement projects.
- Actively participate in technical group discussions and adopt any innovative technologies to improve development and operations.
- Rapidly develop prototypes and deliver just‑in‑time solutions.
- Gather requirements, designs, construct, and deliver solutions with minimal team interaction.
- Work in an environment with rapidly changing business requirements and priorities.
- Demonstrate deep understanding and act as a leader in CI/CD automation pipeline.
- Collaborate with Data Scientists, business, and IT leaders throughout the company to understand Cloud/Big Data needs and use cases.
- Lead a high‑performing team to develop, construct, test and maintain sound, secure data architectures that meet business needs.
- Act as a team‑oriented specialist who works collaboratively with business leaders, project managers, and across technical teams to build the right thing.
- A strategic thinker who improves the functionality and value of clinical systems.
Core Competencies
- Communication and interpersonal skills
- Problem‑solving and critical thinking skills
- Understand strategic imperatives
- Technology & business knowledge
Education & Experience
- Bachelor’s degree in computer science or related field
- Master’s degree in computer science or related field
- 5+ years of experience in Data Engineering
- 1+ year(s) of experience in Healthcare
- 10+ years of experience in Information Technology
- Travel Required
Knowledge, Skills, Abilities, Behaviors
- Strong understanding of best practices and standards for GCP application design and implementation.
- Three+ years of hands‑on experience with GCP platform and experience with many of the following components:
- GCS, Cloud Run, Cloud Functions
- Bigtable, Cloud SQL
- Kafka, Pub/Sub
- Python, Golang, Spark, Scala or Java
- BigQuery, Dataflow, Data Fusion
- GKE, CI/CD and Logging & Monitoring
- Understanding of Lambda Design Architectures and Real‑Time Streaming
- Experience with Unstructured Data, Real‑Time Streaming with GCP
- Ability to multitask and balance competing priorities.
- Requires strong practical experience in agile application development, file systems management, and DevOps discipline and practice using short‑cycle iterations to deliver continuous business value.
- Knowledge of all facets of GCP ecosystem development including ideation, design, implementation, tuning, and operational support.
- Ability to define and utilize best practice techniques and to impose order in a fast‑changing environment. Must have strong critical thinking skills.
- Strong verbal, written, and interpersonal skills, including desire to work within a highly matrixed, collaborative environment.
- Could also have:
- Experience in Healthcare Domain
- Experience in Patient Data
- Experience with Natural Language Processing (NLP)
Hardware / Operating Systems
- Linux
- UNIX
- GCP
- Distributed, highly scalable processing environments
Databases
- NoSQL, Hbase, Cassandra, MongoDB, Cosmos, In‑memory, Columnar, and other emerging technologies
- Java, Python, Scala, R
- Build systems – TFS, GitHub
- Ability to integrate tools outside the core GCP ecosystem
Certifications
- GCP Cloud Professional Data Engineer
- GCP Cloud Professional Data Architect
Physical Demands / Working Conditions
- Prolonged sitting or standing at computer workstations, including use of mouse, keyboard, and monitor.
- Requires the ability to provide after‑hours support.