GCP Data Engineer - DBA

TechDigital Group; Parsippany-Troy Hills (NJ); On-site; USD 110,000 - 140,000; Full time

Job summary

A leading tech firm located in New Jersey is looking for a skilled GCP Data Engineer with DBA experience. The successful candidate will design and maintain a Data Lake architecture using GCP services like BigQuery and AlloyDB. Responsibilities include optimizing data models, administering database instances, and implementing data governance policies. This role requires collaboration with various teams and automation of data pipeline tasks, ensuring data quality and compliance standards are met.

Qualifications

• Strong experience with GCP services, specifically BigQuery and AlloyDB.
• Proven abilities in designing and maintaining Data Lake architectures.
• Expertise in database administration and governance policies.

Responsibilities

• Design and maintain Data Lake architecture using GCP services.
• Administer and ensure performance of AlloyDB instances.
• Implement data governance policies for security and compliance.
• Collaborate with teams to define data requirements and deliver solutions.
• Automate database tasks and set up monitoring/alerting.

Skills

GCP services

BigQuery

Data Lake architecture

ETL/ELT processes

AlloyDB

Data governance

Dataflow

Cloud Composer

Data cataloging

Job description

GCP Data Engineer with DBA

Roles and Responsibilities

Data Engineering

• Design, develop, and maintain a Data Lake architecture using GCP services, particularly BigQuery and AlloyDB.
• Build robust data pipelines for ETL/ELT processes using tools like Dataflow, Cloud Composer, or other GCP services.
• Integrate data from various sources (structured and unstructured) into the Data Lake, ensuring consistency and reliability.
• Optimize BigQuery data models and queries for high performance and scalability.

Database Administration

• Administer and maintain AlloyDB instances, ensuring high availability, security, and performance.
• Perform backup, recovery, and disaster recovery planning for AlloyDB and BigQuery.
• Monitor and optimize database performance, query execution, and resource utilization.
• Manage schema design, indexing, partitioning, and clustering to enhance database efficiency.
• Apply database governance and compliance best practices to ensure data security and regulatory adherence.

Data Governance and Management

• Implement data governance policies, including role-based access controls, data masking, and encryption.
• Manage metadata, data cataloging, and data lineage tracking to support audit and compliance requirements.
• Conduct regular health checks on the Data Lake to ensure data quality and integrity.

Collaboration and Reporting

• Collaborate with data scientists, analysts, and application developers to define data requirements and deliver solutions.
• Design and deploy real-time and batch data analytics solutions using GCP\'s BigQuery and Looker.
• Provide documentation and training to teams on using Data Lake features effectively.

Automation and Monitoring

• Automate database and data pipeline tasks.
• Set up monitoring and alerting for BigQuery and AlloyDB using Cloud Monitoring and Cloud Logging.
• Resolve incidents and troubleshoot performance issues in real time.