Data Engineer - GCP

A2C; Alpharetta (GA); Hybrid; USD 80,000 - 120,000; Full time

Job summary

This exciting contract opportunity invites a skilled Data Engineer to join a forward-thinking company in Alpharetta, GA. You will play a pivotal role in designing and executing vital data projects, focusing on re-platforming data services and delivering real-time streaming capabilities. With your expertise in Python and SQL, you will enhance data processing systems and collaborate with teams to optimize data architecture. This is a fantastic chance to be part of an innovative environment that values intellectual curiosity and solution-oriented approaches, providing you with the platform to advance your career in the data analytics field.

Qualifications

• 5+ years in data and analytics solutions with a focus on data modeling.
• Expertise in Python and SQL for data processing and architecture.
• Experience with cloud-native services and CI/CD pipelines.

Responsibilities

• Design and execute projects for data services on Cloud and on-prem.
• Build scalable ETL pipelines and enhance data processing efficiency.
• Collaborate with teams to optimize data architecture and solutions.

Skills

Python

SQL

Data Modeling

Data Pipeline Architecture

Cloud Services

Agile Methodologies

Critical Thinking

ETL Pipelines

Data Processing Optimization

Education

Bachelor's degree in CS, Engineering, Math, or related field

Tools

GCP (BigQuery, DataFlow, DataStream)

Azure DevOps

Terraform

Oracle

SQL Server

NoSQL

Spark

Job description

Get AI-powered advice on this job and more exclusive features.

Technical Recruiter | Relationship Builder | Trustworthy | Engaging

Exciting contract opportunity for a Data Engineer in Alpharetta, GA. In this role, you will work 3 days/week in the office (Monday, Tuesday, Thursday). As a Data Engineer, you will have the opportunity to design and execute vital projects such as re-platforming data services on Cloud and on-premises, and delivering real-time streaming capabilities to business applications. You should have a clear point of view on data processing optimization, data modeling, data pipeline architecture, and data SLA management. Our client’s mission is to design & implement a data and analytics platform/infrastructure that enables a future-state analytics lifecycle, data monetization opportunities, data acquisition, analysis & feature engineering, model training, impact analysis, reporting, predictive and quantitative analysis, & monitoring.

What You Get to Do:

• Be intellectually curious, solution-oriented, and eager to learn new tools and techniques.
• Design and execute projects such as re-platforming data services on Cloud and on-prem, and delivering real-time streaming capabilities.
• Provide a clear point of view on data processing, modeling, pipeline architecture, and SLA management.
• Ensure the quality, usability, and performance of solutions.
• Lead design sessions and code reviews to elevate engineering quality.
• Design and develop data foundations on cloud platforms using GCP tools like BigQuery, Cloud Storage, DataFlow, DataStream, and others.
• Build scalable ETL pipelines using Python.
• Perform multi-level data curation and modeling.
• Design data architecture and build CI/CD pipelines using Azure DevOps and Terraform.
• Enhance the efficiency of data processing systems.
• Collaborate with architecture teams to optimize data architecture.
• Analyze data to evaluate ML model strengths and weaknesses.
• Translate complex business problems into data solutions that drive value.
• Advance reporting, analytics skills, and data literacy across the organization.
• Develop a certified vs. self-service analytics framework.
• Work with RDMS (Oracle, SQL Server), NoSQL, and messaging systems.
• Possess extensive Python coding skills with understanding of data modeling.

What You Bring to the Table:

• Bachelor’s degree in CS, Engineering, Math, or related field, or equivalent experience.
• 5+ years in data and analytics solutions, with 4+ years in data modeling and architecture.
• Expertise in Python and SQL.
• Experience with Agile or Scrum methodologies.
• Strong critical thinking skills.
• Experience with cloud-native data processing and storage services.
• Knowledge of data pipeline tools like Dataflow, DataForm, Cloud Run, DataStream, and CI/CD pipelines.
• Understanding of security tools like Secret Manager and Cloud IAM.
• Experience with distributed processing frameworks like Spark.
• Strong database and data modeling knowledge.
• Ability to adapt to evolving technologies and explain technical concepts clearly.

Technical Skills:

• Must Have: Python and SQL expertise.

Extra Skills:

• GCP – Professional Data Engineer Certification.
• Experience documenting development processes.
• Managing data collection and providing insights to management.

Seniority level

• Not Applicable

Employment type

• Contract

Job function

• Consulting, Engineering, and IT

Industries

• IT Services and Consulting