A technology company in Marietta is seeking an experienced Data Engineer. Candidates should have 4+ years of experience with Pyspark, Python, or Scala. Strong knowledge of Google Cloud Platform and Big Query is essential. The ideal candidate will possess excellent analytical skills and the ability to work independently with minimal support.
Qualifications
4+ years of experience as Data Engineer.
Expertise in Scala or Python.
Strong ability to write complex SQL queries.
Responsibilities
Work independently with minimal support.
Perform data manipulation and analysis.
Use Spark SQL, Data Frames, and Datasets.
Skills
Pyspark
Python
Scala
GCP
Big Query
SQL
Analytical skills
Job description
Overview
Look for 4+ yrs of experience in Pyspark, Python or Scala with Spark. Good exposure to Google Cloud(Mandate)
Required Skills/Certifications
Knowledge is on GCP & Big Query mandatory
Exposure in Schemas like Rest or Graph QL will be an added advantage. Responsibilities
4+ years of experience as Data Engineer
Strong ability to write complex SQL queries for data manipulation and analysis.
Programming Language: Expertise in at least one of the following languages: Scala (highly preferred), Python
Excellent analytical and problem-solving skills. We expect engineers to work with minimal or no support.
Experience with Spark SQL, Data Frames, and Datasets o Familiarity with distributed systems concepts
Experience with big data processing tools and techniques
Cloud technologies: Experience with Google Cloud Platform (GCP), particularly Big Query (BQ) for data warehousing and analytics.