A data solutions company is seeking a skilled data engineer to work onsite in Iselin, NJ for three days a week. The ideal candidate must have strong skills in Python, SQL, and Spark, along with experience in Big Data tools including RDS, Linux, Hive, and Kafka. This contract position offers an opportunity for growth to a permanent role, focusing on developing data solutions and quality checks.
Qualifications
Experience with Python and SQL is a must.
Familiarity with RDS is mandatory.
Proficiency in Spark is essential.
Responsibilities
Develop data control checks for data quality assurance.
Interact with data using SQL language.
Design new APIs based on requirements.
Skills
Python
SQL
Spark
API design
Big Data platforms/tools
Tools
RDS
Linux
HDFS
Hive
Hortonworks
Scala
Java
Kafka
Job description
Location: Iselin, NJ (3 Days Onsite a Week)
Contract: 6-24 months to perm
Must have: Python, RDS (must have), Spark, and SQL
Nice to have: Pyspark
Experience with Big Data platforms/tools (Linux, HDFS, Hive, Hortonworks, Spark, Scala, Python, Java, Kafka, etc.)
Experience with API’s, reading from and/or designing new