Python / Pyspark Developer

Cloud Hybrid Technologies, LLC; Dallas (TX); On-site; USD 90,000 - 120,000; Full time

Job summary

A leading tech company in Dallas, Texas, is looking for an experienced Big Data Engineer with over 3 years in the industry. Candidates should have strong programming skills in Python, pyspark, and Scala, and experience with big data technologies, including Hadoop, SQL, and NoSQL. The role emphasizes collaboration in key technical decisions and requires knowledge of streaming services such as Kinesis and Kafka. This position supports a diverse work environment for all candidates.

Qualifications

• 3+ years of industry experience, with 2+ years in big data.
• Strong programming experience with Python, pyspark, and Scala.
• Experience with big data streaming services.
• Experience with NoSQL data stores.
• Knowledge of Hadoop and big data frameworks.

Skills

Python

pyspark

Scala

NoSQL

SQL

Tools

HBase

DynamoDB

Hadoop

Spark

Hive

Kinesis

Kafka

Job description

3+ years of industry experience, 2+ years of relevant big data experience.

Strong programming experience, Python , pyspark , Scala preferred.

Experience working with Big Data streaming services such as Kinesis, Kafka, etc.

Experience working with NoSQL data stores such as HBase, DynamoDB, etc.

Experience working with Hadoop and Big Data processing frameworks (Spark, Hive, Nifi, Spark-Streaming, Flink, etc.)

Experience with SQL and SQL Analytical functions, experience participating in key business, architectural and technical decisions.

Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract