Senior Software Engineer, Dataflow & Spark (TS/SCI)

Erias Ventures; Maryland; On-site; USD 229,000 - 251,000; Full time

Benefits offered by this job

Above Market Hourly Pay

11% 401k with immediate vesting

Spot Bonuses for business development

Professional Development Bonuses

Company Health Coverage

Paid Time Off

Job summary

Erias Ventures is seeking a Software Engineer with strong experience in dataflow design and Spark-based analytics. You will design and optimize data ingress/egress pathways, build scalable processing, and orchestrate complex workflows using Apache Airflow.

Ideal candidates have 5–9 years SWE experience, a CS degree, and proficiency in Python/Java, SQL, and data wrangling tools. The role offers a competitive salary and comprehensive benefits, based in the United States.

Qualifications

• Master's or bachelor's degree in CS or related field with relevant SWE experience.
• 5+ years SWE experience for MS or 7+ years for BS, or 9+ years total.
• Experience with dataflow design and Spark-based processing.
• Strong Python and Java development background.
• Experience automating workflows with Airflow and data wrangling with pandas/NumPy.

Responsibilities

• Design, implement, and optimize data ingress/egress pipelines.
• Develop scalable analytics processing using Spark.
• Build and schedule workflows with Airflow DAGs and operators.

Skills

Python

Java

Bash scripting

Linux CLI

Apache Airflow

Apache Spark

SQL

Jupyter Notebook

Pandas/NumPy

Git

Education

Master's degree in Computer Science

Bachelor's degree in Computer Science

Tools

Apache Spark

Apache Airflow

Jupyter Notebook

Git

MySQL / PostgreSQL / MariaDB

Pandas

NumPy

Job description

Erias Ventures is seeking a Software Engineer with strong experience in dataflow design and Spark-based analytics. You will design and optimize data ingress/egress pathways, build scalable processing, and orchestrate complex workflows using Apache Airflow.

Ideal candidates have 5–9 years SWE experience, a CS degree, and proficiency in Python/Java, SQL, and data wrangling tools. The role offers a competitive salary and comprehensive benefits, based in the United States.