HPC - Senior Software Engineer - Linux, Bash, Apache

Erias Ventures; Maryland; On-site; USD 229,000 - 251,000; Full time

Benefits offered by this job

Above Market Hourly Pay

11% 401k with immediate vesting

Spot Bonuses for business development

Professional Development Bonuses

Company Health Coverage

Paid Time Off

Job summary

Erias Ventures is seeking a Software Engineer with strong experience in dataflow design and Spark-based analytics. You will design and optimize data ingress/egress pathways, build scalable processing, and orchestrate complex workflows using Apache Airflow.

Ideal candidates have 5–9 years SWE experience, a CS degree, and proficiency in Python/Java, SQL, and data wrangling tools. The role offers a competitive salary and comprehensive benefits, based in the United States.

Qualifications

• Master's or bachelor's degree in CS or related field with relevant SWE experience.
• 5+ years SWE experience for MS or 7+ years for BS, or 9+ years total.
• Experience with dataflow design and Spark-based processing.
• Strong Python and Java development background.
• Experience automating workflows with Airflow and data wrangling with pandas/NumPy.

Responsibilities

• Design, implement, and optimize data ingress/egress pipelines.
• Develop scalable analytics processing using Spark.
• Build and schedule workflows with Airflow DAGs and operators.

Skills

Python

Java

Bash scripting

Linux CLI

Apache Airflow

Apache Spark

SQL

Jupyter Notebook

Pandas/NumPy

Git

Education

Master's degree in Computer Science

Bachelor's degree in Computer Science

Tools

Apache Spark

Apache Airflow

Jupyter Notebook

Git

MySQL / PostgreSQL / MariaDB

Pandas

NumPy

Job description

Erias Ventures was founded to serve its customers with an entrepreneurial mindset. We value creative problem-solving, open communication, and empowering our employees to make decisions and put forth new ideas. Our staff includes technical experts working across multiple disciplines, bringing diverse perspectives to every project. We are seeking engineers who wish to grow their careers and want to become part of a technically strong and growth-oriented company focused on bringing innovative solutions to the difficult mission problems facing our customers.

Description

The Software Engineer shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing. In this role, the Software Engineer shall be responsible for designing, implementing, and optimizing data ingress/egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads.

Clearance

A current Top-Secret/SCI with polygraph security clearance (within 7 years) is required. Candidates cannot be sponsored or nominated for a government security clearance under this position.

Experience

Master's degree in Computer Science or related discipline from an accredited college or university, plus five (5) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity or bachelor's degree in Computer Science or related discipline from an accredited college or university, plus seven (7) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity or nine (9) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.

Required Skills

• Experience using the Linux CLI and Linux tools
• Experience developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Experience with Distributed Big Data processing engines including Apache Spark
• Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
• Experience using Jupyter Notebook
• Experience with data wrangling and preprocessing using tools such as pandas, NumPy
• Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
• Familiarity with data quality concepts, data validation, and anomaly detection
• Experience with Git Source Control System

Desired Skills

• Familiar with HPC Job Scheduling tools including Slurm
• Experience using the Atlassian Tool Suite (JIRA, Confluence)

Benefits

Erias Ventures provides a complete package of wealth, health, and happiness benefits. The expected salary range for this position, depending on education and years of experience is $229,000 - $251,000.

Wealth Benefits

• Above Market Hourly Pay
• 11% Roth or Traditional 401k with Immediate Vesting and Deposit
• Spot Bonuses for Assisting with Business Development and Company Growth
• Professional Development Bonuses for Certificates and Degrees

Health Benefits

• Company subsidized Medical Coverage
• 100% Company Paid Vision and Dental Coverage
• 100% Company Paid Long Term Disability, Short Term Disability, and Group Life Insurance
• Monthly Wellness Reimbursement

Happiness Benefits

• Paid Time Off with Flexible Work Schedules and Birthday Off
• Amazon Prime Membership and Monthly Internet Reimbursement
• Technology and Productivity Allowance for Equipment and Supplies
• Morale Building and Company Events to Celebrate our Successes and Build our Community
• Onboarding and Annual Swag
• Company Paid Professional Development and Training

At Erias Ventures, we are dedicated to fostering a diverse and inclusive workplace. As an equal opportunity employer, we ensure that all qualified applicants are considered for employment based on merit, without discrimination. We welcome individuals regardless of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

Referrals & Inquiries

Do you know a cleared professional seeking to advance their career? Interested in earning some extra cash? If so, refer them to us with their name and contact details, and you could be eligible for a referral bonus of up to $10,000 for each successful hire.

Not seeing the right position right now? Reach out to us, and we’ll notify you as new contracts and opportunities become available!

Please Send Referrals And Inquiries To

[e-mail]

To learn more about our company visit our webpage or LinkedIn.