Principal Data Processing Engineer

Nyla Technology Solutions; Maryland; On-site; USD 199,000 - 235,000; Full time

Benefits offered by this job

Nyla FLEX program

Paid leave options

Flexible schedule options

Health insurance 100% paid

401k matching

Professional development funds

Student loan repayment

Volunteer hours

Job summary

Nyla Technology Solutions is seeking a Software Engineer in Maryland with expert dataflow design and Spark-based processing to build scalable data pipelines for enterprise analytics.

You will design, implement, and optimize end-to-end data ingress/egress, ensuring data quality and system integrity while collaborating with security and data engineering teams. TS/SCI poly clearance is required for this role.

Qualifications

• Experience with distributed Big Data processing engines, especially Apache Spark.
• Hands-on software development with Python and Java.
• Practical experience with Apache Airflow for workflow management.
• Data manipulation with pandas/NumPy and working with Parquet/JSON/CSV/XML formats.
• Familiarity with MySQL/MariaDB/PostgreSQL for large dataset queries.
• Knowledge of data quality, automated validation, and anomaly detection.
• Linux CLI, utilities, and Bash scripting for automation.
• Git source control workflows.

Responsibilities

• Design, implement, and optimize end-to-end data ingress and egress pipelines.
• Ensure scalable, reliable processing of enterprise analytics workloads.
• Maintain data quality and system integrity across data flows.
• Collaborate with data engineering and security teams to meet requirements.

Skills

Spark

Python

Java

Airflow

Data Wrangling

SQL

Linux

Git

Education

Bachelor's degree in a related field

Master's degree in a related field

High School Diploma / GED with experience

Tools

Apache Airflow

Git

Pandas

NumPy

Jupyter

Parquet

JSON

CSV

XML

MySQL

MariaDB

PostgreSQL

Job description

We have an immediate need for a Software Engineer with extensive expertise in dataflow design, data transport mechanisms, and Apache Spark distributed processing. In this high-impact role, you will be responsible for designing, implementing, and optimizing end-to-end data ingress and egress pathways. You will ensure the efficient, scalable, and highly reliable processing of enterprise-scale analytics workloads while maintaining strict data quality and system integrity.

ACTIVE SECURITY CLEARANCE AT THE TS/SCI POLYGRAPH LEVEL IS REQUIRED.

Compensation

The annual base salary range for this role is $199,000-$235,000 (USD), which does not include discretionary bonus compensation or our comprehensive benefits package. Actual compensation offered to the successful candidate may vary from posted hiring range based upon geographic location, work experience, education, and/or skill level, among other things.

Required Skills

• Distributed Processing: Extensive experience with distributed Big Data processing engines, specifically Apache Spark.
• Software Development: Recent, hands-on software development experience using both Python and Java.
• Workflow Orchestration: Practical experience using Apache Airflow (DAG design, scheduling, operators, and sensors) for workflow management.
• Data Wrangling & Formats: Hands-on experience with data manipulation tools (pandas, NumPy, Jupyter Notebook) and working with formats including Parquet, JSON, CSV, and XML.
• SQL Technologies: Familiarity with relational database technologies (MySQL, MariaDB, PostgreSQL) for querying, joining, and aggregating large datasets.
• Data Quality: Familiarity with data quality principles, automated validation methods, and anomaly detection strategies.
• Linux & Automation: Strong operational experience with the Linux CLI, standard utilities, and writing Bash scripts for process automation.
• Version Control: Proficiency with Git source control workflows.

Education

1. Bachelor’s Degree in Data Analytics, Intelligence Studies, Computer Science, Finance/Economics, or a related discipline, PLUS 7+ years of specialized data analytics or financial intelligence experience
2. Master’s Degree in a related field, PLUS 5+ years of specialized analytical experience
3. High School Diploma / GED, PLUS 9+ years of hands‑on intelligence analysis, financial tracking, and data discovery experience in lieu of a degree.

Desired Skills

• HPC Scheduling: Familiarity with High-Performance Computing (HPC) job scheduling tools such as Slurm.
• Agile Tooling: Practical experience using the Atlassian Tool Suite (Jira, Confluence) for collaborative tracking and documentation.

About Nyla Technology Solutions

Nyla Technology Solutions delivers exceptional Artificial Intelligence (AI), Data Science, and Software Engineering services for the U.S. Government. Nyla embraces a forward‑thinking and bold approach at every turn, earning us a solid reputation of technical trendsetters within the industry. We have a passion for developing solutions that have a quick and immediate impact on mission. Headquartered in Columbia, Maryland, our customers love how we tackle their most challenging problems and get things done.

If you have the unique experience and expertise we are seeking, along with the desire and determination to invest your time and energy as a part of Nyla’s team, we would love to hear from you.

Nyla FLEX Benefit Program

• Nyla FLEX benefit program is designed to offer you flexibility in the 3 biggest areas of your life: your pay, your leave, and your schedule.
• PAY - Nyla starts with 4 weeks of Annual Leave plus 11 holidays and an additional day of Annual Leave for each year you’re at the company. You have the flexibility to cash out your annual leave hours, opt out of other Nyla benefits, and/or arrange for additional hours on contract* (over 40 hrs/week). There’s even an option to earn 1.3 times your hourly rate once you work over 1880 hours on contract!
• LEAVE - Want to spend more time with the family? Want more time to travel the world? You can BUY additional annual leave for a total of 6 weeks of annual leave. That’s up to 240 hours of leave plus 11 holidays! That’s not even including paid anniversary leave!
• SCHEDULE - Does the traditional 40-hour workweek no longer fit your lifestyle? With Nyla FLEX, you have the freedom to scale down to 30-32 hours while still enjoying the top‑notch Nyla benefits you know and love. It's flexibility that works for you without compromising the perks!
• WHAT ABOUT OTHER BENEFITS? Nyla’s health care (medical, dental, and vision) is 100% covered by the company. We provide 10% 401k matching - with full vesting day 1! Our Professional Development offers $5,000 per year to be used towards fees, tuition, or time off for your continued growth. We even have a student loan repayment program and we provide 8 hours of volunteering annually so you can support your community, making your world a better place.

Nyla is an equal opportunity employer.