Data Engineer (Mid-Level) Washington, D.C. · On-site $142,000 to $158,000 per year →

Beautiful Majestic Dolphin LLC

Washington (District of Columbia)

On-site

USD 142,000 - 158,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Beautiful Majestic Dolphin LLC, a software company specializing in cybersecurity, AI infrastructure, and data systems, seeks a mid-level data engineer to turn messy client data into reliable pipelines. This hands-on, client-facing role sits with the client to gather needs and build robust ingestion solutions.

You will design batch and API-driven pipelines, work with unstructured sources like PDFs and scanned forms, and implement AI-assisted development while documenting requirements and coding

Qualifications

  • 5+ years of hands-on data engineering experience.
  • Proficiency with at least one orchestration tool (Airflow, Dagster, Prefect, Mage, AWS Glue or Azure Data Factory).
  • Proficiency in Python and SQL; ability to write efficient queries and reason about performance.
  • Experience with Docker and Git.
  • Familiarity with pub/sub and messaging systems (Kafka, RabbitMQ, AWS SNS/SQS, Google Pub/Sub).
  • Comfort with messy data and ability to structure it for downstream users.
  • Ability to write clear requirements, READMEs, and prompts for coding agents.
  • Strong communication and client-facing skills.

Responsibilities

  • Design, build, and maintain batch and API-driven ingestion pipelines.
  • Build event-driven and streaming flows using pub/sub and messaging services.
  • Extract and structure data from PDFs, scanned forms, documents, and free text.
  • Model, clean, validate, and load data for downstream users.
  • Write clear requirements, technical docs in Markdown, and prompts for coding agents.
  • Use AI-assisted development to move faster while reviewing output rigorously.
  • Share best practices with teammates to improve team velocity.

Skills

Python
SQL
Docker
Git
Messaging
Data modeling
Communication
Documentation
Unstructured data
Airflow

Tools

Airflow
Dagster
Prefect
Mage
AWS Glue
Azure Data Factory
Kafka
pyspark

Job description

About the role

We're hiring a mid-level data engineer to build pipelines that turn a client's messy data into something they can actually trust and use.

Beautiful Majestic Dolphin is a software company working in cybersecurity, AI infrastructure, and data systems, much of it for government and national security customers. Yes, the name is unusual. The work is not. We take it seriously, and we have fun doing it.

This is a hands-on, client-facing role. You'll sit with the client, hear what they need (including the parts they haven't figured out how to say yet), and then build it. Some of the data will arrive clean through APIs. A lot of it won't. Expect PDFs full of orders, scanned documents, inconsistent spreadsheets, and text that needs real structure before it's useful.

What you'll do
  • Work directly with the client, in person and in real time, to understand their data, their workflows, and what "done" actually looks like
  • Design, build, and maintain batch and API-driven ingestion pipelines
  • Build event-driven and streaming flows using pub/sub and message queue services
  • Extract and structure data from unstructured sources: PDFs, scanned forms, documents, and free text
  • Model, clean, validate, and load data so downstream users can rely on it
  • Write clear requirements, technical docs in Markdown, and prompts and specs for coding agents
  • Use AI-assisted development to move faster, and review that output with the same rigor you'd apply to anyone else's code
  • Share what works with your teammates, so the whole team gets faster, not just you
What you bring

Required

  • 5+ years of hands-on data engineering experience
  • Production experience with at least one orchestration or integration tool, such as Airflow, Dagster, Prefect, Mage, AWS Glue, or Azure Data Factory
  • Proficiency in Python and SQL. You can write a gnarly query from scratch and explain why it's fast (or why it isn't)
  • Solid working knowledge of Docker and Git
  • Working knowledge of pub/sub and messaging systems, such as Kafka, RabbitMQ, AWS SNS/SQS, or Google Cloud Pub/Sub
  • Comfort with messy data, and the organizational habits to keep it from becoming a mess for everyone else
  • The ability to write a clear requirements doc, a useful README, and a prompt a coding agent can actually execute
  • Strong communication and listening skills. You'll be talking to the client every day

Nice to have

  • Experience extracting structured data from PDFs and scanned documents, including OCR
  • Experience with a cloud data stack on AWS or Azure
  • Exposure to machine learning workflows, or to preparing data for ML and LLM use
  • Experience working with government or regulated-industry clients
Python libraries you should know

You don't need every library below, but you should have real experience with a solid share of them and be able to pick up the rest quickly.

Data wrangling

  • pandas
  • Polars
  • NumPy
  • PyArrow

Databases and SQL

  • SQLAlchemy
  • psycopg
  • DuckDB

APIs and ingestion

  • requests
  • httpx
  • aiohttp

Cloud

  • boto3 (AWS)
  • Azure SDK for Python

Validation and schemas

  • Pydantic
  • Great Expectations
  • Pandera

Messaging

  • confluent-kafka or kafka-python
  • pika (RabbitMQ)

Distributed processing

  • PySpark
  • Dask

PDFs and documents

  • pdfplumber
  • PyMuPDF
  • Camelot
  • pytesseract

Text and NLP

  • spaCy
  • regex
  • NLTK

Machine learning

  • scikit-learn
  • PyTorch
  • Hugging Face Transformers

Testing

  • pytest
How we use AI

We love coding agents, and we're not shy about it. They make us faster and more efficient, and this role is built around using them well.

If you already work with voice-to-text tools like Wispr Flow, or hand off code to agents and review what comes back, you'll be right at home. You'll have access to compute for deploying your own agents and managed agents, and you get to decide how to solve the problem.

That said, we're not pure AI maximalists. We pick the right tool for the job. If an agent you built is too error-prone, stop using it and write the thing yourself. Good judgment about when not to automate matters as much as knowing how to automate.

We also want you to improve the way the team works. If you find a better workflow, show us.

Why on-site, and where you'll be

This role is in the office five days a week. We know a lot of people want remote work, and we get it. But some problems get solved fastest with a whiteboard, the client in the room, and a lot of face time. This is one of those roles.

Since we're asking you to come in, we made sure the office is somewhere you'll actually want to be:

  • Right on the Metro in Washington, D.C.
  • A comfortable, modern office
  • A gym downstairs
  • Plenty of restaurants within walking distance
Compensation

The salary range for this role in the Washington, D.C., metro area is $142,000 to $158,000 per year. Where you land in that range depends on your experience and skills.

Eligibility

A lot of our work is with the government, but this role does not require a security clearance. Because this role supports a federal contract that requires it, you must be a U.S. citizen. We're not able to sponsor visas at this time.

Who we are

BMD is a unique company, and we're still a serious one. We like to have fun, we skip the aggressive corporate nonsense, and we care a lot about doing the work well.

We're a diverse workplace, and we celebrate it. People from different backgrounds make better teams and better software. That's why we don't have education requirements or background requirements. Everyone's path into software and data engineering is different. It doesn't matter where you started. It matters where you land.

The only requirement is that you're proficient at the job. If that's you, we'd love to hear from you.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Full-Stack Software Engineer Washington, D.C. · On-site $178,000 to $192,000 per year →
Senior Full-Stack Software Engineer Washington, D.C. · On-site $178,000 to $192,000 per year →

Beautiful Majestic Dolphin LLC • Washington

On-site
USD 178,000 - 192,000
Senior Software Engineer (DevSecOps & Cloud) Washington, D.C. · On-site $178,000 to $192,000 per year →
Senior Software Engineer (DevSecOps & Cloud) Washington, D.C. · On-site $178,000 to $192,000 per year →

Beautiful Majestic Dolphin LLC • Washington

On-site
USD 178,000 - 192,000
Right on the Metro in Washington, D.C.
A comfortable, modern office
A gym downstairs
+2
Senior Intelligence Analyst Washington, D.C. · On-site $126,000 to $140,000 per year →
Senior Intelligence Analyst Washington, D.C. · On-site $126,000 to $140,000 per year →

Beautiful Majestic Dolphin LLC • Washington

On-site
USD 126,000 - 140,000
Python Developer Engineer
Python Developer Engineer

Materials Data Management • Indianapolis (IN)

Hybrid
USD 110,000 - 140,000
Competitive salary
Health insurance
Dental insurance
+5
Data Engineer (AI-ML Data Systems)
Data Engineer (AI-ML Data Systems)

Pantheon Data • Reston (VA)

Remote
USD 110,000 - 190,000
SmartBenefits
Tuition assistance
SmarTrip pre-tax
Python Developer Engineer II
Python Developer Engineer II

Materials Data Management • Indianapolis (IN)

Hybrid
USD 90,000 - 140,000
Competitive salary
Health insurance
Dental insurance
+10
Senior Full Stack Developer - AI First
Senior Full Stack Developer - AI First

Pantheon Data • United States

Hybrid
USD 145,000 - 200,000
SmartBenefits program
Tuition assistance
Data Engineering Leader (AI-First) — Remote
Data Engineering Leader (AI-First) — Remote

IVANS Insurance Solutions • United States

Hybrid
USD 135,000 - 185,000
Medical, Dental, and Vision Coverage
Holiday and Vacation Time
Health & Wellness Days
+1
Data Engineer I
Data Engineer I

Duly Health and Care • Downers Grove (IL)

On-site
USD 65,000 - 85,000
Medical, dental, and vision benefits
Tuition reimbursement
Immediate 401(k) match
+1
Sr. Manager, Data Engineering
Sr. Manager, Data Engineering

Applied Systems • United States

Remote
USD 135,000 - 185,000
Medical, Dental, Vision Coverage
Holiday and Vacation Time
Health & Wellness Days
+1