Data Engineer

Speria

Dunwoody (GA)

On-site

USD 90,000 - 130,000

Full time

5 days ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Speria MTech in Atlanta, GA, is seeking a Data Engineer to design, build, and maintain scalable data pipelines that support machine learning, optimization, and operational reporting. You will transform data from sensors and enterprise systems into high-quality datasets using batch and near real-time processing.

The ideal candidate has 2–4 years of data engineering experience, hands-on Spark and Azure/Databricks experience, and a passion for data quality, cost efficiency, and collaboration with

Qualifications

  • Bachelor’s degree in CS, engineering, or related field.
  • 2–4 years of data engineering or data systems experience.
  • Experience with Apache Spark and large-scale data processing.
  • Experience building batch pipelines in production.
  • Experience with cloud platforms (Azure, Databricks).
  • SQL and Apache Spark expertise.

Responsibilities

  • Design and build batch and near real-time data pipelines.
  • Develop transformation workflows for high-quality datasets.
  • Ensure data quality, integrity, and reliability.
  • Collaborate with MLEs for feature data readiness.
  • Implement data monitoring and anomaly detection.
  • Support synthetic data for testing and simulation.
  • Optimize pipelines to remove redundancy and reduce costs.
  • Improve performance, scalability, and efficiency.
  • Maintain pipeline reliability and documentation.

Skills

Batch data pipelines
SQL
Apache Spark
Data quality monitoring
Collaboration with ML engineers

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Azure
Databricks
Event Hub
Cosmos DB
Functions

Job description

At Speria MTech, our company mission is to increase yield in protein production to help feed the growing world population without compromising animal welfare or damaging the planet. We aim to create software that delivers real-time data to the entire supply chain that allows producers to get better insight into what is happening on their farms and what they can do to responsibly improve production. Speria MTech is the industry-leading provider for Live Animal Protein Production Performance Management Tools. For over 30 years, Speria MTech has provided cutting-edge enterprise data solutions for all aspects of the live poultry operations cycle. We provide our customers with solutions in Business Intelligence, Live Production Accounting, Production Planning, and Remote Data Management—all through an integrated system. Our applications can currently be found running businesses on six continents in over 50 countries. Speria MTech has built an international reputation for equipping our customers with the power to utilize comprehensive data to maximize profitability. With over 300 employees globally, Speria MTech currently has main offices in Mexico, United States, and Brazil, with additional resources in key markets around the world. Speria MTech’s headquarters is based in Atlanta, Georgia and has approximately 90 team members in a casual, collaborative environment. Our work culture here is based on a passion for helping our clients feed the world, resulting in a flexible and rewarding atmosphere. We pride ourselves for having a working atmosphere that encourages collaboration, exceptional development tooling, training, and ongoing opportunities to work with senior and executive management.

About the Role

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team at Speria MTech. The ideal candidate will play a crucial role in designing, building, and maintaining scalable data pipelines and platforms that support machine learning, optimization, and operational reporting systems. This role focuses on transforming data from sensors, controllers, and enterprise systems into high-quality datasets using primarily batch and scheduled processing workflows, with support for evolving near real-time use cases. We seek a solution-oriented individual who can provide answers rather than just identify problems. Embracing continuous change is key, as innovation and improvement are integral to Speria MTech's culture. This person should have a service-minded attitude, demonstrating a passion for enhancing the work of others and simplifying processes for stakeholders.

Responsibilities
  • Design and build batch and near real-time data pipelines
  • Develop transformation workflows for high-quality datasets
  • Ensure data quality, integrity, and reliability
  • Collaborate with MLEs for feature data readiness
  • Implement data monitoring and anomaly detection
  • Support synthetic data for testing and simulation
  • Optimize pipelines to remove redundancy and reduce costs
  • Improve performance, scalability, and efficiency
  • Maintain pipeline reliability and documentation
Qualifications
  • Bachelor’s degree in Computer Science, Engineering, or related field
  • 2–4 years experience in data engineering or data systems
  • Experience with Apache Spark and large-scale data processing
  • Experience building batch pipelines in production
  • Experience with cloud platforms (e.g., Azure, Databricks)
  • SQL and Apache Spark expertise
Preferred Skills
  • Experience with batch and scheduled pipelines
  • Experience optimizing pipeline performance and cost
  • Familiarity with Azure ecosystem (Event Hub, Cosmos DB, Functions)
  • Experience with data quality monitoring and validation
  • Strong problem-solving and collaboration skills

MUST BE IN ATLANTA GA AND BEABLE TO COME TO THE OFFICE AT LEAST 2 DAYS A WEEK!

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Speria • Atlanta (GA)

On-site
USD 95,000 - 150,000
Machine Learning Engineer
Machine Learning Engineer

Speria • Atlanta (GA)

On-site
USD 120,000 - 160,000
Data Engineer for Real-Time Farm Data Platforms
Data Engineer for Real-Time Farm Data Platforms

Speria • Atlanta (GA)

On-site
USD 95,000 - 150,000
Sr. Data Architect
Sr. Data Architect

Gilder Search Group • Dunwoody (GA)

Hybrid
USD 119,000 - 140,000
Senior Data Architect
Senior Data Architect

MTech Systems • Dunwoody (GA)

On-site
USD 130,000 - 160,000
Flexible work environment
Career development programs
Collaborative culture
Machine Learning Operations Engineer
Machine Learning Operations Engineer

Speria • Atlanta (GA)

On-site
USD 120,000 - 180,000
Data Engineer (in person)
Data Engineer (in person)

SEP • Westfield (IN)

On-site
USD 90,000 - 110,000
Flexible work schedules
Opportunities to learn and develop
Community of friendly peers
+1
Data Engineer - Real-Time Pipelines, Atlanta Onsite
Data Engineer - Real-Time Pipelines, Atlanta Onsite

Speria • Dunwoody (GA)

On-site
USD 90,000 - 130,000
Senior Engineering Manager
Senior Engineering Manager

MTech Systems • Dunwoody (GA)

Hybrid
USD 130,000 - 160,000
Flexible work environment
Training programs
Access to senior management
Data Engineer
Data Engineer

Compunnel, Inc. • Norfolk (VA)

Hybrid
USD 110,000 - 150,000