Software Engineer ID45371

AgileEngine; Campinas; Híbrido; BRL 240 000 - 360 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Professional growth opportunities

Competitive compensation

Flextime

Exciting projects

Resumo da oferta

A leading software development company in Brazil is seeking a Senior Software Engineer specializing in Data Engineering to create cutting-edge technology. This role involves designing robust data pipelines and tackling complex challenges using modern tools, including Java and K8S. The ideal candidate should have at least 3 years of experience in software engineering, particularly in data pipeline development. Along with a supportive culture, the position offers competitive compensation, professional growth opportunities, and flexible work arrangements.

Qualificações

• 3+ years of experience with Java.
• Experience in data engineering and pipeline development.
• Strong software engineering foundations.
• Proficient SQL skills and experience with Clickhouse or similar DBs.
• Experience with monitoring systems (Prometheus, Grafana, etc.).
• Strong OO design and software engineering fundamentals.
• Ability to work independently and communicate effectively in a remote environment.
• Upper-intermediate English ability.

Responsabilidades

• Design and develop data team microservices.
• Scale data pipeline for processing billions of events.
• Ongoing improvement of data storage and queries.
• Develop and maintain data pipelines in a micro-service architecture on Kubernetes.
• Plan integrations with other teams for data consumption and insights.
• Improve data storage, queries, and formats for diverse clients.
• Optimize queries in data warehouses to ensure data completeness and reliability.

Conhecimentos

Java

Data engineering

SQL

Monitoring systems

Object-oriented development

English communication

Formação académica

BSc. in Computer Sciences

Ferramentas

Clickhouse

Kubernetes

Spark

Kafka

Redis

Descrição da oferta de emprego

Join to apply for the Software Engineer ID45371 role at AgileEngine

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people‑first culture has earned us multiple Best Place to Work awards.

Why Join Us

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

About the Role

Join our ambitious team as a Senior Software Engineer specializing in Data Engineering to develop cutting‑edge trade surveillance technology, protecting investors and ensuring market integrity. You will have a profound impact by designing and scaling robust, highly available data pipelines and microservices, tackling complex data challenges using modern tools. This unique opportunity offers significant influence and professional growth in a dynamic, collaborative environment that values accountability and a self‑starter attitude.

What You Will Do

• Design and develop the data team microservices – Java services running on K8S.
• Scale our data pipeline to support the processing of billions of events in both low‑latency real‑time and T+1 batch using advanced technologies like Clickhouse, Spark, and Kafka.
• Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.
• Develop and maintain our data pipeline written mostly in Java and running on K8S in a micro‑service architecture.
• Plan and communicate integrations with other teams that consume the data and use it for insights creation.
• Ongoing improvement of the way data is stored and served. Improve queries and data formats to make sure the data is optimized for consumption by a variety of clients.
• Query optimizations in our data warehouses, ensuring data completeness and reliability at scale.

Must Haves

• BSc. in Computer Sciences from a top university, or equivalent.
• Strong background as a software engineer with at least 3+ years experience with Java.
• Experience in data engineering and data pipeline development.
• Proven experience with relational and non‑relational DBs. Expert. Proficient in SQL and query optimizations – preferably in clickhouse.
• Experience with monitoring systems (either Prometheus, Grafana, Zabbix, Datadog).
• Experience in object‑oriented development. Should have strong software engineering foundations.
• Curiosity, ability to work independently and proactively identify solutions.
• Excellent verbal and written communication skills in a remote environment.
• Upper‑intermediate English level.

Nice to Haves

• Experience working in low‑latency, real‑time systems processing billions of events a day.
• Experience with data‑engineering cloud technologies as Apache Airflow, K8S, Clickhouse, Snowflake, Redis, Spark, Caching technologies and/or Kafka.

Perks and Benefits

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation: We match your ever‑growing skills, talent, and contributions with competitive USD‑based compensation and budgets for education, fitness, and team activities.
• A selection of exciting projects: Join projects with modern solutions development and top‑tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime: Tailor your schedule for an optimal work‑life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Seniority level

Mid‑Senior level

Employment type

Full‑time

Industries

IT Services and IT Consulting

Referrals increase your chances of interviewing at AgileEngine by 2x