Software Engineer Id45371

Agileengine; Porto Alegre; Híbrido; BRL 120.000 - 160.000; Tempo integral

Resumo da oferta

A leading technology firm in Porto Alegre is seeking a Senior Software Engineer specializing in Data Engineering. The role involves designing and scaling data pipelines and microservices, focusing on real-time data processing and optimization. Candidates should have a strong foundation in Java, data engineering, and SQL. This full-time position offers competitive USD-based compensation, flexible work hours, and opportunities for professional growth. Join a collaborative team making an impactful difference in trade surveillance technology.

Serviços

Professional growth opportunities

Competitive compensation

Flexible work schedule

Exciting projects with top-tier clients

Qualificações

• 3+ years experience as a software engineer with Java.
• Experience in data engineering and data pipeline development.
• Proven experience with relational and non-relational DBs.

Responsabilidades

• Design and develop micro services running on K8S.
• Scale data pipelines for processing billions of events.
• Improve data storage and optimization for clients.

Conhecimentos

Java

Data pipeline development

SQL and query optimizations

Object-oriented development

Monitoring systems (Prometheus, Grafana, Zabbix, Datadog)

Upper-intermediate English level

Formação académica

BSc. in Computer Sciences

Ferramentas

ClickHouse

Kafka

Spark

Apache Airflow

Descrição da oferta de emprego

AgileEngine is an Inc. company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries.

We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Best Place to Work awards.

Why Join Us

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

About the Role

Join our ambitious team as a Senior Software Engineer specializing in Data Engineering to develop cutting-edge trade surveillance technology, protecting investors and ensuring market integrity.

You will have a profound impact by designing and scaling robust, highly available data pipelines and microservices, tackling complex data challenges using modern tools.

This unique opportunity offers significant influence and professional growth in a dynamic, collaborative environment that values accountability and a self-starter attitude.

What You Will Do

• Design and develop the data team micro services – Java services running on K8S.
• Scale our data pipeline to support the processing of billions of events in both low-latency real-time and T+1 batch using advanced technologies like ClickHouse, Spark, and Kafka.
• Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.
• Develop and maintain our data pipeline written mostly in Java and running on K8S in a micro-service architecture.
• Plan and communicate integrations with other teams that consume the data and use it for insights creation.
• Ongoing improvement of the way data is stored and served.
• Improve queries and data formats to make sure the data is optimized for consumption by a variety of clients.
• Query optimizations in our data warehouses, ensuring data completeness and reliability at scale.

MUST Haves

• BSc. in Computer Sciences from a top university, or equivalent.
• Strong background as a software engineer with at least 3+ years experience with Java.
• Experience in data engineering and data pipeline development.
• Proven experience with relational and non-relational DBs.
• Proficient in SQL and query optimizations – preferably in ClickHouse.
• Experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).
• Experience in object-oriented development.
• Strong software engineering foundations.
• Curiosity, ability to work independently and proactively identify solutions.
• Excellent verbal and written communication skills in a remote environment.
• Upper-intermediate English level.

Nice to Haves

• Experience working in low-latency, real-time systems processing billions of events a day.
• Experience with data-engineering cloud technologies such as Apache Airflow, K8S, ClickHouse, Snowflake, Redis, Spark, caching technologies, and / or Kafka.

Perks and Benefits

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation: We match your ever-growing skills, talent and contributions with competitive USD-based compensation and budgets for education, fitness and team activities.
• A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime: Tailor your schedule for an optimal work-life balance, by having the option of working from home and going to the office – whatever makes you the happiest and most productive.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

IT Services and IT Consulting