[Job-20691] Senior Data Architect, Brazil

Ciandt; Brasil; Teletrabalho; BRL 60.000 - 120.000; Tempo integral

Resumo da oferta

An established industry player is seeking a Senior Data Architect with a focus on PySpark and Delta Lake. This role involves implementing AI tools, designing scalable microservices, and optimizing backend architectures. You will take ownership of the service lifecycle, ensuring efficiency and quality in development and deployment. Join a forward-thinking company that values collaboration and diversity, and be a part of innovative projects that leverage AI to transform technology solutions. If you are passionate about automation and AI-driven innovation, this opportunity is perfect for you.

Serviços

Health and dental insurance

Meal and food allowance

Childcare assistance

Extended paternity leave

Wellhub (Gympass)

TotalPass

Profit-sharing (PLR)

Life insurance

CI&T University

Discount club

Qualificações

• Strong experience in Python, Delta Lake, ADB Notebooks, Kafka, and Couchbase.
• Expertise in AI tools for coding, testing, and deployment automation.

Responsabilidades

• Implement AI tools to enhance development and service delivery.
• Design scalable microservices using Python and Delta Lake.

Conhecimentos

Python

Delta Lake

ADB Notebooks

Kafka

Couchbase

AI tools for automation

Microservices architecture

Agile methodologies

Security best practices

Descrição da oferta de emprego

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.

With over 6,500 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.

When applying for one of our positions, you’re agreeing to the use of AI in the early phases of the selection process, where your profile will be evaluated by our virtual assistant. For more information, access our opportunities’ page.

Hello there!

We are seeking an experienced Senior Data Architect, focused on PySpark and Delta Lake.

Responsibilities:

1. Implement AI tools and automation frameworks to enhance development and service delivery, ensuring efficiency and quality.
2. Utilize AI-based tools to automate repetitive tasks, improve service performance, and accelerate development cycles.
3. Design and implement scalable and robust microservices using Python, Delta Lake, ADB Notebooks, KAFKA, and Couchbase.
4. Apply AI techniques to optimize backend architectures for speed, reliability, and efficiency.
5. Take full ownership of the service lifecycle, including technical design, development, testing, and deployment.
6. Ensure services are promoted to production with minimal downtime and human intervention, keeping all environments operational.
7. Develop and integrate automated solutions for development, testing, deployment, and monitoring using AI-driven technologies.
8. Automate unit tests, security checks, and code reviews, using AI tools to identify vulnerabilities and improve code quality.
9. Work in an agile environment, contributing to sprint cycles and enhancing workflow automation.
10. Use AI techniques to analyze large datasets, uncover insights, and optimize system performance and user experience.
11. Be proactive in delivering AI automation across all services, consistently identifying areas for improvement and driving continuous automation.

Must have:

1. Strong working experience in Python, Delta Lake, ADB Notebooks, Kafka, and Couchbase. Deep understanding of microservices architecture and cloud-based service deployment.
2. Expertise in using AI tools for coding, testing, and deployment automation. Familiarity with machine learning, AI model integration, and automation platforms to streamline workflows.
3. Experience working in agile environments and using automation to enhance sprint efficiency, minimize manual tasks, and accelerate delivery.
4. Strong understanding of security best practices and how to automate security checks and vulnerability scans within the development and deployment pipeline.
5. Ability to take full ownership of services, ensuring smooth development, deployment, and maintenance with minimal supervision. Automate the entire pipeline from code development to production.
6. Experience in automating data mining processes and deriving actionable insights using AI-driven techniques.

Nice to have:

1. A strong passion for automation and AI-driven innovation.
2. Ability to quickly adapt to new AI tools and products.
3. Proactive problem solver, constantly looking for ways to improve and automate workflows.
4. Excellent communication skills for collaborating with global teams and stakeholders.

Our benefits:

• Health and dental insurance
• Meal and food allowance
• Childcare assistance
• Extended paternity leave
• Wellhub (Gympass)
• TotalPass
• Profit-sharing (PLR)
• Life insurance
• CI&T University
• Discount club
• Free online platform dedicated to physical, mental, and overall well-being
• Pregnancy and responsible parenting course
• Partnerships with online learning platforms
• Language learning platform
• And many more!

More details about our benefits here: https://ciandt.com/br/pt-br/carreiras

Collaboration is our superpower, diversity unites us, and excellence is our standard.

We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.