Designed and implemented a solution to process information from a Mongo database and a REST API, integrating both sources into Delta Tables to facilitate decision-making and value generation for the company's core area. Implemented data extraction from Azure Data Factory, as well as communication and storage in Blob Storage with firewall rules and communication via SAS tokens. Transformed information in Databricks using a batch process that receives and updates information in conjunction with control tables and metadata monitoring to satisfy audits and maintain knowledge of transit information.

Generated data transformation processes using Spark in Databricks Notebooks with a medallion architecture, automating execution via Azure Data Factory and native Databricks Workflows. Built batch and streaming ETL processes on the Microsoft Fabric platform, consuming structured and semi-structured sources in a medallion model up to visualization in Power BI. Optimized information consumption processes from a Power BI dashboard by 90%, and report response time by 50%. Automated database interaction processes for table generation or information changes based on events. Implemented intelligent chatbots using LangChain in conjunction with OpenAI for interaction with specific knowledge bases (databases, documents, websites, etc.). Provided consulting on the use of Azure tools with best practices to implement data-driven solutions, from ingestion to visualization or interaction via chatbots.

Generated and maintained Natural Language Processing (NLP) tools for data transformation and fraud detection. Conducted code reviews within the area, as well as verification of complementary information in the Atlassian Suite (Confluence, Bitbucket, and Jira). Extracted information from various sources and formats, reconciled, transformed, and generated dashboards for the commercial intelligence area. Was responsible for the optimization, standardization, and automation of internal processes for information extraction, transformation, and enrichment to improve activity efficiency and area performance.