Simera Professional Key (SPK)

Thiago Batista C

Brasil

Data Engineer

$ 8,400/month

8 yrs exp

Engineer with 6+ years building production data platforms (Python, Airflow, AWS, Spark, Databricks) across fintech and e-commerce — now focused on AI/LLM systems. Recently shipping LLM agents and RAG tooling in production at Creditas (Claude Code subagents for dependency analysis, internal RAG over Confluence, agentic CLI for data validation), plus side projects building agentic RAG with full evaluation rigor. Data Engineering foundation: scaled Kafka + PySpark pipelines to billions of daily eve…

Skills

  • Python
  • SQL
  • BigQuery
  • Data Engineer
  • DataBricks
  • Phyton
  • Python/R
  • Data engineering
  • Python3
  • Paython
  • debt
  • RAG
  • dbt
  • MSQL
  • AI Engineer

Thiago Batista C

Brasil

Data Engineer

$ 8,400 /month

8 yrs exp

Engineer with 6+ years building production data platforms (Python, Airflow, AWS, Spark, Databricks) across fintech and e-commerce — now focused on AI/LLM systems. Recently shipping LLM agents and RAG tooling in production at Creditas (Claude Code subagents for dependency analysis, internal RAG over Confluence, agentic CLI for data validation), plus side projects building agentic RAG with full evaluation rigor. Data Engineering foundation: scaled Kafka + PySpark pipelines to billions of daily eve…

Skills

  • Python
  • SQL
  • BigQuery
  • Data Engineer
  • DataBricks
  • Phyton
  • Python/R
  • Data engineering
  • Python3
  • Paython
  • debt
  • RAG
  • dbt
  • MSQL
  • AI Engineer

Data Engineer

Creditas
November 2024 - present

Built an internal agentic tool on Claude Code (custom subagents + tools) to map dependencies between SQL Server stored procedures and data warehouse tables, exposing undocumented data flows and unblocking a large-scale migration project. Developed an internal RAG agent on Langflow over a Confluence knowledge base to serve data product documentation to business users — rewrote the chunking logic with additional split patterns and iterated on retrieval strategy, reducing hallucinations and improving answer relevance. Designed a CLI for cross-validation between Hudi tables, DuckDB, and other sources — orchestrated through Claude Code subagents and commands — that automated data-consistency checks across storage layers and caught discrepancies before production, preventing downstream rework. Built internal developer tooling with Claude Code (custom skills, subagents, slash commands), including a testing-acceleration agent that eliminated manual file uploads and throwaway PRs from the dev loop. Designed and maintained data pipelines using Python, Airflow, AWS, and Spark. Improved pipeline performance and reduced failures by optimizing orchestration and data integration.

Data Engineer

Loja Integrada
June 2022 - October 2024

Built and maintained ETL pipelines using Python, Airflow, AWS, and Spark. Implemented Databricks to improve data processing performance and analytics capabilities. Designed large-scale ingestion pipelines using Kafka and PySpark, processing billions of daily events from marketplace activity. Acted as the only Data Engineer, owning AWS infrastructure, ingestion pipelines, and orchestration workflows, ensuring platform reliability and scalability. Led the migration from Airflow to Databricks, improving scalability and enabling more efficient data processing.

Data Engineer

Stone
June 2021 - June 2022

Built pipelines integrating multiple data sources across cloud environments. Supported financial data workflows and reporting. Led the migration of a legacy SQL Server data warehouse to a Snowflake-based lakehouse, improving performance and scalability. Reverse-engineered business logic from stored procedures to ensure accurate data transformation. Maintained data operations during a team transition, acting as the primary Data Engineer for approximately 1.5 months.

Data Engineer

Smart Fit
February 2020 - June 2021

Built ETL pipelines and data workflows using Python, Airflow, Alteryx, and AWS. Supported analytics and reporting for business teams. Re-architected memory-intensive pipelines into in-database processing (Redshift + Airflow), eliminating recurring failures, reducing approximately 10+ hours/day of manual effort, and improving data delivery reliability.

Business Intelligence Consultant

KPMG Brasil
July 2019 - February 2020

Developed ETL workflows to process and model legal data for analytics.

Business Intelligence Consultant

AMPLIX - Soluções Enterprise
August 2018 - July 2019

Built dashboards and automated reporting solutions using Tableau, Power BI, SQL, and Excel.

Smart Scores

Communication
80
Role Fit
100
Adaptability
80
Problem-solving
90
Professional Presence
90
Drive/Initiative
80

Smart Skills

beta