Led large-scale backfill and optimization of big data pipelines. Developed AI-powered consistency checker for Zillow listings using OpenAI API. Built system to repair Avro header inconsistencies in S3 buckets. Created automated AI system to predict time/space complexity for Avro bucket processing and optimize AWS resource allocation. Designed custom architecture and optimization algorithms to process 500 TB of Avro files into Databricks with Delta Lake in 1 day generating 9 billion records. Solved complex decision tree problem reducing processing time from over 1 month to 1 day, saving costs and enabling business continuity.

Led ETL migration and optimization projects. Automated validation processes and justification documents accelerating compliance and QA workflows. Implemented customizable validators configured via YAML for ETL derivations. Created Logic Library for if/else logic to migrate 5,000 lines of Ab Initio ETL code. Optimized derivations reducing processing times from 6-2 hours to less than 30 minutes. Developed support libraries boosting team productivity and code quality. Implemented SHAP value computations in Apache Spark influencing scoring models.

Optimized entity resolution algorithms and Presto vs Hive usage for SparkSQL jobs. Automated security vulnerability resolution with OWASP dependency check. Supported end-to-end testing and automated REST testing of Ads platform components, improving security compliance, processing efficiency, and testing automation.

Optimized batch ETL processes in Cloudera using Spark best practices. Implemented batch & streaming ETL pipelines under hub-spoke architecture. Resolved complex issues applying AI, logic, and optimization principles. Refactored Big Data code including XSL transformations. Designed graph software to visualize XSLT program file dependencies. Mentored software engineers improving team efficiency.

Implemented retry policies for ETL SaaS pipelines. Engineered optimized Spark pipelines in Databricks. Integrated Hudi metrics monitoring with Prometheus. Developed Cassandra ingestion pipelines with Spark Streaming. Led migration of Walmart APIs and refactored services to Databricks & GCP Dataproc. Built ETL batch & streaming processes across heterogeneous data sources.

Developed full-stack features for BI data cubes. Optimized Spark batch jobs reducing runtimes from 8 hours to less than 4 minutes. Migrated LATAM Spark-Hadoop-Hive-Impala workloads to independent clusters. Validated migrations with unit, integration, regression tests. Refactored legacy Impala queries and components.

Designed and implemented AI chatbot 'Digital Companion' using logic programming and knowledge graphs. Solved Creative Dialogue Composition Problem via dynamic programming and graph theory. Authored and presented scientific papers at ECAI 2020. Developed proof of concept chatbot for emotional well-being.

Designed and implemented a Code Generator to automatically produce full monolithic and microservice systems from DB schemas. Generated CRUD entities, DAOs, services, controllers, and GUIs dynamically. Published free proof of concept online.

Led pre-registration system for Puebla’s education department. Developed scalable public service platform suggesting nearest schools via geolocation handling 10,000 schools and 1 million students.

Lectured in Software Engineering, Physics, and Mechatronics. Coordinated student projects applying computational logic to social systems. Led development of systems for hospital management, vocational guidance prediction, and community service automation.

Designed and developed data warehouse integrating patient history, therapy sessions, and progress metrics. Built decision-making dashboards for psychologists. Implemented K-means clustering algorithms for patient segmentation. Developed appointment management, payments, progress tracking, and reporting system deployed in production.

Taught Advanced Programming, Databases, Machine Learning, and Operating Systems. Supervised research and thesis projects integrating automation, AI, and IoT. Designed and supervised award-winning student projects in automation and AI.

Applied HSBC Security Standards to financial computing systems. Developed secure modules in Java, JSP, and WebSphere. Implemented automated data validation and integration scripts enhancing transactional integrity.

Led team to design and implement Vehicular Control and Student Incident Management System. Automated entry permissions, parking access, and incident logging. Managed data migration and QA for production deployment supporting 9,000 students per year.