Jose Alberto O
Mexico
Data Engineer
$ 5,500/month
5 yrs exp
Data Engineer specialized in the design, optimization, and scalability of cloud architectures within Azure and Databricks ecosystems. Expert in massive data processing using PySpark and the implementation of Medallion Architectures to establish robust Data Governance practices. Proven track record of transforming complex business rules into efficient solutions, drastically reducing compute times and ensuring high data quality for strategic decision-making.
Skills
- Azure
- Big Data
- Git
- PostgreSQL
- Python
- Spark
- SQL
- Data Engineer
- Data Factory
- DataBricks
- Flask
- Pandas
- Phyton
- Pyspark
- Data engineering
- Databricks: Python(Pyspark), SQL, & R
- Python and SQL
- MSQL
- AI Engineer
- ETL/ELT Pipeline
- Fast API
- Data Quality
- SOQL
- ETL Workflows
- WebScraping
- Datalake
- Datawarehouse
- Datalakehouse