Applied academic projects with architecture, execution evidence and limitations
Co-developed end-to-end data platform that predicts customer churn for a telecom operator on synthetic data using PySpark, Delta Lake, Unity Catalog and MLflow.
Cloud IoT platform that collects real-time data from 40 simulated parking sensors and serves it in a web dashboard, using AWS Lambda, DynamoDB and MQTT.
Processes batch and real-time data with Spark, Kafka and Airflow and organises it into layers of increasing quality (Medallion architecture) on Delta Lake.
OpenMetadata metadata catalogue on Kubernetes that discovers PostgreSQL data, keeps it in sync and exports it validated against the DCAT-AP-ES standard.
OpenMetadataDCAT-AP-ESKubernetesPython
Data governance case study with OpenMetadata and Python that applies the UNE 0077-0081 standards to cataloguing, quality and traceability.
OpenMetadataUNE 0077-0081Kubernetes
SSH honeypot with serverless log analysis and infrastructure as code.
Full-stack application for running R scripts through a REST API with a dedicated instance per user.