01Video Retrieval

QueriSight — Multimodal Video Retrieval

Designing a multimodal video retrieval pipeline that transforms videos into searchable, timestamped segments using scene-aware segmentation, keyframe extraction, SigLIP visual embeddings, and Qwen-generated descriptions.

Video RetrievalSigLIPQwenFastAPIMilvus

IPCV final project · Sep 2026 – Present · Supervisor: Fabien Baldacci

Supervisor profile ↗
02CLIP

Cross Modal Attention Bridge

Investigating CLIP interpretability through attention rollout, token filtering, and perturbation-based XAI methods including LIME, SHAP, and RISE.

CLIPXAILIMESHAPRISE

TRDP project · Nov 2025 – Present · Supervisor: Dr. Marcos Escudero-Viñolo

03PPG

Individual HRV Response to Music via PPG

Designed a within-subjects PPG HRV study on music-induced autonomic modulation with Butterworth filtering, IBI extraction, FFT-PSD, and non-parametric statistical analysis.

PPGHRVSignal ProcessingStatistics

Sep 2025 – Dec 2025 · Supervisor: Dr. Márton Áron Goda

Supervisor profile ↗
04Multimodal

Weighted Embeddings Fusion for Hate Detection

Designed an SE-based multimodal fusion model using CLIP, TweetEval, and EfficientNetB3 for meme classification, achieving SOTA performance with an F1 score of 92.5% on the MultiOFF and MAMI datasets.

MultimodalCLIPTweetEvalEfficientNetB3

Sep 2024 – Jan 2025 · Supervisor: Dr. Ram Sarkar

Supervisor profile ↗