Research Papers

Optimizing Resource Consumption in Diffusion Models through Hallucination Early Detection

We introduce HEaD (Hallucination Early Detection), a novel paradigm that swiftly detects incorrect generations in diffusion models during early stages, saving computational resources and accelerating the generation process for complex multi-object images.

Proceedings of the European Conference on Computer Vision Workshops. 2024. | Published: January 2024

Authors: F Betti, L Baraldi, L Baraldi, R Cucchiara, N Sebe

View PDF

Computer Vision Diffusion Models Resource Optimization Computational Efficiency Hallucination Detection Multi-object Generation Cross-attention Maps Energy Consumption

Let's ViCE! Mimicking Human Cognitive Behavior in Image Generation Evaluation

We introduce ViCE, a novel automated method for evaluating consistency between generated images and text prompts by combining Large Language Models with Visual Question Answering in a process inspired by human cognitive assessment.

Proceedings of the 31st ACM International Conference on Multimedia, 9306-9312 | Published: October 2023

Authors: F Betti, J Staiano, L Baraldi, L Baraldi, R Cucchiara, N Sebe

View PDF

Computer Vision Image Generation Cognitive Science Evaluation Metrics Visual Question Answering LLMs Vision-Language Models

Controlled text generation with adversarial learning

This paper presents a novel architecture for conditioned text generation using adversarial learning, allowing users to guide the generation process through simple sentences or concepts as input.

13th International Conference on Natural Language Generation (INLG 2020) | Published: December 2020

Authors: F Betti, G Ramponi, M Piccardi

View PDF

NLP Text Generation Adversarial Learning GAN Conditioned Generation Deep Learning