Latest AI News

Quantum Vision Theory Applied to Audio Classification for Deepfake Speech Detection

arXiv:2604.08104v1 Announce Type: new Abstract: We propose Quantum Vision (QV) theory as a new perspective for deep learning-based audio classification, applied to deepfake speech detection. Inspired by particle-wave duality in quantum physics, QV theory is based on the idea that data can be represented not only in its observable, collapsed form, but also as information waves. In conventional deep learning, models are trained directly on these collapsed representations, such as images. In QV theory, inputs are first transformed into information waves using a QV block, and then fed into deep learning models for classification. QV-based models improve performance in image classification compared to their non-QV counterparts. What if QV theory is applied speech spectrograms for audio classification tasks? This is the motivation and novelty of the proposed approach. In this work, Short-Time Fourier Transform (STFT), Mel-spectrograms, and Mel-Frequency Cepstral Coefficients (MFCC) of speech signals are converted into information waves using the proposed QV block and used to train QV-based Convolutional Neural Networks (QV-CNN) and QV-based Vision Transformers (QV-ViT). Extensive experiments are conducted on the ASVSpoof dataset for deepfake speech classification. The results show that QV-CNN and QV-ViT consistently outperform standard CNN and ViT models, achieving higher classification accuracy and improved robustness in distinguishing genuine and spoofed speech. Moreover, the QV-CNN model using MFCC features achieves the best overall performance on the ASVspoof dataset, with an accuracy of 94.20% and an EER of 9.04%, while the QV-CNN with Mel-spectrograms attains the highest accuracy of 94.57%. These findings demonstrate that QV theory is an effective and promising approach for audio deepfake detection and opens new directions for quantum-inspired learning in audio perception tasks.

Latest News

Extracting Breast Cancer Phenotypes from Clinical Notes: Comparing LLMs with Classical Ontology Methods

SensorPersona: An LLM-Empowered System for Continual Persona Extraction from Longitudinal Mobile Sensor Streams

Latest News

Extracting Breast Cancer Phenotypes from Clinical Notes: Comparing LLMs with Classical Ontology Methods

SensorPersona: An LLM-Empowered System for Continual Persona Extraction from Longitudinal Mobile Sensor Streams

A Comparative Study of Demonstration Selection for Practical Large Language Models-based Next POI Prediction

Environmental, Social and Governance Sentiment Analysis on Slovene News: A Novel Dataset and Models

FMI@SU ToxHabits: Evaluating LLMs Performance on Toxic Habit Extraction in Spanish Clinical Texts

Say Something Else: Rethinking Contextual Privacy as Information Sufficiency

Do We Need Distinct Representations for Every Speech Token? Unveiling and Exploiting Redundancy in Large Speech Language Models

A Parameter-Efficient Transfer Learning Approach through Multitask Prompt Distillation and Decomposition for Clinical NLP

MedConclusion: A Benchmark for Biomedical Conclusion Generation from Structured Abstracts

Luwen Technical Report

Blending Human and LLM Expertise to Detect Hallucinations and Omissions in Mental Health Chatbot Responses

Understanding Structured Financial Data with LLMs: A Case Study on Fraud Detection

LLM-Based Data Generation and Clinical Skills Evaluation for Low-Resource French OSCEs

Transforming the Voice of the Customer: Large Language Models for Identifying Customer Needs

Quantum Vision Theory Applied to Audio Classification for Deepfake Speech Detection

HiCI: Hierarchical Construction-Integration for Long-Context Attention

Efficient Provably Secure Linguistic Steganography via Range Coding

Contextual Earnings-22: A Speech Recognition Benchmark with Custom Vocabulary in the Wild

HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns

ORACLE-SWE: Quantifying the Contribution of Oracle Information Signals on SWE Agents