The World Wide Web thrives on intelligent services that rely on accurate time series classification, which has recently witnessed significant progress driven by advances in deep learning. However, existing studies face challenges in domain incremental learning. In this paper, we propose a lightweight and robust dual-causal disentanglement framework (DualCD) to enhance the robustness of models under domain incremental scenarios, which can be seamlessly integrated into time series classification models. Specifically, DualCD first introduces a temporal feature disentanglement module to capture class-causal features and spurious features. The causal features can offer sufficient predictive power to support the classifier in domain incremental learning settings. To accurately capture these causal features, we further design a dual-causal intervention mechanism to eliminate the influence of both intra-class and inter-class confounding features. This mechanism constructs variant samples by combining the current class's causal features with intra-class spurious features and with causal features from other classes. The causal intervention loss encourages the model to accurately predict the labels of these variant samples based solely on the causal features. Extensive experiments on multiple datasets and models demonstrate that DualCD effectively improves performance in domain incremental scenarios. We summarize our rich experiments into a comprehensive benchmark to facilitate research in domain incremental time series classification.
论文检索
输入标题、作者或关键词，从 7,876 篇学术成果中精准定位
Multimodal dialogue emotion recognition seeks to integrate information from text, audio, and video to accurately determine the emotional state of each utterance. However, prevailing approaches often depend on fixed fusion strategies, failing to account for quality variations across modalities. Consequently, noise from less informative modalities can degrade overall performance. Moreover, most models treat utterances as independent units for static classification, overlooking the dynamic evolution of emotions throughout a dialogue. To overcome these limitations, we propose MIDE, a novel approach that leverages mutual information enhancement and dynamic modality slection for multimodal emotion recognition. Our approach dynamically selects high-quality modality pairs for fusion, minimizing interference from noisy or redundant sources. Specifically, it employs mutual information maximization to achieve cross-modal semantic alignment and incorporates an autonomous modality selection mechanism to assess inter-modal compatibility. Furthermore, an emotion transition prediction module, implemented with a Gated Recurrent Unit (GRU), captures temporal emotional dependencies, enabling joint optimization of static emotion classification and dynamic emotion trajectory prediction. Extensive experiments on the IEMOCAP and MELD datasets demonstrate that MIDE significantly surpasses existing models in accuracy and robustness, highlighting its strength in adaptive fusion for complex dialogue scenarios.
Generalized Category Discovery (GCD) is a critical task in open-world computing scenarios, aiming to automatically classify partially labeled data by recognizing both known and novel categories. However, existing GCD methods usually suffer from inherent bias toward known categories due to the exclusive pre-training on them and the absence of labeled data of novel categories. This bias can lead to significant misclassification and clustering errors for novel categories. Although recent approaches leverage pseudo-label training and contrastive learning to address this, they still lack explicit supervision to disentangle novel and known categories, resulting in performance bottlenecks. To address these limitations, we propose an Expectation-Maximization-driven Contrastive Disentanglement (EMCD) framework designed to explicitly disentangle novel and known categories. We particularly formulate the identification of novel categories as a latent variable estimation problem. Specifically, it incorporates an EM-disentangling regularization to softly identify novel category samples and a consistency regularization to enhance generalization. In addition, we leverage dual contrastive constraints, including a cluster-sample contrastive constraint and a sample-sample contrastive contrastive, to pull close samples of novel categories while pushing apart ambiguous samples near decision boundaries. Empirical results on 3 commonly used datasets demonstrate that our model is effective and outperforms previous state-of-the-art methods. Our code is available at https://github.com/YWY-only/EMCD.
Expert-sharing patterns have emerged as promising paradigms for multi-task learning (MTL) in recommender systems, enabling efficient resource allocation and dynamic modeling of diverse tasks. In this paper, we observe that high-gating (leader) and low-gating (auxiliary) experts play distinct roles in MTL: leader experts dominate task-specific predictions, while auxiliary experts, despite their lower gating scores, often contain complementary knowledge that can enhance model performance. However, critical challenges persist: how to effectively identify and utilize the knowledge of the leader and auxiliary experts in a synergistic manner? To address this, we propose a novel Dynamic Experts Synergy (DES) mechanism that integrates Entropy-driven Experts Classification (EEC) and Multi-view Knowledge Recycle (MVKR). EEC dynamically partitions experts into leader and auxiliary groups by analyzing task-specific prediction and gating entropy, enabling adaptive allocation aligned with real-time task difficulty. MVKR effectively revisits knowledge from auxiliary experts through utility, diversity, and task-relatedness perspectives, ensuring comprehensive knowledge utilization. Extensive experiments on five datasets demonstrate the superiority of our DES against state-of-the-art methods.
The persistent challenges of data sparsity and class imbalance have long limited the development of recommender systems. Fortunately, line graph theory offers a novel perspective to overcome these issues. By transforming the user-item interaction bipartite graph into a line graph, the problems of data sparsity and class imbalance are elegantly reformulated as those of insufficient labeled nodes and imbalanced label distribution in the line graph domain. This reformulation allows us to directly apply mature techniques from node classification and imbalanced graph learning to address these core challenges. Inspired by this insight, we propose a Line Graph Data Augmentation (LGDA) strategy, which features two distinct characteristics. Firstly, it is a plug-and-play module that resolves data sparsity and imbalance without modifying the underlying recommendation framework. Secondly, it employs a targeted augmentation and confidence filtering mechanism to generate high-quality, balanced augmented data. Extensive experiments on four real-world datasets validate that LGDA effectively alleviates data sparsity and class imbalance, leading to significant improvements in both recommendation performance and system robustness.
Federated Learning (FL) is increasingly adopted in edge computing scenarios, where a large number of heterogeneous clients operate under constrained or sufficient resources. The iterative training process of FL incurs considerable computation and communication overhead, which is unfriendly for resource-constrained devices. One-shot FL is a promising approach to addressing communication issues inherent in conventional FL, and model-heterogeneous FL solves the problem of diverse computing resources across clients. However, existing methods face challenges in effectively managing model-heterogeneous one-shot FL, often leading to unsatisfactory global model performance or reliance on auxiliary datasets. To address these challenges, we propose a novel FL framework named FedMHO, which leverages deep classification models on resource-sufficient clients and lightweight generative models on resource-constrained devices. On the server side, FedMHO involves a two-stage process that includes data generation and knowledge fusion. Furthermore, we introduce FedMHO-MD and FedMHO-SD to mitigate the knowledge-forgetting problem during the knowledge fusion stage, and an unsupervised data optimization solution to improve the quality of synthetic samples. Comprehensive experiments demonstrate the effectiveness of our methods, as they outperform state-of-the-art baselines in various experimental setups.
Time series data are prone to noise in various domains, and training samples may contain low-predictability patterns that deviate from the normal data distribution, leading to training instability or convergence to poor local minima. Therefore, mitigating the adverse effects of low-predictability samples is crucial for time series analysis tasks such as time series forecasting (TSF) and time series classification (TSC). While many deep learning models have achieved promising performance, few consider how to identify and penalize low-predictability samples to improve model performance from the training perspective. To fill this gap, we propose a general Amortized Predictability-aware Training Framework (APTF) for both TSF and TSC. APTF introduces two key designs that enable the model to focus on high-predictability samples while still learning appropriately from low-predictability ones: (i) a Hierarchical Predictability-aware Loss (HPL) that dynamically identifies low-predictability samples and progressively expands their loss penalty as training evolves, and (ii) an amortization model that mitigates predictability estimation errors caused by model bias, further enhancing HPL's effectiveness. The code is available at https://github.com/Meteor-Stars/APTF.
Accurate multivariate time series forecasting (MTSF) is critical for intelligent web services in Web of Things. When confronted with unseen multivariate time series (MTS), the industry typically invests significant time and resources in training multiple models to identify the optimal model for deployment. This paper proposes a novel, efficient, and scalable MTSF model selection method that directly selects suitable MTSF methods based on data characteristics without extensive model training. Model selection is a core component of AutoML, which has made significant progress in recent years. However, existing methods incur high operational costs and cannot be directly applied to MTSF tasks. Moreover, there is a lack of a comprehensive and cohesive public time series library for MTSF model selection. To address these challenges, we compile the first large heterogeneous labeled MTSF model selection dataset, called the ModelPile, which covers 41 mainstream datasets across 11 domains. We then propose AutoMTSF, a large model-enabled model selection method that transforms the MTSF model selection problem into a time series classification problem and utilizes the ModelPile to unlock large-scale multi-dataset training. AutoMTSF first uses the pre-trained large model to encode raw MTS. Given the coarse-grained limitations of large model encoding, Recursive Temporal Pattern Feature (RTPF) is proposed to capture both fine-grained and global temporal feature evolution, thereby effectively mapping data characteristics to the MTSF method space. Experiments comparing AutoMTSF with 2 baselines, 17 MTSF methods, and 4 large time series models show that AutoMTSF outperforms state-of-the-art methods while maintaining comparable execution time. This work represents a critical step in validating the accuracy and efficiency of large model-enabled classification for MTSF.
Federated domain generalization (FDG) for time-series classification (TSC) poses a critical challenge for modern intelligent web services, which rely on edge-collected time-series signals from diverse mobile applications and web devices (e.g., wearables sensors) to support decision-making. The source heterogeneity and temporal dynamics give rise to out-of-distribution (OOD) patterns, which hinder the model's ability to generalize to previously unseen users and devices. In this work, we propose Federated Generalization via Diversity Generation (FedDiG), a diffusion-based FDG framework that captures intra-client distribution shifts from a frequency-domain perspective and employs cross-frequency sampling to synthesize time-series data with diverse spectral patterns. Specifically, FedDiG first performs frequency-proxy representation learning on clients to serve as diffusion conditions. The server then aggregates client-side frequency proxies to construct a global proxy pool and applies class-wise mixup to create novel frequency features. These features guide a global diffusion model to produce diverse data, enabling the simulation of previously unseen patterns and thereby enhancing model training. Extensive experiments on four cross-domain time-series benchmarks demonstrate that FedDiG significantly outperforms state-of-the-art federated learning and FDG baselines, particularly under small-data regimes and large-scale client scenarios, achieving robust generalization to unseen domains in federated settings. This work bridges distribution-diversity synthesis and FDG for time-series to support robust, scalable web applications fed by edge-collected signals, delivering web-scale generalization across heterogeneous web, mobile, and IoT clients.
Relational databases (RDBs) underpin the majority of global data management systems, where information is structured into multiple interdependent tables. In social media platforms, for instance, massive user-generated data are organized across related tables such as users, posts, comments, and interactions, enabling large-scale analysis and predictive modeling of social behaviors. To effectively use the knowledge within RDBs for predictive tasks, recent advances leverage graph representation learning to capture complex inter-table relations as multi-hop dependencies. Despite achieving state-of-the-art performance, these methods remain hindered by the prohibitive storage overhead and excessive training time, due to the massive scale of database and the computational burden of intensive message passing across interconnected tables. To alleviate these concerns, we propose and study the problem of Relational Database Distillation (RDD). Specifically, we aim to distill large-scale RDBs into compact heterogeneous graphs while retaining the predictive power (i.e., utility) required for training graph-based models. Multi-modal column information is preserved through node features, and primary–foreign key relations are encoded via heterogeneous edges, thereby maintaining both data fidelity and relational structure. To ensure adaptability across diverse downstream tasks without engaging the traditional, inefficient bi-level distillation framework, we further design a kernel ridge regression-guided objective with pseudo-labels, which produces quality features for the distilled graph. Extensive experiments on multiple real-world RDBs demonstrate that our solution substantially reduces the data size while maintaining competitive performances on classification and regression tasks, creating an effective pathway for scalable learning with RDBs.
Toxicity detection mitigates the dissemination of toxic content (e.g., hateful comments, posts, and messages within online social actions) to safeguard a healthy online social environment. However, malicious users persistently develop evasive perturbations to disguise toxic content and evade detectors. Traditional detectors or methods are static over time and are inadequate in addressing these evolving evasion tactics. Thus, continual learning emerges as a logical approach to dynamically update detection ability against evolving perturbations. Nevertheless, disparities across perturbations hinder the detector's continual learning on perturbed text. More importantly, perturbation-induced noises distort semantics to degrade comprehension and also impair critical feature learning to render detection sensitive to perturbations. These amplify the challenge of continual learning against evolving perturbations. In this work, we present ContiGuard, the first framework tailored for continual learning of the detector on time-evolving perturbed text (termed continual toxicity detection) to enable the detector to continually update capability and maintain sustained resilience against evolving perturbations. Specifically, to boost the comprehension, we present an LLM powered semantic enriching strategy, where we dynamically incorporate possible meaning and toxicity-related clues excavated by LLM into the perturbed text to improve the comprehension. To mitigate non-critical features and amplify critical ones, we propose a discriminability driven feature learning strategy, where we strengthen discriminative features while suppressing the less-discriminative ones to shape a robust classification boundary for detection. Additionally, we introduce a historical capability replay strategy to preserve previously learned features via feature alignment to alleviate capability forgetting. To the best of our knowledge, this work is the first study on continual toxicity detection against time-evolving evasive perturbed text. Extensive experiments prove the superior performance of ContiGuard over both existing detectors and continual methods. Code and dataset are available at https://github.com/khk-abc/ContiGuard. Warning: This paper contains discussions of harmful content that may be disturbing to some readers.
Rare social events are infrequent yet influential incidents. Predicting such events is practically significant yet inherently challenging due to their extreme scarcity in web-based event stream. Existing studies view this task as an imbalanced classification problem and adopt static rebalancing methods to mitigate scarcity. However, they (1) ignore inter-event dependency that represents the interactions between different event streams, failing to capture precursors that lead to rare events and fundamentally limits performance. They (2) overlook intra-event dependency between different time points within single event stream, which prevents the model from adapting to shifting event patterns and degrades its generalization ability. To this end, we propose a novel Mediator Learning (ML) framework, which introduces mediators to explicitly model complex dependencies within web-based event streams. Specifically, we propose (1) Precursor Event Router (PER) that utilizes an information-theoretic routing approach to extract precursor events as mediators from massive event streams. Based on extracted mediators, (2) Conditional Hierarchical Graph Network (CHG) is introduced to model observed events, mediators and rare events into bottom-up graph levels, where its upper-level propagation is conditioned on bottom-level probability distribution. Jointly, these two modules decompose the imbalanced task into two more balanced stages, which not only mitigates the scarcity of rare events but also explicitly model inter-event dependencies, so as to capture precursor events leading to target rare events. Finally, we design (3) Adaptive Information Regularizer (AIR) to optimize the two stages. It dynamically adjusts the information flow between two stages, which models intra-event dependencies and facilitate adaption to drifting event patterns. We theoretically reveal the effectiveness of ML by framing it within Information Bottleneck (IB) principle. Extensive experiments show our superior accuracy and interpretability compared with SOTA.
Graph neural networks (GNNs) have become the cornerstone of graph representation learning in real-world applications, especially in social networks such as Facebook and Twitter, where user interactions naturally form graph-structured data. To safeguard sensitive information, including user attributes and personal connections, locally private graph learning protocols employ local differential privacy (LDP) to provide rigorous user-level guarantees. Despite these protections, we show that such protocols remain highly vulnerable to data poisoning attacks. Our approach targets the full-privacy setting, where both node features and edges are LDP-protected, and executes coordinated manipulations that significantly degrade utility, such as node classification accuracy, across multiple social network benchmarks. To counter these threats, we propose CureNet, a defense framework with four key components: (1) local data perturbation for privacy, (2) trimmed screening to filter abnormal submissions, (3) privacy-aware fake node pruning to remove sophisticated adversaries, and (4) a utility enhancement module to recover graph learning performance under privacy constraints. Extensive experiments on four real-world social network datasets—LastFM, Twitch, Github, and Facebook—demonstrate both the severe impact of our attack and the effectiveness of our defense. This study underscores the critical need to secure privacy-preserving graph learning against sophisticated poisoning threats.
Spamming activities (e.g., fake reviews, click farming, and deceptive content promotion) are increasingly conducted through collusive groups that exploit collective dynamics to manipulate platform metrics and mislead users, posing serious threats to the fairness, credibility, and functionality of online systems. To counteract these harmful behaviors, the task of spam detection has emerged as a critical area of research. However, existing detection methods generally remain limited in three key aspects: (i) They treat detection as a standard classification task, where representation learning and optimization are loosely coupled and suboptimal for capturing complex behaviors; (ii) They rely primarily on individual-level representation modeling, making it difficult to detect collective cheating strategies; (iii) They lack dedicated objective functions explicitly designed to characterize group-level spamming activities. To overcome these limitations, we introduce a collusion-aware Set-level learning framework (SetDet) that redefines the spam Detection task as a unified setwise optimization problem. Our approach offers three core advantages: (i) It enables end-to-end optimization by jointly learning representations and performing detection in a single, integrated process; (ii) It incorporates a model-level design for collusion representation, effectively capturing the temporal and relational patterns of coordinated spam; (iii) It pioneers a dedicated set-level optimization criterion that aligns closely with the structural characteristics of group-based cheating behaviors and accounts for class imbalance in real-world scenarios. Extensive experiments confirm the generalizability and superior performance of our framework across diverse spam scenarios and collusion strategies.
The Web is a rich source of structured data in the form of tables, from product catalogs and knowledge bases to scientific datasets. However, the heterogeneity of the structure and semantics of these tables makes it challenging to build a unified method that can effectively leverage the information they contain. Meanwhile, Large language models (LLMs) are becoming an increasingly integral component of web infrastructure for tasks like semantic search. This raises a crucial question: can we leverage these already-deployed LLMs to classify structured data in web-native tables (e.g., product catalogs, knowledge base exports, scientific data portals), avoiding the need for specialized models or extensive retraining? This work investigates a lightweight paradigm, Table Representation with Language Model (TaRL), for few-shot tabular classification that directly utilizes semantic embeddings of individual table rows. We first show that naive application of these embeddings underperforms compared to specialized tabular models. We then demonstrate that their potentials can be unlocked with two key techniques: removing the common component from all embeddings and calibrating the softmax temperature. We show that a simple meta-learner, trained on handcrafted features, can learn to predict an appropriate temperature. This approach achieves performance comparable to state-of-the-art models in low-data regimes (k ? 32) of semantically-rich tables. Our findings demonstrate the viability of reusing existing LLM infrastructure for efficient semantics-driven pathway to reuse existing LLM infrastructure for Web table understanding.
With the rapid growth of multi-modal content on the Web, robust vision-language models are essential for semantic understanding and classification of web images under diverse and dynamic contexts, supporting Web applications such as multimedia search and recommendation. Prompt learning has proven effective for enhancing vision-language models in semantic image classification tasks. However, previous methods often suffer from poor generalization: the learned prompts tend to overfit the base classes seen during training, leading to poor performance on unseen classes and under distribution shifts. This issue is especially challenging in Web-scale data, where new classes emerge and distributions shift dynamically. To address these limitations, we propose PLIKD, a novel prompt learning method that integrates instance-aware knowledge distillation for robust Web-scale semantic image classification. Specifically, PLIKD introduces an instance-aware knowledge extraction module, which leverages multi-modal large language models through a step-by-step strategy to extract external knowledge for each image instance. To incorporate this extracted knowledge, PLIKD further introduces an instance-aware knowledge distillation module, which consists of two key steps: (1) a dual-teacher strategy for robust and informative knowledge distillation, and (2) fine-grained cross-modal alignment via Smooth and Sparse Optimal Transport. Extensive experiments demonstrate that PLIKD significantly improves generalization to both seen and unseen classes, and remains robust under distribution shifts, outperforming existing state-of-the-art methods on Web-scale semantic image classification.
Text classification is a crucial and fundamental task in web content mining. Compared with the previous learning paradigm of pre-training and fine-tuning by cross entropy loss, the recently proposed supervised contrastive learning approach has received tremendous attention due to its powerful feature learning capability and robustness. Although several studies have incorporated this technique for text classification, some limitations remain. First, many text datasets are imbalanced, and the learning mechanism of supervised contrastive learning is sensitive to data imbalance, which may harm the model's performance. Moreover, these models leverage separate classification branches with cross entropy and supervised contrastive learning branches without explicit mutual guidance. To this end, we propose a novel model named SharpReCL for imbalanced text classification tasks. First, we obtain the prototype vector of each class in the balanced classification branch to act as a representation of each class. Then, by further explicitly leveraging the prototype vectors, we construct a proper and sufficient target sample set with the same size for each class to perform the supervised contrastive learning procedure. The empirical results show the effectiveness of our model, which even outperforms popular large language models across several datasets. Our code is available https://github.com/KEAML-JLU/SharpReCL
Sanctioning blockchain addresses has become a common regulatory response to malicious activities. However, enforcement on permissionless blockchains remains challenging due to complex transaction flows and sophisticated fund-obfuscation techniques. Using cryptocurrency mixing tool Tornado Cash as a case study, we quantitatively assess the effectiveness of U.S. Office of Foreign Assets Control (OFAC) sanctions over a 957-day period, covering 6.79 million Ethereum blocks and 1.07 billion transactions. Our analysis reveals that while OFAC sanctions reduced overall Tornado Cash deposit volume by 71.03% to approximately 2 billion USD, attackers still relied on Tornado Cash in 78.33% of Ethereum-related security incidents, underscoring persistent evasion strategies. In this paper, we identify three significant, structural limitations in current sanction enforcement practices: (i) fragmented censorship in blockchain consensus and application layer; (ii) the complexity of obfuscation virtual asset services exploited by users; and (iii) the susceptibility of naive binary sanction classifications to dusting attacks. Our analysis and findings contribute to ongoing discussions around regulatory effectiveness in Decentralized Finance by providing empirical evidence, clarifying enforcement challenges, and informing future compliance strategies in response to sanctions and blockchain-based security risks.
Website Fingerprinting (WF) is an emerging traffic analysis technique that enables a passive adversary to infer which websites a user visits. However, most existing studies, whether in single-tab or multi-tab settings, rely on the unrealistic assumption that users only access website homepages, diverging significantly from real-world browsing behavior. Even recent works extending WF to subpages primarily focus on website-level identification, without distinguishing which specific subpages are visited, thereby limiting the attack's granularity and scope. In this paper, we propose HiFi-WF (Hierarchical Fine-grained Website Fingerprinting), a novel framework that breaks the homepage-only assumption and extends WF to multi-tab recognition and fine-grained subpage identification. We formulate the task as a hierarchical multi-label classification problem, jointly modeling the distinctions and correlations between homepages and subpages. To this end, HiFi-WF integrates a unified CNN-based extractor and layered encoder with a Feature Interaction Module based on multi-head cross-attention to capture inter-level dependencies. An Enhanced SubHead enforces hierarchical constraints to suppress invalid subpage predictions, while a cascaded channel–spatial attention mechanism refines discriminative features for precise hierarchical identification. Experimental results demonstrate that HiFi-WF achieves state-of-the-art performance at both hierarchical levels, attaining F1-scores of 92.1% (homepage) and 81.9% (subpage), thereby validating its effectiveness in advancing WF attacks toward realistic, fine-grained, and multi-tab browsing scenarios. Related codes and datasets can be found in https://github.com/wusongyang02-blip/HiFi-WF.