Federated Learning (FL) is increasingly adopted in edge computing scenarios, where a large number of heterogeneous clients operate under constrained or sufficient resources. The iterative training process of FL incurs considerable computation and communication overhead, which is unfriendly for resource-constrained devices. One-shot FL is a promising approach to addressing communication issues inherent in conventional FL, and model-heterogeneous FL solves the problem of diverse computing resources across clients. However, existing methods face challenges in effectively managing model-heterogeneous one-shot FL, often leading to unsatisfactory global model performance or reliance on auxiliary datasets. To address these challenges, we propose a novel FL framework named FedMHO, which leverages deep classification models on resource-sufficient clients and lightweight generative models on resource-constrained devices. On the server side, FedMHO involves a two-stage process that includes data generation and knowledge fusion. Furthermore, we introduce FedMHO-MD and FedMHO-SD to mitigate the knowledge-forgetting problem during the knowledge fusion stage, and an unsupervised data optimization solution to improve the quality of synthetic samples. Comprehensive experiments demonstrate the effectiveness of our methods, as they outperform state-of-the-art baselines in various experimental setups.
论文检索
输入标题、作者或关键词，从 15,207 篇学术成果中精准定位
The surge in intelligent applications driven by large language models (LLMs) has made it increasingly difficult for bandwidth-limited cloud servers to process extensive LLM workloads in real time without compromising user data privacy. To solve these problems, recent research has focused on constructing cloud-edge consortia that integrate server-based LLM with small language models (SLMs) on mobile edge devices. Furthermore, designing collaborative training mechanisms within such consortia to enhance inference performance has emerged as a promising research direction. However, the cross-domain deployment of SLMs, coupled with structural heterogeneity in SLMs architectures, poses significant challenges to enhancing model performance. To this end, we propose Co-PLMs, a novel co-tuning framework for collaborative training of large and small language models, which integrates the process of structure-agnostic mutual learning to realize knowledge exchange between the heterogeneous language models. This framework employs distilled proxy models (DPMs) as bridges to enable collaborative training between the heterogeneous server-based LLM and on-device SLMs, while preserving the domain-specific insights of each device. The experimental results show that Co-PLMs outperforms state-of-the-art methods, achieving average increases of 5.38% in Rouge-L and 4.88% in EM. Our code has been released at https://github.com/papercode-DFL/Co-PLMs.
Existing LLM-based Kubernetes diagnostic systems cannot learn from operational experience, operating on static knowledge bases without improving from past resolutions. We present MetaKube, an experience-aware LLM framework through three synergistic innovations: (1) an Episodic Pattern Memory Network (EPMN) that abstracts diagnostic patterns from historical resolutions and provides confidence-calibrated retrieval for both rapid pattern matching and guided causal exploration, (2) a meta-cognitive controller that dynamically routes between intuitive and analytical pathways based on problem familiarity, optimizing the trade-off between speed and depth, and (3) KubeLLM, a locally-deployable 8B model enhanced through domain-specific post-training on our 7,000-sample Kubernetes Fault Resolution Dataset. Evaluation on 1,873 real-world scenarios demonstrates MetaKube transforms Qwen3-8B from 50.9 to 90.5 points, approaching GPT-4.1 performance while ensuring complete data privacy. EPMN contributes 15.3% improvement through experiential learning, with continuous learning experiments showing progressive gains as the system accumulates operational knowledge. The source code and related resources are available at https://github.com/MetaKube-LLM-for-Kubernetes-Diagnosis/MetaKube.
The rapid growth of Web, mobile, and Web of Things (WoT) applications increasingly relies on Federated Learning (FL) to enable privacy-preserving intelligence across distributed and heterogeneous devices. However, the global model in FL often suffers from performance degradation due to global knowledge forgetting caused by highly non-IID client data. While client-side Knowledge Distillation (KD) has emerged as a promising paradigm for transferring global knowledge to local models, existing approaches inadvertently distort global knowledge through local data priors, fundamentally limiting their effectiveness in real-world Web and mobile environments. We further find that this knowledge forgetting is asymmetric, with locally under-represented classes suffering significantly more severe performance degradation than over-represented ones. While the conventional KD inherently couples these two distinct kinds of knowledge, thereby hindering the targeted preservation of critical global knowledge for under-represented classes. To address these challenges, we propose Federated Adaptive Knowledge Distillation (FedAKD), a novel framework that adaptively calibrates and decouples global knowledge according to the local data distribution, enabling precise and flexible distillation across heterogeneous clients. Extensive experiments on benchmark datasets and diverse data heterogeneity settings demonstrate that FedAKD achieves state-of-the-art performance, offering a scalable and sustainable solution for Web, mobile, and WoT intelligence deployment.
Large Language Models (LLMs) are increasingly deployed on edge devices to address privacy and latency concerns in modern Web applications. While numerous studies focus on inference frameworks, the critical problem of tuning runtime configurations remains largely underexplored. This endeavor is particularly challenging on edge devices due to severe budget limitations and the dynamic variability of system resources. To address these challenges, we draw upon key insights regarding parameter sensitivity, configuration transferability, and rank stability to propose LaTune, a lightweight and adaptive tuning framework. LaTune is designed to efficiently find optimal runtime configurations by incorporating three complementary components: parameter selection to focus on the most impactful parameters, knowledge transfer to leverage historical data for accelerated search, and two-stage optimization to dynamically select the best configuration based on real-time resource constraints. Experiments across four edge devices and LLMs show that LaTune achieves up to 3.93x higher hypervolume and 6.90x throughput gains over baselines. It accelerates tuning efficiency by 2-3x, converging within 10-20 iterations, and ensures robust execution under heavy contention where static methods fail. Our code is open-sourced at https://github.com/pkuaiweb/LaTune.
The growing presence of mobile and IoT devices has led to massive decentralized and evolving data, driving the rise of Federated Learning (FL) to enable collaborative training without data sharing. However, traditional FL assumes static data distributions, which is unrealistic for dynamic real-world environments. To address this challenge, Federated Class-Incremental Learning (FCIL) has emerged as a promising framework that enables flexible adaptation to newly introduced classes over time. Existing FCIL methods typically integrate old knowledge preservation into local client training. However, these methods cannot avoid spatial-temporal client drift caused by data heterogeneity and often incur significant computational and communication overhead, limiting practical deployment. To address these challenges simultaneously, we propose a novel approach, Spatial-Temporal Statistics Aggregation (STSA), which provides a unified framework to aggregate feature statistics both spatially (across clients) and temporally (across stages). The aggregated feature statistics are unaffected by data heterogeneity and can be used to update the classifier in closed form at each stage. Additionally, we introduce STSA-E, a communication-efficient variant that enables the server to approximate global second-order feature statistics using first-order statistics uploaded from clients. Theoretical analysis shows that it achieves similar performance to STSA with much lower communication overhead. Extensive experiments on three widely used FCIL datasets, with varying degrees of data heterogeneity, show that our method outperforms state-of-the-art FCIL methods in terms of performance, flexibility, and both communication and computation efficiency. The code is available at https://github.com/Yuqin-G/STSA.
Federated learning is a distributed collaborative training framework that enables multiple clients to share model updates and jointly train deep neural networks without exchanging raw data. Although extensive research has explored data augmentation techniques in federated settings, the naturally non-IID data distributions among clients render blind augmentation prone to severe degradation of the learned model. To solve this problem, we suggest Responsive Augmentation and Approximate Update Method for Fed erated Learning with Non-IID Data (RAFed), aimed at alleviating feature shift in client samples. We leverage a Responsive Augmentation Method to accumulate shared data augmentation policy knowledge through local learning, guiding the policy gradient to consider the impact of data augmentation on unseen local data, and employ an Approximate Update Mechanism to reduce communication costs and achieve efficient policy search. To improve the adaptability of data augmentation policies to local data distributions, we introduce a Dynamic Adaptive Method for searching personalized augmentation policies tailored to heterogeneous clients. Experiments on four popular datasets show that RAFed achieves superior test accuracy and lower communication costs compared to related baselines while providing privacy advantages. The code is available via https://github.com/anonymously123-stcak/RAFed.
Web service administrators must ensure the stability of multiple systems by promptly detecting anomalies in Key Performance Indicators (KPIs). Achieving the goal of ''train once, infer across scenarios'' remains a fundamental challenge for time series anomaly detection models. Beyond improving zero-shot generalization, such models must also flexibly handle sequences of varying lengths during inference—ranging from one hour to one week—without retraining. Conventional approaches rely on sliding-window encoding and self-supervised learning, which restrict inference to fixed length inputs. Large Language Models (LLMs) have demonstrated remarkable zero-shot capabilities across general domains. However, when applied to time series data, they face inherent limitations due to context length. To address this issue, we propose ViTs, a Vision-Language Model (VLM)-based framework that converts time series curves into visual representations. By rescaling time series images, temporal dependencies are preserved while maintaining a consistent input size, thereby enabling efficient processing of arbitrarily long sequences without context constraints. Training VLMs for this purpose introduces unique challenges, primarily due to the scarcity of aligned time series image–text data. To overcome this, we employ an evolutionary algorithm to automatically generate thousands of high-quality image–text pairs and design a three-stage training pipeline consisting of: (1) time series knowledge injection, (2) anomaly detection enhancement, and (3) anomaly reasoning refinement. Extensive experiments demonstrate that ViTs substantially enhance the ability of VLMs to understand and detect anomalies in time series data. All datasets and code will be publicly released at: https://github.com/Uni-WangZexin/ViTs.
A reliable autonomous driving system requires a high-precision perception module. Collaborative perception is emerging as a web-scale information-sharing paradigm for autonomous driving, enabling multiple vehicles to collectively achieve a broader perception field than any single vehicle. However, existing approaches necessitate frequent one-to-many communication, which increases network load and leads to information redundancy. This paper presents Octopus, an innovative vehicle-to-road collaboration framework that leverages the computational capabilities of roadside units. Instead of frequent one-to-many communication, vehicles interact only with roadside units, which significantly reduces communication overhead and improves real-time processing efficiency. While this design alleviates communication burdens, vehicles may still struggle to achieve comprehensive situational awareness in highly dynamic environments. To further address this limitation, our framework incorporates global fusion results as prior knowledge, enabling closed-loop fusion to refine vehicle-side perception. Extensive experiments on OPV2V and V2V4Real datasets demonstrate that Octopus excels at collaborative perception, outperforming the state-of-the-art approach up to 11.58% on AP@0.7, 12.74% on R11@0.7 and 5514× reduction in communication volume.
Collaborative learning between edge servers (e.g., base stations) and end devices (e.g., drones) enables simultaneous model training in web applications through knowledge sharing. The resulting models effectively reduce service latency. However, existing approaches either assume isomorphic models on edge servers and end devices or incur substantial transmission overhead when training. Moreover, edge servers are often unable to access data from end devices on time due to long-distance constraints or strict data privacy regulations. This paper proposes a Prototype Augmentation-based Edge-end Collaborative Learning method (PAECL). It simultaneously trains heterogeneous edge and end models in the absence of data on edge servers by transmitting only augmented class-wise feature vectors (prototypes), significantly reducing communication overhead compared to sharing models, data, or logits. Specifically, on end devices, prototype-implied latent knowledge is augmented via local prototype contrast and global prototype alignment. On edge servers, prototypes are further augmented to produce bounded virtual vectors by mixing them with random noise, and the augmented prototypes are then delivered to generative models to provide data during edge model training. Through simulations and field experiments, PAECL achieves the highest accuracy for edge and end models under limited training resources and reduces the transmission burden by at least 297 times compared to existing edge-end heterogeneous learning methods.
Mobile agents have made progress toward reliable smartphone automation, yet performance in complex applications remains limited by incomplete knowledge and weak generalization to unseen environments. We introduce a curiosity driven knowledge retrieval framework that formalizes uncertainty during execution as a curiosity score. When this score exceeds a threshold, the system retrieves external information from documentation, code repositories, and historical trajectories. Retrieved content is organized into structured AppCards, which encode functional semantics, parameter conventions, interface mappings, and interaction patterns. During execution, an enhanced agent selectively integrates relevant AppCards into its reasoning process, thereby compensating for knowledge blind spots and improving planning reliability. Evaluation on the AndroidWorld benchmark shows consistent improvements across backbones, with an average gain of six percentage points and a new state of the art success rate of 88.8% when combined with GPT-5. Analysis indicates that AppCards are particularly effective for multi step and cross application tasks, while improvements depend on the backbone model. Case studies further confirm that AppCards reduce ambiguity, shorten exploration, and support stable execution trajectories. Task trajectories are publicly available at https://lisalsj.github.io/Droidrun-appcard/.
Trace analysis is essential for understanding system behaviors, detecting anomalies, and diagnosing faults in complex microservice-based web applications. Existing trace analysis approaches face several challenges in industrial microservice-based systems, including high manual overhead, limited functionality, unfriendly interaction mechanisms, and difficulties in deployment and integration. The strong capabilities of large language models (LLMs) in natural language understanding, reasoning, and multi-task generalization provide new opportunities for a more intelligent and flexible trace analysis approach. However, the trace analysis capabilities of LLMs remain underexplored and underdeveloped. To bridge this gap, we conduct the first comprehensive evaluation on the trace analysis capabilities of LLMs. In particular, we construct the first instruction&response benchmark dataset for trace analysis, named TraceBench. It involves a wide range of trace analysis tasks, allowing us to systematically evaluate the capabilities of LLMs in this area. Experimental results show that LLMs have potential in handling trace analysis tasks, but there leaves room for improvement. To this end, we propose TraceLLM, an approach that significantly enhances the capabilities of LLMs via fine-tuning, outperforming the open-source LLMs by 34.77% on average in terms of accuracy, and outperforming the closed-source model by 21.66% in the best case. The generalization and robustness of TraceLLM are also confirmed in our experiments. To the best of our knowledge, TraceLLM is the first LLM which is specialized for handling various types of trace analysis tasks. This work provides a foundation for future research to further explore the trace analysis capabilities of LLMs.
In an edge-assisted federated learning (FL) system, edge servers aggregate client models into intermediate models for the cloud server to produce the global model communication-efficiently. However, existing edge-assisted systems fail to accommodate model-heterogeneous clients, i.e., clients running models with different architectures. To tackle this problem, this paper proposes FedBridge, a novel edge-assisted system that enables FL across model-heterogeneous clients through a two-tier knowledge-sharing mechanism. It deploys an expandable fusion model on each edge server in the system to fuse the knowledge from heterogeneous client models through knowledge distillation. In the meantime, it employs a contrastive loss to mitigate data heterogeneity in client data by aligning the logits of the fusion model close to those of the global model. On the cloud server, it employs a block-based aggregation method to merge fusion models transmitted from the edge servers. We conduct extensive experiments with three models on two widely-used public datasets to evaluate the performance of FedBridge. The results demonstrate that, compared to state-of-the-art systems, FedBridge accelerates model convergence by up to 6.3x and improves model accuracy by 6.2%-17.7%, with 89.51%-96.13% reduction in communication overhead and 48.12%-61.77% in memory overhead.
The World Wide Web increasingly relies on intelligent services that require accurate time series forecasting, from urban mobility platforms to adaptive web-based decision systems. In practice, building effective forecasting models typically requires abundant high-quality data, which may not always be available in all cities due to sensing limitations or data sparsity. To address this challenge, transfer learning methods aim to transfer knowledge from data-rich source cities to data-scarce target cities. However, source and target data distributions are often not identical: while some patterns from source cities may be beneficial, others can be irrelevant or even misleading. Existing transfer learning methods generally train the target model using all available source data without explicitly distinguishing between useful and non-useful knowledge, which may hinder performance. In this work, we propose xRAG4TS, a novel framework that integrates Retrieval-Augmented Generation (RAG) with Large Language Models (LLMs) for cross-city time series forecasting. xRAG4TS introduces a Cross-City Selective Retriever Module that filters semantically relevant historical patterns and documents from data-rich source cities, and incorporates them as structured prompts in an LLM Inference Module to guide forecasting in data-scarce target cities. By enabling selective, interpretable, and context-aware knowledge transfer, our method enhances robustness and scalability in web-oriented spatio-temporal applications. Extensive experiments on real-world cross-city datasets demonstrate that xRAG4TS significantly outperforms state-of-the-art baselines, highlighting its potential for powering adaptive and trustworthy web services under severe data scarcity.
Online question-and-answer (Q&A) platforms facilitate knowledge exchange through posted questions and answers. Recent advances in large language models (LLMs) have shown their strong capability in generating high-quality answers, leading to a recent surge in LLM-generated answers (LGAs) on Q&A platforms. In this paper, we conduct an in-depth analysis of how LGAs affect Naver Knowledge iN, the most popular Q&A platform in South Korea. To this end, we implement nine state-of-the-art LLM-generated text (LGT) detection methods and evaluate their performance on answers collected from Naver Knowledge iN. We then build an ensemble detector by stacking the three best-performing LGT detection methods, achieving an AUC of 0.9987 with a false positive rate below 1%. Using this LGA detector, we identify 75,558 LGAs among 1.46M answers. We find that LGAs tend to be longer, use more punctuation marks, and exhibit higher lexical diversity. However, LGAs do not show clear differences in user reactions, such as upvotes, downvotes, or selection rates by questioners. We also find that LGAs are primarily intended for knowledge sharing rather than personal experiences sharing. Finally, we observe a shift in the Q&A platform: questions increasingly move from simple fact-seeking to those involving complex contexts and seeking personal opinions or past experiences.
Relational databases (RDBs) underpin the majority of global data management systems, where information is structured into multiple interdependent tables. In social media platforms, for instance, massive user-generated data are organized across related tables such as users, posts, comments, and interactions, enabling large-scale analysis and predictive modeling of social behaviors. To effectively use the knowledge within RDBs for predictive tasks, recent advances leverage graph representation learning to capture complex inter-table relations as multi-hop dependencies. Despite achieving state-of-the-art performance, these methods remain hindered by the prohibitive storage overhead and excessive training time, due to the massive scale of database and the computational burden of intensive message passing across interconnected tables. To alleviate these concerns, we propose and study the problem of Relational Database Distillation (RDD). Specifically, we aim to distill large-scale RDBs into compact heterogeneous graphs while retaining the predictive power (i.e., utility) required for training graph-based models. Multi-modal column information is preserved through node features, and primary–foreign key relations are encoded via heterogeneous edges, thereby maintaining both data fidelity and relational structure. To ensure adaptability across diverse downstream tasks without engaging the traditional, inefficient bi-level distillation framework, we further design a kernel ridge regression-guided objective with pseudo-labels, which produces quality features for the distilled graph. Extensive experiments on multiple real-world RDBs demonstrate that our solution substantially reduces the data size while maintaining competitive performances on classification and regression tasks, creating an effective pathway for scalable learning with RDBs.
They Said Memes Were Harmless - We Found the Ones That Hurt: Decoding Jokes, Symbols, and Cultural References
PDF ↗Meme-based social abuse detection is challenging because harmful intent often relies on implicit cultural symbolism and subtle cross-modal incongruence. Prior approaches, from fusion-based methods to in-context learning with Large Vision-Language Models (LVLMs), have made progress but remain limited by three factors: i) cultural blindness (missing symbolic context), ii) boundary ambiguity (satire vs. abuse confusion), and iii) lack of interpretability (opaque model reasoning). We introduce CROSS-ALIGN+, a three-stage framework that systematically addresses these limitations: (1) Stage I mitigates cultural blindness by enriching multimodal representations with structured knowledge from ConceptNet, Wikidata, and Hatebase; (2) Stage II reduces boundary ambiguity through parameter-efficient LoRA adapters that sharpen decision boundaries; and (3) Stage III enhances interpretability by generating cascaded explanations. Extensive experiments on five benchmarks and eight LVLMs demonstrate that CROSS-ALIGN+ consistently outperforms state-of-the-art methods, achieving up to 17% relative F1 improvement while providing interpretable justifications for each decision.
Generative agents are rapidly advancing in sophistication, raising urgent questions about how they might coordinate when deployed in online ecosystems. This is particularly consequential in information operations (IOs), influence campaigns that aim to manipulate public opinion on social media. While traditional IOs have been orchestrated by human operators and relied on manually crafted tactics, agentic AI promises to make campaigns more automated, adaptive, and difficult to detect. This work presents the first systematic study of emergent coordination among generative agents in simulated IO campaigns. Using generative agent-based modeling, we instantiate IO and organic agents in a simulated environment and evaluate coordination across operational regimes, from simple goal alignment to team knowledge and collective decision-making. As operational regimes become more structured, IO networks become denser and more clustered, interactions more reciprocal and positive, narratives more homogeneous, amplification more synchronized, and hashtag adoption faster and more sustained. Remarkably, simply revealing to agents which other agents share their goals can produce coordination levels nearly equivalent to those achieved through explicit deliberation and collective voting. Overall, we show that generative agents, even without human guidance, can reproduce coordination strategies characteristic of real-world IOs, underscoring the societal risks posed by increasingly automated, self-organizing IOs.
Restaurants, as small hospitality businesses, are inherently vulnerable, making accurate survival prediction crucial. Previous studies have demonstrated the significance of user reviews and incorporated diverse review?derived factors, yet they have largely overlooked the large?scale network formed by user–restaurant interactions. How restaurant survival is influenced by the review network remains insufficiently explored. To fill this gap, leveraging network embeddedness theory, we statistically analyze the impact of two dimensions of embeddedness, structural and positional, on each restaurant's survival. Utilizing two real-world review datasets, the newly curated OpenRice and the well-established Yelp, our results reveal that a restaurant's network embeddedness and its temporal evolution positively correlate with its survival. Building on this insight, we propose a Dynamic Embeddedness-aware Graph Neural Network, DyE-GNN, for restaurant survival prediction. DyE-GNN not only explicitly integrates network embeddedness theory to guide the model design but also leverages domain knowledge to enable robust adaptability. Extensive experiments on both datasets confirm the superiority of DyE-GNN, underscoring the importance of network embeddedness attention, temporal dynamics, and survival knowledge of peer restaurants. Visualizations further demonstrate that network embeddedness facilitates the identification of at-risk restaurants at the network margin.
Toxicity detection mitigates the dissemination of toxic content (e.g., hateful comments, posts, and messages within online social actions) to safeguard a healthy online social environment. However, malicious users persistently develop evasive perturbations to disguise toxic content and evade detectors. Traditional detectors or methods are static over time and are inadequate in addressing these evolving evasion tactics. Thus, continual learning emerges as a logical approach to dynamically update detection ability against evolving perturbations. Nevertheless, disparities across perturbations hinder the detector's continual learning on perturbed text. More importantly, perturbation-induced noises distort semantics to degrade comprehension and also impair critical feature learning to render detection sensitive to perturbations. These amplify the challenge of continual learning against evolving perturbations. In this work, we present ContiGuard, the first framework tailored for continual learning of the detector on time-evolving perturbed text (termed continual toxicity detection) to enable the detector to continually update capability and maintain sustained resilience against evolving perturbations. Specifically, to boost the comprehension, we present an LLM powered semantic enriching strategy, where we dynamically incorporate possible meaning and toxicity-related clues excavated by LLM into the perturbed text to improve the comprehension. To mitigate non-critical features and amplify critical ones, we propose a discriminability driven feature learning strategy, where we strengthen discriminative features while suppressing the less-discriminative ones to shape a robust classification boundary for detection. Additionally, we introduce a historical capability replay strategy to preserve previously learned features via feature alignment to alleviate capability forgetting. To the best of our knowledge, this work is the first study on continual toxicity detection against time-evolving evasive perturbed text. Extensive experiments prove the superior performance of ContiGuard over both existing detectors and continual methods. Code and dataset are available at https://github.com/khk-abc/ContiGuard. Warning: This paper contains discussions of harmful content that may be disturbing to some readers.