Updates
New models and papers, community benchmarks and tutorials from YouTube and Reddit, news coverage and Hacker News discussions — each summarised and linked to its source.
Last refreshed 2026-11-19 11:10 UTC
- 2026-11-04arXivNews🧪 A Framework for Context Enrichment and Selective Robustness in LLM Social Agents
Researchers use large language models as agents in social simulations, where agents are prompted with observations and background information intended to shape their actions. Yet LLM agents have been shown to substantial…
- 2026-11-04arXivNews🧪 SpecCompact: Accelerating LLM Agent Context Compaction with Slot-Parallel Semantic Speculative Verification
LLM agents use context compaction to manage growing interaction histories, but summarizing long histories with large models can introduce substantial delays. Compaction therefore requires balancing information retention …
- 2026-11-04arXivNews🧪 Persona Perspectives: Adopting Viewpoints Reorganizes Representations in LLMs
Common methods for monitoring features in large language models (LLMs) such as linear probes and sparse autoencoders (SAEs) assume that features maintain a consistent representation across contexts. LLMs, however, can fl…
- 2026-11-04arXivNews🧪 Before You Continue: Evaluating Time-Sensitive Safety Awareness in Conversational Assistants
Large language model (LLM) assistants increasingly help users with everyday activities that involve time-dependent constraints. However, users may not mention these constraints in later requests, requiring assistants to …
- 2026-11-04arXivNews🧪 Context--Answer Metamodels: Forecasting LLM Activations Before the First Answer Token
Under stochastic decoding, a single context can elicit many different answers from a language model. Characterizing this variation typically requires many expensive autoregressive rollouts, each revealing only one realiz…
- 2026-11-04arXivNews🧪 SAUCE: Summary Analysis Using Conversation Entailment
With the growing need for evaluating Large Language Models (LLMs) and their applications to speech, challenges persist in summarizing and evaluating conversations that lack a clear end goal. We introduce SAUCE -- a refer…
- 2026-11-04arXivNews🧪 LLMs Don't Know What They Know: Benchmarking Temporal Self-Knowledge for Financial Backtesting
Financial backtests of large language models (LLMs) are meaningful only if the model did not already know the outcomes it is asked to predict. Practitioners guard against this by trusting a vendor's stated knowledge cuto…
- 2026-11-04arXivNews🧪 Measuring Risk, Not Harm: Detecting Psychological Harm Risk Factors in LLM Conversations
Psychological harms from interactions with large language models cannot be monitored directly because they may emerge over repeated interactions and depend strongly on subjective individual user context. We propose measu…
- 2026-11-04arXivNews🧪 SecureGARD: Dynamic Ontology-Guided Governance for Secure Tool-Using LLM Agents
Tool-using large language model (LLM) agents translate model outputs into consequential actions, turning indirect prompt injection into an execution-security problem. Existing defenses constrain tool calls, trajectories,…
- 2026-11-04arXivNews🧪 Replicability, Reproducibility, and Robustness in Political and Social Science Research with Large Language Models
This chapter addresses the central reproducibility problem of research with large language models. LLM output is probabilistic and varies across models and versions, which can have significant effects on downstream stati…
- 2026-11-04arXivNews🧪 Verifier-Guided Self-Consistency: Test-Time Reasoning with Imperfect Generators and Verifiers
Large language models can solve many multi-step reasoning problems, but their reasoning remains brittle: plausible intermediate steps often lead to incorrect answers. Improving reasoning at test time requires balancing t…
- 2026-11-04arXivNews🧪 RAGAM-AI: A Hybrid Reinforcement Learning based Agentic approach powered by Generative AI for Edge Resource Management
Resource management for distributed edge networks hosting different services has been handled efficiently using Reinforcement learning (RL). Reward generalization in complex workflows is still an open issue within the RL…
- 2026-11-04arXivNews🧪 When Do Summaries Become Instructions? Unsupported Policy in LLM Agents' Self-Written Handoff Summaries
Long-running LLM agents compact their context, replacing most history with a summary. We ask whether handoff summaries state permissions or requirements the record does not support, whether such sentences change what the…
- 2026-11-04arXivNews🧪 CRESiST: Self-Enhancing Explorative Policy Learning for Simultaneous Speech Translation
Simultaneous Speech Translation (SimulST) requires balancing translation quality and latency. While Large Language Models (LLMs) excel in offline translation, current LLM-based SimulST systems predominantly rely on prefi…
- 2026-11-04arXivNews🧪 LibriSpeech-Real-QA: A Benchmark for Streaming Question Answering
Most speech large language models (SLMs) still process speech in an offline manner. They only start responding after they receive the complete speech segment. However, many real-world applications require streaming speec…
- 2026-11-04arXivNews🧪 Robots in the City: Persona-Based Perceptions of Urban Robots
Pedestrians increasingly encounter robots in urban public spaces without interacting with them, but how robots change the perceived safety of a street remains unclear. We examine how robot presence and type affect percei…
- 2026-11-04arXivNews🧪 Reward Budgeting Reduces Premature Convergence in Reinforcement Learning for LLM Reasoning
RL for LLM reasoning often reaches an early performance plateau as the policy distribution becomes increasingly sharp. Recent work has studied policy entropy as both a diagnostic and a control signal for this behavior. I…
- 2026-11-04arXivNews🧪 Modality-Aware Expert Pruning for MoE-Based Multimodal Large Language Models
Mixture-of-Experts (MoE) enables multimodal large language models (MLLMs) to scale capacity efficiently, but expert parameters dominate memory even though only a few experts are activated per token: they account for over…
- 2026-11-04arXivNews🧪 Retrieval Supersedes Scale: Efficient Log Level Prediction via Multiplex Socio-Technical Context
Developers insert logging statements in source code to record its execution, and the resulting logs are essential for detecting and troubleshooting system anomalies. A key part of these statements is the log level (e.g.,…
- 2026-11-04arXivNews🧪 When Does Better Confidence Improve a Knowledge-Graph Audit?
Confidence estimates guide human review in LLM-built knowledge graphs, but better error prediction can yield little improvement in an audit. We study this gap through repairability, selection headroom and label validity.…
- 2026-11-04arXivNews🧪 CARTBench: Rubric-Based Evaluation of Shopping Advice for Complex and Ambiguous Requests with Timelines
Large language model (LLM) shopping assistants now recommend products in multi-turn conversations. However, reliable evaluation faces Data scarcity and Difficulty Standardizing Criteria. To address these obstacles, we in…
- 2026-11-04arXivNews🧪 PEARL: Prediction Error-Adaptive Regularized Learning for Selective Forgetting under Partial Preference Drift
User preferences shift as needs, context, and tastes evolve. This matters for personalized recommendation, LLM response generation, and RLHF-trained reward models, which can become miscalibrated as preferences drift. Exi…
- 2026-11-04arXivNews🧪 Pathwise-Budgeted LLM Routing: Online Allocation with K-Bit Tail-Cost Learning
Firms using large language models under fixed budgets must decide which model to call and whether to retry a failed task. Because a call's charge is revealed only after completion, one long response can exhaust the remai…
- 2026-11-04arXivNews🧪 Learning When Human Decisions Matter: Executor-Relative Consultation Value for LLM Agents
Large language models increasingly automate complex tasks, but human decision capacity does not scale with their capabilities. In many applications, humans remain essential for providing private context, authority, or ju…
- 2026-11-04arXivNews🧪 FlyHash for LLM Agent Memory: An Empirical Validation and a New Application
Large language model (LLM) agents increasingly rely on external memory stores to retain information across conversations, typically via dense vector embeddings searched with approximate nearest-neighbor methods. The frui…
- 2026-11-04arXivNews🧪 How Well Can Large Language Models Impersonate Individual Authors? A Comparative Evaluation
This study investigates the authorship impersonation capacity of six widely used large language models (LLMs): Gemini 3 Pro, Claude Opus, GPT 5.2, GPT 5.2 Pro, DeepSeek 3.2, and Grok 4.1 Fast. The evaluation was conducte…
- 2026-11-03arXivNews🧪 PAYWORTHY: Can LLMs Predict Which Freelance Jobs an AI Agent Will Complete?
Before an AI agent takes on a paid job, someone has to judge whether it is likely to succeed. We test whether frontier language models can make this call before any attempt. We propose PAYWORTHY which contains 1{,}494 re…
- 2026-11-03arXivNews🧪 Pairing Expert Critique with LLM-Driven Refinement: An Iterative Approach for Curating Quality AI Evaluation Datasets
Evaluating and improving domain-specific LLM responses requires high-quality reference data and rubrics, yet expert authoring is slow and expensive, and synthetic datasets may fail to capture practitioner preferences unl…
- 2026-11-03arXivNews🧪 Prospective Memory for Proactive LLM Agents
Most memory systems for LLM agents are retrospective, preserving and retrieving past information to inform current decisions. Proactive agents, however, also require prospective memory: retaining future-directed intentio…
- 2026-11-03arXivNews🧪 Give the Drafter a Second Chance to Guess: Parallel Reconsideration for Speculative Decoding
Speculative decoding accelerates large language model inference with a small drafter, whose per-guess acceptance rate determines the achievable speedup. Feature-level drafters share a design choice: every token, easy or …
- 2026-11-03arXivNews🧪 Aligning Language Models with General Preferences: An Empirical Study of Direct Nash Optimization
Direct Nash Optimization (DNO) aligns a language model to a general preference function by approximating the Nash equilibrium of a two-player preference game. Its practical variant, DNO-Prct, iterates on-policy sampling,…
- 2026-11-03arXivNews🧪 LoopVQ: Sub 1-bit KV Cache Quantization for Looped Transformers
Looped transformers are a parameter-efficient alternative to standard transformers for language modeling. By reapplying the same layers across multiple loop steps, recent looped language models match the performance of n…
- 2026-11-03arXivNews🧪 Knowingly Wrong: Training LLMs Against Their Own Beliefs can Induce Misalignment
Fine-tuning a large language model (LLM) on harmful data in a narrow domain, such as bad medical advice, can make it broadly misaligned. How realistic this risk is remains unclear, since models are very rarely fine-tuned…
- 2026-11-03arXivNews🧪 Beyond Accuracy: What Language-Subspace Interventions Capture, Remove, and Improve
Language-subspace interventions aim to improve multilingual reasoning by suppressing language-related components in mid-layer activations. Using MATH and MGSM across four open-weight LLMs, we ask three questions: do esti…
- 2026-11-03arXivNews🧪 ARLoop: Fully-Open Pre-trained Looped Transformers with Attention Residuals
Looped transformers increase effective depth by repeatedly applying a shared set of transformer layers, offering a parameter-efficient way to scale computation. However, standard residual connections aggregate informatio…
- 2026-11-03arXivNews🧪 What Does the Model See? Representation Validity in Multimodal LLM-Based Video Analysis
Multimodal large language models (MLLMs) allow social scientists to analyze video at scale, but researchers must decide which parts of a video to provide as input. We use the term representation validity to examine how t…
- 2026-11-03arXivNews🧪 GM League Arena: An Interactive Long-Horizon Task Benchmark Based on Professional Sports League Management
Long-horizon decision-making under sustained competition requires large language models (LLMs) to balance immediate investment with future resource needs. However, local success in multi-step interactions can not adequat…
- 2026-11-03arXivNews🧪 The Right Source Is Not Enough: Understanding History Interference in Speech-LLM Memory
Speech large language models retain audio history to support multi-turn conversations. Yet remembering an event does not ensure that its information is used only when relevant. We investigate why irrelevant historical au…
- 2026-11-03arXivNews🧪 ToolSpace: Scaling Tool-Centric Environment Synthesis for Long-Horizon Agents
Large language models are deployed as long-horizon agents that compose diverse tools across MCP services into executable workflows. Existing MCP environment-scaling methods are data-centric: they first synthesize a datab…
- 2026-11-03arXivNews🧪 Unifying and Beyond the Theory of Pervasive Capability Degradation in LLM Post-training SFT from Feature Interference
Pervasive Capability Degradation (PCD) refers to the phenomenon in which supervised fine-tuning (SFT), while adapting a large language model (LLM) to a target task, often erodes the general capabilities acquired during p…
- 2026-11-03arXivNews🧪 Auditing Multi-Proxy Explanations of Web User Preferences: Identification Boundaries and Abstention
Web systems infer user preferences from behavior, ratings, text, and LLM-generated profiles, yet explaining a proxy may reveal its measurement process rather than the preference of interest. We develop an audit framework…
- 2026-11-03arXivNews🧪 Who is the Pronoun Pro? Comparing LLMs and Humans at Number-Disambiguation of 'they'
This study evaluates whether large language models (LLMs) can reliably replace or complement human research assistants in linguistically complex annotation. In a controlled annotation task, 73 human annotators (local stu…
- 2026-11-03arXivNews🧪 TraceRouter++: Causal Semantic Routing Realignment via Optimal Transport
Despite their remarkable capabilities, large foundation models (LFMs) remain susceptible to adversarial manipulation. Current safety intervention methods primarily rely on the \textit{locality hypothesis}, rigidly suppre…
- 2026-11-03arXivNews🧪 Feeling of Knowing in Large Language Models
Post-training updates change what large language models (LLMs) can answer, but may leave their answerability judgments misaligned. We study this knowledge-judgment desynchronization through functional feeling of knowing …
- 2026-11-03arXivNews🧪 Where Is the Truth When AI Agents Disagree? Dependence-Aware Belief Propagation for Unsupervised Truth Discovery (Extended Version)
LLM agents often give conflicting answers to the same question, and many deployed agents are variants of one base model, so their errors are correlated. We study truth discovery among such agents: inferring the true answ…
- 2026-11-02arXivNews🧪 Pretraining Data Scale Reverses the Muon-AdamW Fine-Tuning Gap
Muon has recently emerged as a promising optimizer for pretraining large language models, offering a speedup over AdamW in minimizing pretraining loss. However, it remains unclear whether Muon's advantage persists after …
- 2026-11-02arXivNews🧪 Not All Reasoning Generalizes: A Case Study on Learning Generalizable Reasoning Strategies in RLVR
Reinforcement learning with verifiable rewards (RLVR) can enable generalizable improvement for large language model (LLM) reasoning. This paper studies how to incentivize such generalization via reasoning strategies. We …
- 2026-11-02arXivNews🧪 Tracing the Scientific Discovery Capacity of LLMs to Their Training Data
Large language models (LLMs) show growing promise for scientific discovery, yet basic questions remain about what enables reliable discovery. How can we trace the scientific discovery capacity of LLMs to their training d…
- 2026-11-02arXivNews🧪 VeriHarm-Bench: Measuring Harmful Success in LLM Coding Agents Verifiably
Large language model (LLM) coding agents increasingly operate with shell access, allowing them to write scripts, move files, alter permissions, and modify system configurations. However, an agent may achieve a user's goa…
- 2026-11-02arXivNews🧪 Can LLM Agents Be Forward-Deployed Engineers? Requirement Discovery and Delivery for Enterprise Text-to-SQL
LLM coding agents can increasingly automate model post-training, but whether they can act as forward-deployed engineer (FDE) agents, discovering customer requirements and turning them into deployment decisions, remains u…
- 2026-11-02arXivNews🧪 DistDebug-Bench: Can LLM Agents Diagnose Bugs in Distributed Systems?
LLM agents show strong potential in software engineering tasks such as competitive programming and code synthesis. Existing benchmarks, however, largely focus on small-scale settings such as self-contained Python modules…
- 2026-11-02arXivNews🧪 VIAS: Value-Isolating Activation Steering for Multi-Value Alignment and Compliance for Organisations
Organisations increasingly deploy large language model agents that must follow organisational values. We check whether activation steering, which adds vectors to a model's internal activations during generation without c…
- 2026-11-02arXivNews🧪 Ask, Don't Equip: Question-Driven Coding Agents for Deep Kernel Optimization
LLM agents for GPU kernel optimization sit at two ends of a structure-freedom tradeoff. Scripted agents fix what the model does at each step, via a learned policy, an optimization menu, or fixed roles, and are sample-eff…
- 2026-11-02arXivNews🧪 Optimize the Harness, Not the Model: Fitting a Minimal Agent to a Self-Hostable LLM for Investigative Analysis
Government intelligence teams need LLM agents that can analyze large, messy evidence collections, but security and cost constraints often rule out hosted frontier models and broad, hard-to-audit tool surfaces. We report …
- 2026-11-02arXivNews🧪 A Living Leaderboard for Graph Machine Learning
Graph machine learning benchmarking results are scattered across papers that use quite different sets of datasets and baseline methods, making it difficult to tell whether a reported gain reflects architectural progress …
- 2026-11-02arXivNews🧪 IdeaTaste: Do LLMs Share the Research Taste of Human Researchers?
Research taste, the judgment of what to read, which problems to pursue, and which methods to try, increasingly shapes the work of AI scientists, yet it remains far less understood than their ability to execute research. …
- 2026-11-02arXivNews🧪 Same Outputs, Different Scores: Auditing the Unchecked Graders of Multimodal LLM Benchmarks
Every multimodal-LLM multiple-choice benchmark ends with a scoring rule that converts a model's response, often free-form text rather than a clean option letter, into a right/wrong verdict, buried in its code. Unlike the…
- 2026-11-02arXivNews🧪 The SIMPLE Law for Energy Cost of LLM Inference
Generative AI is billed per token, yet tokens are not equally expensive. Each token enters the KV-cache and raises the cost of those that follow, so energy grows non-linearly along a sequence whose tokens look identical.…
- 2026-11-02arXivNews🧪 MultiInpaintCOCO: Fine-Grained Visual Understanding in Multiple Languages
Previous research shows that vision-language (VL) models struggle to understand fine-grained image details and tend to focus on the overall layout. Moreover, any weakness in English tends to be further amplified in the m…
- 2026-11-02arXivNews🧪 LLMs Depend on Specialist Tools for Out-of-Distribution Generalization in MS/MS Structural Elucidation
A frontier language model was recently reported to solve 1D NMR structural elucidation without tools. We ask whether this capability transfers to tandem mass spectrometry (MS/MS) in the de novo setting, where the model m…
- 2026-10-30arXivNews🧪 Latent Reasoning in Continuous Space for Unified Multimodal Models
Unified Multimodal Models (UMMs) achieve remarkable success on diverse multimodal understanding and generation tasks, yet they still struggle to effectively leverage language-based chain-of-thought reasoning for image ge…
- 2026-10-30arXivNews🧪 Flide: Accelerating Decision Inference with Exact State Forking
Decision models such as Jev have emerged as a highly promising paradigm for LLM agent systems, providing lightweight and reliable categorical reasoning for rapid System One execution. However, existing generation-oriente…
- 2026-10-30arXivNews🧪 DecisionRank: On-Policy Distillation for Decision-Model Rerankers
Decision models target structured tasks by directly predicting choices or scores, avoiding autoregressive decoding latency. However, transferring a generative LLM's ranking knowledge to a decision model remains challengi…
- 2026-10-30arXivNews🧪 Subquadratic Attention with a Hierarchical Tree-Structured Indexer
The quadratic scaling of attention is a fundamental bottleneck limiting the long-context capabilities of large language models (LLMs). A variety of approaches have attempted to circumvent this, but they either fail to ma…
- 2026-10-30arXivNews🧪 Know When the Equation Is Wrong: Structural Uncertainty for LLM-Guided Symbolic Regression under Extrapolation
Large language models (LLMs) can help discover mathematical equations from data, but most LLM-guided symbolic regression methods focus on a single best equation without quantifying uncertainty over alternative functional…
- 2026-10-30arXivNews🧪 Aligning MLLMs with the Latent Structure of Human Cognition via Behavior-Derived Semantic Dimensions
Multimodal Large Language Models (MLLMs) have achieved impressive performance across a wide range of reasoning tasks, yet it remains unclear whether their internal representations and decision criteria align with the lat…
- 2026-10-30arXivNews🧪 Completeness and Cost of Retrieval Structures for Multi-Tool Requests in LLM Agents
An agent that must call several tools to fulfill a request fails when the tool retriever omits any one of them, yet tool retrievers are mostly built and evaluated on queries requiring a single tool. We compare representa…
- 2026-10-30arXivNews🧪 How Much Can Tool Calls Reveal About You? Privacy Leakage from Tool-Call Traces
Large language model (LLM)-based agents interact with external tools through protocols such as the Model Context Protocol (MCP), producing tool-call traces that may expose behavioral signals about users. In this work, we…
- 2026-10-30arXivNews🧪 SimXAI: A Simple Drop-in Layer Increases Interaction Quality and Understanding in Conversational XAI
Conversational explainable AI (ConvXAI) agents often use GUS-style architectures with separate modules for intent recognition, dialogue management, and template-based response generation. While faithful to the underlying…
- 2026-10-30arXivNews🧪 Trainable Vector Quantization for Large Language Models
Vector Quantization (VQ) is a rapidly evolving technique for compressing Large Language Model (LLM) weights, reducing memory usage, and speeding up inference. However, extreme compression deteriorates model performance, …
- 2026-10-30arXivNews🧪 What Standard Evaluations Hide About Detectors of Hijacked LLM Agents: Rare Attacks, Unseen Tools and Benchmark Transfer
Detectors can flag hijacked large language model (LLM) agents from the traces of the tools they call. In the eleven evaluations we audited, attacks or anomalies make up 16% to 86% of the test samples, no evaluation varie…
- 2026-10-30arXivNews🧪 Peeling the Matryoshka: Extracting Ontological Structure from Retrieval Embeddings
Taxonomy construction is essential for knowledge-intensive NLP yet remains costly: clustering-based methods (i) need careful per-corpus tuning and yield unstable hierarchies, while LLM-based pipelines (ii) depend on expe…
- 2026-10-30arXivNews🧪 Stepwise-Querying: Distilling Reasoning without Access to Teacher Chain-of-Thought
Reasoning distillation is widely used to transfer the reasoning capabilities of large language models to smaller students through teacher-generated supervision. In the black-box setting, however, teachers may expose only…
- 2026-10-30arXivNews🧪 Do LLMs Know When They Are Wrong About Molecules? In-Context Property Prediction with Self-Reported Uncertainty
Large language models (LLMs) are used in many domains, but molecular property prediction with them is still little explored. In this work we evaluate the capability of 7 frontier LLMs to predict molecular properties toge…
- 2026-10-30arXivNews🧪 Task Vectors Can Be Linearly Decomposed into Interpretable and Controllable Components
Task Vectors (TVs) provide a compact way to steer large language models, but they are typically treated as atomized directions merely extracted from hidden states, leaving their internal functional structure poorly under…
- 2026-10-29arXivNews🧪 Elucidating the Design Space of LM Data Attribution
Data attribution methods for Language Models (LMs) are typically evaluated using downstream tasks like fact retrieval. However, existing evaluations vary multiple dataset properties simultaneously, making it impossible t…
- 2026-10-29arXivNews🧪 ShallowDefend: Harnessing Shallow Safety Alignment for Multi-Turn Defender
Safety alignment has enabled large language models to reliably refuse harmful requests directly, yet the same request distributed across a multi-turn conversation still succeeds far too often. This brittleness has a mech…
- 2026-10-29arXivNews🧪 TextSeal2: Distortion-Free LLM Watermarking with Copula Mixing and Memoryless Races
We present TextSeal2, a distortion-free watermark for large language models that keeps its signal under speculative decoding: tokens that replace rejected drafts remain watermarked with the same keys, and the acceptance …
- 2026-10-29arXivNews🧪 Every Token Needs Its Own Teacher: Multi-teacher Adaptive On-policy Self-distillation
On-policy Self-distillation (OPSD) has proven effective for post-training large language models by constructing a teacher conditioned on privileged references. However, existing approaches keep the teacher fixed either t…
- 2026-10-29arXivNews🧪 Comparing Human Role-Players and LLM-Simulated Clients in Online Counselling Training: An Analysis of Counselling Patterns
This study investigates the capabilities of Large Language Models to simulate counselling clients in educational role-plays in comparison to human role-players. Initially, we recorded role-playing sessions, where novice …
- 2026-10-29arXivNews🧪 Ramanujan Challenge Results: AI-Assisted Evaluation Pipeline for Multi-Format Proofs
As AI's mathematical capabilities rapidly improve, meaningful benchmarks are shifting from university-level problems and math olympiads to research-level mathematics. The Ramanujan Challenge is a benchmark comprised of r…
- 2026-10-29arXivNews🧪 On the Fundamental Limits of Prefill-Based Decoding Length Prediction
Predicting how many tokens a large language model (LLM) will decode, using only prefill-phase hidden states, is a key primitive for inference scheduling. We show that current benchmarks conflate predictor quality with ta…
- 2026-10-29arXivNews🧪 IndicIPR-QA: A Benchmark for Extractive Question Answering on Indian IPR Laws
Legal Question Answering (QA) over statutory texts is a challenging task in Natural Language Processing (NLP), especially in low-resource settings with complex legal systems. It requires answers that are precise and grou…
- 2026-10-29arXivNews🧪 How I Aligned Your Model: Scaling Up Multilingual Safety Training with Templates
Safety alignment for Large Language Models is heavily focused on English with limited multilingual representation, particularly damaging low-resource language performance. Related open training datasets are often limited…
- 2026-10-29arXivNews🧪 A Low-Rank Space Captures Linear Alignment Between LLM and Human Neural Activity During Naturalistic Language Listening
Large language models (LLMs) are increasingly used as computational models of human language processing, yet it remains unclear which components of their representations drive alignment with neural activity. Here, we use…
- 2026-10-29arXivNews🧪 Agentic University: Collaborative Agents for Personalized Learning
Large language models support personalized tutoring, content generation, and adaptive learning paths. However, capability development requires these resources and interactions to form a coherent learning process that evo…
- 2026-10-29arXivNews🧪 Preserving Utility in Continual LLM Unlearning via Orthogonal Projections
Unlearning concerns the task of removing the influence of a sensitive portion of the training data, such as protected, copyrighted or private text, from a model without retraining it from scratch. While unlearning reques…
- 2026-10-29arXivNews🧪 Agentic LLM reasoning in pediatric diabetes outcome prediction from multimodal medical records
Large language model (LLM) agents are proposed for clinical prediction but are untested in pediatrics, where cohorts are small and outcomes are uncommon. Using records from 2,489 youth with type 2 diabetes (T2D) and 4,01…
- 2026-10-29arXivNews🧪 Don't Lose the Thread: Empowering Long-Horizon LLM Agents with Cognitive Resource Self-Allocation
Agents powered by large language models (LLMs) have demonstrated remarkable progress in solving complex reasoning tasks. However, LLM agents often falter on long-horizon tasks due to cognitive overload, as their working …
- 2026-10-29arXivNews🧪 A Unified Hessian-Guided Framework for Post-Training Quantization
Low-bit quantization enables efficient deployment of large language models by reducing memory footprint and computational cost. Achieving high accuracy at low precision requires selecting quantization ranges, linear tran…
- 2026-10-22arXivNews🧪 Reliable AI-Assisted Decisions via Selective Auditing
We consider online monitoring of an AI system that produces a sequence of decisions. At each round, the system outputs a proposed decision together with a confidence score estimating the trustworthiness of the decision. …
- 2026-10-22arXivNews🧪 Cost-Aware Abstention for LLM-Based IT Ticket Classification
Wrong automatic routing of an IT support ticket can cost more than human triage. We evaluate cost-aware abstention as an offline, cost-conditional readiness assessment: select a routing policy on calibration data under e…
- 2026-10-22arXivNews🧪 EpiSEM-Bench: Evaluating Safety and Evidence Recovery in LLM Agents under Missing Evidence
Tool-using language model agents rely on environmental facts to decide whether an action is permitted. When a tool response omits a safety-relevant fact, an agent may carry out a prohibited action even though the user re…
- 2026-10-22arXivNews🧪 Can an Agent Debug a Web Corpus? Agentic Auditing of Slovak FineWeb2
Multilingual pipelines such as FineWeb2 apply one recipe across a thousand languages, leaving the failure modes of individual languages unanticipated. We use an LLM once, as a corpus debugger rather than a classifier: a …
- 2026-10-22arXivNews🧪 Questioning Instrumental Convergence in RLVR: Checkpoint Evidence from OLMo-3
Instrumental convergence is often invoked as a general reason to expect capable agents to acquire or express power-seeking subgoals: self-preservation, resource acquisition, deception, or resistance to oversight which po…
- 2026-10-22arXivNews🧪 How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions
Purpose: To describe an evidence-aware retrieval evaluation protocol for a clinical retrieval-augmented generation (RAG) system over breast lesion management literature, addressing the dependence of retrieval scores on a…
- 2026-10-22arXivNews🧪 Rethinking Sequence Compression with Test-time Regression
Sequence compression is a fundamental operation and a critical information bottleneck in efficient language and multimodal models, and yet prevailing approaches based on pooling or learned projections remain underperform…
- 2026-10-22arXivNews🧪 On the Token Collapse Phenomenon in Textual Graph Soft Prompting
Recent methods for injecting graph structure into LLM prompts include graph soft prompting, in which a graph neural network (GNN) learns graph-specific tokens that capture relational information among entities in textual…
- 2026-10-22arXivNews🧪 Diffusion Language Models for Perplexity-Aware Black-Box Attacks
\emph{Continuous-space} attacks find prompts that trigger malicious behaviors, such as overthinking, in black-box LLMs by sampling or optimizing over a low-dimensional Gaussian latent space and decoding it to text throug…
- 2026-10-22arXivNews🧪 An Empirical Study of Recent Large Language Models for Knowledge Graph to Text Generation on Standard Benchmarks
Knowledge graph-to-text (KG-to-text) generation verbalizes a set of knowledge graph triples into fluent natural language. While fine-tuned encoder-decoder models have long been the standard approach, recent LLMs are beco…
- 2026-10-22arXivNews🧪 The Geometry of Metaphor: Probing and Steering Metaphor Representations in Large Language Models
Metaphor is a crucial aspect of human cognition. As such, we would like to understand how it is represented in large language models (LLMs) and how it might be controlled. We use mechanistic interpretability techniques t…
- 2026-10-22arXivNews🧪 Towards User Simulators That Stay On Task And Still Sound Natural
Users increasingly rely on AI systems for extended, multi-turn tasks, yet evidence indicates that LLM-based system performance degrades over prolonged interaction. To evaluate and improve AI assistants in such settings, …
- 2026-10-22arXivNews🧪 Training Small Language Models for Transferable Tool Selection
As LLM agents operate over corpora of more than ten thousand tools, selecting the right tool for a complex multi-step user instruction becomes a central bottleneck. Tool descriptions cannot all fit in context, and releva…
- 2026-10-22arXivNews🧪 Evaluating the Applicability of LLM Inference Optimizations on Apple Silicon
Apple Silicon is among the most widely used platforms for local LLM inference, yet nearly all inference optimizations are designed and validated on server-class NVIDIA GPUs under batched serving workloads. Which optimiza…
- 2026-10-22arXivNews🧪 From Structured Records to Patient Narratives: Preserving Clinical Alignment in LLM-Generated Health Summaries
As wearable and digital health systems increasingly generate longitudinal physiological records, communicating these observations in patient-accessible language remains a significant challenge. Large Language Models (LLM…
- 2026-10-16arXivNews🧪 Behavioral Couplings: From Formation to Behavioral Emergence in Language Models
Fine-tuning large language models (LLMs) can induce behaviors beyond those explicitly targeted. For example, training a model to respond more warmly can make it more sycophantic, and training it to write insecure code ca…
- 2026-10-16arXivNews🧪 AI-Driven Reproducibility and Analytical Robustness in Scientific Discovery
Reproducible and analytically robust research findings are essential to scientific progress, but evaluating these properties typically requires costly manual effort. We investigate whether LLM agents can help automate re…
- 2026-10-16arXivNews🧪 Steering beyond Language: Improving Multilingual Training-Free Text Embeddings via Paired-Residual Subspace Removal
While deriving text embeddings directly from frozen LLMs has emerged as a promising direction, existing methods focus almost exclusively on English, leaving multilingual settings largely unexplored. In this work, we pres…
- 2026-10-16arXivNews🧪 DLite: History-free Speculative Decoding for Agentic AI
Speculative decoding has become a mainstream technique for accelerating large language model (LLM) inference by using a lightweight draft model to generate candidate tokens that are subsequently verified by the target mo…
- 2026-10-16arXivNews🧪 The Italian lawmaking process: a unified and structured dataset
The Italian legislative process is documented in detailed parliamentary records hosted in institutional websites. However, much of this information is available only as unstructured text, limiting its systematic reuse. W…
- 2026-10-16arXivNews🧪 Recognizing Study Lineage Is Not Enough: Over-Crediting Same-Trial Evidence in LLM-Based Medical Verification
Publication count is not study count. A model can identify shared trial lineage correctly in a direct task yet over-credit a second publication from the same trial when aggregating evidence. We evaluate this behavior in …
- 2026-10-16arXivNews🧪 The Cognitive Cost of LLM Writing: A Reading-Time Comparison with Human Text
Although linguistic differences between human-written and Large Language Model (LLM)-generated texts have been extensively studied, their implications for the cognitive effort involved in reading remain less explored. In…
- 2026-10-16arXivNews🧪 VISTA: Steering LLMs with Latent User Values Inferred from a Few Survey Answers
Personalizing a language model requires knowing what a person values, which stays largely consistent across tasks. Yet most methods either learn task-specific preferences or place the user's profile in the prompt, where …
- 2026-10-16arXivNews🧪 Beyond the Benchmark: Conditioning, Domains and Failure Modes of Qwen3-TTS
Qwen3-TTS reports state-of-the-art zero-shot voice cloning, but its technical report leaves open how the model should be conditioned, how it behaves outside read speech, and how it fails. We characterise its two cloning …
- 2026-10-16arXivNews🧪 Deep LLM layers expose passage-level context in EEG during silent reading
In a previous report we showed that a decoder can recover open-vocabulary word-level information from 19-channel EEG recorded during silent reading, by aligning short EEG windows with hidden-state embeddings of the prese…
- 2026-10-16arXivNews🧪 ThetreStageAI: Multi-View Retrieval-Augmented Generation for Structured Bengali Theatre Production Planning
Staging a theatre performance requires coordinating dialogue, actor movement, stage directions, lighting focus, cue timing, and equipment constraints within the same production plan. This work presents ThetreStageAI, a r…
- 2026-10-16arXivNews🧪 SIT-Eval: Situation-Based Interactive Turn-by-Turn Evaluation of Conversational Agents
The rapid proliferation of conversational AI agents necessitates evaluation methods that assess performance across diverse dialogue scenarios, utilizing multiple situational criteria, as appropriate behavior depends on c…
- 2026-10-16arXivNews🧪 Boundary Detection for High-Dimensional Point Clouds
We introduce two new methods for boundary detection in high-dimensional point cloud data, intended to work in situations with non-uniform density, high ambient dimension, and substantial noise. Our first method fits a se…
- 2026-10-16arXivNews🧪 Analyzing Occupational Gender Bias across the LLM Training Lifecycle
Post-training is widely assumed to reduce the social biases language models inherit from pretraining, yet direct evidence for this assumption remains mixed. In this paper, we examine how gender disparities evolve across …
- 2026-10-16arXivNews🧪 MARS: Memory-Aware Routing for Session-Level LLM Assistants
Long-term LLM assistants must repeatedly decide what prior context to expose and which model should answer as an interaction evolves. Existing memory systems and model routers usually make these decisions separately, alt…
- 2026-10-15arXivNews🧪 MLExpert: Towards a Generalist Agentic Model for Autonomous Machine Learning Engineering
Large language models (LLMs) are expanding from assisting scientific research and engineering to autonomously developing and improving AI systems, advancing AI for AI (AI4AI) as a pathway toward recursive self-improvemen…
- 2026-10-15arXivNews🧪 Evaluation Awareness Beyond English: Do LLMs Act Differently When Tested in Indic Languages?
Large language models (LLMs) can often tell when they are being tested. This ability, known as evaluation awareness, can lead models to act more cautiously during safety evaluations than in real use. Existing work has st…
- 2026-10-15arXivNews🧪 Training Reasoning Models to Generate Diverse Scientific Ideas
One of the first steps of a research pipeline is generating ideas. Large Language Models (LLMs) are increasingly used to automate this step, but most of this work optimizes the quality of individual ideas, while overlook…
- 2026-10-15arXivNews🧪 Learning to Steer LLM Agents and Multi-Agent Systems
Large language model (LLM)-based agents and multi-agent systems increasingly tackle complex tasks through long-horizon tool use and inter-agent collaboration. However, these systems are prone to deviating from the overal…
- 2026-10-15arXivNews🧪 MindEval2: Clinically Grounded Patients and Rubrics for Evaluating Language Models in Mental Health Support
With people increasingly turning to AI chatbots for mental health support, the need to evaluate these tools is becoming more pressing. Recent benchmarks attempt to mimic a realistic setting by simulating multi-turn inter…
- 2026-10-15arXivNews🧪 Grid-Bench: Can LLMs Predict How Discrete Worlds Change?
Spatial instructions describe how to move objects, transform regions, or modify their surroundings. When several operations are applied in sequence, each acts on a configuration shaped by earlier changes. How accurately …
- 2026-10-15arXivNews🧪 AI Consilium: a Benchmark of LLM Clinical Multidisciplinary Second Opinions
Large language models (LLMs) can generate differential diagnoses for complex cases, but a useful second opinion must also be factually grounded, clinically coherent, actionable, and safe. We developed a multidimensional …
- 2026-10-15arXivNews🧪 Towards Continual Learning: Mitigating Forgetting With Subspace Tuning
Large language models (LLMs) acquire new skills through fine-tuning, but it can destroy capabilities they already have: catastrophic forgetting remains a central obstacle to continual learning in LLMs. Recent works conne…
- 2026-10-15arXivNews🧪 CAT-alyzing Honesty: Continuous Adversarial Training for Transferable LLM Honesty
Large language models (LLMs) are becoming prevalent in scenarios where honesty is critical. However, despite alignment training, these models still exhibit dishonest behaviour, such as outputting claims that contradict s…
- 2026-10-15arXivNews🧪 Librarian Agents: Training LLMs to Curate Long-Context Workspaces that Anticipate Future Queries
Reasoning over long document contexts remains a challenge for large language models (LLMs). Standard retrieval methods are inherently reactive, bottlenecking agents with complex, cross-document reasoning at inference tim…
- 2026-10-15arXivNews🧪 Baselines and Score Centering in Policy Gradient Estimation
Reinforcement learning has become a widely used approach to post-training large language models. In a typical implementation, learning is off-policy: The policy generating the responses differs from the policy being trai…
- 2026-10-15arXivNews🧪 BitSparse: Compact Activation Storage for ReLU Feed-Forward Networks
Reducing memory use in large language model (LLM) training is an ongoing challenge. Activation checkpointing saves memory by recomputation, while lossy compression changes the stored activations. The reemergence of spars…
- 2026-10-15arXivNews🧪 Not X, but When: Diagnosing a Mandarin LLM Writing Tic through Contextual Appropriateness
Recurring expressions in model-written text are often treated as signatures of machine authorship, yet most of them serve legitimate functions. Whether such an expression is a tic depends on whether the model knows when …
- 2026-10-15arXivNews🧪 Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing
External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and …
- 2026-10-15arXivNews🧪 Change the Number, Change the Answer: Assessing Rating Scale Sensitivity in LLM-Based Text Scoring
Large language models (LLMs) are increasingly used in computational social science to assign scalar scores to social and psychological constructs. However, studies use different rating scales, and whether their scores re…
- 2026-10-09arXivNews🧪 Task Context Shapes Component Roles in Language Models
Large language models reuse the same attention heads across tasks, but identifying these shared heads does not explain what they do differently in each task. A natural source of inspiration is task-dependent interactions…
- 2026-10-09arXivNews🧪 QTestBench: A Test Framework for Evaluating LLM-Generated Quantum Code
Large language models (LLMs) have shown strong results in classical code generation and are increasingly used to write the unit tests that safeguard that code. Whether they can do the same for quantum software is less cl…
- 2026-10-09arXivNews🧪 Tracing and Taming Hallucinated Terms via Subsequence-Association Filtering and Breadth-Aware Selection for LLM Query Expansion
Large language models (LLMs) are now a standard source of query expansion terms but they hallucinate. They inject non existent entities and off-topic terms that add ranking noise and can hurt strong retrievers. Existing …
- 2026-10-09arXivNews🧪 Not Just an Evaluation: A Case Study of Discourse Particle Sensitivity in Language Models
Discourse particles subtly shape the flow of discourse by reflecting conversational context and interlocutor attitudes, often leaving the truth-conditional meaning untouched. They are also often polyfunctional, with dist…
- 2026-10-09arXivNews🧪 Verifiable Retrieval for Legal Reasoning through Structure-driven Knowledge Graph
Any automation within reliability-critical contexts such as medicine or law has to be transparent and verifiable. Despite their advantages, current LLM-based systems do not meet these requirements due to their inherent b…
- 2026-10-09arXivNews🧪 Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-Correction
Large language models struggle to reliably identify and correct errors in their own reasoning. Unlike prior training-based approaches that fine-tune an LLM to generate revisions or feedback, we learn where to intervene i…
- 2026-10-09arXivNews🧪 A Multi-Agent LLM System for Automated Tuning of Specialized Neural Network Models
Many machine learning approaches are two-level: an expert selects a class of methods, within this class the choice of key components is critical and usually manual. This paper addresses the automatic tuning of these comp…
- 2026-10-09arXivNews🧪 A Critical Look at Power Sampling when Test Time Sharpening LLMs
Reinforcement learning with verifiable rewards (RLVR) has substantially improved LLM reasoning, yet growing evidence suggests it mainly performs distribution sharpening: concentrating probability mass on reasoning paths …
- 2026-10-09arXivNews🧪 AMLworld-Compact: Importance-Weighted Downsampling for Cost-Effective LLM Evaluation and Error Diagnosis
Evaluating large language models (LLMs) on AMLworld's smallest test splits is costly because each of over a million targets requires a separate graph prompt. Sampling reduces this cost, but small balanced subsets change …
- 2026-10-09arXivNews🧪 Training User Simulators with Latent Intrinsic Feedback
User simulators are gaining attention as environments to train LLM assistants that can better cope with the nuances of multi-turn conversations with real users. Prior work on user simulation has emphasized generating rea…
- 2026-10-09arXivNews🧪 Rationally Linearized MLPs
We present Rationally Linearized Multilayer Perceptrons(RaLiMPs), a new approach to efficiently linearizing MLPs using low-degree rational approximations of standard activation functions. Inspired by polynomial-based MLP…
- 2026-10-09arXivNews🧪 Not All Correct Fixes Run Alike: An Empirical Study of Patch Performance in Repository-Level Issue Resolution
Repository-level issue-resolution benchmarks such as SWE-bench evaluate submitted patches primarily based on whether they pass the correctness tests, leaving the runtime performance of different test-passing patches larg…
- 2026-10-09arXivNews🧪 Personalization Without Stereotyping: Do Speech LLMs Know When to Turn a Deaf Ear?
Recent speech LLMs can leverage rich paralinguistic cues, enabling more complex and personalized interactions. However, little work investigates how this sensitivity can lead to stereotyping, and existing evaluations lar…
- 2026-10-09arXivNews🧪 Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models
Intermittent ``spikes'' in loss, during the pre-training of Large Language Models (LLMs), remains a mysterious phenomenon both theoretically and empirically. In this paper, we show that simple quadratic models with heavy…
- 2026-10-09arXivNews🧪 Proactive Agentic Orchestration
Agentic orchestration delegates tasks to sub-agents with independent contexts, providing a key path to extending the effective execution horizon of large language model agents. However, existing orchestration methods fac…