Artificial Intelligence research

What AI tools are, how they work, where your data goes, and how to use and build them responsibly at work.

Our articles on Artificial Intelligence →

Filters
Format
Peer review
Publisher
Added

688 entries

The summaries are open to everyone. Sign in, free, to read the full entry.

  • Preprint
  • Not peer reviewed

Preprint describes single-pass method for routing prompts to the best LLM expert

Original title: ScoutRoute: Efficient Mixture-of-Experts Routing Using Internal Language Model Signals

A preprint reports a lightweight routing method that picks which language model should handle a prompt using one inexpensive scout model's internal signals.

Rajdeep Pandhare et al. · Added

  • Preprint
  • Not peer reviewed

Researchers report pair-norm guided method cuts KV-cache bits in long-output LLMs

Original title: PN-Mix: Pair-Norm Guided Mixed-Precision Key Cache Quantization for Efficient Long-Output LLM Inference

A preprint reports a mixed-precision key-cache quantization scheme that uses query-key pair norms to preserve accuracy at very low bit-widths.

Gil Jae Song et al. · Added

  • Preprint
  • Not peer reviewed
  • From AXA AI Research

Preprint profiles how input-token length drives LLM energy use on GPUs

Original title: The Cost of Context: Profiling the Energy Footprint of Input Tokens in Large Language Models

A preprint measures how context length and serving engines shape the energy cost of processing LLM input tokens.

Added

  • Preprint
  • Not peer reviewed

Preprint adds token identity to gray-box hallucination detection in LLMs

Original title: Gray-Box Hallucination Detection in LLMs with Token Identities

A preprint reports that factoring in which tokens a model considered, not just their probabilities, improves hallucination detection accuracy.

Shaked Goldshtein et al. · Added

  • Preprint
  • Not peer reviewed

Researchers train AI agents to pre-organise documents for future questions

Original title: Librarian Agents: Training LLMs to Curate Long-Context Workspaces that Anticipate Future Queries

A preprint describes training an agent to restructure document collections in advance so another agent can answer queries more accurately later.

Anikait Singh et al. · Added

  • Preprint
  • Not peer reviewed
  • From Amazon

A preprint proposes letting LLMs decide when to retrieve help for translation

Original title: Retrieve What Helps, Only When It Helps: Agentic Reinforcement Learning for Selective Retrieval-Augmented Machine Translation

Researchers report a reinforcement-learning system that learns when and what to retrieve for machine translation, beating fixed retrieval strategies.

Added

  • Preprint
  • Not peer reviewed
  • From Toyota Motor Europe

A preprint reports client-tailored sub-networks for federated LLM fine-tuning

Original title: Optimal Hydra: Model Heterogeneous Federated Learning for LLMs using Data-Informed Hydra-Nets

Researchers propose Optimal Hydra, which builds client-specific sub-networks for federated fine-tuning of large language models under uneven resource limits.

Added