AI NEWSSee every step of AI
THE NEXT THING, IN PERSPECTIVEIndependent AI news

The latest AI news, in focus.

Official announcements and industry reporting. Follow the timeline of AI.

In focusAgents & automation Models AI creation Research & methods

Today's news

News feed
AI NEWS × FOXAIFind your next step

From the latest news to tools that work for you.

Explore AI tools

Discover AI tools

Swipe to explore →
ClaudeAI Assistants & Search

Claude is an AI assistant launched by Anthropic that can assist with writing, reading materials, analyzing data, and programming through conversation, and can organize some tasks into editable documents, spreadsheets, or presentation files. It’s ideal for individuals and teams who want to connect their ideas, materials, and drafts.

WritingAnalysisProgrammingFree entry availableView details GeminiAI Assistants & Search

Gemini is Google’s AI assistant, which can assist with writing, planning, organizing information, and analyzing uploaded files through conversation. It can also use Deep Research to retrieve information on a topic and generate research reports.

Q&AWritingAssistantPricing unverifiedView details MidjourneyImage Generation & Editing

Midjourney is an AI-powered creative tool that generates visual artworks from text and reference images. On the web-based Create page, you can enter prompts, compare generated versions, and then continue creating using features such as variations, editing, upscaling, or converting images to video.

Image GenerationText-to-imageVisual CreativityPaidView details KreaImage Generation & Editing

Krea is an AI visual creation workspace that can generate images from text or reference images, compare different models and variants, and then perform editing, detail enhancement, and upscaling. It also provides access to video and other creative tools.

Image GenerationVideo3DPricing unverifiedView details RunwayVideo & Animation

Runway is an AI platform that integrates video generation, visual editing, and creative workflows. Starting from text, images, or existing clips, users can generate or modify shots, then extend, upscale, and export them—serving concept shorts, advertisements, and other visual productions.

Video generationCreative VideoVisual CreationFree entry availableView details SunoMusic & Audio

Suno is an AI music platform that creates songs from text descriptions, lyrics, and reference materials. Users can generate vocal tracks or instrumental music, then use features like editing, remixing, and audio track separation to further produce and share their creations.

Music generationsongAudioFree entry availableView details ElevenLabsSpeech & Transcription

ElevenLabs is a platform that offers AI-powered voice generation, audio creation, and voice-enabled agents. Creators can produce voiceovers, audiobooks, podcasts, and localized content, while developers can leverage its APIs to integrate speech synthesis, transcription, and conversational capabilities.

VoiceoverText to speechVoice agentsFree entry availableView details Notion AIOffice & Productivity

Notion AI is an AI assistant integrated into Notion workspaces, designed to search team knowledge, generate and edit pages, manage databases, and organize meeting notes. By leveraging the context of your workspace and connected apps, it helps you complete information retrieval, content organization, and follow-up tasks all within the same working environment.

Knowledge BaseDocumentOfficeFree entry availableView details GammaOffice & Productivity

Gamma is an AI-powered tool for creating presentations, documents, web pages, and visual content. It can generate content starting from a goal, an outline, or existing materials, and then refine the final output through conversational prompts, layout adjustments, and free-form editing.

PPTPresentationDocumentFree entry availableView details CursorCoding & Development

Cursor is an AI programming product designed to support software development tasks, assisting with code planning, modification, testing, and review within the code context, and offering usage options such as desktop, command-line, and cloud-based agents.

ProgrammingCodeAI IDEFree entry availableView details

AI, as it happens

950 published stories
Model evaluations & benchmarks · Research paper · 8 storiesClear filters ×
2026-10-26
Follow the timeline
12:00
aarXiv cs.CL·Selected82

SAGE Benchmark and GAR Framework Released: Advancing Multimodal Semantic Alignment Evaluation

On October 26, 2026, arXiv published the paper arXiv:2610.31838v1, introducing Sense-Aligned Grounding Evaluation (SAGE)—a unified 10-candidate image-selection benchmark—along with the training‑agnostic Gloss-Augmented Reasoning (GAR) framework, designed for cross‑noun, verb, and entity‑centered multimodal grounding evaluation.

Why it mattersThis study is the first to unify three types of tasks—VWSD, VerSe, and WikiDiverse—under a term-centric grounded evaluation protocol, introducing a mechanism for identifying hard negative samples and context‑exchange diagnostics. Empirical results demonstrate that the synergistic effect of definition enhancement and constraint‑guided reasoning can significantly improve the Hits@1 metric (from 65.90 to 71.22), thereby providing a more fine-grained, interpretable new evaluation paradigm for multimodal semantic alignment.
Model evaluations & benchmarksRead original Timeline and related coverage
12:00
aarXiv cs.CL·Selected89

Query recall determines the retrieval performance of classical Arabic poetry: BM25 and dense encoders show markedly divergent behavior as query abstraction increases.

A recent study published on October 26, 2026, on arXiv (arXiv:2610.31821v1) shows that, in classical Arabic poetry retrieval tasks, the degree to which users retain fragments of poetic lines—such as whether they can recall half a line—plays a more critical role in determining retrieval performance than model capabilities. BM25 outperforms all dense encoders, including state-of-the-art models with 8B parameters, on “tip-of-the-tongue” queries, but falls significantly behind on abstract queries.

Why it mattersThis study, through systematic benchmarking using a bilingual corpus, a three-index model, and a dual-evaluation protocol, for the first time quantitatively reveals the dominant influence of query abstraction on different retrieval paradigms (lexical vs. dense), and—after being validated by both human annotators and open-source weight models—the conclusions demonstrate methodological universality and empirical robustness.
Model evaluations & benchmarksRead original Timeline and related coverage
12:00
aarXiv cs.CL·Selected87

In LLM evaluation, relying solely on the overall F1 score to validate automated scorers carries the risk of misleading results: a new study underscores the need to calibrate for prompt-specific differences.

An arXiv paper (2610.31678v1) points out that, in interactive evaluations of large language models, relying solely on the overall accuracy or F1 score of automated scorers can mask prompt-specific errors, leading to misjudgments of prompt effects. Empirical evidence shows that the same scorer exhibits substantial variation in its false-positive rate across different prompts (2.6%–33.3%), and a seemingly significant 9.3-point effect shrinks to 2.3 points—and becomes non-significant—under dual-LLM review.

Why it mattersThis study, based on real experimental data (6 models, 180 fictional entity‑based questions, and 6 prompt conditions), reveals a widespread methodological flaw in current LLM evaluations: equating the scorer’s overall performance with its reliability on key benchmark tasks. Its central claim—that each prompt must be audited separately and uncertainty must be incorporated—rests on clear empirical evidence and offers actionable recommendations, making it highly timely (published on 2026‑10‑26) and backed by a credible source (the arXiv preprint platform).
Model evaluations & benchmarksRead original Timeline and related coverage
12:00
aarXiv cs.CL·Selected87

New research reveals serious measurement bias in LLM-based math tutoring assessments: exact-match scoring underestimates effectiveness by nearly 40 percentage points.

The paper “MisconceptDialogue: Evaluation Criteria Shape Measured Success in LLM Math Tutoring,” published on arXiv on October 26, 2026, introduces the MISCONCEPTDIALOGUE automated evaluation framework, which assesses the performance of five open-source small-parameter LLMs (7B–14B) as math tutoring models through over 5,000 rounds of dialogue. The study finds that the mainstream exact-match scoring method achieves only a 42.1% remediation success rate, whereas an expert‑calibrated LLM referee evaluates the same dialogues at 81.3%, a gap of 39.2 percentage points; moreover, this discrepancy is not accidental—four types of LLM referees show high agreement with 200 human‑annotated results, with a maximum kappa coefficient of 0.91. In addition, the models exhibit virtually no differentiation in their responses to diagnostic information (correct or incorrect concepts), indicating their limited ability to effectively leverage such diagnostic inputs.

Why it mattersThis study directly addresses the core flaw in current methodologies for evaluating LLM-based educational applications: reliance on a single, rigid automated scoring system can severely distort assessments of actual competence. Its large-scale simulation experiments, multi-rater convergence validation, and empirical analysis of the breakdown in diagnostic–instructional coupling provide critical warnings and a replicable methodological benchmark for standardizing AI-driven educational assessment.
Model evaluations & benchmarksRead original Timeline and related coverage
2026-10-24
Follow the timeline
12:00
aarXiv cs.CL·Selected87

TRIAD Release: The First Multimodal Large Model Evaluation Benchmark for All-Modal Ambiguity Resolution

On October 24, 2026, researchers published the paper arXiv:2610.30841v1 on arXiv, officially introducing the TRIAD benchmark—a new evaluation framework designed to assess the ability of text–image–audio tri-modal systems to resolve cross-modal ambiguities. The benchmark comprises 327 hand-crafted tri-modal samples, spanning 86 scenario groups and 18 categories of cross-modal ambiguity types.

Why it mattersThis achievement directly addresses a core blind spot in current multimodal large-model evaluations: existing benchmarks focus on perception or reasoning under deterministic, single-modal inputs. In contrast, TRIAD is the first to systematically target “modal-complementary disambiguation” as its evaluation objective. Through rigorously designed leave-one-modal-out counterfactual tests, it reveals critical shortcomings—particularly in audio processing—and highlights weak scene-level robustness, thereby providing a reproducible diagnostic protocol and taxonomy for assessing next-generation all‑modal models.
Model evaluations & benchmarksRead original Timeline and related coverage
12:00
aarXiv cs.CL·Selected87

FusionEval Released: A New Benchmark for Large Language Model Fusion

On October 24, 2026, researchers published the paper arXiv:2610.30162v1 on arXiv, introducing FusionEval—the first unified benchmark specifically designed to evaluate fusion methods for large language models. It covers vulnerable aspects such as reasoning chain length and tool invocation, and supports comparisons between fine-tuning-based and zero-shot fusion approaches.

Why it mattersThis benchmark fills the gap left by existing evaluations, which inadequately cover long-chain reasoning and tool usage; it clearly distinguishes between average performance and worst-case capability retention, provides a reproducible expert pool (based on Qwen3/Llama), multi-dimensional metrics (including GPU memory and runtime), and open-source code, offering strong practical guidance.
Model evaluations & benchmarksRead original Timeline and related coverage
12:00
aarXiv cs.CL·Selected92

Research reveals the “norm–oracle gap” problem in benchmarking coding agents.

A paper published on arXiv on October 24, 2026, points out that current mainstream benchmarks for coding AIs—such as SWE-Milestone—suffer from a “specification–oracle gap”: the natural-language descriptions of tasks fail to capture crucial implementation details required for testing (e.g., constant names, module paths, and precise error messages), resulting in evaluations that measure the ability to reproduce upstream code rather than genuine understanding and reasoning.

Why it mattersThis study is the first to formally define this type of bias, develop a static analysis tool covering five languages (with 89.2% precision and 92.9% recall), and empirically demonstrate in SWE-Milestone that 25 milestone tasks contain non-inferable implicit dependencies, significantly increasing the failure rate (80.6% vs. 48.4%). These findings reveal that current leaderboards may systematically favor “name‑copying” agents. The results have been made publicly available, including the open-source auditing tool and corrective resources, offering both methodological and practical value.
Model evaluations & benchmarksRead original Timeline and related coverage
12:00
aarXiv cs.CL·Selected82

New arXiv paper compares the performance of joint scoring and item-by-item scoring for compact encoders.

On October 24, 2026, arXiv published the paper arXiv:2610.30970v1, which systematically evaluates design choices for compact encoders with model sizes ranging from 17 million to 1 billion parameters in closed-set decision-making tasks (such as tool selection): joint reading of all options versus independent scoring of each option. The study finds that, at a parameter scale of 32 million, option-by-option scoring significantly outperforms joint scoring on skill metrics; however, it incurs higher computational costs and exhibits more uneven latency. Multiple System1-Arena benchmarks show that joint encoders with 68 million and 150 million parameters surpass the 435-million-parameter DeBERTa-v3 zero-shot classifier.

Why it mattersThis paper presents a key empirical comparison of lightweight design approaches for downstream decision-making modules in large models, covering engineering considerations such as architecture selection, initialization dependencies, the latency–accuracy trade-off, and input-order robustness. The data are based on experiments conducted with three random seeds and validated against both public and private benchmarks. The publication date (2026-10-24) matches the current UTC date (2026-10-25), making this the latest credible research advancement.
Model evaluations & benchmarksRead original Timeline and related coverage
Every update links back to its source.
STAY CURIOUS. STAY INFORMED.

Stay informed about the changes that matter.

Give your curiosity direction. Make every day of reading count.

Subscribe via RSS