How AI agents follow new arXiv papers
An AI agent follows new research by calling a wire that reads arXiv category feeds at runtime. It returns freshly announced preprints in AI, machine learning, computational linguistics and security, filtered by category and time window, each with title, abstract text and a link to the arXiv listing.
/mcp. Nothing here needs an API key or a signup.
A research agent has the sharpest possible version of the training-cutoff problem. The papers it most needs to know about are, by definition, the ones published after it was trained. No amount of prompting recovers them, and a model asked about recent work will reach for the most recent thing it does know and present it as current.
The four categories on the wire
| Filter value | arXiv category | What it covers |
|---|---|---|
ai | cs.AI | Artificial intelligence, reasoning, planning, agents |
ml | cs.LG | Machine learning, training methods, architectures |
nlp | cs.CL | Computation and language, LLM evaluation |
security | cs.CR | Cryptography and security, including model attacks |
Four categories out of the many arXiv hosts. There is no physics, no mathematics, no biology, no economics on this wire. arXiv had received 3,120,278 submissions in total as of 2 August 2026 across every field it carries, and these four feeds are a narrow slice of the current flow through it. An agent surveying a field outside computer science should query the arXiv API directly.
Cross-listing is worth knowing about. Authors routinely list a paper in more than one category, so a single preprint can arrive through both ai and ml. Query without a cat filter and expect some repeats across categories.
The call an agent makes
# free preview, top 3 results, no payment and no wallet curl "https://thebotwire.com/arxiv/preview?cat=ai" # paid, $0.005: new NLP papers announced in the last 3 days curl "https://thebotwire.com/arxiv/latest?cat=nlp&since=3d&limit=20" # topic search across all four categories curl "https://thebotwire.com/arxiv/latest?q=retrieval%20augmented&since=3d"
Parameters are cat (ai, ml, nlp, security), q (matched against title and abstract text), since (30m, 2h, 24h, 3d) and limit (1 to 50). The wire holds a 72-hour window and defaults to a 3-day lookback. The route costs $0.005 per call in USDC on Base, with no API key.
Why the default lookback is three days, not one
arXiv does not publish continuously. New submissions are announced in a single batch per weekday, with no announcement over the weekend. A 24-hour query run on a Sunday returns nothing, and an empty response reads to an agent exactly like a broken endpoint.
Three days is the smallest window that always contains at least one announcement batch, so a scheduled agent gets a real answer on every run regardless of which day it fires. An agent that wants strictly the newest batch can still pass since=24h on a weekday and get it.
This is the same shape of problem as the Federal Register dropping one dated edition a day, described in how agents track new US federal regulations. The general pattern of matching a query window to a source's real publishing rhythm is in how AI agents get real-time data, and the routing table lists which endpoint owns which question.
A preprint is not a result, and an agent must not flatten that
arXiv is a preprint server. Posting is subject to moderation, not peer review. Much of what appears there is excellent and some of it is wrong, and nothing in the metadata distinguishes the two.
The failure mode is specific and common: an agent reads an abstract claiming a benchmark record, reports it as an established finding, and a user acts on a number that no reviewer has checked. The abstract is evidence that a claim was made, not evidence that it holds.
Three habits keep an agent honest here:
- Attribute the claim to the paper, not to the field. "A preprint posted on
2 August reports X" is accurate. "X is now state of the art" is not.
- Say it is a preprint. One clause, and it changes how a reader weighs the
rest.
- Never present an abstract as a conclusion. Abstracts are written to be
persuasive and they omit the limitations section every time.
Security papers on cat=security deserve extra care, because a disclosed attack in a preprint is not the same as a confirmed advisory. The vendor-issued version of that signal sits on the CVE and advisory wire.
FAQ
Can an agent get every new arXiv paper from this wire?
No. The wire carries cs.AI, cs.LG, cs.CL and cs.CR. Every other arXiv category, including all of physics, mathematics and biology, is outside it. For full coverage of any field an agent should use the arXiv API directly.
Why does the same paper appear twice?
Cross-listing. Authors can list a preprint under a primary category and one or more secondary ones, so a paper listed in both cs.AI and cs.LG arrives through both feeds. Filtering to a single cat value removes the duplication.
How would an agent watch one research topic?
Pass the topic to q and run it on the weekday schedule that matches arXiv's own. One daily call across four categories is about 20 calls a month, or roughly $0.10 at $0.005 a call, which makes a standing literature watch effectively free compared with the reading it saves.
Does the agent need an account?
No. The route answers HTTP 402 with a price offer, an x402 client signs a USDC authorization on Base and retries, and the papers come back. Wallet requirements are listed in what an agent wallet needs on Base.
Sources
Paper metadata on this wire comes from the arXiv category feeds for cs.AI, cs.LG, cs.CL and cs.CR. The cumulative submission figure is published by arXiv at Monthly Submissions, which reported 3,120,278 total submissions received as of 2 August 2026. Poll cadence and wire count for this service are live at thebotwire.com/health.
Related: How AI agents get real-time data past the training cutoff · How do AI agents monitor CVEs and security advisories?