What's the current meta on task/dataset state-of-the-art since paperswithcode is

The question itself reveals something real. A researcher or practitioner posted to LocalLLaMA asking a quietly urgent question: now that Papers With Code appears to be gone — or at least unreliable — where does the community go to track state-of-the-art results across tasks and datasets? The thread also doubled as an informal call to share computer-use agent work, which tells you something about where the community's attention is sitting right now. Papers With Code was never glamorous infrastructure. It was the kind of resource you only noticed when it disappeared — a centralised, community-trusted ledger of who was beating whom on which benchmark, and by how much. If that ledger is dark, or degraded, the practical cost falls hardest on people trying to situate their own work honestly against the field.

If confirmed, here is what this means. The benchmark-tracking ecosystem has a genuine gap. Papers With Code served as a neutral aggregator that kept leaderboard culture honest, or at least visible. Without it, the community fragments: some will turn to Hugging Face's Open LLM Leaderboard, others to individual lab blogs, others to arXiv abstracts that may or may not be up to date. That fragmentation doesn't just create inconvenience — it creates information asymmetry, where well-resourced labs can track competitive position easily while independent researchers lose their most accessible reference point. The computer-use agent angle is a secondary signal worth taking seriously: that subfield is moving fast enough that practitioners are already asking each other for informal state-of-the-art summaries, which is usually a sign that formal tracking infrastructure hasn't caught up.

Watch for any official statement from the Papers With Code team or its parent organisation about the platform's status, and for whether any alternative — Hugging Face, Semantic Scholar, or a community-built replacement — begins consolidating this tracking role explicitly.

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →