Baidu Wenxin Assistant Tops SuperCLUE XClaw After Leading PinchBench v2
Baidu Wenxin Assistant has taken first place in another agent-style benchmark. In SuperCLUE’s August 2026 XClaw product evaluation, Wenxin Assistant received an overall score of 97
Baidu Wenxin Assistant Tops SuperCLUE XClaw After Leading PinchBench v2
Introduction
Baidu Wenxin Assistant has taken first place in another agent-style benchmark.
In SuperCLUE's August 2026 XClaw product evaluation, Wenxin Assistant received an overall score of 97.62, the highest score in the published snapshot.
Its category scores were:
| Capability | Score |
|---|---|
| Coding | 90.28 |
| Content creation | 99.44 |
| Data processing | 98.86 |
| Research analysis | 96.44 |
| Memory | 100.00 |
The result arrived less than three weeks after another strong showing.
In a July snapshot of PinchBench v2, Baidu's task agent—submitted as Orion Mission Mode—recorded a 94.6% best score and a 94.4% average score, placing it at the top of that leaderboard snapshot.
The two benchmarks are different. SuperCLUE XClaw focuses on Chinese agent products and practical deliverables across five capability dimensions. PinchBench v2, created by Kilo, is built around real-world computer and automation tasks.
Together, they point to the same shift:
Agent evaluation is moving from "Can the model answer correctly?" toward "Can the system finish the job and deliver something usable?"
A language model can know the answer and still fail as an agent because it forgets requirements, chooses the wrong tool, mishandles files, stops halfway through a workflow, or returns the wrong artifact.
That makes the latest Wenxin results more about task execution than raw language-model intelligence.
Wenxin Assistant Takes First Place in SuperCLUE XClaw
SuperCLUE describes XClaw as a product-oriented evaluation for "Claw"-style AI assistants.
Rather than relying mainly on multiple-choice questions, the benchmark emphasizes completed deliverables.
The August 2026 snapshot ranks the leading products as follows:
| Rank | Product | Score |
|---|---|---|
| 1 | Baidu Wenxin Assistant | 97.62 |
| 2 | MiMoClaw | 96.74 |
| 3 | WorkBuddy | 96.61 |
| 4 | KimiClaw | 96.01 |
| 5 | MaxClaw | 94.79 |
The benchmark evaluates five dimensions:
- Data processing.
- Content creation.
- Memory.
- Coding.
- Research analysis.
The basic logic is straightforward: the agent receives a task and must produce a final artifact or result that can actually be judged.
That makes instruction following, file handling, tool use, and long-horizon execution part of the score.
Memory Reaches 100
The most eye-catching category score is 100.00 in memory.
Memory matters because real work rarely fits inside one isolated prompt.
A user may provide constraints early in a conversation and expect the agent to respect them much later.
For example:
Turn 1:
Use only Q2 2026 data.
Turn 3:
Keep the report under 10 pages.
Turn 6:
Use the same product segmentation as the spreadsheet.
Turn 10:
Generate the final Word document.
An agent that forgets the first instruction can produce a polished but unusable deliverable.
Memory therefore affects:
- Requirement retention.
- Multi-step planning.
- Consistency.
- Rework.
- User trust.
- Long-running task completion.
A perfect category score on one benchmark does not mean the product will never forget information in arbitrary real-world sessions. It does show that Wenxin performed extremely well on the memory tasks included in this XClaw evaluation.
Data Processing Scores 98.86
Wenxin Assistant received 98.86 in data processing.
The source describes this category as testing whether the system can interpret fields, combine information, preserve numerical precision, and produce structured outputs.
These are deceptively difficult tasks.
A general chat model may summarize a spreadsheet well while still making one subtle error in:
- A date filter.
- A subtotal.
- A cross-sheet lookup.
- A unit conversion.
- A decimal value.
- A category mapping.
For business use, one incorrect number can invalidate an entire document.
The source publisher tested Wenxin with a company-information file and asked it to produce a 2026 Q2 business plan as a Word document.
According to the test record, the agent:
- Used Pandoc to extract the uploaded file.
- Structured the source information.
- Loaded a Word-processing capability.
- Generated a formatted document.
- Returned a document containing more than 6,000 Chinese characters and 148 paragraphs.
This shows the difference between chat and agent work.
A chat model might write the plan inside the conversation.
An agent workflow can do this:
Read source file
→ extract structured information
→ draft content
→ format Word document
→ validate output
→ return a file
The artifact, not the prose response, becomes the end product.
Content Creation Scores 99.44
Wenxin scored 99.44 for content creation.
In an agent benchmark, content creation is not simply creative writing.
The system may need to satisfy multiple constraints at once:
- Required format.
- Tone.
- Length.
- Section structure.
- Audience.
- File type.
- Factual grounding.
- Visual presentation.
A draft can be grammatically good and still fail because it
ignores the requested format.
That is why product benchmarks increasingly score completion rather than linguistic quality alone.
Coding Scores 90.28
Wenxin’s lowest XClaw category was coding at 90.28.
That is still a strong score, but the gap relative to content creation and data processing is informative.
Coding agents have to manage a wider operational loop:
Understand requirement
→ choose stack
→ write files
→ execute or preview
→ inspect errors
→ fix
→ verify interaction
→ package result
The source publisher tested the product with a one-sentence request for a 3D Solar System simulator.
The reported workflow used Three.js and returned a 31 KB single-file HTML application.
The article also shows a weather-simulation teaching page generated through a similar interactive-web workflow.
These are illustrative demos rather than official XClaw benchmark items.
Research Analysis Scores 96.44
Wenxin received 96.44 in research analysis.
A serious research task may involve:
- Understanding the question.
- Breaking it into subquestions.
- Searching multiple sources.
- Evaluating source quality.
- Comparing conflicting claims.
- Checking dates.
- Extracting numerical values.
- Building a structured argument.
- Adding citations.
- Producing a report.
The source article describes two test cases.
Researching the Three-Dimensional Kakeya Problem
The publisher asked Wenxin to research the three-dimensional Kakeya conjecture in the context of Fields Medalist Hong Wang.
The reported agent behavior was:
- Plan a six-step research process.
- Launch several subagents in parallel.
- Search 16 academic sources.
- Produce a Markdown document.
- Produce a 62 KB interactive HTML result.
The number of sources is not a quality metric by itself.
What matters is whether the final agent uses authoritative sources, attributes claims correctly, resolves conflicts, avoids outdated data, and separates facts from interpretation.
Comparing Recent AI Models and Prices
The publisher also asked Wenxin to analyze the capabilities and pricing of major domestic and international models from the previous month.
The article says the agent:
- Loaded an industry-research skill.
- Searched 45 sources across two rounds.
- Detected uncertainty in some key figures.
- Performed another targeted search across 29 sources.
- Cross-checked pricing.
- Produced a report of roughly 7,000 Chinese characters with charts.
The useful research loop is:
Search
→ identify uncertainty
→ search again
→ compare sources
→ resolve or flag disagreement
→ write
That extra verification pass is often where research quality improves.
A Second First Place: PinchBench v2
The SuperCLUE result followed a July first-place showing on PinchBench v2.
PinchBench was created by Kilo to evaluate agents on real-world workflows rather than traditional question-answer benchmarks.
Kilo's PinchBench 2.0 release expanded the benchmark to 148 tasks and added stronger grading and leaderboard rules.
In the July leaderboard snapshot reproduced by the source article, Baidu's system appeared as:
Orion-Mission-Mode
with:
Best score: 94.6%
Average score: 94.4%
The screenshot places Orion Mission Mode ahead of systems based on models from Anthropic, Alibaba, NVIDIA, Xiaomi, xAI, OpenAI, and others in that particular snapshot.
The important word is snapshot.
Agent leaderboards change rapidly.
Models, harnesses, prompts, tool policies, and benchmark submissions can all be updated.
A July first-place result should therefore be cited with its date rather than treated as a permanent global ranking.
What PinchBench v2 Actually Tests
Kilo describes PinchBench 2.0 as a benchmark of real-world agent workflows.
It contains tasks that require a system to use tools and complete operations rather than simply select an answer.
The benchmark covers categories such as:
- Writing.
- Creative work.
- Data analysis.
- Research and knowledge work.
- Code and operations.
- Other computer-based workflows.
The source article says 59 model or agent entries were represented in the leaderboard snapshot.
That count can change as submissions are added or updated.
The benchmark itself is more stable than the leaderboard population.
PinchBench 2.0's official release describes:
148 tasks
The source and several July reports describe Wenxin's evaluation across 147 completed tasks while also describing PinchBench as a 148-task benchmark.
The safest interpretation is:
PinchBench v2 contains 148 tasks; the reported Orion Mission Mode evaluation may have produced scored results on 147 of them in that snapshot.
This distinction matters because benchmark reporting often mixes the size of the benchmark with the number of successfully
completed runs.
Best Score vs. Average Score
The source emphasizes that Orion Mission Mode recorded:
94.6% best score
94.4% average score
The 0.2-point gap is small.
That suggests low variation across the reported runs.
However, it should not be interpreted as a universal stability guarantee.
Benchmark variance can depend on:
- Number of repetitions.
- Sampling temperature.
- Tool availability.
- External websites.
- Network conditions.
- Grader behavior.
- Agent timeouts.
- Model updates.
The practical lesson is simply that the reported PinchBench run was not built around one isolated lucky result.
Its average remained close to its best score.
The Agent Is More Than the Underlying Model
One of the most important points in the source article is that the benchmark is evaluating a product or agent system, not a naked language model.
The task agent can combine:
- A foundation model.
- Search.
- Memory.
- File handling.
- Tool selection.
- Planning.
- Subagents.
- Document-generation skills.
- Browser or web access.
- Code execution.
- Validation.
This can be expressed as:
Agent result
=
model capability
+
tools
+
memory
+
planning
+
search
+
execution environment
+
verification
This is why one should be careful when saying:
“Model X beat Model Y.”
The leaderboard may actually compare two different agent stacks using different tools and orchestration.
A more precise description is:
“Agent system X scored above agent system Y under this benchmark configuration.”
That wording becomes increasingly important as AI products turn into complex software systems.
From Answering Questions to Completing Work
The source article frames 2026 as the year in which the standard for a useful AI product is shifting.
The older interaction looked like this:
User asks
→ model answers
→ user performs the work
The emerging agent pattern looks like this:
User gives goal
→ agent plans
→ agent gathers context
→ agent calls tools
→ agent creates files
→ agent checks results
→ agent delivers artifact
This changes what users notice.
A model can be extremely knowledgeable but frustrating if it cannot:
- Remember earlier requirements.
- Open the file.
- Format the spreadsheet.
- Create the requested document.
- Finish all steps.
- Correct its own mistakes.
The new success condition is closer to:
Did the task actually get finished?
than:
Was the answer impressive?
Wenxin’s Task Entry Point
The BAAI article shows the “Task” option directly inside the Wenxin interface.
Baidu’s official Wenxin website describes the product as a multimodal AI assistant for:
- Trusted creation.
- Deep search.
- Intelligent tool use.
- Document work.
- Writing.
- Images.
Cross-device usage.
The Baidu App also lists Wenxin Assistant as an integrated AI feature for deep research, search, writing, image generation, video generation, and conversational assistance.
This confirms that task-oriented AI has moved into Baidu’s mainstream consumer surfaces rather than remaining a developer-only experiment.
Is Wenxin Assistant Really Free and Unlimited?
The source article repeatedly highlights one commercial point:
Wenxin Assistant is free and has no paywall.
Baidu’s official Wenxin pages currently offer free access or free experience.
That is easy to verify.
The stronger statement—permanently unlimited for every task-agent feature—is harder to verify from a stable official policy page.
AI products can introduce:
- Daily quotas.
- Concurrency limits.
- Feature-specific limits.
- Temporary promotions.
- Account tiers.
- Regional restrictions.
- Future pricing changes.
For publication, the safer wording is:
Wenxin Assistant is currently available to individual users with free-access options, and the task experience shown in the source article did not require a paid subscription.
Do not build a long-term cost comparison around “unlimited forever” unless Baidu publishes a specific policy guaranteeing it.
Why Search Experience Can Help an Agent
The final section of the source article argues that Baidu’s search history gives it a structural advantage in agent design.
There is a real analogy.
A search engine handles something like:
User query
→ intent understanding
→ query decomposition
→ retrieval
→ ranking
→ result aggregation
→ response
An agent handles:
User goal
→ intent understanding
→ task decomposition
→ tool selection
→ execution
→ result aggregation
→ delivery
The two pipelines are not identical.
An agent has a much larger action space and carries greater execution risk.
But several technical capabilities transfer naturally:
- Intent understanding.
- Query rewriting.
- Retrieval.
- Source ranking.
- Session context.
- Freshness handling.
- Deduplication.
- Evidence aggregation.
This is especially relevant to research agents.
A system that already has strong search infrastructure can build deeper workflows on top of it.
Search Query Understanding vs. Agent Task Understanding
Consider a traditional search request:
Find the cheapest flight from Beijing to Shanghai.
A search system may need to infer:
- Origin.
- Destination.
- Travel dates.
- Price preference.
- Eligible flight inventory.
- Sort order.
An agent asked:
Find the cheapest Beijing–Shanghai flight and prepare an itinerary.
may need to add:
- Tool selection.
- Multiple searches.
- Comparison.
- Constraint checking.
- File generation.
- Possibly a calendar or booking step.
The first half of the problem resembles search.
The second half is action orchestration.
Search experience provides useful components, but agent quality still depends on the execution layer.
Memory and Search Sessions Are Related—but Not the Same
The source also connects Wenxin’s memory score with Baidu’s experience in search-session understanding.
There is
some conceptual overlap.
Both systems need to infer what information from earlier interactions remains relevant.
A search session may contain:
Query 1: electric cars
Query 2: range over 600 km
Query 3: under RMB 250,000
The system should understand that the third query is still about electric cars.
An agent memory system has a harder job.
It may need to remember:
- User preferences.
- Task constraints.
- File-derived facts.
- Decisions.
- Tool outputs.
- Temporary state.
- Long-term preferences.
Search-session expertise is useful, but persistent agent memory requires additional storage, retrieval, privacy, and relevance mechanisms.
Research Analysis Is Where Baidu’s Search Stack Is Most Directly Relevant
Among the five XClaw categories, research analysis is the clearest place where Baidu’s search background can transfer directly.
A research agent needs:
- Search coverage.
- Fresh information.
- Query expansion.
- Ranking.
- Citation handling.
- Source comparison.
- Entity understanding.
- Multilingual retrieval.
Baidu’s official Qianfan AI Assistant documentation also describes an enterprise agent solution integrating Baidu Search, Baidu Baike, image search, conversation management, memory management, and document capabilities.
That does not prove that the consumer Wenxin product uses the exact same implementation.
It does show that Baidu is building a common agent stack around search, memory, tools, and multimodal retrieval across its product portfolio.
What the Two Benchmark Wins Do Not Prove
High benchmark scores are useful evidence.
They are not the whole evaluation.
They Do Not Prove Permanent Global Leadership
Leaderboards change.
New models and new agent submissions can overtake the current leader.
They Do Not Prove Every Task Will Score 97%
XClaw aggregates selected tasks and categories.
A user’s real workflow may be very different.
They Do Not Isolate the Foundation Model
The score belongs to the complete assistant or agent stack.
They Do Not Measure Every Safety Issue
An agent that can complete tasks efficiently may still make unsafe tool calls or expose sensitive information in a different environment.
They Do Not Guarantee Factual Accuracy
Research agents can cite weak sources or misread changing data.
They Do Not Prove Unlimited Free Use
Product pricing and quotas are commercial policies, not benchmark properties.
How to Evaluate Wenxin Assistant Yourself
A useful personal test should resemble your real work.
Do not ask only trivia questions.
Give the agent a complete task.
Test 1: Memory
Provide five constraints at the start of a long conversation.
After several unrelated turns, ask for a final artifact and check whether all five are preserved.
Test 2: Data Processing
Upload:
- A spreadsheet.
- A PDF.
- A short text file.
Ask the agent to combine them into one report.
Verify every numerical value independently.
Test 3: Research
Choose a topic with changing information.
Require:
- Primary sources.
- Publication dates.
- Conflicting-source comparison.
- Direct links.
- A list of uncertain claims.
Test 4: Document
Creation
Ask for a Word, PowerPoint, spreadsheet, or HTML artifact.
Judge:
- Structure.
- Formatting.
- Completeness.
- Downloadability.
- Whether the file actually opens.
Test 5: Coding
Ask for a small interactive application.
Check:
- Whether it runs.
- Whether all requested features exist.
- Whether errors are fixed.
- Whether the final file is self-contained when requested.
Test 6: Long-Horizon Execution
Give a task that requires several tools.
Watch whether the system:
- Makes a plan.
- Chooses reasonable tools.
- Recovers from failures.
- Avoids repeating work.
- Verifies the final result.
A Better Way to Compare Agent Products
When comparing Wenxin with other agents, use a table wider than "benchmark score."
| Dimension | What to measure |
|---|---|
| Task success | Did the requested work finish? |
| Memory | Were earlier constraints retained? |
| Accuracy | Are numbers and claims correct? |
| Research quality | Are sources authoritative and current? |
| Tool reliability | Do tool calls succeed consistently? |
| Artifact quality | Are files usable without manual repair? |
| Recovery | Can the agent fix failed steps? |
| Latency | How long does a complete task take? |
| Cost | What does one accepted result cost? |
| Privacy | How are uploaded files and memory handled? |
| Availability | Are key features free, quota-limited, or paid? |
This gives a more realistic picture than one leaderboard rank.
The Bigger Shift: "Can It Deliver?"
The source article's strongest point is broader than Baidu.
Agent competition is changing the definition of AI quality.
For the first generation of chatbots, users focused on answer quality.
For current task agents, the key questions are becoming:
- Can it keep context?
- Can it find the right information?
- Can it operate tools?
- Can it create the file?
- Can it finish a multi-step workflow?
- Can it verify its own result?
- Can I trust it with repeated work?
That is why benchmarks such as XClaw and PinchBench are attracting attention.
They move evaluation closer to production work.
There is still a long distance between a benchmark and an enterprise deployment.
But the direction is useful:
Knowledge benchmark
→ reasoning benchmark
→ tool-use benchmark
→ end-to-end task benchmark
→ real production outcome
The last step is ultimately the one that matters.
Frequently Asked Questions
What score did Baidu Wenxin Assistant receive on SuperCLUE XClaw?
The August 2026 SuperCLUE XClaw snapshot gives Wenxin Assistant an overall score of 97.62, placing it first among the products shown. Its category scores were 90.28 for coding, 99.44 for content creation, 98.86 for data processing, 96.44 for research analysis, and 100 for memory.
What does a 100 memory score mean?
It means Wenxin received full marks on the memory tasks included in that XClaw evaluation. It does not mean the assistant can never forget context in every possible real-world conversation.
What is PinchBench v2?
PinchBench v2 is an agent benchmark created by Kilo that evaluates systems on real-world computer and workflow tasks. Version 2.0 contains 148 tasks and is designed to measure
end-to-end execution rather than simple question answering.
What was Wenxin’s PinchBench v2 score?
In a July 2026 leaderboard snapshot, Baidu’s task agent appeared as Orion Mission Mode with a 94.6% best score and a 94.4% average score. Leaderboards change over time, so the date of the snapshot should be included when citing the result.
Is Wenxin Assistant completely free?
Baidu’s official Wenxin pages currently provide free-access or free-experience options, and the source article says the demonstrated task features were available without a paid subscription. A stable official guarantee of permanently unlimited usage for every feature was not located, so current quotas should be checked directly in the product.
Can Wenxin Assistant generate Word documents and web pages?
The source article shows test sessions in which Wenxin generated a formatted Word business plan and interactive HTML pages. These examples demonstrate the product’s task workflow, but they are not a guarantee that every prompt or environment will produce the same result.
Why might Baidu search technology help its AI agents?
Search and agents share capabilities such as intent understanding, query decomposition, retrieval, ranking, source aggregation, and session context. Agents add a broader execution layer, including tool calls, file creation, memory, planning, and action.
Are XClaw and PinchBench model benchmarks?
Not in the narrow sense. They evaluate product or agent systems that may combine models with tools, memory, search, prompts, orchestration, and execution environments. Their scores should therefore be attributed to the full agent configuration.
Related Tools
- Baidu Wenxin: Baidu’s official multimodal AI assistant for search, creation, documents, and task-oriented work.
- SuperCLUE XClaw: The product-oriented Chinese agent benchmark cited in the source article.
- PinchBench: Kilo’s real-world benchmark for coding and computer-use agent workflows.
- Pandoc: A document-conversion tool used in the source test workflow for extracting and transforming document content.
- Three.js: A JavaScript 3D graphics library used in the source article’s generated Solar System example.
- Baidu Qianfan: Baidu’s enterprise platform for models, agents, data, and AI application development.
- Baidu AgentBuilder: Baidu’s platform for building and publishing custom Wenxin-based agents.
Related Links
- Baidu Wenxin Official Website: Current official product entry point for Wenxin Assistant across web and downloadable clients.
- Baidu Wenxin Desktop Assistant: Official desktop page highlighting document analysis, search, creation, export, and free experience.
- [SuperCLUE XClaw August 2026
Evaluation](https://superclueai.com/xclawpage?category=openclaw&name=SuperCLUE-XClaw%E9%BE%99%E8%99%BE%E4%BA%A7%E5%93%81%E6%B5%8B%E8%AF%84&folder=XClaw&date_if_exists=2026%E5%B9%B48%E6%9C%88): The benchmark page referenced by the original article.
- Kilo: PinchBench 2.0 Is Here: Official explanation of PinchBench v2's 148 tasks, scoring changes, parallel judging, and leaderboard design.
- Baidu Qianfan AI Assistant Documentation: Official documentation describing Baidu's search-integrated enterprise AI assistant, memory, conversation, and file services.
- Baidu App Official Download Page: Baidu's official app listing describing the integrated Wenxin Assistant and deep-research features.
- Baidu Wenxin AgentBuilder Documentation: Official documentation for building agents on Baidu's Wenxin ecosystem.
Summary
Baidu Wenxin Assistant ranked first in SuperCLUE's August 2026 XClaw snapshot with 97.62 points, including a perfect 100 in memory and scores above 96 in data processing, content creation, and research analysis.
That result follows a July PinchBench v2 leaderboard snapshot in which Baidu's Orion Mission Mode recorded a 94.6% best score and 94.4% average score. The benchmarks use different tasks, but both emphasize actual task completion rather than simple question answering.
The strongest takeaway is not that one assistant has permanently "won" the agent race. Agent rankings move quickly, and the measured systems include models, tools, search, memory, prompts, and orchestration.
What the two results do show is that AI evaluation is moving toward a more practical standard: not whether the model sounds intelligent, but whether the agent can finish the work and hand back a usable result.