Knowledge Refresh, Agent Memory, and Unified 3D

Today's Overview

  • KGD Separates Knowledge Refresh From Task Adaptation. It beats strong baselines by 4%–12% across eight public benchmarks and sustains gains over a 90-day data stream and a Shopee production test.
  • Persistent Memory Does Not Guarantee Continuous Improvement. PAST-Bench uses 26 scenarios and 204 task episodes to test whether saving, retrieving, and updating experience actually improves future behavior.
  • Hunyuan3D-Buffalo Unifies 3D Understanding, Generation, and Editing. Its 87-million-sample multimodal corpus includes 12 million editing examples, targeting geometrically consistent local changes and integrated workflows.

Featured

01 Training KGD Decouples Knowledge From Geometry

Continuous pretraining must track changing user behavior without damaging representations already tuned for downstream tasks. KGD separates these jobs. A refreshable encoder captures behavioral knowledge, while task models access it through read-only cross-attention and calibrate their own representation geometry.

The training objective also filters behavioral supervision. Multi-token prediction keeps only future items with collaborative or semantic relevance. This avoids treating unrelated clicks from adjacent sessions as meaningful dependencies.

KGD reportedly beats strong baselines by 4%–12% across eight public benchmarks. It maintains its advantage over a 90-day production stream, while comparison methods show no gain. Shopee's online A/B test reports 1.75% higher GMV per user in homepage search and 1.53% higher advertising revenue. The full paper still needs to clarify refresh frequency, training and storage costs, and each module's contribution.

Key takeaways:

  • Separate knowledge updates from downstream representation adaptation to protect existing tasks during each refresh.
  • Filter spurious cross-session associations instead of treating every adjacent click as a dependency.
  • Judge refresh systems by long-term data streams and online results, not one-time offline gains.

02 Evaluation More Memory Does Not Make Agents Better

Persistent memory is often treated as the foundation for personal agents that improve over time. Saving preferences, history, and skills only proves that the agent retained information. It does not prove that future behavior improved.

PAST-Bench tests that distinction across 26 scenarios and 204 task episodes. It compares matched conditions with and without experience retention. The benchmark also checks whether gains follow the intended save, retrieve, and update path.

Across seven base models and four agent frameworks, similar surface gains can have very different supporting evidence. The researchers added five targeted interventions to Hermes, with the largest improvements on tasks requiring outdated state replacement. Results still depend on the model and specific capability.

Key takeaways:

  • Do not equate persistent memory with self-improvement.
  • Longitudinal evaluations should test both later gains and the save, retrieve, and update chain behind them.
  • Validate memory systems by model and capability because average scores hide important differences.

03 Multimodal One Model for 3D Workflows

Generating a 3D object is only the first step. Production workflows also need models to understand parts, edit selected regions, and leave everything else unchanged.

Hunyuan3D-Buffalo 1.0 combines 3D understanding, text-to-3D generation, instruction-based editing, and specified-part generation in one architecture. Its understanding module supplies semantic and spatial conditions. A diffusion model then generates or modifies the asset.

The team built an 87-million-sample multimodal corpus, including 12 million editing examples. The abstract says generation and understanding also improve editing performance. The main advance is workflow integration, not another isolated benchmark lead. Geometry quality, complex-instruction reliability, and production control still require full-paper review and testing on real projects.

Key takeaways:

  • Evaluate 3D models across understanding, generation, and local editing.
  • Geometrically consistent editing data may become a major barrier to building unified 3D models.
  • Focus on workflow integration without treating benchmark leadership as proof that 3D generation is solved.
Knowledge Refresh, Agent Memory, and Unified 3D

Also Worth Noting

04
Queryable World Models for Cheaper, Safer Agent Feedback. AgentQuo Vadis, World Modeling? extends world models beyond forecasting physical futures into controllable interaction proxies agents can query before acting. link
05
Confident Teacher Outputs Can Still Be Spurious Signals. TrainingThe proposed on-policy distillation method identifies language priors and formatting templates unrelated to the task input. link
06
Video Research Benchmarks Expose Two Evaluation Illusions. MultimodalAgents may bypass visual tools or present memorized parameters as genuine retrieval and execution. Video-DeepResearch tests exploration across continuous video streams and the open web. link
07
Diffusion MoE Models Need Their Own Scaling Laws. ArchitectureOptimal batch size, learning rate, and compute allocation cannot be copied from autoregressive models. LLaDA MoE v2 measures these behaviors systematically. link
08
Any-OPD Bridges Incompatible Teacher and Student Representations. Image GenIt connects heterogeneous teachers to flow-matching distillation across different VAE latent spaces, architectures, and timesteps. link
09
Larger Skill Libraries May Not Produce Better Agents. EvaluationContinualSkillBench tests whether new skills can be reused, combined, and applied to improve later tasks. link
10
The LM Output Head Can Hide Quantization Costs. EfficiencyARCHead compresses the high-precision output head after the Transformer body is quantized, using activation-aware residual correction. link
11
ChronoLens Compares How Languages Change Across Multiple Levels. EvaluationIts cross-temporal, multilingual measurements test whether morphology, syntax, semantics, and pragmatics change in step. link

Today's Observation

KGD, PAST-Bench, and ContinualSkillBench define a shared audit boundary for long-running systems. Storing, refreshing, or adding knowledge does not prove capability growth.

Two questions need separate tests. Can old knowledge still transfer after representations change? Does new knowledge produce attributable gains in later behavior?

The first requires tracking retention and reuse of historical capabilities. The second needs matched controls or ablations that rule out the model, retrieval path, and task variance. Teams should also measure any negative transfer to existing capabilities.

For the next model refresh or skill update, keep a fixed set of historical tasks and an unrefreshed control group. Make retention rate, reuse gains, and negative-transfer rate deployment gates.