Grok 동영상 분석·검색 분리·AI4AI 논문이 한주를 주도

Elon Musk

@elonmusk

True

Elon Musk

@elonmusk

Grok can analyze any video

Google and Anthropic agree on one thing about retrieval. They both moved it out of the app and turned it into a standalone service that agents invoke. - Anthropic's MCP exposes retrieval as a tool that an agent invokes. - Google ships it similarly, with its RAG Engine sitting under the Gemini agent platform next to MCP servers. They did this because the old naive RAG setup was built as a one-time pipeline inside a single app, and it caused problems in two places: - The first is stale embeddings. They reflect the source at indexing time, so the index drifts from the source when a doc or a row changes, and stays wrong until the pipeline is rerun. - The second is coupled infrastructure. The retrieval logic sits inside one app, so another app duplicates the connectors, chunking, and embedding instead of reusing them. Both failure modes are resolved by separating ingestion from query and running ingestion as a standing layer. Ingestion runs continuously with content-hash sync, so only changed data is re-embedded, and the layer sits behind one API, so a chatbot and an agent hit the same index. The agent then calls that layer as a tool inside a loop. It reasons, runs a search, reads the result, and issues a refined query, instead of retrieving once at the start. The diagram below depicts all three stages, covering naive RAG, the standing layer, and the agent consuming it. This helps, but it didn't solve all problems yet because across all three stages, the unit of retrieval is the same, i.e., a chunk of text. And inherently, a chunk has no idea of a semantic boundary, version, or source info. The splitter cuts documents mostly on token count, so a single chunk can end mid-table or mid-argument. Because of that, it can pull the top half of a table without the rows, or a conclusion without the reasoning that supports it. Moving to a structured unit, embedding a question with its validated answer, addresses this. I wrote wrote a full breakdown on solving this. It replaces raw chunks with structured blocks that carry their own source and version. The approach reduces corpus size 40x and improves vector relevance 2.3x. Read it below.

"Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineering" This 35B AI4AI agent is trained to improve ML solutions through executable evolution. Rather than generating one ML pipeline, it evolves many candidates by drafting, refining, repairing, and recombining code. It then executes each in a sandbox, and learns from real task scores to guide longer-horizon search. This turns recursive self-improvement into a MLE loop, pushing the model from 39.39% to 60.61% Medal Average with OpenMLE-Evo, and 71.21% with Evo-Max. Read more: https:// alphaxiv.org/abs/2607.28568

“MemHarness Memory Is Reconstructed, Not Replayed” Most memory agents retrieve old experiences and paste them straight into context, even when the current state no longer matches. This paper makes memory adaptive by having the agent critique and reconstruct retrieved memories before acting. Trained end-to-end with GRPO, MemHarness turns memory from copied context into state-aligned guidance, beating pure RL and static memory baselines with stronger OOD robustness. You can read more here: https:// alphaxiv.org/abs/2607.28272

simon

@disiok

Dear LLMs, Do not ever go near a tool, use bash, or write code. And god forbid, a full harness. Going neurosymbolic is a path of no return. Stay pure, stay safe. Signed Gary