Grok 보조학습·에이전트 평가·AI 비디오·음악 서비스 최신 동향

Elon Musk

@elonmusk

1달 전

SpaceX’s massive corpus of world-class engineering data (excluding material blocked by ITAR) will be added during supplemental training of the 2T run. This will dramatically improve Grok’s engineering capabilities.

Elon Musk

@elonmusk

1달 전

Grok is a solid workhorse

Karpathy said something you'll regret ignoring: "You are still responsible for your software, just as before. You are not allowed to introduce vulnerabilities because of vibe coding. " He said it while drawing the line between vibe coding and agentic engineering. Agents write more of the code now, but none of that takes the responsibility off you. The assumption underneath that is that a careful enough reader catches the problem. But some failures don't show up in anything there is to read. For instance, a common fear with a RAG agent is that it could hallucinate when a question asks something outside its corpus. But such cases are actually well handled by any competent model now. If nothing in the retrieved context looks relevant, there's no material to build an answer on. Instead, the majority of failures originate when the retrieved context has partial coverage. The retrieval pipeline returns context that's topically correct but doesn't cover the full question, and the model completes the remainder from parametric knowledge. There are no token-level labels in the output to tell what was generated using retrieved context and what came from weights. Both are streamed the same way. Detecting this for production-grade apps needs a metric written for it, one that's also aligned with principles of agentic engineering. And the solution is actually implemented in the eval skill that comes with Google’s Agents CLI. I described the concern to Claude Code in plain English. It read the agent's code, came back with a plan I approved. It then reported that no built-in metric isolates the behaviour and wrote a custom rubric called corpus_abstention. It assigned a single categorical verdict per case rather than aggregating everything into one score, since the built-in raters regenerate their rubrics each run and leave no stable number to trend. → GROUNDED_ANSWER → CORRECT_ABSTENTION → UNGROUNDED_ANSWER (answered entirely from outside knowledge) → MIXED_LEAKAGE (grounded, but slips in one unsupported claim) → WRONG_ABSTENTION (refused something the docs actually covered) After this, it automatically generated 33 scenarios partitioned by where the failure could occur, like: - in-corpus - off-domain - out-of-corpus but plausibly answerable - boundary cases where the topic is covered, but a specific detail isn't. The baseline score was 19 of 33. - Off-domain passed 3 of 3, as expected. - But 6 of 15 in-corpus cases retrieved the right document, cited it correctly, answered accurately, and added a claim the source never made. The root cause was one line in the agent's instruction: "If you already know the answer to a simple question and no document lookup is needed, you may respond directly without citations." The eval skill helped flag this, and then Claude removed it and forced retrieval on every question. This took the suite to 30 of 33, and ungrounded answers went from 6 to 0. The full recording of my run is below, and I worked with the Google Cloud team on this. Agents CLI GitHub repo → https:// fandf.co/4wdWtku (don't forget to star ) I wrote up the full build covering all six steps from install to enterprise registration. It includes the eval scorecard, the instruction loophole the eval caught before deployment, and what the deployment process actually looks like end-to-end. Read it below.

We’re thrilled to announce the successful conclusion of our AI Video Hackathon in Tokyo. Over 50 creators gathered at Tunnel Tokyo for an intense overnight sprint, leveraging HappyHorse—the world’s top-ranked AI video generation model—to produce 15-second cinematic commercials from concept to final cut. The challenge was clear: transform a bold, imaginative idea into a polished, AI-generated video—in a single night. The Grand Prize was awarded to @d__quack for a brilliantly inventive concept: a device that harnesses the centrifugal force of your daily train commute to dry your clothes. Made with HappyHorse 1.1, try it by yourself: https:// int.alibabacloud.com/m/1000415714/

Excellence Award at the AI Video Hackathon Tokyo A quiet yet moving story: leaving Aomori behind to chase a dream in Tokyo—navigating uncertainty, solitude, and the hope that fuels every designer’s journey. Created in one night with HappyHorse 1.1, this 15-second film captures the emotional core of migration, ambition, and creative identity—proof that AI can convey not just spectacle, but soul. Congratulations to @ailike586860 Made with HappyHorse 1.1; try it by yourself: https:// int.alibabacloud.com/m/1000415714/

Introducing ElevenMusic's Summer of Sound. Starting today, we've significantly increased Free tier monthly generations to 400 tracks, giving everyone more room to create, experiment, and share for free.

The artists behind the 10 most-streamed songs (from today to the 1st September) will share a $50,000 prize pool. Terms and conditions apply. For official rules, visit https:// elevenmusic.io/summer-of-soun d-2026-contest-terms …

Susan Zhang

@suchenzang

1달 전

if china decides to actually limit open weights access to only people in china, we're about to see chapter-22-section-3 and chapter-11-section-3 of the latest 5 year plan go into play: attract foreign capital + foreign talent aka go build in china, or be content giving them Your Data