Dev.to AI 🤖 Ai 👁 0 📖 2 min read

The Audio Ran for 93 Seconds. The Picture Cut Out Before 18. — Making a Kojiki Anime with AI

I used AI to make the first episode of an animated adaptation of the Kojiki, Japan's oldest surviving chronicle. The episode is called "The Beginning of Heaven and Earth." I used AI for the script, artwork, narration, mu

I used AI to make the first episode of an animated adaptation of the Kojiki, Japan's oldest surviving chronicle. The episode is called "The Beginning of Heaven and Earth." I used AI for the script, artwork, narration, music, and editing. I made the final calls.

How far could I get with one home PC and AI? I finished four videos: a main video and a Short in Japanese, and a main video and a Short in English. But the road there was a series of failures. Of all the things that went wrong, the spear is the one I remember best.

The spear I couldn't get AI to draw

The key item in the story is a spear called Amenonuboko. The two deities stir the sea with it, and brine dripping from its tip forms Onogoro Island, the first island.

But I couldn't get the spear drawn. I kept trying to generate the spear on its own, and it failed again and again. I also tried showing the two deities holding it, but I never got that pose to work.

I found two ways to keep the spear in the story. In one shot, I showed only the tip in close-up. In another scene, I changed the staging itself and had the two deities receive the spear in a hall of light.

I could describe the shot I wanted and still end up with a different image. And at the very end, the spear's shape still varied from shot to shot, so I redid every shot that showed it, using the close-up of the tip as the reference.

That was not all

  • The export was marked "complete." The file showed the expected duration, but the picture cut out at about 17.7 seconds while the audio ran for 93. That's why I didn't catch it right away
  • I rejected the narration voice three times: "It's grating," "It puts me to sleep," and "It reminds me of a specific character"
  • I'd added the word "land" (陸) to the script. That wording was my addition — it appears nowhere in the original text
  • The task of revising the character designs produced zero images

How the script was fixed, how the voice was chosen, and what got rejected in the music mix — the full story is collected as a making-of journal on the official KOHAKU WORKS site.

▶ Read the full making-of story
https://kohaku-works.pages.dev/en/kojiki/ep01-making/

▶ Watch Episode 1
English: https://youtube.com/shorts/MnCJUExBBOc
Japanese: https://youtube.com/shorts/XFvFSzrsPOA

The same approach failed differently in game development

For video, this way of working held up. When I tried the same approach on a game, the AI missed instructions and let its own mistakes go unnoticed. As the project records piled up, token usage rose. Eventually, I replaced the AI agent leading the project. That record is here.

▶ When I Let Muse Build My Game, the Production Lead Had to Be Replaced (paid; free up to the middle of Chapter 3)
https://note.com/kohakuworks/n/n784c27c10a6e

📰 Read the original article on Dev.to AI

Originally published by Dev.to AI. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.