How Claude Code Gave Minecraft and Terraria Real 3D on the 3DS
Claude Code reverse-engineered compiled Minecraft and Terraria binaries on Nintendo 3DS, adding true stereoscopic 3D with no source code access.
What did Claude Code actually do to Minecraft and Terraria on 3DS?
Claude Code, Anthropic’s AI coding agent, reverse-engineered the compiled binaries of Minecraft: New Nintendo 3DS Edition and Terraria’s 3DS port to add working stereoscopic 3D, a feature the 3DS’s main hardware gimmick promised but these games never properly delivered. No source code was available for either game. The AI worked entirely from machine code, emulator behavior, and real hardware testing, building plugins that intercept each game’s rendering pipeline and inject a second eye’s worth of frame data to produce true parallax 3D. Both mods are now released as open-source, MIT-licensed projects on GitHub.
TL;DR
- Minecraft’s 3DS edition actually shipped with dead 3D code, including right-eye buffers and camera math for the depth slider, that was stripped out before release, likely for performance and comfort reasons.
- Claude Code rebuilt stereoscopic 3D from scratch by reading disassembled machine code, with no access to either game’s original source.
- The breakthrough technique renders the frame once, then re-aims the GPU output a second time with a small sideways shift instead of doubling all CPU work, which kept performance close to the stock game.
- Early attempts caused eye strain because left and right eye frames updated at mismatched rates (described as roughly 17Hz per eye), a problem the team called “uncomfortable 3D” before fixing it.
- Old 3DS got 3D too, despite having far less memory than the New 3DS, by hiding a smaller right-eye buffer in an unused gap of video memory at effectively no extra memory cost.
- Terraria’s mod went further than Minecraft’s, adding working C-stick support, true item stacking and sorting, a map that no longer crashes, and a crash-free old 3DS build.
- AI “self-auditing” caught bugs before they shipped, with the model reviewing its own patches for crash risks as a regular step in the workflow, separate from live hardware testing.
Remy.
How do you add 3D to a game without its source code?
Both Minecraft and Terraria on 3DS draw their scenes in layered passes: background, terrain, player sprites, UI, and so on. Neither game’s compiled code labels these passes in any human-readable way, so the first job was figuring out which chunk of machine code did what. The process described was largely empirical: take a pass, apply a small sideways pixel shift, screenshot the result, and observe how far the layer moved on screen. Repeat that across dozens of rendering passes until the depth order of the whole scene is mapped out.
This is standard reverse-engineering methodology, the kind a human engineer would do with a disassembler and a lot of patience, except Claude Code was running the loop: inspecting binaries, forming hypotheses about what a given function did, testing the hypothesis, and refining it. An existing open-source project that had already documented parts of Minecraft’s internals gave the effort a head start, but Terraria had no such foundation and had to be mapped from nothing.
Once the layers were identified, the actual 3D trick was comparatively elegant. Instead of rendering the entire frame twice (once per eye), which would double CPU load and break anything tied to frame timing like rain effects, the plugin lets the game draw its frame normally, then takes the finished GPU output and re-renders it a second time for the other eye with a small shift applied. CPU cost barely changes. The GPU, which had spare headroom on these titles, absorbs the extra draw call.
Why did Minecraft 3DS never ship with 3D in the first place?
The transcript’s finding is notable on its own: Minecraft’s New 3DS edition contains leftover plumbing for a 3D renderer, including right-eye screen buffers, shader eye matrices, and camera math tied to the console’s physical 3D slider. That code existed at some point in development and was removed before the final shipped build. The game already runs at a low render distance, and generating a second full eye of geometry would have been a heavy lift on 3DS hardware, suggesting cost was one factor.
Early tests pointed to a second reason: comfort. When the team ran an initial, straightforward double-render implementation, the left and right eye images updated out of sync, each updating at a low independent rate. In practice this meant one eye’s image visibly lagged the other while the player’s head or camera moved, producing an effect described as nauseating. That mismatch is exactly the kind of problem that could make a feature too uncomfortable to ship, and it’s plausible this contributed to why 3D was cut from the original release.
Solving it required the “render once, re-aim twice” approach instead of a naive double render, which eliminated the independent-update timing drift and produced what the creator called comfortable 3D, playable for extended sessions.
How did testing on real 3DS hardware differ from using an emulator?
Emulators don’t simulate 3DS hardware at full fidelity. They trade some accuracy for speed, since full-precision emulation would be too demanding to run smoothly on a PC or phone. That gap meant plugins that worked fine in the emulator sometimes crashed outright on a real console.
Testing exposed several hardware-only failures. On Terraria, one build caused the right eye display to go completely black on actual hardware despite working in the emulator, because the game’s default rendering pool couldn’t accommodate the extra data and the right eye needed its own reserved space in video memory. On the old 3DS Terraria build, with its reduced memory compared to the New 3DS, an early version crashed within seconds of booting.
The fix for old 3DS was to shrink the right-eye image to a lower resolution and store it in an unused gap of video memory that Claude located, meaning the added 3D cost essentially zero extra game memory. The result still delivers layered parallax with a limited number of depth layers, but it runs on hardware that was already memory-constrained and underpowered relative to the New 3DS.
Hardware testing also caught a separate, unrelated bug: the New 3DS’s C-stick was being read as connected but stuck at a dead value of zero. This turned out to be an input-handling conflict within the plugin framework itself, discovered while working on Minecraft and then fixed in both mods.
What else changed in Terraria besides the 3D effect?
Terraria’s mod went well beyond adding depth. Because the 3D result turned out strong, the project expanded into general quality-of-life fixes that the 3DS port never had:
- Item sorting: holding A and D-pad down merges and sorts stacked items automatically across chests and inventory, implemented by locating the game’s existing item-moving functions (originally built for multiplayer sync messages) and repurposing them.
- Larger stack sizes, raised up to a much higher cap for most items (coins excluded), done by adjusting the stack limit value rather than rewriting inventory logic.
- A map that doesn’t crash: opening the in-game map used to crash the old 3DS version outright. The fix makes the map release its memory every time it’s closed instead of leaking it.
- Performance diagnostics during testing that turned up specific causes of slowdown, including a “full bright” lighting cheat that was found to tank frame rate, and a cosmetic “fake OLED” color boost mode added to make colors pop closer to how they look on other handhelds.
Across both games, the plugins ship with in-game menus (accessed via the Select button) offering different depth presets and performance options, letting players tune the 3D intensity or fall back toward stock performance if they prefer 2D.
Is this kind of AI-driven reverse engineering reliable?
Nothing gets lost.
The creator built in a repeated self-auditing step: after each round of changes, the AI reviewed its own code changes looking for likely crash conditions or logic errors before they were tested on hardware. This caught real bugs ahead of time, according to the project’s account, and was treated as a core part of the workflow rather than a one-off check. Combined with extensive human playtesting captured on video and fed back to the model as a transcript of real-time observations, the process resembled an iterative debugging loop more than a single AI-generated patch.
That said, both mods are explicitly released without ongoing maintenance guarantees. The creator noted they are not committed to maintaining the projects long-term, though both are open-sourced under the MIT license specifically so other developers can fork, extend, or fix them independently.
Frequently Asked Questions
Did Claude Code have access to Minecraft or Terraria’s source code?
No. Both projects were done entirely through reverse engineering of the compiled game binaries, using machine code analysis, emulator testing, and extensive real-hardware validation, with no original source code from either developer.
Why did the 3D effect hurt players’ eyes at first?
Early implementations rendered each eye’s frame independently and they updated at mismatched rates, causing one eye’s image to visibly lag the other during movement. This was fixed by rendering the frame once and reusing that output for both eyes with a sideways shift, rather than generating two fully separate frames.
Does the 3D mode hurt game performance?
On Terraria, the 3D effect was described as costing almost nothing to performance. On Minecraft, there’s a modest performance cost compared to switching the plugin back to 2D mode, though the team added optimizations like skipping offscreen backdrop rendering to keep frame rates close to stock.
Can other developers build on these mods?
Yes. Both the Minecraft and Terraria 3DS plugins were released on GitHub under the MIT license, with documentation of the technical findings included, specifically so other developers can fork or extend the work.
Does this work on both New and Old 3DS?
Yes, though differently. The New 3DS versions use full stereoscopic 3D layering. The Old 3DS, which has significantly less memory, uses a smaller right-eye image stored in an unused region of video memory to achieve a lighter form of layered 3D at effectively no extra memory cost.