RMW Archive

A desktop app for archiving and browsing public content from forums.rpgmakerweb.com, preserving its categories, forums, threads, posts and members for offline browsing.

Stack

• Tauri 2 desktop shell
• Rust crawler, XenForo parsers and SQLite storage
• TypeScript + Vite frontend without a framework
• Local filesystem for assets and optional raw page HTML

Layout

src/                  frontend (TypeScript)
  views/              Home, Forum, Members, Downloads, Settings, Viewer
  styles/             application styles
  assets/icons/       bundled Lucide SVGs
src-tauri/src/
  db.rs               schema and queue/storage helpers
  settings.rs         persisted crawler settings
  commands.rs         Tauri commands and viewer data loading
  crawler/
    mod.rs            crawl engine and persistent queue
    client.rs         rate-limited HTTP client
    parse.rs          XenForo page parsers
    bbcode.rs         rendered HTML to BBCode reconstruction
    assets.rs         asset storage and download bookkeeping

Data locations

• Database: %APPDATA%/com.rmwarchive.app/rmw-archive.sqlite3
• Archive folder: configurable in Settings, containing assets/ and optional raw/ page captures

Crawling model

The persistent crawl_queue table makes these entry flows resumable and deduplicated by URL:

1. Forum root discovers categories and forums.
2. Forum selection archives thread lists, threads, posts and enabled assets.
3. Thread URL archives one public thread directly.
4. Member profile URL archives the public profile and selected wall posts, comments and referenced content.

The crawler uses one connection, one request at a time and a 10-second default delay between page requests. It does not log in or bypass permissions.

Development

npm install
npm run tauri dev
npm run build
npm run tauri build

The release/ directory contains versioned packaging material and end-user notes for the corresponding release artifact. Distribution-specific details such as WebView2 installation and SmartScreen behavior belong there rather than in this development overview.