Repository navigation
fix(rss): 跳过自动扫描的离线 archive 查询 + archive 流式可取消 + URL 噪音系列名 - #96
Merged
Merged
Conversation
|
Important
This repository does not receive automatic reviews because it has fewer than 10 stars. ⚙️ Run configuration
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
修复 ANi RSS 全量扫描在真机上卡死的问题,并顺手修掉同一次联调里暴露的 URL 噪音系列名。
根因(真机证据钉死,非推测)
bangumi.archive.search单次 704993ms(11.7 分钟),query 仅 6 字符;986MBsubject.jsonlines当日刚下载完,前一日无 archive 时同款扫描 105 秒跑完BangumiArchiveSubjectSearch每次查询全量 parse 1GB 文件成 40 万对象 + 全排序,在 50MB 堆的 TV 盒子上 GC 泥潭;且searchByAlias按候选逐个调,每个候选都重复一次;且整个循环无取消点改了什么
MetadataScraper.searchAnime/searchByAlias新增includeArchive = true参数(默认保持原行为,手动搜索不受影响);ScanCoordinatorenrichment 传false。扫描恒有网(刚拉完 feed),在线搜索 0.5s 级,archive 只留给手动搜索/离线场景ensureActive(取消/超时立刻生效);findById同样流式早退PATH_BERT 700碾压干净标题FILE_BERT 510,造出A1%80%这类名字并送进本就慢的查询)验证
assembleDebug + test + lint全绿includeArchive=false跳过 archive 只走在线;100 万行文件 200ms 取消必抛;分类器 URL 用例 ×2;扫描单测断言 enrichment 全传false未覆盖