Bin-packing optimizer grouping variable-length training examples into fixed context window token budgets
-
Updated
Sep 29, 2026 - Python
Bin-packing optimizer grouping variable-length training examples into fixed context window token budgets
Evolutionary prompt mutation algorithm adding constraints, deepening reasoning, and increasing problem complexity
Bidirectional dataset format converter and schema validator between Alpaca and ShareGPT formats
Direct Preference Optimization (DPO) and RLHF dataset constructor pairing prompt, chosen, and rejected responses
Rule-based and heuristic question-answer pair generator extracting factual and definitional training tuples from raw text
To associate your repository with the dataset-prep topic, visit your repo's landing page and select "manage topics."