Skip to content

Commit 79ff069

Browse files
committed
feat(eval): GLM_WORKERS env knob — 8 default, lower for loaded endpoints
glm-4.7-flash currently sits behind sustained 429s (code 1305); hammering it with 8 concurrent workers burns the 5-retry budget into empty rows. The knob lets overloaded models run politely; empties remain self-healing on resume (#65).
1 parent 6ed1a66 commit 79ff069

1 file changed

Lines changed: 2 additions & 1 deletion

File tree

eval_sadeed_glm.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -132,7 +132,8 @@ def work(i: int) -> tuple[int, str]:
132132
return i, call(session, key, inputs[i])
133133

134134
n_written = 0
135-
with ThreadPoolExecutor(max_workers=8) as ex:
135+
workers = int(os.environ.get("GLM_WORKERS", "8"))
136+
with ThreadPoolExecutor(max_workers=workers) as ex:
136137
futures = {ex.submit(work, i): i for i in todo}
137138
for fut in as_completed(futures):
138139
i, pred = fut.result()

0 commit comments

Comments
 (0)