Skip to content

Report kernel lookups to the compile hook instead of recompiling #659

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
maleadt merged 1 commit into from
Oct 8, 2026
Merged

Report kernel lookups to the compile hook instead of recompiling #659

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions src/compiler/execution.jl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -326,14 +326,15 @@ end
# by `GPUCompiler.cached_results` (Julia's integrated code cache on 1.11+, which also
# persists artifacts through precompilation; a session-local store on 1.10).
#
# `image === nothing` identifies a `oneAPIResults` that hasn't been compiled yet. The
# `compile_hook` check additionally forces the compile path so reflection-style
# consumers (`@device_code_*`) observe the compilation even on a cache hit.
# `image === nothing` identifies a `oneAPIResults` that hasn't been compiled yet. Every
# lookup is reported to the `@device_code_*` hook, so reflection observes cached kernels
# without recompiling them.
# Specialize on the target/parameter types so callers can avoid boxing CompilerJob.
# Keep the body out of callers that specialize per kernel.
@noinline function compile_or_lookup(job::CompilerJob)::oneAPIResults
GPUCompiler.run_compile_hook(job)
res = GPUCompiler.cached_results(oneAPIResults, job)
if res === nothing || res.image === nothing || GPUCompiler.compile_hook[] !== nothing
if res === nothing || res.image === nothing
compiled = compile_to_obj(job)
res = @something res GPUCompiler.cached_results(oneAPIResults, job)
res.image = compiled.image
Expand Down
Loading