Skip to content

Gemma4 ov int4 and stateful fixes - #260

Draft
cavusmustafa wants to merge 4 commits into
ravi9:dev_backend_openvinofrom
cavusmustafa:gemma4_ov_int4_and_stateful_fixes
Draft

Gemma4 ov int4 and stateful fixes#260
cavusmustafa wants to merge 4 commits into
ravi9:dev_backend_openvinofrom
cavusmustafa:gemma4_ov_int4_and_stateful_fixes

Conversation

@cavusmustafa

Copy link
Copy Markdown
Collaborator
  • enables gemma4 dense stateful support
  • optional int4 downscale for requant: sacrifice accuracy for performance (env to enable - GGML_OPENVINO_INT4_REQUANT)

@cavusmustafa
cavusmustafa force-pushed the gemma4_ov_int4_and_stateful_fixes branch from 530aa62 to cbb8242 Compare July 21, 2026 19:26
@wine99
wine99 force-pushed the dev_backend_openvino branch from 4250de7 to 175f422 Compare July 27, 2026 04:33
@cavusmustafa
cavusmustafa force-pushed the gemma4_ov_int4_and_stateful_fixes branch from 53d099b to 61c08f4 Compare August 11, 2026 21:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant