Skip to content

fix: handle GPU memory reports and LLM encoding failures - #2020

Merged
leejet merged 1 commit into
masterfrom
fix/gpu-capacity-and-llm-failures
Sep 21, 2026
Merged

leejet merged 1 commit into
masterfrom
fix/gpu-capacity-and-llm-failures

Conversation

@leejet

@leejet leejet commented Sep 21, 2026

Copy link
Copy Markdown
Owner

Summary

  • Restrict the free-memory underflow rejection to Vulkan. Other backends remain capped by total memory minus tracked residency.
  • Log reported memory and tracked allocations when capacity checks fail, and update the backend documentation.

Related Issue / Discussion

Try to fix #1989.

Additional Information

N/A

Checklist

@leejet
leejet merged commit 6dcb5bb into master Sep 21, 2026
9 checks passed
@leejet
leejet deleted the fix/gpu-capacity-and-llm-failures branch September 21, 2026 16:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CUDA: model manager reports "available 0.00 MB device" on discrete GPUs — klein/z-image fail at weight prep

1 participant