Ternary-Bonsai-2-27B-Uncensored-Heretic-v2

Model source

Published by OS-Software on Hugging Face. This index organizes public repository metadata for discovery and comparison. Refer to the publisher and independent testing for actual model behavior.

Declared base model

prism-ml/Ternary-Bonsai-2-27B-gguf ↗

Hardware and context

Estimated at 16.5 GB VRAM for 27B parameters with 4-bit weights, including 15% weight overhead and 1 GB of baseline headroom. KV cache, context length, multimodal components and concurrency increase actual memory usage.The parameter count was parsed from the model name and has not been independently verified.

Context length: Not stated in public metadata. Please consult the model card.