Ternary-Bonsai-2-27B-Abliterated-v2-PQ2_0-MTP

Model source

Published by BoldingBuilds on Hugging Face. This index organizes public repository metadata for discovery and comparison. Refer to the publisher and independent testing for actual model behavior.

Declared base model

prism-ml/Ternary-Bonsai-2-27B-gguf ↗

Hardware and context

Estimated at 16.5 GB VRAM for 27B parameters with 4-bit weights, including 15% weight overhead and 1 GB of baseline headroom. KV cache, context length, multimodal components and concurrency increase actual memory usage.The parameter count was parsed from the model name and has not been independently verified.

Context length: Not stated in public metadata. Please consult the model card.