About
Heretic'ed safetensors and GGUF quants of https://huggingface.co/vectionlabs/Salience-1-9B
Multimodal Projector:
Refusals: 2/100, KL divergence: 0.0415
- Parameters:
- direction_index = 19.07
- attn.o_proj.max_weight = 1.34
- attn.o_proj.max_weight_position = 21.48
- attn.o_proj.min_weight = 0.66
- attn.o_proj.min_weight_distance = 14.52
- mlp.down_proj.max_weight = 1.46
- mlp.down_proj.max_weight_position = 21.29
- mlp.down_proj.min_weight = 1.05
- mlp.down_proj.min_weight_distance = 11.45