No model card yet.
License
cc-by-nc-4.0
Frameworks
transformers
Hardware-aware snippets
Runtime-specific quick starts for mradermacher/Arsenic-Shahrazad-12B-v4.3.2-i1-GGUF. Detected hardware: No explicit hardware metadata.
Task: text-generationTransformersGGUF
NVIDIA CUDA path
Best default for NVIDIA GPUs and hosted accelerator nodes.
pip install torch transformers accelerate
python - <<'PY'
from transformers import pipeline
model_id = "mradermacher/Arsenic-Shahrazad-12B-v4.3.2-i1-GGUF"
pipe = pipeline(
task="text-generation",
model=model_id,
device_map="auto",
model_kwargs={"torch_dtype": "auto"},
)
print(pipe("Hello from Inferix"))
PYModel lineage
1 reposBase model
Lambent/Arsenic-Shahrazad-12B-v4.3.2Finetuned
1Arsenic-Shahrazad-12B-v4.3.2-i1-GGUFselected
Quantizations
0No quantization variants detected.
Model info
Namespace
mradermacher
Visibility
public
Downloads
2
Likes
0
License: cc-by-nc-4.0
Evaluation results
Entries
0
Tasks
0
Datasets
0
No evaluation results published yet.
Metadata links
Base model
Lambent/Arsenic-Shahrazad-12B-v4.3.2Trained on datasets
No linked datasets
Linked papers
No linked papers
Inference providers
0/0 fitNot available for inference yet.
Spaces using this model
No spaces linked yet.
Part of collections
No public collections include this model.
Tags
importedhuggingfaceminiotransformersggufnot-for-all-audiencesenbase_model:Lambent/Arsenic-Shahrazad-12B-v4.3.2base_model:quantized:Lambent/Arsenic-Shahrazad-12B-v4.3.2license:cc-by-nc-4.0endpoints_compatibleregion:usimatrixconversational