Llama3-Omphalos-12B / mergekit_config.yml
Tremontaine's picture
Upload folder using huggingface_hub
b96fb69 verified
dtype: bfloat16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 8]
model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- sources:
- layer_range: [4, 12]
model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
- sources:
- layer_range: [9, 16]
model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- sources:
- layer_range: [13, 20]
model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
- sources:
- layer_range: [17, 24]
model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- sources:
- layer_range: [21, 28]
model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
- sources:
- layer_range: [25, 32]
model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1