Llama3-Omphalos-12B / README.md
Tremontaine's picture
Update README.md
ddc910e verified
metadata
base_model:
  - bluuwhale/L3-SthenoMaidBlackroot-8B-V1
  - Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
tags:
  - merge

Llama3-Omphalos-12B

Llama3-Omphalos-12B is a merge of the following models using LazyMergekit:

🧩 Configuration

dtype: bfloat16
merge_method: passthrough
slices:
- sources:
  - layer_range: [0, 8]
    model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- sources:
  - layer_range: [4, 12]
    model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
- sources:
  - layer_range: [9, 16]
    model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- sources:
  - layer_range: [13, 20]
    model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
- sources:
  - layer_range: [17, 24]
    model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- sources:
  - layer_range: [21, 28]
    model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
- sources:
  - layer_range: [25, 32]
    model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1