Zyphra — Complete End-to-End Pipeline

Zyphra's portfolio spans the entire AI stack: EEG → LLM (dense, MoE, Mamba) → TTS → voice cloning. 1bit supports all of it — 11 models in 1BP format, plus EEG and TTS pipelines documented for ecosystem completeness. This is the family the engine was tuned against, and the one that powers the JARVIS pipeline.

Legend: 🧠 LLM · 👁️ vision · 🗣️ voice · 🧬 EEG · 🏁 end-to-end validated

Models

Model	Params	1BP Size	Backend(s)	Pipeline	Perf
ZAYA1-8B	8.8B	6.6 GB¹	HIP / NPU	🧠🗣️	64 tok/s HIP
ZAYA1-74B-preview	74B	45.8 GB²	HIP	🧠🗣️	16.7 tok/s HIP³ (measured 2026-08-05)
ZAYA1-VL-8B	8.8B	—	HIP (vision)	👁️🧠🗣️	—
ZR1-1.5B	1.5B	781 MB	ZINC / NPU	🧠🗣️	26 tok/s ZINC
BlackMamba-1.5B	1.5B	970 MB	Mamba1 HIP	🧠🗣️	79.4 tok/s 🏁
BlackMamba-2.8B	2.8B	1.8 GB	Mamba1 HIP	🧠🗣️	46.0 tok/s 🏁
Zamba2-1.2B-v2	1.2B	1.1 GB	HIP / CPU	🧠	30 tok/s HIP
Zamba2-2.7B-v2	2.7B	2.4 GB	HIP / CPU	🧠	—
Zamba2-7B-v2	7B	6.6 GB	HIP / CPU	🧠	—
Zamba-7B-v1	7B	4.3 GB	Mamba1 HIP	🧠	—

¹ ZAYA1-8B 1BP is ~6.6 GB full-weight — the 149 MB entry on HF is MoE-expert-stripped; use the complete file. ² Earlier catalogs listed a 739 MB 1BP for the 74B — that is physically impossible for a full 74B model (even ternary ≈ 18 GB) and refers only to a stripped-expert variant; the runnable 74B Q4_K_M GGUF is 45.8 GB. ³ 74B measured on ROCm TheRock HIP 7.15a, zaya-llama.cpp/build-hip (Juste-Leo2 Zaya branch), full GPU offload — see benchmarks/RESULTS-zaya1-74b-benchmark-2026-08-05.md.

Architectures in this family

Zaya1 — MoE + CCA. Zyphra MoE architecture with Cross-Channel Attention + MoE FFN. Flagship 1BP ternary model. Tile8 GEMV (28-layer, Zaya1-8B shaped) measured at 77 tok/s on ROCm HIP. TQ2 ternary weights bridged to INT8 for NPU via ternary_npu_bridge.h (pack_tq2_to_npu_int8()) onto existing INT8 xclbin kernels — a true native 2-bit AIE microkernel (4× less DDR traffic) is designed but not yet the default path, see the NPU ternary roadmap. CPU AVX-512 portable path ~2.5 tok/s (8B-shaped).
ZR1 — dense reasoning. Reasoning-tuned dense transformer (Qwen2 architecture). End-to-end validated ~26 tok/s on Vulkan ZINC; 1BP conversion complete. Builds via the Qwen3-0.6B xclbin stanzas (same tile template).
BlackMamba — Mamba1 + top-1 MoE. No attention mechanism — alternating SSM scan and MoE FFN per layer. The engine's fastest end-to-end family (79.4 tok/s at 1.5B). SSM scan via kernel/ssm_selective_scan.cc.
Zamba2 — Mamba2 hybrid. Mamba2 SSM layers with sparse attention every 6 layers. ~30 tok/s at 2.7B on Vulkan ZINC; Mamba2 decode block benchmarked at 1270 tok/s on ROCm HIP. NPU AIE2 selective-scan kernel (per-head d_state=64 vectorized, 32 heads/tile).
Zamba — Mamba1 hybrid. Original Zamba-7B-v1: Mamba1 SSM + shared attention layers. GGUF through ROCm HIP.

Full pipeline depth

🧠 LLM — Zaya (MoE+CCA), ZR1 (dense reasoning), BlackMamba (Mamba1+MoE), Zamba (Mamba1/2 hybrid)
👁️ Vision — ZAYA1-VL-8B (built-in vision encoder)
🗣️ Voice — voice cloning pipeline (RVQ-VAE codec + QLoRA adapter + ONNX decoder + streaming + persona), see JARVIS pipeline
🧬 EEG — ZUNA1.1 / ZUNA (diffusion autoencoder, not 1BP) → Zyphra/ZUNA1.1
🗣️ TTS — Zonos-v0.1-hybrid / ZONOS2 (neural audio codec + MoE, not 1BP) → Zyphra/Zonos-v0.1-hybrid

1BP catalog

Every file below is on the public mirror and fetchable by name with packaging/model-download.sh <name> — the script the packaged image's 1bit-model-fetch.service calls. Sizes are the actual file sizes on the mirror, decimal (GB = 10⁹ B); model-download.sh list prints the same files in IEC units, so its ZAYA1-8B reads 6.1G where this table says 6.6 GB. Each download is checked against the sha256 the hub reports for that file (deleted on mismatch).

Model	1BP Size	Verified	Download name
ZAYA1-8B	6.6 GB	✅ loads	`zaya1-8b`
ZAYA1-74B-preview	49.6 GB	✅ loads	`zaya1-74b`
ZR1-1.5B	819 MB	hosted	`zr1-1.5b`
Zamba2-1.2B-v2	1.15 GB	hosted	`zamba2-1.2b`
BlackMamba-1.5B	1.0 GB	✅ loads	`blackmamba-1.5b`

Zamba2-2.7B/7B-v2, BlackMamba-2.8B and Zamba-7B-v1 are on the mirror as well; they are not in the downloader's default list because they are larger and rarely the first thing to try. The sizes above are the measured artifacts — ZR1-1.5B is 819 MB (matching the table at the top of this page), and the 74B .1bp is 49.6 GB.