New metrics for weight compression with dynamic quantization#2829

Closed

ljaljushkin wants to merge 2 commits intoopenvinotoolkit:developfrom ljaljushkin:nl/dyn_quant_conform

+56-44

Commits on Nov 13, 2024

enabled dynamic quantization and kv cache precision u8
ljaljushkin
committed

Commits on Nov 14, 2024

updated references for u8 kv cache compression
ljaljushkin
committed