David & Henning's Master Thesis on quantization of LLMs for integer-only hardware

Softmax Implementation Comparison

Select Methods to Display:

LUTi16 LUTi8 DIGmaxi16 Log DIGmaxi16 Linear DIGmaxi8 Log DIGmaxi8 Linear

Mode: Positive: exp(x) Negative: exp(-x)

X Range: [0, ] Number of Points:

Generating comparison plots for x ∈ [0, 32] with all 6 methods.
This may take a few seconds...

💾 Save Plots as PNG:

Evaluating methods...

⏳ Preparing request...

⏳ Generating data on server...

⏳ Receiving data...

⏳ Rendering plots...

⏳ Finalizing...