back to writings

#gemmachallenge

2 posts

I built a local document Q&A tool around Gemma 4 E4B's 128K context — five days, no RAG, no cloud
Five days, an 8 GB laptop GPU, and a stubborn belief that for the kind of documents I actually read…
#devchallengeMay 24, 20269 min
I stress-tested Gemma 4 E4B's 128K context on a laptop GPU — recall is great, prefill is not
Thursday night I let a benchmark run while I slept. By Friday morning Gemma 4 E4B had answered…
#devchallengeMay 24, 20269 min

view #gemmachallenge in the knowledge graph