Aces@lemmy.today to No Stupid Questions@lemmy.world · 9 months agoHas Google’s search results drastically declined for anyone else?message-squaremessage-square200fedilinkarrow-up1638arrow-down126
arrow-up1612arrow-down1message-squareHas Google’s search results drastically declined for anyone else?Aces@lemmy.today to No Stupid Questions@lemmy.world · 9 months agomessage-square200fedilink
minus-squarenotfromhere@lemmy.mllinkfedilinkarrow-up1·9 months agoI think this is because of how transformer style LLMs tokenizers work, the models don’t really understand the spelling of the words when asked like that. Karpathy has a great learning video on the GPT2 tokenizer that just came out.
I think this is because of how transformer style LLMs tokenizers work, the models don’t really understand the spelling of the words when asked like that. Karpathy has a great learning video on the GPT2 tokenizer that just came out.