manitcor@lemmy.intai.tech to Technology@beehaw.orgEnglish · 1 year agoDifferent development paths of LLMslemmy.intai.techimagemessage-square16fedilinkarrow-up144arrow-down10file-text
arrow-up144arrow-down1imageDifferent development paths of LLMslemmy.intai.techmanitcor@lemmy.intai.tech to Technology@beehaw.orgEnglish · 1 year agomessage-square16fedilinkfile-text
cross-posted from: https://lemmy.intai.tech/post/5502 cross-posted from: https://lemmy.intai.tech/post/5501 https://www.interconnects.ai/p/llm-development-paths
minus-square🐝bownage [they/he]@beehaw.orglinkfedilinkEnglisharrow-up4·1 year agoI was going to ask which are transformer based but it’s actually nearly all of them (non grey) 😳. I thought BERT was still pre transformers. Goes to show how quickly things have evolved in recent years.
minus-squaremanitcor@lemmy.intai.techOPlinkfedilinkEnglisharrow-up1·1 year agoyeah, the idea of making it transformers all the way down was key, each node is a complete Turing machine.
I was going to ask which are transformer based but it’s actually nearly all of them (non grey) 😳. I thought BERT was still pre transformers. Goes to show how quickly things have evolved in recent years.
yeah, the idea of making it transformers all the way down was key, each node is a complete Turing machine.