• Markaos@discuss.tchncs.de
      link
      fedilink
      arrow-up
      0
      ·
      3 months ago

      What about “Attention Is A You Need”, the white paper that kick-started the whole generative AI and LLM thing? OpenAI’s GPT models are built off of that architecture, like pretty much everything that came after it.

      Like sure, modern Google is notoriously bad at building the actual end products, but it publishes a lot of research and some of it pushes others forward quite a lot.