all 1 comments

[–]Canbot 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (0 children)

The end of Google is transformers because it does not require programming. You feed in all the data you can get your hands on and the transformer does it's thing. Then the totality of the data you gathered can be searched with natural language prompts. Google would be dead by the end of the year except they are not going down without a fight. Information is getting commoditized and the major powers are going to gatekeep it. That means everyone trying to build their own transformer models is going to have a hard time getting their hands on enough data. Or rather good data.

One of the nasty tricks I expect them to play is to use salting techniques to sabotage the data so when it is fed into a transformer it fucks it up. This technique is, as far as I know, undetectable and the people who fall victim to it will only see that their LLMs are not good but they won't know why. It is going to be an information war. But all weapons are eventually defeated.

At first there will only be LLMs that search the internet for you to get better results. But those systems will still be at the mercy of search engine manipulation. The true revolution will happen when open source LLMs defeat the subversive attacks of the elites.