I mean that’s kind of how chatgpt is now, I’ve been slowly getting into llama, can’t quite get it as good as gpt yet but I’m learning

Tbh I think you’re making a lot of assumptions and ignoring the point of this paper. The small model was used to quickly show proof of generative degradation over itérations when the model was trained on its own output data. The use of opt125 was used precisely due to its small size so they could demonstrate this phenomenon in less iterations. The point still stands that this shows that data poisoning exists, and just because a Model is much bigger doesn’t make sense that it would be immune to this effect, just that it will take longer. I suspect that with companies continually scraping the web and sources for data, like reddit which this article mentions has struck a deal with Google to allow their models to train off of, this process will not in fact take too long as more and more of reddit posts become AI generated in itself.

I think it’s a fallacy to assume that a giant model is therefore “higher quality” and resistant to data poisoning

I have, I’ve noticed. I’ve noticed that I’m no longer screaming out in a sea of people and being ignored or ridiculed. We’re in a smaller pond here and the waters are much clearer

No no it was totally worth it, if you had done them all in one go the gradient would have been the same on all the models, this way it’s much more interesting and each kid gets their own color

Oh God did you do these one model at a time?

Holy shit that’s exactly the mistake I was making 😂 good catch

I mean, kind of hard to cover up a shooting or bombing in a public office building, I can bet that if Google got attacked it would be all over the news

I was just trying to think of corperation names, though I do believe HG wells was at the center of some controversy

I’ll be honest, if I got it at 16, I would fuck around with it for a few weeks and then get bored

The steppers run quieter? I didn’t realize this was possible from just a board change

While I agree it shouldn’t be a big deal to have a star of David on your person. as an atheist if you wanna support your faith on your clothes, go nuts, it’s not hurting anyone. But this was already his employers policy and it’s a work uniform so for that reason alone it should be taken off.