Over the past time I collected some interesting mechanistic interpretability papers - trying to understand the information processing in AI systems.
Since I'm not an expert, I delegated some of the work to AI itself 🙃
Why I find it interesting? Well, the field of "AI neuroscience" is emerging. This, firstly, brings two fields closer together (neuroAI doesn't count). Second, I believe both understanding of AI and the brain can be advanced by testing theories on the systems where everything can be measured and controlled.
Of course, LLMs are far from natural biological nervous systems, but I believe there are fundamental information processing principles that are shared.
💡Some insights: > Activations in RNNs mirror the statistics of their input data > Apparently chunking of computations is present akin to brain's hierarchical processing > "Grandmother cell" are real but sparse, distributed processing is more likely to be happening
Over the past time I collected some interesting mechanistic interpretability papers - trying to understand the information processing in AI systems.
Since I'm not an expert, I delegated some of the work to AI itself 🙃
Why I find it interesting? Well, the field of "AI neuroscience" is emerging. This, firstly, brings two fields closer together (neuroAI doesn't count). Second, I believe both understanding of AI and the brain can be advanced by testing theories on the systems where everything can be measured and controlled.
Of course, LLMs are far from natural biological nervous systems, but I believe there are fundamental information processing principles that are shared.
💡Some insights: > Activations in RNNs mirror the statistics of their input data > Apparently chunking of computations is present akin to brain's hierarchical processing > "Grandmother cell" are real but sparse, distributed processing is more likely to be happening
Have a look, it's fun 🙂
BY the last neural cell
Warning: Undefined variable $i in /var/www/group-telegram/post.php on line 260
In the past, it was noticed that through bulk SMSes, investors were induced to invest in or purchase the stocks of certain listed companies. Ukrainian forces have since put up a strong resistance to the Russian troops amid the war that has left hundreds of Ukrainian civilians, including children, dead, according to the United Nations. Ukrainian and international officials have accused Russia of targeting civilian populations with shelling and bombardments. On December 23rd, 2020, Pavel Durov posted to his channel that the company would need to start generating revenue. In early 2021, he added that any advertising on the platform would not use user data for targeting, and that it would be focused on “large one-to-many channels.” He pledged that ads would be “non-intrusive” and that most users would simply not notice any change. "We as Ukrainians believe that the truth is on our side, whether it's truth that you're proclaiming about the war and everything else, why would you want to hide it?," he said. Telegram does offer end-to-end encrypted communications through Secret Chats, but this is not the default setting. Standard conversations use the MTProto method, enabling server-client encryption but with them stored on the server for ease-of-access. This makes using Telegram across multiple devices simple, but also means that the regular Telegram chats you’re having with folks are not as secure as you may believe.
from ms
