Over the past time I collected some interesting mechanistic interpretability papers - trying to understand the information processing in AI systems.
Since I'm not an expert, I delegated some of the work to AI itself 🙃
Why I find it interesting? Well, the field of "AI neuroscience" is emerging. This, firstly, brings two fields closer together (neuroAI doesn't count). Second, I believe both understanding of AI and the brain can be advanced by testing theories on the systems where everything can be measured and controlled.
Of course, LLMs are far from natural biological nervous systems, but I believe there are fundamental information processing principles that are shared.
💡Some insights: > Activations in RNNs mirror the statistics of their input data > Apparently chunking of computations is present akin to brain's hierarchical processing > "Grandmother cell" are real but sparse, distributed processing is more likely to be happening
Over the past time I collected some interesting mechanistic interpretability papers - trying to understand the information processing in AI systems.
Since I'm not an expert, I delegated some of the work to AI itself 🙃
Why I find it interesting? Well, the field of "AI neuroscience" is emerging. This, firstly, brings two fields closer together (neuroAI doesn't count). Second, I believe both understanding of AI and the brain can be advanced by testing theories on the systems where everything can be measured and controlled.
Of course, LLMs are far from natural biological nervous systems, but I believe there are fundamental information processing principles that are shared.
💡Some insights: > Activations in RNNs mirror the statistics of their input data > Apparently chunking of computations is present akin to brain's hierarchical processing > "Grandmother cell" are real but sparse, distributed processing is more likely to be happening
Have a look, it's fun 🙂
BY the last neural cell
Warning: Undefined variable $i in /var/www/group-telegram/post.php on line 260
"The inflation fire was already hot and now with war-driven inflation added to the mix, it will grow even hotter, setting off a scramble by the world’s central banks to pull back their stimulus earlier than expected," Chris Rupkey, chief economist at FWDBONDS, wrote in an email. "A spike in inflation rates has preceded economic recessions historically and this time prices have soared to levels that once again pose a threat to growth." The account, "War on Fakes," was created on February 24, the same day Russian President Vladimir Putin announced a "special military operation" and troops began invading Ukraine. The page is rife with disinformation, according to The Atlantic Council's Digital Forensic Research Lab, which studies digital extremism and published a report examining the channel. The Security Service of Ukraine said in a tweet that it was able to effectively target Russian convoys near Kyiv because of messages sent to an official Telegram bot account called "STOP Russian War." These administrators had built substantial positions in these scrips prior to the circulation of recommendations and offloaded their positions subsequent to rise in price of these scrips, making significant profits at the expense of unsuspecting investors, Sebi noted. Since January 2022, the SC has received a total of 47 complaints and enquiries on illegal investment schemes promoted through Telegram. These fraudulent schemes offer non-existent investment opportunities, promising very attractive and risk-free returns within a short span of time. They commonly offer unrealistic returns of as high as 1,000% within 24 hours or even within a few hours.
from in
