A year ago I wrote that meta-RL captures #MedialPrefrontalCortex processing of #predictionerror, #DecisionMaking, and #CognitiveControl. I was wrong. It also captures #Foraging and #WorkingMemory. Thanks to all the authors.
dx.plos.org/10.1371/journal.…
Massimo Silvetti retweeted
I probably mentioned this to you before, but now it's statistically proven :-)
Mental effort feels unpleasant across a wide wide range of tasks and circumstances. Work led by Louise David and @erikbij
This Post is from an account that no longer exists. Learn more
Meta-RL and dysfunction of the mesolimbic DA system in people with subclinical psychotic symptoms: a small step toward identifying psychosis vulnerability markers.
Thanks to @DamianoTerenzi, @RafRumiati, and Marilena Aiello for making me part of it!
authors.elsevier.com/a/1jV5%…
Massimo Silvetti retweeted
If you are a student or academic researcher and want to make progress towards human-level AI:
>>>DO NOT WORK ON LLMs<<<
LLMs are an off ramp.
Thousands of engineers are working on LLMs with enormous computing resources.
The only way you could possibly contribute is by analyzing existing LLMs and showing their power and limitations.
But it's more fun and impactful to come up with new ideas and new architectures and show that they might work, even on small problems.
Great talk by @ylecun yesterday, at the scientific symposium for the opening of the @ELLISInst_Tue! I took the liberty of summarizing one of his main take-home messages...
Massimo Silvetti retweeted
New preprint from the lab! 🚨
Replay of procedural experience occurs in the striatum and is independent of the hippocampus.
Heroic effort by @EmmettJThompson & the rest of the team @_JasvinKaur, @_GeorginaMills, @dorrell_will, @ClementineDomi6, @TomNotGeorge
🧵👇1/13
Replay of procedural experience is independent of the hippocampus biorxiv.org/cgi/content/shor… #biorxiv_neursci
If you’re wondering whether the #MedialPrefrontalCortex processes #predictionerror, #DecisionMaking, or #CognitiveControl, meta-RL will finally bring you peace of mind.
biorxiv.org/content/10.1101/…
Congrats to @Tim_Vriens, thanks to @ElianaVassena @GiovanniPezzulo and @saldasbarre.
Massimo Silvetti retweeted
Do people with different temperamental styles orient their attention in space differently? In our latest publication on "Cortex", we tried to answer this relevant question. shorturl.at/nstI8
#academia #research #neuroscience
Massimo Silvetti retweeted
GPT-4 is getting worse over time, not better.
Many people have reported noticing a significant degradation in the quality of the model responses, but so far, it was all anecdotal.
But now we know.
At least one study shows how the June version of GPT-4 is objectively worse than the version released in March on a few tasks.
The team evaluated the models using a dataset of 500 problems where the models had to figure out whether a given integer was prime. In March, GPT-4 answered correctly 488 of these questions. In June, it only got 12 correct answers.
From 97.6% success rate down to 2.4%!
But it gets worse!
The team used Chain-of-Thought to help the model reason:
"Is 17077 a prime number? Think step by step."
Chain-of-Thought is a popular technique that significantly improves answers. Unfortunately, the latest version of GPT-4 did not generate intermediate steps and instead answered incorrectly with a simple "No."
Code generation has also gotten worse.
The team built a dataset with 50 easy problems from LeetCode and measured how many GPT-4 answers ran without any changes.
The March version succeeded in 52% of the problems, but this dropped to a pale 10% using the model from June.
Why is this happening?
We assume that OpenAI pushes changes continuously, but we don't know how the process works and how they evaluate whether the models are improving or regressing.
Rumors suggest they are using several smaller and specialized GPT-4 models that act similarly to a large model but are less expensive to run. When a user asks a question, the system decides which model to send the query to.
Cheaper and faster, but could this new approach be the problem behind the degradation in quality?
In my opinion, this is a red flag for anyone building applications that rely on GPT-4. Having the behavior of an LLM change over time is not acceptable.
Have you noticed any issues when using GPT-4 and ChatGPT lately? Do you think these problems are overblown?
Massimo Silvetti retweeted
The last work of my PhD thesis together with @RafRumiati @MassimoSilvetti Marilena Aiello and others
"The impact of Subclinical Psychotic Symptoms on Delay and Effort discounting: insights from behavioral, computational, and electrophysiological methods"
biorxiv.org/cgi/content/shor…
Massimo Silvetti retweeted
Really nice collaboration with @arossotto led by Sean Devine.
We show that facial EMG, and particularly the corrugator supercilii, tracks not only mental effort but also the integration of anticipated effort & reward.
Your feelings, measured by facial EMG, track a cost-benefit evaluation of to-be-experienced cognitive effort, reflecting both demand (costs) and benefits (rewards)
new work just out in CABN, by student Sean Devine in collaboration with
@ElianaVassena
link.springer.com/article/10…
Massimo Silvetti retweeted
Some good remarks about the mood of many AI researchers and engineers at the moment.
It's easy to make two mistakes and get depressed or feel burned out:
1. Thinking that AI is "solved" or will soon be.
2. Thinking that one can not contribute.
Both are false.
Almost everyone I know working in AI these days feels one step away from total burnout. I took the time to take you behind the curtain and know what people on the state-of-the-art AI are struggling with:
robotic.substack.com/p/behin…
Massimo Silvetti retweeted
Finally! This is what happens when you work with your best friend @AndreaPisauro on the idea of making the Prisoner Dilemma a continuous game. Our paper is out @NatureComms. Cannot believe it after 6y of hard work! nature.com/articles/s41467-0…
Massimo Silvetti retweeted
Meloni, restrizioni e dati… butac.it/meloni-restrizioni-…
Massimo Silvetti retweeted
Salvini: "Mi occupo di terra e di mare". Poi ha elencato i piatti fuori menù.
[sosco]
Bridging information demand, visual attention, effort and free energy? Thanks to the collaboration with Jackie Gottlieb’s lab, we propose a brand new perspective under the hat of meta-RL.
sciencedirect.com/science/ar…
Massimo Silvetti retweeted
Replying to @jacopo_iacoboni
Massimo Silvetti retweeted
Cardiac sympathetic-vagal activity (reflected in R-R intervals) is an "effect" and cannot "cause" cortical activity. Rather, the integrative activity of amygdala-ventral hippocampus-hypothalamus triggering that activity can do it doi.org/10.1016/S0079-6123(0… @SIPFNC
PNAS
Cardiac sympathetic-vagal activity initiates a functional brain–body response to emotional arousal
pnas.org/doi/full/10.1073/pn…
Massimo Silvetti retweeted
Sdegno di Salvini non reggerebbe,in Paese normale. Ci sono prove materiali che al Metropol suoi fidi chiedessero a Mosca milioni x disallineare ITA da UE Irrilevante se Putin non glie l'ha dati,ritenendo Salvini inaffidabile.A Vienna vicepremier cacciato in 48h,per la stessa cosa






















