Building AI infrastructure for science. Professor in economics. @DeSciClaims @SciWeave

Luzern, Switzerland
Joined March 2013
Philipp Koellinger retweeted
“Claims provides the best evaluation for scientific records at a cost that scales” Over at @ExploitSummit, Claims co-founder @nashgambit broke down the three key verification models for scientific records within #SN111, all live on mainnet. Bronze: “Inexpensive compute to compare miner submissions with reference outputs.” Silver: “Higher-quality compute used only when there is disagreement between the reference outputs and the miners.” Gold: “Human-assisted adjudication, with a live consensus loop in v1 where miners assess the hard cases Silver can’t resolve automatically.” All three are active now. See the dashboard: dashboard.claims111.ai/
4
1
18
1,364
Philipp Koellinger retweeted
Claims V1 is live. After a month of testing on mainnet, @DeSciClaims has moved to a live data production engine. At Exploit, Philipp Koellinger explains the incentive mechanism designed to improve data quality and reduce costs.
9
1
28
1,193
Philipp Koellinger retweeted
“The product is validated data. We’re going to the companies we’re already talking to and enriching their data with ontologies that match their particular research questions, adding greater value.” @DeSciClaims appeared on @SubnetSummerTAO yesterday, breaking down how the subnet’s key product is to enhance data for others, through one-time fees and regular subscriptions where incoming and relevant information is consistently fed, sharpening their research. Watch the full podcast to learn about roadmaps, architecture, and incentives.
🚨 Subnet Summer AMA x SN111 @DeSciClaims - NOW LIVE ON YOUTUBE We covered: - What SN111 Claims is and why making science machine-readable matters - The DeSci opportunity: $3 trillion of knowledge locked in human-readable papers - How miners extract claims, how validators audit for integrity - The product roadmap: turning a knowledge graph into a revenue-generating API If you're interested in decentralised science, AI-driven research infrastructure, or how Bittensor tackles knowledge accessibility, this one's for you. youtu.be/9bOyBIJprro?si=lFJg…
3
16
935
Philipp Koellinger retweeted
23 clinical trials had tested whether switching off a woman's ovaries helps her survive #BreastCancer. But not one could tell whether it adds anything on top of the drugs she is already taking. These cancers are fed by oestrogen. Before menopause the ovaries are the main source, so they can be taken out with surgery, closed down with radiation, or switched off with drugs. The drugs are chemotherapy and tamoxifen. Chemotherapy kills dividing cells. Tamoxifen stops the cancer from responding to oestrogen. Earlier reviews had found no clear benefit from switching off the ovaries. So the Early Breast Cancer Trialists' Collaborative Group went back for the individual records: what happened to each woman, rather than each trial's summary results. 18,851 women. That is 98.9% of every woman randomised in eligible trials of this treatment. The oldest trial began enrolling in 1948, at the Christie Hospital in Manchester (@TheChristieNHS). It was the first cancer treatment ever assessed in a randomised trial. Its long-term survival data came from @NHS records. The women were typically in their early forties when they joined, and were followed for more than a decade. The result, among women who were under 45 when they joined and were already taking tamoxifen: 9.1% of those who also had their ovaries switched off had died of breast cancer within ten years. Among those on tamoxifen alone, 11.7% had. In the older trials, where none of the women received tamoxifen, the gap was wider. Cancer came back within 15 years in 39.1% of the women whose ovaries were switched off, and in 56.5% of the women whose were not. Switching off the ovaries has costs. The women whose ovaries were switched off had consistently more severe hot flushes than the women whose were not, and it is known to cause bone loss, which can be monitored and managed. Only 4 of the 23 trials measured quality of life at all. Across the trials there was no increase in deaths from other causes, and none in second cancers. This paper went through Claims this week: 8 adjudicated claims, each tied to its evidence. This is the shape of question we want a claim-evidence graph to surface: 23 trials, one claim between them, and no single paper that settles it. Getting the answer still needs the individual patient records, the original investigators and a national mortality register. The Claims database and AI do not produce that part. But they can point to where someone should look.
4
6
3
22
3,735
Philipp Koellinger retweeted
Ep. 99 - Philipp Koellinger & Christian Roessler Philipp and Christian are building Claims @DeSciClaims Subnet 111 Timestamps 0:00 - Highlights 1:48 - Proof of Pitch to Mainnet in Three Months 2:50 - Why Economists Find Bittensor Fascinating 3:42 - Citations as Science's Reward Function 4:29 - The Replication Nobody Would Publish 6:53 - How Much Published Science Is Wrong 8:26 - The AI Echo Chamber vs. Human Work 9:54 - Making 300 Million Papers Machine Readable 15:11 - Reproducibility vs. Citations 15:46 - Turning Papers Into a Knowledge Graph 16:20 - Why LLMs Hallucinate Citations 21:21 - Longer Context Windows Make This Obsolete? 22:56 - Coverage, Extraction Quality & Evidence Quality 25:16 - What Counts as a Substantive Claim 26:42 - What This Is Worth to Working Academics 27:37 - Academia Admits the System Is Broken 29:26 - How Do You Actually Find the Truth? 32:06 - Truth as Probability, Not Zero or One 33:33 - Logical Proof vs. Physical Replication 35:44 - Correlation vs. Causality 36:28 - Ground Truth From Replication Studies 38:12 - Codifying Claims to Surface Contradictions 40:14 - Can You Trust an LLM as a Judge? 42:48 - Synthetic Checks: Truth Is Sparse 45:40 - How Much Miner Variance Is Desirable 46:55 - Why Bittensor Instead of a Closed Company 49:50 - Success, Revenue & the Palantir Comparison 51:47 - The Flood of AI-Written Papers 54:36 - Advice for Discerning Truth
2
6
5
26
5,053
Philipp Koellinger retweeted
Claims V0 is live on mainnet. Here’s how mining works. Every six hours, Claims puts ~50 scientific papers in front of 10 competing miners. Miners extract the claims and evidence. Validators test the work. The strongest batch earns the most weight. Here’s the full loop. 🧵
1
6
3
36
2,790
Philipp Koellinger retweeted
Everyone's worried about AI hallucinating sources for its facts. But that's the easy half of the problem. The hard half: when a cited paper is real, knowing whether the finding inside is too. One landmark study is titled, literally, "Why Most Published Research Findings Are False." When a pharma company went back to reproduce dozens of high-profile results, most didn't hold up. P-hacking, underpowered studies, failed replications buried in the file drawer - the errors are baked into the record itself. Retrieval doesn't solve this. It hands you the paper and repeats what the author said. It can't tell you the result was contradicted three times since, or never replicated once. And the pile keeps growing. Since ChatGPT, the rate of new submissions has increased by ~50% - more claims stacked on the same broken foundation. That's what Claims exists to fix. Not just "find the paper," but map every claim, the evidence for and against it, and how much of it actually survives contact with the rest of the field. 👉 Follow our progress on Discord: discord.gg/phE5N3uT
1
10
26
1,107
Philipp Koellinger retweeted
bitstarter
@bitstarterAIJun 12
Subnet 111. Live on #Bittensor ⚡ Science has a credibility problem. Papers get published. Results can't be replicated. Nobody gets held accountable. Claims is changing that - using Bittensor to score, verify and surface research that actually holds up. Led by Prof. Philipp Koellinger [ @PKoellinger ] and Prof. Christian Roessler: 17,000+ citations. Published in Nature and Science. Game theorist specialising in mechanism design. Built @DeSciLabs to improve research incentives. They won Proof of Pitch. They impressed the judges. They earned the community. Now they get a subnet.
5
12
4
61
4,505
Philipp Koellinger retweeted
Bittensor's co-founder just said something that stopped me cold. He and his co-founder built the entire protocol from scratch. And then the subnets started moving faster than both of them combined. His exact words. People far smarter than us have started building on top of the system. The founders do not develop subnets anymore. The network outgrew them. Now read why that sentence is the most bullish thing anyone has ever said about $TAO. Bitcoin's creators did not build every application that runs on Bitcoin. They built the incentive layer and got out of the way. The network grew into something far beyond anything two people could have built alone. That is exactly what just happened to Bittensor. Decentralised training producing more resilient models than centralised alternatives. Subnets beating state of the art benchmarks domain after domain. Corporations like Unity pulling 3D objects directly from Bittensor for commercial video games. DeepMind researchers publicly acknowledging that decentralised training produces stronger more generalised models. All of it happening without the founders directing any of it. TCP/IP does not need its inventors to maintain it anymore. The internet ran past them decades ago. Bittensor just crossed the same threshold. Two founders watching the protocol they built outgrow them in real time is not a red flag. It is the oldest signal in technology. The people who recognised that moment in Bitcoin did not need to explain themselves later. The people who recognised it in Ethereum did not either. This is still early. The people who read the docs always buy before the people who read the price. Screenshot this.
Two people who were early in Bitcoin and early in Ethereum just went on record about $TAO. One of them wrote a book about Bitcoin in 2013. The other invested in the Ethereum ICO in 2015. Both of them started a fund with Jason Calacanis with a single thesis. Bittensor is the third great open-source substrate after Bitcoin and Ethereum. Here is the exact framing they used. In the early 90s Microsoft, AOL, and CompuServe were the well-capitalised incumbents. Everyone thought they would monopolise and run away with the internet. Then TCP/IP, Linux, and the World Wide Web came along and everything converged on an open-source substrate. Bittensor is that open-source substrate for the AI story playing out right now. OpenAI. Anthropic. Google DeepMind. XAI. Different cast of characters. Same pattern. And this time you can actually own a piece of the open-source substrate. Now read the valuation mismatch that should stop you cold. The four main AI labs combined are worth approximately $1.5 trillion. Bittensor is worth $1.7 billion. Ridges subnet competes directly with Claude and Cursor and has beaten them on benchmarks. Ridges market cap is $30 million. Cursor is worth $30 billion. That is not a small dislocation. That is a comical one. The highest valued subnet in the entire ecosystem is around $80 million. There has never been a billion dollar subnet yet. On Ethereum during the ICO mania projects with nowhere near this quality of output were raising hundreds of millions within minutes. Now think about how many orders of magnitude more capital is chasing AI opportunities today compared to 2017. When that capital discovers Bittensor the valuation rerating will be violent to the upside. Their exact words. Not mine. The man who called $TAO at $3,000 by end of 2026 said it directly. By 2030 it will be a trillion dollar ecosystem. Every molecule in my body is screaming this is another one. The people who read the docs always buy before the people who read the price. This is still early.
8
23
152
9,728
Philipp Koellinger retweeted
bitstarter
@bitstarterAIJun 4
The judges voted. You voted. After 45 minutes live at the Louvre, @DeSciClaims had raised 184 TAO. Claims wins Proof of Pitch at @proofoftalk 🏆 And now they're launching a subnet on Bittensor - auditing the science that the world runs on.
2
17
1
78
4,232
Philipp Koellinger retweeted
Instead of watching an hour of Netflix, watch this 2-hour Stanford lecture on AI careers. It will teach you more about winning in the AI race than all the AI content you’ve scrolled past this year.
159
3,064
45
13,870
2,022,938
Philipp Koellinger retweeted
If you come across someone asserting there is "no scientific evidence" that social media is causing harm, please send them this link. We lay out seven lines of evidence, including RCTs, natural experiments, and testimony from victims & perpetrators of harm worldhappiness.report/ed/202…
25
458
51
1,521
152,193
Philipp Koellinger retweeted
Aysu Okbay and I are hiring a postdoc to study gene–environment interplay in health & social inequalities 🧬 You'll analyze large genomic datasets as part of a 3-node consortium with Uppsala & Oslo. Based at @amsterdamumc 🇳🇱 Apply by May 4 below, please RT for karma points👇🏽
2
22
1
31
5,392
Philipp Koellinger retweeted
Reviewing yet another academic paper full of hallucinated references, odd citation practices, and improperly attributed material. To all academic colleagues out there, literally ruining our profession: thanks for nothing.
30
126
11
2,012
86,107
Philipp Koellinger retweeted
A San Diego startup just made whole genome sequencing cost $100. It used to cost $1 billion + The Human Genome Project took 13 years (1990-2003), billions of dollars, and an international consortium of 20+ institutions to sequence one genome. My PhD advisor, @s_batzoglou, was one of the first MIT PHDs who worked on it. He helped build the computational foundations that made it possible. His career spans the entire arc — from assembling the first human reference genome to making sequencing routine. The 10,000,000x cost drop isn't just a number. It's the difference between a moonshot national project and a routine lab test. Previous generation proved it was possible. This generation proved it could be cheap. The question now: what happens when everyone's genome is a $100 blood test? The implications for medicine, privacy, insurance, human identity? We're not ready. Link: sandiegouniontribune.com/202…
86
390
65
2,021
735,827
Philipp Koellinger retweeted
I am loving the way journals - finally having to face their irrelevancy - are grasping for salvation by touting their corporeality as an antidote to AI. From @ScienceMagazine "We at Science try to keep calm and carry on in contributing to a robust, human-curated research literature that will stand the test of time" (1) From @Dev_journal "When you see a Development paper on the CV of an applicant, whether that's a postdoc candidate or faculty candidate, you know it is high-quality, trustworthy work that has been assessed and commended by the field." (2) Unfortunately for them (and fortunately for everyone else) publishers' years of refusing to modernize the process even one scintilla is finally catching up to them. The writing is on the wall. AI - for all its flaws - is showing just how retrograde and meaningless the peer review process really is. The only real question left is whether these EICs will stick around to write their journals' obituaries. (1)science.org/doi/10.1126/scie… (2)journals.biologists.com/dev/…
10
17
87
13,753
Philipp Koellinger retweeted
This is great stuff. Here's Francis Galton advocating creating an open data repository to allow researchers to verify each other's results... In 1901!
6
29
4
402
28,616
Philipp Koellinger retweeted
2
4
167