AI for Humanity: Shaping a Better Future
San Francisco
Joined May 2023
- Tweets61
- Following174
- Followers114
- Likes36
San Francisco A.I. retweeted
Foundation models have profound societal impact, but transparency about these models is waning. Today, we are launching the Foundation Model Transparency Index, which offers a deep dive into the transparency practices and standards of key AI developers.
crfm.stanford.edu/fmti/
ALT Overall scores of the various foundation model developers.
San Francisco A.I. retweeted
Nice RAG trick for diverse content types (images / tables): generate + embed a text summary (for natural language search), but return full doc for LLM synthesis.
Short write-up w/ 3 cookbooks below showing semi-structured and multi-modal RAG using this idea with the multi-vector retriever.
Table summaries work nicely w/ the multi-vector retriever for semi-structured RAG. And I use LLaVA-7b (c/o @imhaotian) to generate image summaries.
Also include a cookbook showing this full pipeline running private / local on my laptop w/ llama.cpp c/o @ggerganov, @ollama_ai, @nomic_ai embeddings, and @trychroma.
Write-up:
blog.langchain.dev/semi-stru…
