Saahil Ognawala (@saahil) profile picture

Head of Product @JinaAI_ . Tweets about AI, ML, software, security and everything that is not those.

Munich; Udaipur
Joined July 2008
Photo by Saahil Ognawala (@saahil)Photo by Saahil Ognawala (@saahil)Photo by Saahil Ognawala (@saahil)Photo by Saahil Ognawala (@saahil)Photo by Saahil Ognawala (@saahil)Photo by Saahil Ognawala (@saahil)Photo by Saahil Ognawala (@saahil)Photo by Saahil Ognawala (@saahil)Photo by Saahil Ognawala (@saahil)Photo by Saahil Ognawala (@saahil)
Saahil Ognawala retweeted
4K. That's the max depth you can hide text to and embedding models can still retrieve it. Beyond that, it's gone. Using jina-embeddings-v3, we reproduced the new Needle-in-a-Haystack from recent NoLiMA paper - by removing literal matches between queries and the relevant information (the needle) hidden in the haystack. We ask ourselves: - How do embedding models perform retrieval across long-context? - Can query expansion mitigate this performance gap?
7
36
6
311
26,625
Saahil Ognawala retweeted
Elasticsearch Open Inference API now supports @JinaAI_! Developers can now build search and RAG applications using the latest Jina AI embedding and reranking models without additional integration or costs. Learn more: go.es.io/4i8sNOs
8
3
27
4,034
Saahil Ognawala retweeted
For every model we release, there are 3 ways of using it at scale: Jina API, CSP (e.g. SageMaker), self-hosted K8s. Here we evaluate latency, throughput, neighborhood problem, cost/token across three options to help you decide which one best suits you.👇jina.ai/news/a-practical-gui…
4
1
22
3,893
Saahil Ognawala retweeted
My colleague @saahil wrote a detailed review of model deployment options, api vs cloud providers vs self-hosting, full of numbers and insights for serious developers:
For every model we release, there are 3 ways of using it at scale: Jina API, CSP (e.g. SageMaker), self-hosted K8s. Here we evaluate latency, throughput, neighborhood problem, cost/token across three options to help you decide which one best suits you.👇jina.ai/news/a-practical-gui…
1
9
481
Saahil Ognawala retweeted
Jina-CLIP-v2: a 0.9B multilingual multimodal embedding model that supports 89 languages, 512x512 image resolution, 8192 token-length, and Matryoshka representations down to 64-dim for both images and text. jina.ai/news/jina-clip-v2-mu… With of course strong performance on retrieval & classification tasks. Like Jina-CLIP v1, the text encoder of Jina-CLIP v2 can function as a standalone dense retriever, giving performance comparable to jina-embeddings-v3, which is currently the best multilingual embedding model under 1B parameters.
7
69
6
345
42,369
Saahil Ognawala retweeted
At #EMNLP2024 Miami next week? Join us on November 14, 2024, from 10:30 AM to 12:00 PM (Miami Time) for a BoF session on Embeddings, Rerankers, and Small LMs for better search. This 1.5-hour in-person session will bring together researchers in embeddings, rerankers & information retrieval; offering an excellent opportunity to explore recent advances in search foundation models, share your work with a specialized audience, and discuss emerging trends in search models in 2024. All EMNLP on-site participants are welcome to attend. Topics of interest: - Multimodal, multilingual, cross-lingual, and cross-modal embeddings and rerankers - Late-interaction models (e.g., ColBERT, ColPali) and late chunking - Long-context embedding models - Instruction-tuning for embedding and reranker models - LLM-based embedding and reranker models - Small language models for document reading - Efficient and lightweight embedding architectures, attention mechanisms - Zero/few-shot retrieval and adaptation methods - Contrastive learning approaches for retriever - Matryoshka representation learning, embedding compression and quantization - Hybrid sparse-dense retrieval systems - Task-LoRA, domain adaptation, OOD, fine-tuning for embedding models - MTEB, LongMTEB, RAG evaluation metrics and benchmarks - Embedding models for code and structured data - Privacy-preserving embedding techniques
1
9
3
20
4,799
Saahil Ognawala retweeted
curl docs.jina.ai This is our Meta-Prompt. It allows LLMs to understand our Reader, Embeddings, Reranker, and Classifier APIs for improved codegen. Using the meta-prompt is straightforward. Just copy the prompt into your preferred LLM interface like ChatGPT, Claude, or whatever works for you, add your instructions, and you're set. In this example, we copied the entire prompt into Anthropic Claude and asked it to grab every sentence from Hacker News front page and visualize them using UMAP with matplotlib. This task is nontrivial as it combines multiple APIs from our Search Foundation, like Reader and Embedding where Claude may not have knowledge of. So if you asked Claude directly, it probably wouldn't give an optimal answer. But with the meta-prompt, Claude now has good knowledge about our APIs and can generate much better code! We can copy paste the code directly to Google Colab and with minimum modification, the code just works!
15
78
29
656
209,258
Saahil Ognawala retweeted
Classification is the #1 downstream task for embeddings. It's recently popular for routing queries to LLMs too. We're excited to launch new Classifier API jina.ai/classifier/ - supports both zero-shot and few-shot online classification for text & image, powered by our latest jina-embeddings-v3 and jina-clip-v1.
2
13
5
108
11,669
Saahil Ognawala retweeted
"It's a multilingual embedding model"—okay, but what's that mean? Does it mean you can search German docs with a German query, French docs with a French one, all within the same model? Or can you also search French docs using Japanese queries? A lot of these multilingual models are pretty vague about this: is it just about handling multiple languages separately, or can it do true cross-lingual retrieval? In fact, most models can only manage the former because of the 'language gap'—where similar phrases in different languages don’t align as closely as they should. This makes them less useful for cross-lingual search, which would be much more valuable for global businesses. While training jina-embeddings-v3, we realized that bridging the language gap isn't straightforward. The two figures below illustrate this. We pre-trained jina-roberta-xlm (the backbone of v3) to see how well it could learn cross-language equivalencies through masked language pre-training. We used UMAP to plot 2D sentence representations for a set of English sentences and their translations into German, Dutch, Simplified Chinese, and Japanese. And it's bad. Comparing this with the final v3 model, it’s clear that the language gap has been significantly reduced. The embeddings in v3 show minimal language-specific clustering, and semantically similar texts produce close embeddings, no matter the language.
3
36
4
191
12,771
Saahil Ognawala retweeted
We extended our priprint about late chunking, a novel method to make embeddings of chunks context-aware. We added: - Algorithm for long documents - Training method to make late chunking more effective - Comparison to Anthropic's contextual embedding arxiv.org/abs/2409.04701
4
10
2
62
7,030
Saahil Ognawala retweeted
jina-embeddings-v3, reader-lm-0.5b, and reader-lm-1.5b models are now available on AWS SageMaker and Azure Marketplace. Deploy these frontier models within your company’s cloud infrastructure to maintain compliance and full data ownership. Learn more at the link below: AWS v3: aws.amazon.com/marketplace/p… reader-lm-1.5b: aws.amazon.com/marketplace/p… reader-lm-0.5b: aws.amazon.com/marketplace/p… Azure: v3: azuremarketplace.microsoft.c… reader-lm-1.5b: azuremarketplace.microsoft.c… reader-lm-0.5b: azuremarketplace.microsoft.c…
3
21
2
124
9,848
Saahil Ognawala retweeted
We will use the latest multilingual text embedding model from @JinaAI_ to encode over 100 million entries of human knowledge and make it easier to reach:
Wikimedia, DataStax, and Jina AI launch semantic search for non-profit AI developers buff.ly/3TwC49g
2
3
41
2,710
Saahil Ognawala retweeted
Neat, looks like @JinaAI_ have a CLIP-style model available via their API
3
2
2
59
9,319
Saahil Ognawala retweeted
What a day! Today we got 🎉Qwen Party of models (base, code, math,...) 💬 Kyutai Moshi on-device speech-to-speech 📹 CogVideoX image-to-video 🤏 Jina releasing one of the best open embedding models
4
22
163
9,732
Saahil Ognawala retweeted
my personal favourite about jina-embeddings-v3 (beyond fancy features) is, we manually checked the common failures made by different text embedding models, created failure taxonomy, and try to fix them one by one. This involves a lot of painful, manual work:
Finally, jina-embeddings-v3 is here! A frontier multilingual embedding model with 570M parameters, 8192-token length, achieving SOTA performance on multilingual and long-context retrieval tasks. It outperforms the latest proprietary models from OpenAI and Cohere, and outperforms multilingual-e5-large-instruct across all multilingual tasks. In fact, as of today, jina-embeddings-v3 is the best multilingual model and ranks 2nd on the MTEB English leaderboard for models < 1B parameters.
9
15
141
11,352
Optimizing your chunking techniques is one of the top places to improve performance in your RAG pipelines, but what’s the best one? @JinaAI_ just released a new method called late chunking that takes the same amount of storage space as naive chunking, but solves the problem of lost context similarly to ColBERT. You can implement it super easily with just a few extra lines in your embedding step! Blog: weaviate.io/blog/late-chunki… Notebook: github.com/weaviate/recipes/… Thanks so much to @DanielW966 again for the awesome collaboration 💚 📄 Papers Late Chunking: arxiv.org/pdf/2409.04701 ColBERT: arxiv.org/pdf/2004.12832
6
89
6
407
32,318
Saahil Ognawala retweeted
Replying to @JinaAI_
@jinaai_ just launched jina-embeddings-v3 — featuring LoRA adapters, cost-efficient performance, and superior results compared to models 12x its size.
Finally, jina-embeddings-v3 is here! A frontier multilingual embedding model with 570M parameters, 8192-token length, achieving SOTA performance on multilingual and long-context retrieval tasks. It outperforms the latest proprietary models from OpenAI and Cohere, and outperforms multilingual-e5-large-instruct across all multilingual tasks. In fact, as of today, jina-embeddings-v3 is the best multilingual model and ranks 2nd on the MTEB English leaderboard for models < 1B parameters.
1
3
9
1,192
Saahil Ognawala retweeted
Wikimedia, DataStax, and Jina AI launch semantic search for non-profit AI developers buff.ly/3TwC49g
4
1
9
4,450
Saahil Ognawala retweeted
Thanks to @NVIDIAAI for including our 𝕁𝕚𝕟𝕒-𝕣𝕖𝕣𝕒𝕟𝕜𝕖𝕣-𝕧𝟚-𝕞𝕦𝕝𝕥𝕚𝕝𝕚𝕟𝕘𝕦𝕒𝕝 in their recent benchmark on text retrieval for Q&A! It’s great to see more focus on reranker models in this benchmark, as there's still a lot to explore in this area.
Enhancing Q&A Text Retrieval with Ranking Models: Benchmarking, fine-tuning and deploying Rerankers for RAG NVIDIA benchmarks ranking models for text retrieval in QA tasks introducing a new sota model NV-RerankQA-Mistral-4B-v3 📝arxiv.org/abs/2409.07691 👨🏽‍💻build.nvidia.com/explore/ret…
1
5
181
Saahil Ognawala retweeted
Announcing reader-lm-0.5b and reader-lm-1.5b, jina.ai/news/reader-lm-small… two Small Language Models (SLMs) inspired by Jina Reader, and specifically trained to generate clean markdown directly from noisy raw HTML. Both models are multilingual and support a context length of up to 256K tokens. Despite their compact size, these models achieve state-of-the-art performance on this HTML2Markdown task, outperforming larger LLM counterparts while being only 1/50th of their size.
26
189
52
1,199
157,104