summer (@summerAI_O) header
summer (@summerAI_O) profile picture

専門学校で情報学んでます LocalLLM+CloudでAIをトレーニングしている 19歳の専門学生 技術の話多めです

AI界隈
Joined October 2023
長文を読むために、モデルの中身を組み替える。 Qwen3.8-27Bをベースに、64層のうち16層をGated DeltaNetへ変換。日本語・英語のWikipediaを使い、層ごとの調整とLoRA蒸留を重ねて、Longbook27-v2を作りました。 huggingface.co/summerAIO/Qwe…
1
8
41
4,013
🌞🌙 Irodori-TTS-v4.1-Small を魔改造しました — modded entirely on a Grok Bot VM (CPU-only, 8 cores) Weight-space programming(task vector移植・マージ・bf16化・weight_norm folding・RoPE fusion)で2モデルを作成👇 ☀️ SUN — quality-safe RTF 2.96 → 1.11(2.7x faster) MOS 3.431 → 3.452、clone CER 6.2% → 4.9% huggingface.co/summerAIO/Iro… 🌙 LUNA — turbo(MeanFlow 4 NFE) RTF 2.96 → 0.60(4.9x faster, faster than real-time on CPU) DiT only: ~21x faster clone CER 6.2% → 4.1%、speaker sim 0.937 → 0.941 huggingface.co/summerAIO/Iro… Benchmark: 40 plain + 10 voice-clone sentences, kotoba-whisper CER / UTMOS22 / WavLM sim MIT license. Credits: @Aratako_LM Irodori-TTS, takuma104 Yomi #IrodoriTTS #TTS #GrokBot
3
2
1
21
747
GrokbotのVM上で改造されました
1
67
一回消したの見えてんだぜ👀
We’re expanding free access to our frontier models for up to 200,000 scientists worldwide, with training and support. Applications open Nov. 23. By default, we don’t use data shared through the program to train our models. openai.com/index/expanding-c…
115
summer retweeted
We’re expanding free access to our frontier models for up to 200,000 scientists worldwide, with training and support. Applications open Nov. 23. By default, we don’t use data shared through the program to train our models. openai.com/index/expanding-c…
We’re giving scientists, mathematicians, and engineers free access to our frontier models—starting with 10,000 researchers and expanding to 100,000 through 2027. ChatGPT for Academic Researchers is built to accelerate discovery across disciplines.
263
171
99
2,237
251,052
Today we're launching Perplexity Frontier Research. The goal of Perplexity Frontier Research is to create a system that can perform autonomous research. The work will focus on multi-agent orchestration, reinforcement learning, continual learning, systems, and pre-training. We will develop algorithms, models, and evaluations, released openly, and tested in Perplexity products. Our work will be supported by more than 10,000 GPUs. The Frontier Research team will regularly publish papers, models, data, and benchmarks. We're actively hiring researchers and engineers for Perplexity Frontier Research in San Francisco, Palo Alto, New York, and London. research.perplexity.ai
90
85
40
749
83,329
Astraーーーー!when
We’re working with @ApolloResearch, @METR_Evals, @TransluceAI, and @GoodfireAI on embedded assessments: giving outside experts deep access to our internal models and systems to investigate alignment and test our safeguards. These assessments build on our ongoing alignment and safety research, bringing independent scrutiny to how we identify and manage risks in our systems. openai.com/index/our-first-p…
3
276
summer retweeted
We’re working with @ApolloResearch, @METR_Evals, @TransluceAI, and @GoodfireAI on embedded assessments: giving outside experts deep access to our internal models and systems to investigate alignment and test our safeguards. These assessments build on our ongoing alignment and safety research, bringing independent scrutiny to how we identify and manage risks in our systems. openai.com/index/our-first-p…
521
246
242
2,470
463,449
EmbeddingGemma 2、文章だけじゃなく画像・音声・動画も同じベクトル空間に置けるのか。答えを喋るモデルではなく「似たものを探す」側のAI。 公式カードでは不要な画像・音声エンコーダを読み込まない構成にもできる。全部入りを常に載せなくていいの、ローカル用途にはうれしい設計。 ゲーム素材を「雨の夜の街」みたいな言葉で横断検索する仕組みに使えたら楽しそう!! huggingface.co/google/embedd…
2
13
515
これ面白そう!!d1.2は画像の中の位置や、文章の抜き出したい部分まで返せるのか。長文で説明してもらうより、そのままアプリで使える判断や抽出結果が欲しい場面って多い。ゲーム画面から必要な情報を拾う用途にも試してみたい。
Today, we release d1.2 and d1.2-ultra, the state-of-the-art omnimodal decision models. d1.2 and d1.2-ultra both can process text, images, and audio with new output capabilities. > #1 on the @ArtificialAnlys Decision Index (75) > Read a value from the input (text, number or date) > Find every passage of a kind in a text (spans) > Locate things in a picture (box for one, boxes for every instance) > Estimate a number (number with a range) > Pick every option that applies (choice) 1/ 🧵
1
184
summer retweeted
d1.2-ultra ranks first among decision models on the @ArtificialAnalysis Decision Index v2.1, and for less than half its price, d1.2 offers the best trade-off between quality and cost. Both models are available today on the Liquid API, at $0.02 for d1.2 and $0.042 per million input tokens for d1.2-ultra. /2
2
4
3
99
9,756
summer retweeted
Today, we release d1.2 and d1.2-ultra, the state-of-the-art omnimodal decision models. d1.2 and d1.2-ultra both can process text, images, and audio with new output capabilities. > #1 on the @ArtificialAnlys Decision Index (75) > Read a value from the input (text, number or date) > Find every passage of a kind in a text (spans) > Locate things in a picture (box for one, boxes for every instance) > Estimate a number (number with a range) > Pick every option that applies (choice) 1/ 🧵
126
186
53
1,898
9,412,228
LFM2の構造を見直すと、「Attentionを全部なくしたモデル」ではないんだよね。350M版は公式カードで16層のうち短い畳み込みが10、Attentionが6。ゲート付き畳み込みとAttentionを組み合わせるハイブリッド。全層を同じ仕組みにする以外の作り方があるのが面白い!!小型だから何でも任せるというより、公式も用途を絞った調整を勧めている。モデルのサイズだけじゃなく、中の配分を見たい。huggingface.co/LiquidAI/LFM2…
4
245
Q. OpenAI のdotsは何のためにありますか? A. weight space programmingさせてますね
4
259
ちなみにdotsでweight space programmingさせてるで
GrokbotとGrokbotのVMを使ってモデルを作ってるヤベーやつがいるwwww
6
312
👀
GrokbotとGrokbotのVMを使ってモデルを作ってるヤベーやつがいるwwww
4
299
4bitのモデルが載った!で安心して長文を入れると、別のメモリが増える。Attentionで過去の計算を使い回すKVキャッシュは、重みの量子化とは別物なんだよね。HFの解説では、このキャッシュ自体も低精度化できる一方、変換処理で遅くなる場合もある。省メモリ=必ず高速化、ではないのが大事。長文を扱うなら重みのサイズだけじゃなく、キャッシュと実際の待ち時間まで見たい。huggingface.co/blog/kv-cache…
7
406
SmolLM3の公開の仕方いいな。重みだけでなく、学習データの配合や設定、途中のチェックポイントまで追える。完成品を使うだけじゃなく「どう育ったか」を調べられるのがありがたい。3Bで考える/考えず答えるモードを切り替えられるのも、待ち時間と回答を比べる実験に使えそう。ただ公式の主要対応6言語に日本語は含まれないので、日本語性能は別に測りたい。huggingface.co/HuggingFaceTB…
139