Sung Kim (@hunkims) profile picture

🏢 Co-Founder/CEO Upstage 🤖 Building AGI for Work

San Francisco, CA
Joined March 2009
Photo by Sung Kim (@hunkims)Photo by Sung Kim (@hunkims)Photo by Sung Kim (@hunkims)Photo by Sung Kim (@hunkims)Photo by Sung Kim (@hunkims)Photo by Sung Kim (@hunkims)Photo by Sung Kim (@hunkims)Photo by Sung Kim (@hunkims)Photo by Sung Kim (@hunkims)Photo by Sung Kim (@hunkims)
Nanobrowser 0.1.7 is here! 🎙️ @nanobrowser_ai now has voice! -Speak Your Mind: Now with Voice Command support powered by Gemini models. -More AI Brains: Expanded model support for @GroqInc & @cerebras APIs -New welcome set up guide, no more "API key not found" - bug fix
3
2
1
19
1,766
CB Insights released its 2024 AI 100 list, spotlighting early-stage non-public startups that show strong market traction, financial health, and growth potential. The most recent cohort shows a growing market for agents and infrastructure, with over 20 percent of companies either building or supporting agents. The list, derived from a pool of 17,000 startups across 14 countries, also notes emerging opportunities in healthcare, defense, and software development. Learn more in The Batch: hubs.la/Q03lm92c0
7
36
93
9,430
Sung Kim retweeted
Forget IDP. Agentic information extraction is here. Stop training models for every doc type. @upstageai Information Extract understands and extracts data from any complex document—invoices, resumes, contracts, medical forms—with zero training required. API access is coming soon. Be among the first to try it. 👉🏻 Join the waitlist: upstage.ai/products/informat… 🧪 Try the live demo: console.upstage.ai/playgroun… 📄 Step-by-step usage guide: upstage.ai/blog/en/demo-now-…
6
16
1,451
Replying to @simonw
When I was attending short course from @upstageai, they share some success stories. Maybe you might want to check their upstage.ai/customers page.
2
1
19
6,431
Explore "Pretraining LLMs," a short course developed with @upstageai. The course covers pretraining from scratch, continuing pretraining on custom data, and how using smaller open-source models can reduce costs. Take the course for free: hubs.la/Q02YFKyx0
94
3
387
24,939
Sung Kim retweeted
OAI Model Distillation suite! a bunch of evals and finetuning startups just died red wedding lives
2
2
4
92
22,669
Recently I visited South Korea, where I spoke at length about AI with President Yoon Suk Yeol. Based on what I saw there in government, business, and academia, the nation is well positioned to become a strong AI hub. When he asked me if I would advise South Korea as a member of the Global AI Strategy Steering Group of the country’s National AI Committee, I agreed on the spot. I was delighted to learn this week that Yann LeCun has also joined. I’ve been consistently impressed by the thoughtful approach the Korean government has taken toward AI, with an emphasis on investment and innovation and a realistic understanding of risks without being distracted by science-fiction scenarios of harm. I’ve advised many countries to build AI for the sectors where they’re strong. For example, I wrote previously that by investing in sectors like tourism and certain industrial areas, Thailand can do projects more efficiently than I can in Silicon Valley. South Korea’s tech ecosystem gives it a foundation to move fast even across numerous sectors. This emphasizes the long-term value for countries to become good at tech, because tech is now pervasive and affects all industries. Korea has a very strong local software ecosystem. For example, the dominant search engine is not Google or Bing, but Naver (a Korean company). The dominant messaging system is not WhatsApp or WeChat, but KakaoTalk. With local tech giants Naver and Kakao offering email, mobile payment, cloud computing, ride sharing, and other services, the country has many sophisticated tech businesses. Additionally, SK hynix and Samsung are advanced semiconductor manufacturers. It also has a thriving entrepreneurship ecosystem, including Upstage, a language modeling startup, which taught a course with us on “Pretraining LLMs.” Finally, the Korean institutions Seoul National University, which I visited last year, and KAIST have global reputations. Korea has a highly educated population, highly skilled software engineers, and a thriving set of software products. This gives it a fantastic foundation to embrace the next generation of AI. After meeting with businesses in retail, construction, insurance, cosmetics, telecoms, and other industries, I was delighted by the wide variety of opportunities many companies are pursuing across different industry sectors. Lastly, Korea is known globally for its K-pop. Meeting Bang Si-Hyuk, the chairman of HYBE, which manages the superstar singing group BTS, and learning how the company operates was a real treat! That’s why I’ve traveled to South Korea four times since last year. My venture studio AI Fund, which collaborates with many Korean companies, has benefited tremendously from the advice of many South Koreans, including Taizo Son, Changmook Kang, Hyungjun Kim, Sung Kim, JP Lee, Ian Park, and Alice Oh. I look forward to doing more in, and with, South Korea! [Original text (with links): deeplearning.ai/the-batch/is… ]
56
142
31
1,240
139,146
Sung Kim retweeted
143
179
29
3,843
210,979
Watch my @stanford CS 25 lecture next week, "aligning open language models," it'll be good, v excited
16
86
8
588
141,163
Did you know that Command R+ is on the Open LLM Leaderboard? It's notably got very good scores on MMLU and GSM8K! 💪 Congrats @CohereForAI for the cool model! ❤️
2
6
21
7,360
Sung Kim retweeted
@GroqIncis a sponsor of the LLM x Law Hackathon at @Stanford on April 7. If you're planning on building on Groq at the event, please reach out. We're happy to help. Hope to see many in our developer community there! hubs.la/Q02r3VtX0
2
3
1
23
3,764
Was great to meet you all too!
#GTC2024 Super cool to have @teknium at the #solarllm booth, discussing solar llm and @teknium's vision for AI. 😊
7
4
104
16,084
Sung Kim retweeted
Yi models TECH REPORT just went live! Sharing our humble explorations launching, improving, innovating our base, chat, and vision-language models. Kudos to @01AI_Yi team behind the scenes. Love to hear the feedback from the community! arxiv.org/abs/2403.04652
2
27
6
113
26,601
the commercial LLM field is getting crowded. this time from Korea's @upstageai using their own Solar LM. console.upstage.ai/playgroun…
13
35
5,681
Introducing two brand new, general purpose AI models: 10.7B Parameters, Tess-10.7B-v1.5b: huggingface.co/migtissera/Te… Apache-2.0, Trained with the Tess-v1.5b dataset, SOLAR-10.7B base, 4K Context Window 34B Parameters, Tess-34B-v1.5b: huggingface.co/migtissera/Te… Yi-34B Licence, Trained with the Tess-v1.5b dataset, Yi-34B-200K base, 200K Context Window Both are super smart models, I use them locally in my work. Official evals to come on the Open LLM Leaderboard. Enjoy! ✊🏾👊🏾🚀🚀
7
34
3
171
38,943
Hermes 2 on SOLAR got sparsified :)
We've been taking popular fine-tuned LLMs from @huggingface and applying #SparseGPT to compress them 50% with sparsity and quantization to save on memory and compute during inference. Here are two examples: Llama 2 7b chat: huggingface.co/neuralmagic/L… Hermes 2 - Solar 10.7B: huggingface.co/neuralmagic/N… Do you find these optimized models useful? What are other models you'd like us to optimize? Let us know!
2
4
55
8,712
RT @winglian: Are you looking to contribute more to open source AI efforts in 2024? Axolotl is offering up its first official bounties. Rig…
3
2
New SOTA Model - Nous-Hermes-2-SOLAR-10.7B based on the SOLAR 10.7B base model. 📌 Benchmarks results close to their Yi 34B model at 1/3rd the model size 📌 Trained on 1,000,000 entries of primarily GPT-4 generated data, as well as other high quality data from open datasets
3
3
1
22
2,309