#WWDC24 #Apple hasn't used the 'AI' term yet. Just ML and machine learning.
Get ready for the #AppleIntelligence (their AI) reveal.
4
340
Johnny Crupi retweeted
Apparently, the Apple - OpenAI deal just closed! One day before the voice assistant announcement :)
Guess Apple decided that it couldn't make it on its own 🤷
The new Siri will be from OpenAI
Johnny Crupi retweeted
🤝😍
First @NVIDIA DGX H200 in the world, hand-delivered to OpenAI and dedicated by Jensen "to advance AI, computing, and humanity":
Hello,
If you love reading and also appreciate listening to your PDFs, books, and various documents, you might want to consider the Speechify app.
Use this link to receive a $60 discount on their premium plan : share.speechify.com/mC8nup4
56
Johnny Crupi retweeted
Exciting News! We're thrilled to announce a new partnership with @nmibleco to support better #clinicaltrials. nmible will incorporate #Ryght's advanced #GenAI into its platform. Read the full press release here: hubs.li/Q02vt9X60
#CRO #Biotech #Pharma
Johnny Crupi retweeted
Hi!
Wanted to clarify something regarding the Open LLM Leaderboard team.
The maintainers of the leaderboard (since May) have been one engineer ( @nathanhabib1011 ) and one researcher (me) full time on leaderboards/evals.
So, what do we do? 🧵
Johnny Crupi retweeted
"Wesley and I believe there is no greater blessing in life than our children," the Sen. added. This comes after her home state of AL was plunged into controversy after the state Supreme Court ruled embryos are children.
#TheBachelor Conspiracy theory. Producers told #maria to f-it up because she will be the next #Bachelorette
5
594
#TheBachelor WTF Maria! You had this. You could have gotten the rose if you had simply told Joey before he left. Why is everyone so frigin fearful?
Johnny Crupi retweeted
ChatMusician
Understanding and Generating Music Intrinsically with LLM
While Large Language Models (LLMs) demonstrate impressive capabilities in text generation, we find that their ability has yet to be generalized to music, humanity's creative language. We introduce ChatMusician, an open-source LLM that integrates intrinsic musical abilities. It is based on continual pre-training and finetuning LLaMA2 on a text-compatible music representation, ABC notation, and the music is treated as a second language. ChatMusician can understand and generate music with a pure text tokenizer without any external multi-modal neural structures or tokenizers. Interestingly, endowing musical abilities does not harm language abilities, even achieving a slightly higher MMLU score. Our model is capable of composing well-structured, full-length music, conditioned on texts, chords, melodies, motifs, musical forms, etc, surpassing GPT-4 baseline. On our meticulously curated college-level music understanding benchmark, MusicTheoryBench, ChatMusician surpasses LLaMA2 and GPT-3.5 on zero-shot setting by a noticeable margin. Our work reveals that LLMs can be an excellent compressor for music, but there remains significant territory to be conquered. We release our 4B token music-language corpora MusicPile, the collected MusicTheoryBench, code, model and demo in GitHub.
Check out my latest article:
Orchestration is a Best Practice for Enterprise-Grade Generative AI Platforms and Solutions linkedin.com/pulse/orchestra… via @LinkedIn
51
Johnny Crupi retweeted
Fun LLM challenge that I'm thinking about: take my 2h13m tokenizer video and translate the video into the format of a book chapter (or a blog post) on tokenization. Something like:
1. Whisper the video
2. Chop up into segments of aligned images and text
3. Prompt engineer an LLM to translate piece by piece
4. Export as a page, with links citing parts of original video
More generally, a workflow like this could be applied to any input video and auto-generate "companion guides" for various tutorials in a more readable, skimmable, searchable format. Feels tractable but non-trivial.
Great point, Jim. The Sora physics engine will be a game-changer in the worlds of sports and robotics.
If you think OpenAI Sora is a creative toy like DALLE, ... think again. Sora is a data-driven physics engine. It is a simulation of many worlds, real or fantastical. The simulator learns intricate rendering, "intuitive" physics, long-horizon reasoning, and semantic grounding, all by some denoising and gradient maths.
I won't be surprised if Sora is trained on lots of synthetic data using Unreal Engine 5. It has to be!
Let's breakdown the following video. Prompt: "Photorealistic closeup video of two pirate ships battling each other as they sail inside a cup of coffee."
- The simulator instantiates two exquisite 3D assets: pirate ships with different decorations. Sora has to solve text-to-3D implicitly in its latent space.
- The 3D objects are consistently animated as they sail and avoid each other's paths.
- Fluid dynamics of the coffee, even the foams that form around the ships. Fluid simulation is an entire sub-field of computer graphics, which traditionally requires very complex algorithms and equations.
- Photorealism, almost like rendering with raytracing.
- The simulator takes into account the small size of the cup compared to oceans, and applies tilt-shift photography to give a "minuscule" vibe.
- The semantics of the scene does not exist in the real world, but the engine still implements the correct physical rules that we expect.
Next up: add more modalities and conditioning, then we have a full data-driven UE that will replace all the hand-engineered graphics pipelines.
openai.com/sora
354
🚨 BREAKING: Nvidia just released Chat with RTX, an AI chatbot that runs locally on your PC.
It can summarize or search documents across your PC's files and even YouTube videos and playlists.
The chatbot runs locally, meaning results are fast, you can use it without the internet, and the user's data stays private.
New day, new chatbot. Let's go.
1
96