“Compute is going to be the currency of the future” - Sam Altman io.net is building IO into the currency of compute.
Transcript
I think compute is going to be the currency of the future. I think it will be maybe the most precious commodity in the world. How are you going to scale such large model and replicate it in a lot of machines and devices, GPUs. So this model could serve this demand. It's really complex and ASH is considered one of the most complex computer science fields, which is distributed computing. So if you want to provide GPUs at scale, you can't just give people. Instance of 32 GPU or 64 GPU. That's for indie developers, that's for people who are playing around just learning. If you really want to serve enterprises, enterprises, you need to provide clusters of 507 hundred GPU. That's like I got three guys, I know three guys playing around, they have 100, 000 years. Or on an app that generates 3 more 3D model for video game designers, 900 GPU paying $6000 a day. Just playing around any model that you any, I think that whatever you see whether it's an app or it's a feature or whatever, it has to use GPU period. It's like there's no way around it. And you know these GPUs as you know we're used to use them for crypto mining, gaming etcetera, etcetera and they're just so good with you know kind of like Transformers which are basically the architecture behind some of the models that we're playing with right now and large language models, yes, they are using a lot of. Use and they need sometimes multiple GPUs for one model to run, just to run, because it's a big model and they use like thousands of GPUs when you train them. Actually by end of 2024, Facebook would have 800,000 H 100 P so there would be like the largest in the world who happens. Yeah, so. We need a lot of reviews, but not just, you know, he's a GPU. Here's a GPU. We need to cluster these GPU together into a network that can be, that people can scale at something that could serve something like charity or something that could serve something like Instacart. So Instacart, they're using distributed machine learning and I'm going to just tell you some examples, they have tens, 10s of thousands of models. So we are seeing a future where people are building these SASS apps. It's already happening right now, 3000 of them right now live started using Open Eye API and they built an app on top of that. So, so basically the the cost of any such stars, 40% is going to AI compute even though they are not renting really AI compute or renting GPUs. But they're using some product that's using the AI at the end, so this is really important for us to focus on.To view or add a comment, sign in
Co-Founder @ Pragmatike | 👉 Remote Work
3moHey - little typing mistake "compute" 🤟 - but.. I agree though - it is :)