Sequoia Capital reposted this
On the latest episode of Training Data Bill Coughran and I spoke with Microsoft CTO Kevin Scott who has led their AI strategy for the past seven years. Kevin describes himself as a “short-term pessimist, long-term optimist” and he sees the scaling trend as durable for the industry and critical for the establishment of Microsoft’s AI platform. Kevin believes there will be a shift across the compute ecosystem from training to inference as the frontier models continue to improve, serving wider and more reliable use cases. He also discusses the coming business models for training data, and even what ad units might look like for autonomous agents.
Insightful discussion. Thanks for hosting. Interested in seeing how scale not just in compute but across layering of different novel research across implementations can be combined (eg, Textbooks are all you need 1-bit quantization federated learning)
Sequoia Capital
2wListen to the full ep on these platforms or wherever you listen to podcasts: YouTube: https://seq.vc/tde4yt Apple: https://seq.vc/0uq Amazon: https://seq.vc/bm2 Spotify: https://seq.vc/z48