MinIO

MinIO just reached an amazing milestone, one that no storage company has even come close to - one billion Docker pulls. Thank you to our customers, partners and our community for helping us get here. Read Garima Kapoor's thoughts here: https://hubs.li/Q01mQc9X0 #opensource

It's newsletter time—featuring, for the first time, AIStor. #AIStor is the most powerful version of MinIO to date. It represents our singular focus on building the world’s best #objectstore for AI/ML workloads. You all have been loving getting to know what's new in the feature suite. We have lots of other good stuff in here too. Check it out.

Amazing interview with SiliconANGLE & theCUBE at #KubeCon North America in Salt Lake City. Savannah Peterson, Rob Strechay and Sanjeev Mohan join MinIO's co-founder & co-CEO Anand Babu Periasamy to discuss the exciting release of MinIO's new #AIStor and the challenges of #AI data infrastructure. Give it a watch. https://lnkd.in/g4YYA-Ya

Killer piece by the esteemed Chris Mellor at Blocks and Files covering our release of #AIStor, MinIO’s most powerful #objectstore to date purpose-built for AI/ML workloads. Chris has a great take on promptObject, #S3 over RDMA, AIHub and the redesigned Global Console—the core pillars of AIStor. Give it a read here: https://lnkd.in/gKHRV2Fg

As one of the smartest storage analysts in the business, Philippe NICOLAS' takes are always great reading. He covers the #AIStor release in this excellent installment of the StorageNewsletter. He immediately grasped the power of the promptAPI. Well worth your time. https://lnkd.in/d6beCp9R

With more features, more user constituents and more data and instances, we needed to overhaul our GUI. Introducing the new and improved #AIStor Global Console—a completely redesigned user interface for MinIO that provides extensive capabilities around cluster management, observability, IAM, ILM, load balancing, firewall, security, caching and orchestration. All through a single pane of glass. Bonus feature! The updated console features a new MinIO #Kubernetes operator that further simplifies the management of large-scale #datainfrastructure, where there are hundreds of servers and tens of thousands of drives. Go deep here: https://lnkd.in/g_SEKA6Z

#Security remains the number one challenge for enterprises building AI #datainfrastructure. One approach to solve this is the new AIHub. AIHub is a private repository for storing AI models and datasets directly on AIStor. Because AIHub runs inside the enterprise’s secure network zone, it greatly reduces the risk of developers leaking sensitive data sets or models. API compatible with Hugging Face, AIHub allows enterprises to create their own data and model repositories on the private cloud or in air-gapped environments powered by #AIStor… all without changing a single line of code. https://blog.min.io/aihub/

AIStor’s promptObject API represents a powerful extension of the #S3 API that enables applications, developers and administrators to “talk” to unstructured objects in the same way one would engage an LLM—without having any expertise around #LLMs, RAG, Vector Databases and other AI constructs. The applications are almost infinite when considering this extension. The object storage world now moves from a PUT and GET paradigm to a PUT and PROMPT paradigm. Applications can use promptObject through function calling with additional logic. This can be combined with chained functions with multiple objects addressed at the same time. This will dramatically simplify AI application development while simultaneously making it more powerful. That is one of the core constructs of the new #AIStor. https://lnkd.in/ge3tY-Gr 

A critical new feature of AIStor is our added support for S3 over RDMA. With the proliferation of 400GbE and even 800GbE NICs, conventional protocols such as TCP/IP struggle to maintain efficiency, creating bottlenecks due to high CPU overhead and latency.  By leveraging RDMA’s low-latency, high-throughput capabilities, MinIO enables customers to take full advantage of their hyperfast Ethernet investments. RDMA reduces CPU overhead by bypassing the TCP/IP stack, allowing direct memory-to-memory #data movement and zero-copy transfers. MinIO has never been the bottleneck. With #S3 over RDMA, we continue that proud tradition. #aistor https://lnkd.in/gkttRb-T

Introducing AIStor— the most powerful version of MinIO to date. It represents our singular focus on building the world’s best object store for AI/ML workloads. It also reflects real-world learning from EiB deployments. At this scale, problems emerge that most storage vendors will never see, because they can’t operate at that scale. The AIStor release extends the industry’s most feature-complete #objectstore with new capabilities including S3 over RDMA, promptObject, AIHub and a completely updated Global Console. It is time to rethink what is possible. It is time for AIStor. #aistor #ai https://lnkd.in/gS2DYFvH