Today, we’re announcing Scale has closed $1B of financing at a $13.8B valuation, led by existing investor Accel. For 8 years, Scale has been the leading AI data foundry helping fuel the most exciting advancements in AI, including autonomous vehicles, defense applications, and generative AI. With today’s funding, we’re moving into the next phase of our journey: accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI). “Our vision is one of data abundance, where we have the means of production to continue scaling frontier LLMs many more orders of magnitude. We should not be data-constrained in getting to GPT-10.” - Alexandr Wang, CEO and founder of Scale AI. This new funding also enables Scale to build upon our prior model evaluation work with enterprise customers, the U.S. Department of Defense, and collaboration with the White House to deepen our capabilities and offerings for both public and private evaluations. There’s a lot left to do. If this challenge excites you, join us: https://scale.com/careers Read the full announcement: https://lnkd.in/gVBhaPZ5
Scale AI
Software Development
San Francisco, California 170,080 followers
The Data Engine that powers the most advanced AI models.
About us
At Scale, our mission is to accelerate the development of AI applications. We believe that to make the best models, you need the best data. The Scale Generative AI Platform leverages your enterprise data to customize powerful base generative models to safely unlock the value of AI. The Scale Data Engine consists of all the tools and features you need to collect, curate and annotate high-quality data, in addition to robust tools to evaluate and optimize your models. Scale powers the most advanced LLMs and generative models in the world through world-class RLHF, data generation, model evaluation, safety, and alignment. Scale is trusted by leading technology companies like Microsoft and Meta, enterprises like Fox and Accenture, Generative AI companies like Open AI and Cohere, U.S. Government Agencies like the U.S. Army and the U.S. Airforce, and Startups like Brex and OpenSea.
- Website
-
https://scale.com
External link for Scale AI
- Industry
- Software Development
- Company size
- 501-1,000 employees
- Headquarters
- San Francisco, California
- Type
- Privately Held
- Founded
- 2016
- Specialties
- Computer Vision, Data Annotation, Sensor Fusion, Machine Learning, Autonomous Driving, APIs, Ground Truth Data, Training Data, Deep Learning, Robotics, Drones, NLP, and Document Processing
Locations
-
Primary
303 2nd St
South Tower, 5th FL
San Francisco, California 94107, US
Employees at Scale AI
Updates
-
How do you know if a model is truly solving problems or if it’s just repeating answers from its training? Scale Machine Learning Engineer, Hugh Zhang and his team tackled this question earlier in the year and discovered current benchmarks may be inadvertently compromising model evaluations due to data contamination. This is an issue because improving a model’s reasoning is key to advancing large language models overall. It’s critical the benchmarks we use accurately reflect LLMs' true reasoning capabilities. As a result, Hugh’s team developed GSM1k, a mathematical evaluation dataset comparable to GSM8k but built exclusively by humans, ensuring the models have never seen the problems they’re tested on. The researchers then used GSM1k to evaluate leading open-source and closed-source LLMs and compared it to the existing mathematical benchmark (GSM8k) performance results to discover any overfitting. Join Hugh on Wednesday September 4 at 10AM PT for a tech talk to learn what the team found. He will also cover the latest trends in LLM performance evaluation and how you can stay ahead of the curve in the rapidly evolving field of AI benchmarking and evaluation. You don't want to miss this one. 👉 Register here: https://lnkd.in/gRFgMSVT
-
-
“The most valuable thing for most businesses going forward is the proprietary data that they have. You can point that model at your data and be able to extract information and value from that that no one else can.” Scale’s Managing Director and former CTO of the United States, Michael Kratsios went on the You Might be Right podcast from the Howard H. Baker Jr. School of Public Policy and Public Affairs at the University of Tennessee, Knoxville. Along with hosts, former Tennessee Governors Philip Bredesen and Bill Haslam, he discussed: • Has AI been as disruptive as we imagined a year ago? • Whether the United States is in a position to lead in AI • How businesses can use AI to their competitive advantage Listen → https://lnkd.in/dSBcT94m
-
-
Scale is on Forbes’ 2024 Cloud 100 list! The list recognizes the world’s top 100 cloud computing companies: https://lnkd.in/etRHGNfs Join us on our mission to accelerate the development of AI applications 👉 https://scale.com/careers
-
-
📣 Scale is excited to introduce the latest addition to the SEAL Leaderboards: Adversarial Robustness! Designed to uncover potential risks that may not be apparent in standard testing, this leaderboard evaluates top models against 1,000 adversarial prompts, covering critical areas like illegal activities, harm, and hate speech. Here's what sets the leaderboard apart: ✅ It measures harm that is universally recognized as problematic, rather than issues that might be deemed harmful by some but not others. ✅ Its evaluation dataset was created by red teamers selected for their creativity, different approaches to model prompting, and unique opinions. ✅ We implemented a multi-tiered review system to ensure thorough assessment and accurate categorization of potentially harmful content. ✅ We openly publish our harm categories and encourage contributions from the community to refine and add details to these definitions. By releasing the Adversarial Robustness leaderboard, we remain committed to advancing AI safety standards industry-wide, empowering the AI community to build safer, more trustworthy models. Explore our methodology and results: https://lnkd.in/g7hW476N
-
-
Bloomberg named Scale as one of its 10 AI Startups to Watch in 2024 in its second-annual leaderboard of AI trailblazers. The list recognizes the top AI startups leading the industry. Join us on our mission to accelerate the development of AI applications: https://lnkd.in/gwgNK9pY Read more: https://lnkd.in/gNbG72PN
These Are the 10 AI Startups to Watch in 2024
bloomberg.com
-
This morning Scale Field CTO Vijay Karunamurthy testified in front of the U.S. House Financial Services Committee on AI applications for the financial services and housing sectors. During the hearing, he discussed how AI is used in these sectors, recommendations for the safe deployment of AI, and industry trends in adopting AI. His key points included: 1️⃣ Foundational AI elements, like AI-ready data strategies, are critical to companies getting high quality outputs from their AI systems. 2️⃣ Fine-tuned, proprietary data is a game changer that enables enterprises to derive value from generative AI for their particular applications. 3️⃣ Deploying AI is top of mind and must be done safely and responsibly. Read his prepared remarks here: https://lnkd.in/dW6Sqsig
-
-
Scale is excited to be named a Llama 3.1 Launch Partner! Meta and Scale partnered to help businesses customize, evaluate, and deploy Llama 3.1 405B for enterprise use cases to drive real business value. Scale Data Engine provided data for supervised fine-tuning and RLHF to help make Llama 3.1 the leading open-source LLM. We also used Scale GenAI Platform to evaluate Llama 3.1 for performance and reliability on financial services, legal, and edTech use cases. We found that Llama 3.1 rivals leading models on these enterprise tasks. It performs particularly well in the categories of completeness, accuracy, and depth. Llama 3.1 is also good at summarizing content from provided context, which is especially useful for enterprise workflows that rely on retrieval augmented generation (RAG). 👉 Read about the full results of our evaluation as well as our methodology with AI at Meta in the latest blog from Scale: https://lnkd.in/gYKMxxqy
-
-
Scale is in Vienna for [ICML] Int'l Conference on Machine Learning! Along with the Center for AI Safety, Scale will be presenting the poster “The WMDP Benchmark: Measuring and Reducing Malicious Use with Unlearning” on Thursday July 25 at 1:30pm local time: https://lnkd.in/gCGukMMe If you are a Director Level or Senior Researcher attending ICML, join us for an exclusive reception on Tuesday July 23 at 6pm local time. We’re bringing together a select group of individuals from various industries to meet each other and exchange ideas on the latest advancements in Generative AI and Machine Learning. If you're interested in attending please email [email protected]. Looking forward to seeing you there!
-
-
Scale AI reposted this
Exploring Scale AI’s data-centric approach and more ⚡ #theCUBE reports on-site at this week’s #AWSSummit NYC In this exclusive, we’re joined by Vijay Karunamurthy, the Field CTO of Scale AI, to discuss the company’s data-centric approaches, collaboration with OpenAI, and three types of customers. “We took the data-centric approach to computer vision and partnered with some cutting-edge research labs like OpenAI. Today, we have three big buckets of customers. One is the OpenAIs of the world, the research labs that are building the next cutting-edge models. We're helping make those models more trustworthy across a range of new capabilities, like writing code or doing multimodal data, explained Karunamurthy. “The second is enterprises or private companies that are adopting gen AI. They have really unique needs because they have private data that needs to be kept in a VPC in Stockholm, and it can't leave the bounds there. If it does, there has to be really strict role-based access control around how that data is used, even if you have derived data from that data. So, we've built this gen AI platform around that,” he added. “The third big bucket of customers is the public sector. We have a range of agent-driven workflows; it's called Agent Donovan. It helps people with really mission-critical objectives accomplish their work by talking to that commander in the way that they expect to be talked to,” Karunamurthy concluded. 📰 More: https://lnkd.in/gYmdfKi3 #EnterpriseTechNews #GenAI #theCUBE