Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create dataset loader for Indonesian News Dataset #366

Open
SamuelCahyawijaya opened this issue Nov 28, 2023 · 0 comments
Open

Create dataset loader for Indonesian News Dataset #366

SamuelCahyawijaya opened this issue Nov 28, 2023 · 0 comments

Comments

@SamuelCahyawijaya
Copy link
Member

NusaCatalogue: https://indonlp.github.io/nusa-catalogue/card.html?id_news_dataset

Dataset id_news_dataset
Description The dataset compiles information from seven prominent Indonesian news platforms: Tempo, CNN Indonesia, CNBC Indonesia, Okezone, Suara, Kumparan, and JawaPos. Each source contributes a diverse range of articles, collectively forming a comprehensive repository of Indonesian news content. This dataset includes 2 special columns, 'embedding' which houses the text embeddings extracted using the OpenAI text-embedding-ada-002 model, and 'summary' which encapsulates the concise article summary generated via the ChatGPT API.
License CC-BY-NC-4.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
Nusantara Dataset Initiative
Status: No status
Milestone
No milestone
Development

No branches or pull requests
1 participant
@SamuelCahyawijaya