Replies: 2 comments 1 reply
-
|
There's a misp module for that! https://github.com/MISP/misp-modules/blob/main/misp_modules/modules/expansion/sourcecache.py - it will create a local cache of the website. |
Beta Was this translation helpful? Give feedback.
-
|
Hi @iglocska, It is useful yet does not solve the link rot in the references -not IOCs. Many blogs, articles are gone because the acquisitions and mergers unfortunately required removal or restructuring. It may not be a major proportion of them but the link rot is there and in time it will be an issue -even though some information would not be worth retaining in the long term. This 9-year-old article explains better than I can do in a non-CTI context: https://journalistsresource.org/media/website-linking-best-practices-media-online-publishers/ If I write a new MISP plugin that checks and creates a snapshot/memento in Wayback Machine if no shapshot exists, the issue becomes the usage of it. I need to create only for references not URLs in IOCs. What do I need to make it useful? |
Beta Was this translation helpful? Give feedback.
-
|
I mean you can add the URL of an article / whatever and use the above to archive it, not necessarily an IoC. (we often add references as links in MISP, which we can then store this way) - with that said, I can't recall what it's using under the hood, so I can see it not being nearly as comprehensive as the wayback machine, so a new module would be nice. |
Beta Was this translation helpful? Give feedback.
-
Link rot is a problem in science due to loss of references, but also a problem with CTI. Many of the references are gone after some time. That's why, I wonder, if it is possible to evaluate all links in MISP, try to resolve them and add to internetarchive.org? It would be better if any link added first added to internet archive, and then replaced by the archive link by default. That'd help us especially after mergers and acquisitions. What do you think?
Beta Was this translation helpful? Give feedback.
All reactions