Skip to content

This repository contains code to crawl websites and visualise it as a graph

License

Notifications You must be signed in to change notification settings

shhs29/website-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

website-crawler

crawler.py contains code to crawl ontario tech websites and visualise it as a graph.

To run crawler, execute command:

python crawler.py

statistics.py contains code to obtain network statistics of a network.

To run network statistics, execute command:

python statistics.py

graph_condensation.py contains multiple approaches to summarise a network through networkx apis such as condensation and dedensify.

To run summarisation, execute command:

python graph_condensation.py

About

This repository contains code to crawl websites and visualise it as a graph

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages