A HTML page may contain links/references to other pages/files/images etc. in various attributes of several elements (a.href, img.src, …).

link-elements.yaml provides a list of HTML elements and attributes which contain URLs (see below) and may be useful for other languages too.

Add this line to your application's Gemfile:

gem 'findlinks'

And then execute:

$ bundle

Or install it yourself as:

$ gem install findlinks

Findlinks.urls_from_file('/path/to/html/file.html')

After checking out the repo, run bin/setup (or use bundler) to install dependencies. You can also run bin/console for an interactive prompt that will allow you to experiment.

To install this gem onto your local machine, run bundle exec rake install. To release a new version, update the version number in version.rb, and then run bundle exec rake release, which will create a git tag for the version, push git commits and tags, and push the .gem file to rubygems.org.

Bug reports and pull requests are welcome on GitHub at https://github.com/lapizistik/findlinks.

To assemble the list of elements and attributes link-elements.yaml I used

• HTML5 Attributes list from the w3 specs
• HTML4 Attributes list from the w3 specs

I also had a look into

• the wget sources
• the spidr gem sources