watchme

WatchMe has a set of environment variables that can alter default base organization and setup, along with variables that can be set across watcher tasks to change how the outputs are saved there.

Organization

WatchMe will default to saving your configuration in a subfolder of your home, $HOME/.watchme, and with the configurations for your watchers (the groups of pages to watch, and the frequencies). For example, if you have a watcher called jobs, one called watcher (this is the default) and one called pizzas, your .watchme folder would looklike this:

.watchme
     jobs/
     pizzas/
     watcher/

What goes in each folder? It’s actually a git repository, and this helps to track changes for pages. We do this instead of saving duplicates of the pages, and if you are doing research, you have a GitHub repository that updates with each.

Watcher Folder

Thus, if you want to change the default folder base ($HOME/.watchme) you can do the following:

export WATCHME_BASE_DIR=$HOME/.creepywatcher

If you decide to make this change, it’s important to write this into your .bashrc or equivalent, otherwise the default will be used.

Default Watcher

If you want to set a default watcher (different than “watcher”) to interact with, you can do that too:

export WATCHME_WATCHER=pizzas

And remember that you don’t have to do this - you can specify the watcher name on the command line to setup and create commands.

Variables

By default, when you run a task for a watcher, it will save the result in the watcher folder, in a folder named for the task. For example, if we run the task “task-harvard-hpc” for a watcher called “watcher,” the result will (without any special change) save like this:

.watchme/
    watcher/
       watchme.cfg
       task-harvard-hpc/
          result.txt        

Of course this isn’t ideal for all use cases! If you want a custom file name for the task, just use the variable file_name when you create the watcher. Let’s say we want to use the default urls watcher to post to some endpoint, and save the result as json with a custom file name:

$ watchme add-task watcher task-api-post url@https://singularityhub.github.io/registry/vanessa/fortune/manifests/latest/ [email protected] save_as@json func@post_task

“save_as” is custom for the urls watcher (so json is returned) but for any watcher that is saving some file, you can customize the file_name variable:

Name Required Default Example Notes
file_name No unset [email protected] the filename to save, only for download_task

Where should I go next?

Read about Concepts or go back to the Quick Start