UsageΒΆ

memorious is controlled via a command-line tool, which can be used to monitor or invoke a crawler interactively. Most of the actual work, however, is handled by a daemon service running in the background. Communication between different components is handled via a central message queue.

See the status of all crawlers managed by memorious:

memorious list

Force an immediate run of a specific crawler:

memorious run my_crawler

Cancel a running crawler

memorious cancel my_crawler

Clear all the run status and cached information associated with a crawler:

memorious flush my_crawler

Clear only the cached information associated with a crawler:

memorious flush_tags my_crawler

Run a worker process and process tasks as they come. Blocks while waiting

memorious process