| mnoGoSearch 3.3.7 reference manual: Full-featured search engine software | ||
|---|---|---|
| Prev | Chapter 4. mnoGoSearch HTML parser | Next |
The indexer's HTML parser currently understands the following special META tags. Note that "HTTP-EQUIV" may be used instead of "NAME" in all entries.
<META NAME="Content-Type" Content="text/html; charset=xxxx"> This tag is used to detect the document's character set if it is not specified in Content-type HTTP header.
<META NAME="REFRESH" Content="5; URL=http://www.somewhere.com"> The URL value will be inserted into the database.
<META NAME="Robots" Content="xxx"> with content being one of the following values: ALL, NONE, INDEX, NOINDEX, FOLLOW, NOFOLLOW.