- You submit your URL (including text http://). URLs with query strings (http://sample.com/?search=keyword will become http://sample.com) will not be accepted, but directory and page structures can be submitted (ex: http://www.yoursite.com/yourdir/yourpage.htm).
- Our spidering crawler bot will visit your submitted page immediately.
- Our server will look for links on your page (only the submitted page) and break them down to the top level domain name (if you submit say http://www.geocities.com/mydir/mypage.htm, it will get broken down to http://www.geocities.com).
- Our bot will display the accepted cached URLS (will be spidered for meta tags later) immediately after URLs have been fetched from your submitted link/page.
- We will cache the gathered links to a daily text file instantly.
- We will also cache your submitted link to the daily text file.
- Once a week (or so) we merge the text files and feed the large file to our meta tag crawling robot.
- Our spider bot retrieves your meta tags (once a week or so). For proper meta tag usage (you may use characters abcdefghijklmnopqrstuvwxyz 1234567890-/,. in either upper or lower cases), use the following format:
<head> <title>The Title Of Your WebSite</title> <meta NAME="description" CONTENT="Tell the surfers what your site is about and what services you offer."> <meta NAME="keywords" CONTENT="keys, similar words, keywords, key words related, search words"> </head> - We check to make sure your meta tags contain normal characters (do not use special characters, stick to normal letters and numbers). If a field is invalid, it gets replaces with NA (not applicable), so make sure you double check your meta tags before submission. If a title is blank or has improper characters, it will not be accepted (only for title field dos this apply).
- Our "spider bot" will automatically submit the data (if all good, but remember that we only run the merged files weekly or sometimes longer) to our searchable database.
|