On Fri, Mar 16, 2001 at 10:36:31AM -0800, Karyn Ulriksen had this to say:
How about something like this (not suggesting as an DNS replacement!):
Search Engine requires a key certificate style license embeded in the html or website (whether it's internet centralized or just for the search engine). A "rating" and "type" is associated with the license for the type of site it is. As the search engine crawls the site, if the license is gone... it doesn't get listed. If the type and rating doesn't match the information associated with the license data... it doesn't get listed. If the license certificate doesn't match the IP(s) associated with the certificate... it doesn't get listed. Has anybody tried something like this before?
good in theory, but in practice ... bleah. Let's just say the thought of having to go through every page of just my own site to add HTML in a certain spot makes me nauseous. I can't imagine doing this on sites with thousands of pages. Now, if you could mandate it in the robots.txt somehow ... but I've been noticing enough underhanded tricks in robots.txt using wget (like zero-sec redirects to pages that don't exist, or redirect to themselves) to not trust that option either. And say, didn't RSAC try this already? I seem to recall this being a configurable option in MSIE under the security settings ... -- Scott Francis scott@ [work:] v i r t u a l i s . c o m Systems Analyst darkuncle@ [home:] d a r k u n c l e . n e t PGP fingerprint 7ABF E2E9 CD54 A1A8 804D 179A 8802 0FBA CB33 CCA7 illum oportet crescere me autem minui