Search Engine Accountability (was RE: Reality Check)

Fri Mar 16 19:54:59 UTC 2001

On Fri, Mar 16, 2001 at 10:36:31AM -0800, Karyn Ulriksen had this to say:
> 
> How about something like this (not suggesting as an DNS replacement!):
> 
> 	Search Engine requires a key certificate style license embeded in
> the html or website (whether it's internet centralized or just for the
> search engine).  A "rating" and "type" is associated with the license for
> the type of site it is.  As the search engine crawls the site, if the
> license is gone... it doesn't get listed.  If the type and rating doesn't
> match the information associated with the license data... it doesn't get
> listed.  If the license certificate doesn't match the IP(s) associated with
> the certificate... it doesn't get listed.  Has anybody tried something like
> this before?

good in theory, but in practice ... bleah. Let's just say the thought of
having to go through every page of just my own site to add HTML in a certain
spot makes me nauseous. I can't imagine doing this on sites with thousands of
pages.

Now, if you could mandate it in the robots.txt somehow ... but I've been
noticing enough underhanded tricks in robots.txt using wget (like zero-sec
redirects to pages that don't exist, or redirect to themselves) to not trust
that option either.

And say, didn't RSAC try this already? I seem to recall this being a
configurable option in MSIE under the security settings ...

-- 
Scott Francis           scott@   [work:] v i r t u a l i s . c o m
Systems Analyst     darkuncle@   [home:] d a r k u n c l e . n e t
PGP fingerprint 7ABF E2E9 CD54 A1A8 804D  179A 8802 0FBA CB33 CCA7             
               illum oportet crescere me autem minui