Hello Guest November 26, 2024, 21:35:54 *
Welcome, Guest. Please login or register.

Login with username, password and session length
 
Ship Simulator > English forum > Small talk > New Search Engine- "Cuil"
Pages: 1 [2]   Go Down
Print

Author Topic: New Search Engine- "Cuil"  (Read 3320 times)

bsm2003

  • Forum member
  • Posts: 180
Re: New Search Engine- "Cuil"
« Reply #25 on: March 23, 2009, 00:18:36 »
Here is what a crawl looks like from my http access log.
ipaddress - - [21/Mar/2009:13:59:48 -0500] "GET /robots.txt HTTP/1.0" 200 603 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
ipaddress - - [21/Mar/2009:13:59:49 -0500] "GET /htj.html HTTP/1.0" 200 7552 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
ipaddress - - [21/Mar/2009:14:26:20 -0500] "GET /robots.txt HTTP/1.1" 200 603 "-" "msnbot/1.1 (+http://search.msn.com/msnbot.htm)"
ipaddress - - [21/Mar/2009:14:30:36 -0500] "GET /robots.txt HTTP/1.1" 200 603 "-" "msnbot/1.1 (+http://search.msn.com/msnbot.htm)"

here is an entry from a web browser
ipaddress - - [22/Mar/2009:15:40:26 -0500] "GET /style.css HTTP/1.1" 200 3059 "http://farriscreeklodge.org/" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.6) Gecko/2009021619 Mandriva/1.9.0.6-0.1mdv2009.0 (2009.0) Firefox/3.0.6"
ipaddress - - [22/Mar/2009:15:40:26 -0500] "GET /images/valid-xhtml10-blue.png HTTP/1.1" 200 2026 "http://farriscreeklodge.org/" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.6) Gecko/2009021619 Mandriva/1.9.0.6-0.1mdv2009.0 (2009.0) Firefox/3.0.6"
Logged
Never get caught with your head in the head.

capn_cal

  • Forum member
  • Posts: 529
Re: New Search Engine- "Cuil"
« Reply #26 on: March 23, 2009, 00:21:43 »
that is very interesting!!!!!!!!! :o :o :o
Logged
i don't know what to say on here so i'm typing what i'm typing now because i can't think of what else to type

llamalord

  • Forum member
  • Posts: 2590
Re: New Search Engine- "Cuil"
« Reply #27 on: March 23, 2009, 15:32:14 »
Does Any one know if Google's Primary crawler is a spider or something else,  Because I like to track my website's crawlings.
Logged
"I reject your reality and substitute my own!"

(http://www.userbars.com)
www.llamalord

bsm2003

  • Forum member
  • Posts: 180
Re: New Search Engine- "Cuil"
« Reply #28 on: March 23, 2009, 16:17:36 »
http://www.google.com/support/webmasters/?hl=en
Logged
Never get caught with your head in the head.
Print
Pages: 1 [2]   Go Up
Ship Simulator > English forum > Small talk > New Search Engine- "Cuil"
 
 


SMF 2.0.14 | SMF © 2017, Simple Machines