snowdeal logo

archives archives

ex machina

slashdot picked up the infrasearch story yesterday. there were a few good comments on problems with the concept:
"Imagine a network of a million hosts (a small subset of all webservers). Each of these is running a gnutella-based search-engine. On one of the servers is an interface to search the network for some information. The query is forwarded onto the overlay network, to say 10 nodes at each node, assuming some mechanism is in place to avoid loops. if the network is well interconnected, it will take about 5-6 hops to reach an edge of the cloud (probably a couple of times more to reach all the nodes). As soon as the first nodes get the search-request, they send back results, say limited to the first 5-10 most significant hits. Each reply has a number of tuples consisting of (URLs, a description and an indication of how close the match is and a timestamp and probably some more), maybe 1-2 kB per reply. Say 10% of servers have a match, then 100000 hosts will at some point send back results.

I calculate, roughly a 100 MB of results will be arriving at the searching node within a few minutes, if it can process the dataflow.

This is only one search, both the searching nodes and the servers will have to deal with a lot of searches if you look at other search-engines as a comparison. "
at least that's better than the bandwidth hogginess that jacob levy noticed while evaluating gnutella:
"...most importantly, it sucks bandwidth. I can easily see how network admins will want to outlaw this beast, if they can. For my evening of experimentation, I downloaded a total of 65 MBytes of files, while my total incoming consumed bandwidth was 365 MBytes, and my upstream bandwidth was 755 MBytes. Yes, really -- all that, in a measly five hours."
bookmark: ::digg it ::furl ::reddit ::yahoo ::
6/01/2000 07:56:00 AM 0 comments


Post a Comment

[ rhetoric ]

"it is hard to be brave," said piglet, sniffing slightly, "when you're only a Very Small Animal." rabbit, who had begun to write very busily, looked up and said: "it is because you are a very small animal that you will be Useful in the adventure before us."

the complete tales & poems of winnie the pooh

[ about ]

this site chronicles the continuing adventures of my son, odin, who was unexpectedly born on the fourth of july at 25 weeks gestation, weighing 1 pound 7 ounces.

he's quite a fighter and you can always send him a postcard to the most current address listed here if you're inspired by his adventures. see the postcard project/google maps mashup to see a map of the postcards.

if you're new, you can browse the archives to catch up. and don't forget to watch a few movies that i made while we were in the neonatal intensive care unit. or if you want the abridged version and you can find a copy, you can read about his adventures in the november 2005 issue of parents magazine.

[ search ]

[ outbound ]

daddytypes / blogging baby /

rebeldad / thingamababy / The Continuing Adventures of Super-Preemie / dooce /

[ schwag ]

look snazzy and support the site at the same time by buying some snowdeal schwag!

[ et cetera ]

valid xhtml 1.0?

This site designed by
Eric C. Snowdeal III .
© 2000-2005