Spider

When I go to who is online I see Guest & Spider. Well I know what a guest is------But what is a SPIDER ?----can't figure it out :huh:

 

It is either:

1. An eight legged arachnid which is sometimes venomous and sometimes not or:

2. A bot (automated program) that crawls through the forum reading posts and reporting back usually to a Search Engine. Having spiders "crawling" through the forums is a good thing.

 

Still a little lost---

-----If ya have time----TELL ME MORE

I have googeled it---but still do not completely understad----though when I saw "yahoo spider"----that helped----just a wee bit more info---think I will undersand----or give me a better link-----thanks---gunnner

 

Ok this should help!
[ame="http://en.wikipedia.org/wiki/Web_crawler"]Web crawler - Wikipedia, the free encyclopedia[/ame]

 

what they are doing is reading the site, making notes of what is here and sending it back to Google,Yahoo,Bing, and Ask and other Search engines.

A bit like someone opening there refegirator and writing down everything that they find there,

then when someone types something into say Google, they have a big list of whats on the internet and can give you Millions of internet Pages that contain what your looking for.

They are the reason that Search engines know where everything is on the internet.

 

Thanks Barry---Good info there even though---

I read most all of it, undersand a little better now. But did not got to any of the referances----40----what a complex doo-dad , but Very interesting. Thanks again------------gunnner

 

I suppose the simplest way to look at them is as Internet Librarians, when you want a book in the library you ask a Librarian, who looks up where that book is.

when you ask a Search engine eg. Google to find an Internet page it asks a Bot/Spider/Crawler that knows where that page is.

 

Hey Stabuck & Match---------Both of your explanations realy helped me understand what I read in Wcrawler.

Realy good & simple Replys------------Thanks ---- gunnner

 

Another more indepth, explaination of spiders and what they do, is they start off with a list of a few website URLS, they visit the first one, send the content of that page to be saved/indexed in the Search Engine's servers, then they find every link on that page and add them to it's list.
It then visits the next link on it's list, sends the content of that page to the servers, and grabs all the links on that page and adds them to the list.

It continues to do this over and over again.

The rating fo a website, aka, it's placement in the search results, is due to the number of INCOMING links, to that page.

For example, say yous earched for 'Kanye West' and my website had... 20 links on it, form other user home-created websites linked to that key word. Sounds like it would be highly rated due to it's large number of links? Well, say that BBC has just done a stroy on Kanye West, and had linked to someone elses website, but that was the only link they had to do with that key word.

Their page would appear higher in the results than mine. That is because the BBC website has a much higher reputation than any of the sites linking to mine, and therefore, 1 link from the BBC is worth many many minor links from small almosy unknown websites.

You can also set how often the "sider" or "crawler" visits your website to gather new content, or it does it itself. If it visits your website once a day, but one day finds that nothing has changed or been updated on your site, it will decide "ok, I'll come back in a week and see if anything has changed" if it hasnt, then it lengthens the time for its return. If there are changes, then it will shorten that time. Some sites, such as the large BBC news website, gets trawled for updates around every 30 seconds, due to how popular it is, and how much it updates stories and things constantly.

That is a slightly more indepth description of how a spider,basically gathers information from the page it is currently viewing and add's it to the search engines index so whe people search on say, Google, it doesn't have to then trawl the web trying to find matches there and then, when it has them already saved.

 

Hey DP---Good In Depth info---the more I read the more I learn

BTW---Just went to "who's Online"-----counted 13 spiders :yks:

-But now I know what thoes SPIDERS are doing---------gunnner

 

Aaah, how reassuring there's someone else out there who didn't know that 'spiders' were harmless - huge happy smile, gunner!

The moment I saw them I thought 'aha, evil things must be afoot' - which pretty much gives you an idea of what I think of those hairy spiders that inhabit our world .

 

Mara, just think how many flies there would be if the spiders were not around

Very interesting thread regarding the net spiders or should that be web spiders or spiders in the web :huh::huh::huh: Nurse the meds are wearing off !!!!!!!!

 

Laughing because of course you are quite right, I4N - spiders do have their place . I loathe the things but never kill them either ... but even scooping them up and tossing them back outside gives me the willies (should never, ever have played with magnifying glasses and checked out bugs when I was a kid - grin!)

 

We have a cat that loves to hunt them and them eat them, problem solved as long as you don't watch, after the kill is made

 

I don't kill any thing----unless it posesses a threat to me---in the yard or on the web,

BTW------I will go out of my way to "elimatatate ALL Yellow jacket nests----Oh Yea

 

Oh my dod, your pussy cat eats spiders??? Please tell me you don't let your kitty lick your face directly afterward, Match!

I laughed out loud, gunner - because I too slay yellow-jackets with no qualms whatsoever, but have spent hours trying to gently capture a tiny mouse to release back outside while kids are leaping onto the chairs and kitty is trying to beat me to the capture - poor mouse! Don't know who was more frazzled by the time I got it outside and released it into the grass with a blob of peanut butter on it's little paw lest it was hungry after all that scary behaviour by 2-legged giants - eek!

Gotta teach your puddy-cat that spiders are yuck, Match - and mice are just smaller cats .

 

I hate Spiders (Real Ones) with a passion.
Here in OZ,they are everywhere.
Spiders of Australia with information and pictures

 

Eeeeeek!! Took a quick look at the images at the link site and am still shuddering!

 

This is Absolutey The best mouse trap I have ever used. We had a real problem with mice, this thing got rid of all of them ( I have 3). Most released unharmed. Easy to use & no bait required. :lol:---gunnner

Kness Ketch-All Mousetrap