organic search. crawl index rank crawling known web pages index servers crawler machines crawler...

33
ORGANIC SEARCH

Post on 19-Dec-2015

223 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

ORGANIC SEARCH

Page 2: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

CRAWL

INDEX

RANK

Page 3: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

CRAWLING

KnownWeb

pages

Index Servers

CrawlerMachines

Googlebot

Doc Servers

Page 4: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

DEVELOPING THE LIST OF KNOWN WEB PAGES

KnownWeb

pages

Prior Crawls

/addurl

Page 5: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

PEREMECH

Page 6: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

CRAWLING FOR PEREMECH

usm.maine.edu/index.html

/academic/index.html

/sb/index.html

/sb/facultystaff.html

/sb/zsuleiman.html

/~suleiman/index.html

/~suleiman/peremech/index.html

other linked pages

other linked pages

other linked pages

Page 7: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

CRAWLERS IDENTIFY THEMSELVES

Page 8: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

ROBOTS.TXT – EXCLUDES SITES FROM CRAWLING

whitehouse.gov/robots.txt

Page 9: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

CRAWLERS SHOULD NOT HOG RESOURCES

Page 10: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

CRAWLING PROBLEM: THE WEB IS VAST

Page 11: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

CRAWLING PROBLEM: THE HIDDEN WEB

Page 12: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

INDEXING

Page 13: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

RANKING

Closely guarded, proprietary algorithm

Page 14: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

RANKING

Organic Search Results

Keyword Phrase

Page 15: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

RANKING – THINGS THAT MATTER

Can you find the word Lobster?

Page 16: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

WHY IS RED LOBSTER RANKED HIGHER?

Can you find the word Lobster?

Page 17: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

HOW CAN I IMPROVE MY RANK?

Page 18: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS –TEXT

KEYWORD PROXIMITY

We sell live Maine lobster

Home of Maine’s best lobster

All of our lobsters come from Maine

Page 19: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS –TEXT

KEYWORD DENSITY

What percentage of the words on this page are lobster.

Page 20: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS –TEXT

KEYWORD FREQUENCY

The keyword lobster is visible 32 times and occurs 182 times on the page

Page 21: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS –TEXT

KEYWORD PROMINENCE

LobsterLobster

Lobster

Lobster

Lobster

Lobster

Page 22: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS – LINKING

LINK EXCHANGE AND PAID PLACEMENT

Page 23: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS – LINKING

An article written at thefreelibrary.com

Page 24: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS – LINKING

PAID PLACEMENT

Page 25: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS – LINKING

LINK EXCHANGE - RELEVANT

Page 26: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS – LINKING

LINK EXCHANGE – NON RELEVANT

Page 27: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS – LINKING

LINK SPAM

Page 28: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS – LINKING

COMMENT/ FORUM SPAM

Page 29: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

BASIC SEO CONCEPTS – LINKING

COMMENT/ FORUM SPAM

Page 30: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

LINK EXCHANGE IS CONTROVERSIAL

Page 31: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

USER RELEVANCE

LOCATION

USER ID

130.111.115.24

Page 32: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

USER EXPERTISE VARIES

Page 33: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers

PHOTO ATTRIBUTIONS

Slide 10: 'OINK! OINK!’ www.flickr.com/photos/49968232@N00/51679641

Slide 11: ‘The Vast Web’ wikicommons.com

Slide 13: 'Royal Guards’ www.flickr.com/photos/23697065@N05/2356109302

Slide 17: 'Yoda (IMG_3308)‘ www.flickr.com/photos/73531322@N00/194828922

Slide 30: ‘Vera Cruz’ BAM/Photofest