Keywords all websites will be included in the databases.
are words/phrases which can be put into a search engine so that they will come
back identical and related results. Businesses often use market research
companies to see what keywords best reflect their business, products and
To make sure when spiders file websites accurately, web
developers add in meta tags in the code of a web page. Meta tags are inserted
supply search engines with information about a website. Texts within the tags
are not shown within the web page, but informs conveys explicit information to
search engines regarding the page
engines use the keyed search use phrase to find websites in its database which
includes the phrase, rather than searching the entire internet each time.
Search engines use ‘spiders’ to search the internet for new websites to include
in their databases, with the purpose that all websites will be included in the
databases. The spiders inspect each website that they face and send data about
that page back to search engine to be stored in its database. The process is termed
web crawling. Consequences can arise from web crawling, because every so often
web crawlers will try to spider websites violently which can overload servers,
as a result of this, only limited crawling must be conducted.