- Beranda
- Komunitas
- Tech
- Website, Webmaster, Webdeveloper
Koleksi lengkap pemanggil robot crawler dan cara pasangnya pada meta tag


TS
ashar22
Koleksi lengkap pemanggil robot crawler dan cara pasangnya pada meta tag
Koleksi lengkap pemanggil robot crawler dan cara pasangnya pada meta tag - Perlu kita ketahui, bahwa google memang mesin pencari nomer 1 di dunia, tapi google bukan merupakan satu satunya mesin pencari didunia, memang untuk saat ini google adalah rajanya mesin pencari. tapi ingat.. itu tidak di semua tempat dan semua browser. misalnya di china, google disana tidak berlaku, penduduk china 90% menggunakan baidu daripada mesin pencari lainnya. dan faktanya china adalah penduduk terbanyak di muka bumi. itu baru china, belum rusia yang lebih loyal terhadap yandex.
Ada banyak mesin pencari lainnya yang bisa anda manfaatkan untuk sumber traffic web/bloga anda. Dibawah ini kami sediakan Koleksi lengkap pemanggil robot crawler dan cara memasangnya pada meta tag.
Kita mulai dari "INDEX FOLLOW" nya:

Catatan: Robot crawler ini akan berfungsi bila web/blog anda menggunakan multi bahasa, namun bila web/blg anda menggunakan bahasa indonesia saja, cukup gunakan robot google, yahoo dan bing saja.
visit my blogs:
FREE DOFOLLOW BACKLINKS

Ada banyak mesin pencari lainnya yang bisa anda manfaatkan untuk sumber traffic web/bloga anda. Dibawah ini kami sediakan Koleksi lengkap pemanggil robot crawler dan cara memasangnya pada meta tag.
Kita mulai dari "INDEX FOLLOW" nya:

Quote:
<meta content='INDEX FOLLOW' name='Robots'/>
<meta content='2 days' name='revisit'/>
<meta content='2 Days' name='Revisit-after'/>
<meta content='ID' name='language'/>
<meta content='ID' name='geo.country'/>
<meta content='Indonesia' name='geo.placename'/>
<meta content='global' name='distribution'/>
<meta content='blogger' name='generator'/>
<meta content='general' name='rating'/>
<meta content='global' name='target'/>
<meta content='index,follow,snipet' name='googlebot'/>
<meta content='follow, all' name='Googlebot-Image'/>
<meta content='follow, all' name='Scooter'/>
<meta content='follow, all' name='msnbot'/>
<meta content='follow, all' name='ia_archiver'/>
<meta content='follow, all' name='Slurp'/>
<meta content='follow, all' name='ZyBorg'/>
<meta content='follow, all' name='ABACHOBot'/>
<meta content='follow, all' name='Accoona-AI-Agent'/>
<meta content='follow, all' name='AnyApexBot'/>
<meta content='follow, all' name='Arachmo'/>
<meta content='follow, all' name='Baiduspider'/>
<meta content='follow, all' name='BecomeBot'/>
<meta content='follow, all' name='BeslistBot'/>
<meta content='follow, all' name='BillyBobBot'/>
<meta content='follow, all' name='Bimbot'/>
<meta content='follow, all' name='Bingbot'/>
<meta content='follow, all' name='boitho.com-dc'/>
<meta content='follow, all' name='boitho.com-robot'/>
<meta content='follow, all' name='btbot'/>
<meta content='follow, all' name='CatchBot'/>
<meta content='follow, all' name='Charlotte'/>
<meta content='follow, all' name='ConveraCrawler'/>
<meta content='follow, all' name='Covario IDS'/>
<meta content='follow, all' name='DataparkSearch'/>
<meta content='follow, all' name='DiamondBot'/>
<meta content='follow, all' name='Discobot'/>
<meta content='follow, all' name='Dotbot'/>
<meta content='follow, all' name='EmeraldShield.com WebBot'/>
<meta content='follow, all' name='envolk[ITS]spider'/>
<meta content='follow, all' name='EsperanzaBot'/>
<meta content='follow, all' name='Exabot'/>
<meta content='follow, all' name='FAST Enterprise Crawler'/>
<meta content='follow, all' name='FAST-WebCrawler'/>
<meta content='follow, all' name='FDSE robot'/>
<meta content='follow, all' name='FindLinks'/>
<meta content='follow, all' name='FurlBot'/>
<meta content='follow, all' name='FyberSpider'/>
<meta content='follow, all' name='Gaisbot'/>
<meta content='follow, all' name='GalaxyBot'/>
<meta content='follow, all' name='genieBot'/>
<meta content='follow, all' name='GigabotGigabot'/>
<meta content='follow, all' name='GurujiBot'/>
<meta content='follow, all' name='HappyFunBot'/>
<meta content='follow, all' name='Holmes'/>
<meta content='follow, all' name='htdig'/>
<meta content='follow, all' name='iaskspider'/>
<meta content='follow, all' name='iCCrawler'/>
<meta content='follow, all' name='ichiro'/>
<meta content='follow, all' name='igdeSpyder'/>
<meta content='follow, all' name='IRLbot'/>
<meta content='follow, all' name='IssueCrawler'/>
<meta content='follow, all' name='Jaxified Bot'/>
<meta content='follow, all' name='Jyxobot'/>
<meta content='follow, all' name='KoepaBot'/>
<meta content='follow, all' name='L.webis'/>
<meta content='follow, all' name='LapozzBot'/>
<meta content='follow, all' name='LDSpider'/>
<meta content='follow, all' name='DiamondBot'/>
<meta content='follow, all' name='LexxeBot'/>
<meta content='follow, all' name='Linguee Bot'/>
<meta content='follow, all' name='LinkWalker'/>
<meta content='follow, all' name='lmspider'/>
<meta content='follow, all' name='lwp-trivial'/>
<meta content='follow, all' name='mabontland'/>
<meta content='follow, all' name='magpie-crawler'/>
<meta content='follow, all' name='MJ12bot'/>
<meta content='follow, all' name='Mnogosearch'/>
<meta content='follow, all' name='mogimogi'/>
<meta content='follow, all' name='MojeekBot'/>
<meta content='follow, all' name='Moreoverbot'/>
<meta content='follow, all' name='Morning Paper'/>
<meta content='follow, all' name='MSRBot'/>
<meta content='follow, all' name='MVAClient'/>
<meta content='follow, all' name='mxbot'/>
<meta content='follow, all' name='NetResearchServer'/>
<meta content='follow, all' name='NetSeer Crawler'/>
<meta content='follow, all' name='NG-Search'/>
<meta content='follow, all' name='nicebot'/>
<meta content='follow, all' name='noxtrumbot'/>
<meta content='follow, all' name='Nusearch Spider'/>
<meta content='follow, all' name='NutchCVS'/>
<meta content='follow, all' name='Nymesis'/>
<meta content='follow, all' name='obot'/>
<meta content='follow, all' name='oegp'/>
<meta content='follow, all' name='omgilibot'/>
<meta content='follow, all' name='OmniExplorer_Bot'/>
<meta content='follow, all' name='OOZBOT'/>
<meta content='follow, all' name='Orbiter'/>
<meta content='follow, all' name='PageBitesHyperBot'/>
<meta content='follow, all' name='Peew'/>
<meta content='follow, all' name='polybot'/>
<meta content='follow, all' name='Pompos'/>
<meta content='follow, all' name='PostPost'/>
<meta content='follow, all' name='Psbot'/>
<meta content='follow, all' name='PycURL'/>
<meta content='follow, all' name='Qseero'/>
<meta content='follow, all' name='Radian6'/>
<meta content='follow, all' name='RAMPyBot'/>
<meta content='follow, all' name='RufusBot'/>
<meta content='follow, all' name='SandCrawler'/>
<meta content='follow, all' name='SBIder'/>
<meta content='follow, all' name='ScoutJet'/>
<meta content='follow, all' name='Scrubby'/>
<meta content='follow, all' name='SearchSight'/>
<meta content='follow, all' name='semanticdiscovery'/>
<meta content='follow, all' name='Sensis Web Crawler'/>
<meta content='follow, all' name='SEOChat::Bot'/>
<meta content='follow, all' name='SeznamBot'/>
<meta content='follow, all' name='ShopWiki'/>
<meta content='follow, all' name='Seekbot'/>
<meta content='follow, all' name='Shoula robot'/>
<meta content='follow, all' name='silk'/>
<meta content='follow, all' name='Sitebot'/>
<meta content='follow, all' name='Snappy'/>
<meta content='follow, all' name='sogou spider'/>
<meta content='follow, all' name='Sosospider'/>
<meta content='follow, all' name='suggybot'/>
<meta content='follow, all' name='SynooBot'/>
<meta content='follow, all' name='Teoma'/>
<meta content='follow, all' name='TerrawizBot'/>
<meta content='follow, all' name='TheSuBot'/>
<meta content='follow, all' name='Thumbnail.CZ robot'/>
<meta content='follow, all' name='TinEye'/>
<meta content='follow, all' name='truwoGPS'/>
<meta content='follow, all' name='TurnitinBot'/>
<meta content='follow, all' name='TweetedTimes Bot'/>
<meta content='follow, all' name='updated'/>
<meta content='follow, all' name='Urlfilebot'/>
<meta content='follow, all' name='Vagabondo'/>
<meta content='follow, all' name='VoilaBot'/>
<meta content='follow, all' name='Vortex'/>
<meta content='follow, all' name='voyager'/>
<meta content='follow, all' name='webcollage'/>
<meta content='follow, all' name='Websquash.com'/>
<meta content='follow, all' name='wf84'/>
<meta content='follow, all' name='WoFindeIch Robot'/>
<meta content='follow, all' name='WomlpeFactory'/>
<meta content='follow, all' name='Xaldon_WebSpider'/>
<meta content='follow, all' name='yacy'/>
<meta content='follow, all' name='Yahoo! Slurp China'/>
<meta content='follow, all' name='YahooSeeker-Testing'/>
<meta content='follow, all' name='Yasaklibot'/>
<meta content='follow, all' name='Yeti'/>
<meta content='follow, all' name='YodaoBot'/>
<meta content='follow, all' name='yoogliFetchAgent'/>
<meta content='follow, all' name='YoudaoBot'/>
<meta content='follow, all' name='Zao'/>
<meta content='follow, all' name='Zealbot'/>
<meta content='follow, all' name='zspider'/>
<meta content='follow, all' name='Discobot'/>
<meta content='follow, all' name='Dotbot'/>
<meta content='follow, all' name='EmeraldShield.com WebBot'/>
<meta content='follow, all' name='envolk[ITS]spider'/>
<meta content='follow, all' name='EsperanzaBot'/>
<meta content='follow, all' name='Exabot'/>
<meta content='follow, all' name='FAST Enterprise Crawler'/>
<meta content='follow, all' name='FAST-WebCrawler'/>
<meta content='follow, all' name='Mediapartners-Google'/>
<meta content='follow, all' name='NewsGator'/>
<meta content='follow, all' name='Yahoo! Slurp'/>
<meta content='follow, all' name='YandexBot'/>
<meta content='follow, all' name='Speedy Spider'/>
<meta content='follow, all' name='Seekbot'/>
<meta content='follow, all' name='Twitterbot'/>
<meta content='follow, all' name='YahooSeeker'/>
<meta content='follow, all' name='YandexImages'/>
<meta content='follow, all' name='msnbot-media'/>
<meta content='follow, all' name='Yahoobot'/>
<meta content='2 days' name='revisit'/>
<meta content='2 Days' name='Revisit-after'/>
<meta content='ID' name='language'/>
<meta content='ID' name='geo.country'/>
<meta content='Indonesia' name='geo.placename'/>
<meta content='global' name='distribution'/>
<meta content='blogger' name='generator'/>
<meta content='general' name='rating'/>
<meta content='global' name='target'/>
<meta content='index,follow,snipet' name='googlebot'/>
<meta content='follow, all' name='Googlebot-Image'/>
<meta content='follow, all' name='Scooter'/>
<meta content='follow, all' name='msnbot'/>
<meta content='follow, all' name='ia_archiver'/>
<meta content='follow, all' name='Slurp'/>
<meta content='follow, all' name='ZyBorg'/>
<meta content='follow, all' name='ABACHOBot'/>
<meta content='follow, all' name='Accoona-AI-Agent'/>
<meta content='follow, all' name='AnyApexBot'/>
<meta content='follow, all' name='Arachmo'/>
<meta content='follow, all' name='Baiduspider'/>
<meta content='follow, all' name='BecomeBot'/>
<meta content='follow, all' name='BeslistBot'/>
<meta content='follow, all' name='BillyBobBot'/>
<meta content='follow, all' name='Bimbot'/>
<meta content='follow, all' name='Bingbot'/>
<meta content='follow, all' name='boitho.com-dc'/>
<meta content='follow, all' name='boitho.com-robot'/>
<meta content='follow, all' name='btbot'/>
<meta content='follow, all' name='CatchBot'/>
<meta content='follow, all' name='Charlotte'/>
<meta content='follow, all' name='ConveraCrawler'/>
<meta content='follow, all' name='Covario IDS'/>
<meta content='follow, all' name='DataparkSearch'/>
<meta content='follow, all' name='DiamondBot'/>
<meta content='follow, all' name='Discobot'/>
<meta content='follow, all' name='Dotbot'/>
<meta content='follow, all' name='EmeraldShield.com WebBot'/>
<meta content='follow, all' name='envolk[ITS]spider'/>
<meta content='follow, all' name='EsperanzaBot'/>
<meta content='follow, all' name='Exabot'/>
<meta content='follow, all' name='FAST Enterprise Crawler'/>
<meta content='follow, all' name='FAST-WebCrawler'/>
<meta content='follow, all' name='FDSE robot'/>
<meta content='follow, all' name='FindLinks'/>
<meta content='follow, all' name='FurlBot'/>
<meta content='follow, all' name='FyberSpider'/>
<meta content='follow, all' name='Gaisbot'/>
<meta content='follow, all' name='GalaxyBot'/>
<meta content='follow, all' name='genieBot'/>
<meta content='follow, all' name='GigabotGigabot'/>
<meta content='follow, all' name='GurujiBot'/>
<meta content='follow, all' name='HappyFunBot'/>
<meta content='follow, all' name='Holmes'/>
<meta content='follow, all' name='htdig'/>
<meta content='follow, all' name='iaskspider'/>
<meta content='follow, all' name='iCCrawler'/>
<meta content='follow, all' name='ichiro'/>
<meta content='follow, all' name='igdeSpyder'/>
<meta content='follow, all' name='IRLbot'/>
<meta content='follow, all' name='IssueCrawler'/>
<meta content='follow, all' name='Jaxified Bot'/>
<meta content='follow, all' name='Jyxobot'/>
<meta content='follow, all' name='KoepaBot'/>
<meta content='follow, all' name='L.webis'/>
<meta content='follow, all' name='LapozzBot'/>
<meta content='follow, all' name='LDSpider'/>
<meta content='follow, all' name='DiamondBot'/>
<meta content='follow, all' name='LexxeBot'/>
<meta content='follow, all' name='Linguee Bot'/>
<meta content='follow, all' name='LinkWalker'/>
<meta content='follow, all' name='lmspider'/>
<meta content='follow, all' name='lwp-trivial'/>
<meta content='follow, all' name='mabontland'/>
<meta content='follow, all' name='magpie-crawler'/>
<meta content='follow, all' name='MJ12bot'/>
<meta content='follow, all' name='Mnogosearch'/>
<meta content='follow, all' name='mogimogi'/>
<meta content='follow, all' name='MojeekBot'/>
<meta content='follow, all' name='Moreoverbot'/>
<meta content='follow, all' name='Morning Paper'/>
<meta content='follow, all' name='MSRBot'/>
<meta content='follow, all' name='MVAClient'/>
<meta content='follow, all' name='mxbot'/>
<meta content='follow, all' name='NetResearchServer'/>
<meta content='follow, all' name='NetSeer Crawler'/>
<meta content='follow, all' name='NG-Search'/>
<meta content='follow, all' name='nicebot'/>
<meta content='follow, all' name='noxtrumbot'/>
<meta content='follow, all' name='Nusearch Spider'/>
<meta content='follow, all' name='NutchCVS'/>
<meta content='follow, all' name='Nymesis'/>
<meta content='follow, all' name='obot'/>
<meta content='follow, all' name='oegp'/>
<meta content='follow, all' name='omgilibot'/>
<meta content='follow, all' name='OmniExplorer_Bot'/>
<meta content='follow, all' name='OOZBOT'/>
<meta content='follow, all' name='Orbiter'/>
<meta content='follow, all' name='PageBitesHyperBot'/>
<meta content='follow, all' name='Peew'/>
<meta content='follow, all' name='polybot'/>
<meta content='follow, all' name='Pompos'/>
<meta content='follow, all' name='PostPost'/>
<meta content='follow, all' name='Psbot'/>
<meta content='follow, all' name='PycURL'/>
<meta content='follow, all' name='Qseero'/>
<meta content='follow, all' name='Radian6'/>
<meta content='follow, all' name='RAMPyBot'/>
<meta content='follow, all' name='RufusBot'/>
<meta content='follow, all' name='SandCrawler'/>
<meta content='follow, all' name='SBIder'/>
<meta content='follow, all' name='ScoutJet'/>
<meta content='follow, all' name='Scrubby'/>
<meta content='follow, all' name='SearchSight'/>
<meta content='follow, all' name='semanticdiscovery'/>
<meta content='follow, all' name='Sensis Web Crawler'/>
<meta content='follow, all' name='SEOChat::Bot'/>
<meta content='follow, all' name='SeznamBot'/>
<meta content='follow, all' name='ShopWiki'/>
<meta content='follow, all' name='Seekbot'/>
<meta content='follow, all' name='Shoula robot'/>
<meta content='follow, all' name='silk'/>
<meta content='follow, all' name='Sitebot'/>
<meta content='follow, all' name='Snappy'/>
<meta content='follow, all' name='sogou spider'/>
<meta content='follow, all' name='Sosospider'/>
<meta content='follow, all' name='suggybot'/>
<meta content='follow, all' name='SynooBot'/>
<meta content='follow, all' name='Teoma'/>
<meta content='follow, all' name='TerrawizBot'/>
<meta content='follow, all' name='TheSuBot'/>
<meta content='follow, all' name='Thumbnail.CZ robot'/>
<meta content='follow, all' name='TinEye'/>
<meta content='follow, all' name='truwoGPS'/>
<meta content='follow, all' name='TurnitinBot'/>
<meta content='follow, all' name='TweetedTimes Bot'/>
<meta content='follow, all' name='updated'/>
<meta content='follow, all' name='Urlfilebot'/>
<meta content='follow, all' name='Vagabondo'/>
<meta content='follow, all' name='VoilaBot'/>
<meta content='follow, all' name='Vortex'/>
<meta content='follow, all' name='voyager'/>
<meta content='follow, all' name='webcollage'/>
<meta content='follow, all' name='Websquash.com'/>
<meta content='follow, all' name='wf84'/>
<meta content='follow, all' name='WoFindeIch Robot'/>
<meta content='follow, all' name='WomlpeFactory'/>
<meta content='follow, all' name='Xaldon_WebSpider'/>
<meta content='follow, all' name='yacy'/>
<meta content='follow, all' name='Yahoo! Slurp China'/>
<meta content='follow, all' name='YahooSeeker-Testing'/>
<meta content='follow, all' name='Yasaklibot'/>
<meta content='follow, all' name='Yeti'/>
<meta content='follow, all' name='YodaoBot'/>
<meta content='follow, all' name='yoogliFetchAgent'/>
<meta content='follow, all' name='YoudaoBot'/>
<meta content='follow, all' name='Zao'/>
<meta content='follow, all' name='Zealbot'/>
<meta content='follow, all' name='zspider'/>
<meta content='follow, all' name='Discobot'/>
<meta content='follow, all' name='Dotbot'/>
<meta content='follow, all' name='EmeraldShield.com WebBot'/>
<meta content='follow, all' name='envolk[ITS]spider'/>
<meta content='follow, all' name='EsperanzaBot'/>
<meta content='follow, all' name='Exabot'/>
<meta content='follow, all' name='FAST Enterprise Crawler'/>
<meta content='follow, all' name='FAST-WebCrawler'/>
<meta content='follow, all' name='Mediapartners-Google'/>
<meta content='follow, all' name='NewsGator'/>
<meta content='follow, all' name='Yahoo! Slurp'/>
<meta content='follow, all' name='YandexBot'/>
<meta content='follow, all' name='Speedy Spider'/>
<meta content='follow, all' name='Seekbot'/>
<meta content='follow, all' name='Twitterbot'/>
<meta content='follow, all' name='YahooSeeker'/>
<meta content='follow, all' name='YandexImages'/>
<meta content='follow, all' name='msnbot-media'/>
<meta content='follow, all' name='Yahoobot'/>
Catatan: Robot crawler ini akan berfungsi bila web/blog anda menggunakan multi bahasa, namun bila web/blg anda menggunakan bahasa indonesia saja, cukup gunakan robot google, yahoo dan bing saja.
visit my blogs:
FREE DOFOLLOW BACKLINKS

Diubah oleh ashar22 20-01-2015 04:23


nona212 memberi reputasi
1
1.3K
Kutip
2
Balasan


Komentar yang asik ya
Urutan
Terbaru
Terlama


Komentar yang asik ya
Komunitas Pilihan