!!

Welcome Guest

You are viewing this forum as a guest therefore You are Not Allowed to Post and Reply and You are not allowed to view links. Register or Login

collapse

* Search


* Recent Replies

Adsense Account by [Not Shown, Login to View]
[Yesterday at 06:39 AM]


Facebook ban or Not? What to do? by [Not Shown, Login to View]
[Apr 17, 2018]


Tips to Get an Approved Adsense Account by [Not Shown, Login to View]
[Apr 17, 2018]


I am unable to see and edit published Post on my blog back end by [Not Shown, Login to View]
[Apr 16, 2018]


Areghan method on keyword research by [Not Shown, Login to View]
[Apr 16, 2018]


New Facebook Page by [Not Shown, Login to View]
[Apr 10, 2018]


PPC ads for News Website by [Not Shown, Login to View]
[Apr 01, 2018]


Wordpress Featured Image by [Not Shown, Login to View]
[Mar 31, 2018]


"Add To Cart" and "Ordered Items" by [Not Shown, Login to View]
[Mar 29, 2018]


Clicks on Amazon by [Not Shown, Login to View]
[Mar 26, 2018]


Having Issues With The Latest version of the Google Keyword Planner by [Not Shown, Login to View]
[Mar 24, 2018]


Amazon and Bing ads by [Not Shown, Login to View]
[Mar 12, 2018]


Webhost purchase by [Not Shown, Login to View]
[Feb 27, 2018]


Best hosting platforms by [Not Shown, Login to View]
[Feb 06, 2018]


AdSense Account. by [Not Shown, Login to View]
[Jan 28, 2018]


See What Happen To My Payoneer Card by [Not Shown, Login to View]
[Jan 22, 2018]


MybWebsite is Not Opening in Firefox and Chrome by [Not Shown, Login to View]
[Jan 21, 2018]


Happy New Year by [Not Shown, Login to View]
[Jan 17, 2018]


About the ftp client Filezilla login details by [Not Shown, Login to View]
[Jan 17, 2018]


How to Do Niche / Keyword Research Without Any Tools by [Not Shown, Login to View]
[Jan 15, 2018]


Local wordpress or live wordpress?? by [Not Shown, Login to View]
[Jan 09, 2018]


PayPal issues by [Not Shown, Login to View]
[Dec 31, 2017]


Website design issUe by [Not Shown, Login to View]
[Dec 31, 2017]


Facebook Ads Payment by [Not Shown, Login to View]
[Dec 29, 2017]


Running a PPC Campaign in an Non-English Language Country by [Not Shown, Login to View]
[Dec 29, 2017]


Joint venture on a single site by [Not Shown, Login to View]
[Dec 25, 2017]


How to Apply for Payoneer Card and US Payment Service to Receive Amazon & others by [Not Shown, Login to View]
[Dec 16, 2017]


don't have a website but still wants to run the online marketin by [Not Shown, Login to View]
[Dec 09, 2017]


Payoneer Application by [Not Shown, Login to View]
[Dec 09, 2017]


Bing Ads And Google Adwords Payment Methods by [Not Shown, Login to View]
[Dec 07, 2017]

Author Topic: Crawler and indexing and robots.txt  (Read 943 times)

0 Members and 1 Guest are viewing this topic.

Offline [Not Shown, Login to View]

  • Level 1 (Infant)
  • *
  • Posts: 38
  • Respect: +4
  • Gender: Male
  • Location: Osun state (osogbo)
  • 1st Chamber
  • My Rank: 0
Crawler and indexing and robots.txt
« on: Mar 31, 2013 »
0
 Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the robots file in text format and select from 'custom robot header tags'. Thanks



Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 340
  • Respect: +81
  • Gender: Female
  • Location: Port Harcourt
  • My Rank: 40
    • Chioma Andy's Blog
Re: Crawler and indexing
« Reply #1 on: Apr 01, 2013 »
0
if it is the one i know in Blogger, then i will advise that you do not temper with that area at all except you are well grounded in HTML.
Doing so will be putting your blog in danger.
for your daily scoop on Entertainment, News, and much more- You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 399
  • Respect: +42
  • Gender: Male
  • Location: Port Harcourt, Nigeria
  • You Won't Shrink if you can think.
  • My Rank: 61
    • http://hotbusinesslink.com
Re: Crawler and indexing
« Reply #2 on: Apr 01, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks



Addition to Chimummy have said, you don't have anything to do with the crawler and indexing in your  blog if you don't have any idea of HTML code.

or what exactly are you trying to do?
You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 4 (Dedicated)
  • ******
  • Posts: 1056
  • Respect: +267
  • Gender: Male
  • Location: Ibadan, Oyo State of Nigeria
  • 1st Chamber
  • My Rank: 86
Re: Crawler and indexing
« Reply #3 on: Apr 03, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks


@ Sunelpal3398 -  You should be guided accordingly.
Please don't  tamper with crawler and indexing if you are not
expert in HTML code.

Best regards,

Aare MacFally
Knowledge Is Power – Seek For It

Offline [Not Shown, Login to View]

  • Administrator
  • Level: Mentor
  • ******
  • Posts: 259748
  • Respect: +8002
  • Gender: Male
  • Location: Benin City
  • 18th Chamber
  • My Rank: 92
Re: Crawler and indexing
« Reply #4 on: Apr 12, 2013 »
0
Those settings and the robots.txt file are used to tell search engines what pages or links not to index. In most cases you do not need to change anything here so just as everyone else have suggested, do not change any of those settings.
Leave it for God, don't worry yourself. Leave it for God, don't cry no more.

 

Related Topics

  Subject / Started by Replies Last post
2 Replies
492 Views
Last post Feb 09, 2015
by [Not Shown, Login to View]
Google Indexing is Taking too long

Started by [Not Shown, Login to View] General Questions

3 Replies
749 Views
Last post Jan 26, 2016
by [Not Shown, Login to View]

TinyPortal © 2005-2011
SimplePortal 2.3.5 © 2008-2012, SimplePortal