!!

Welcome Guest

You are viewing this forum as a guest therefore You are Not Allowed to Post and Reply and You are not allowed to view links. Register or Login

collapse

* Search


* Recent Replies

Payoneer card by [Not Shown, Login to View]
[May 24, 2017]


Good Day by [Not Shown, Login to View]
[May 24, 2017]


Help on how to send bulk emails by [Not Shown, Login to View]
[May 18, 2017]


changing domain name by [Not Shown, Login to View]
[May 13, 2017]


No place like home by [Not Shown, Login to View]
[May 13, 2017]


Google AdSense by [Not Shown, Login to View]
[May 09, 2017]


How To Change Dot blogspot to Dot com by [Not Shown, Login to View]
[May 08, 2017]


Meta Tag Error - The element type "meta" must be terminated by the matching end- by [Not Shown, Login to View]
[May 07, 2017]


Site for soccer news by [Not Shown, Login to View]
[May 04, 2017]


How do I know if my new blog is Live? by [Not Shown, Login to View]
[May 04, 2017]


Linking a web page to http://www.ng.com by [Not Shown, Login to View]
[May 03, 2017]


Is Hostnownow.com a reliable company for hosting and domain name registrstion? by [Not Shown, Login to View]
[Apr 28, 2017]


How Can I Set-up social network on my blog website? by [Not Shown, Login to View]
[Apr 24, 2017]


How to register and link my blog to Adsense by [Not Shown, Login to View]
[Apr 23, 2017]


fiverr backlinks by [Not Shown, Login to View]
[Apr 18, 2017]


Is SFI real? by [Not Shown, Login to View]
[Apr 18, 2017]


Good day everyone by [Not Shown, Login to View]
[Apr 18, 2017]


Mapping or Linking Goddady Domains to Blogger Blog by [Not Shown, Login to View]
[Apr 18, 2017]


How to Create Peer to Peer Donation Website / Ponzi Script? by [Not Shown, Login to View]
[Apr 18, 2017]


Amazon registration in becoming an affiliate 2016 by [Not Shown, Login to View]
[Apr 18, 2017]


Introducing My Own Free Web Hosting Company by [Not Shown, Login to View]
[Apr 11, 2017]


How To Get Free Web Hosting And Free domain by [Not Shown, Login to View]
[Apr 05, 2017]


Should I use both Wordpress and Joomla on same website? by [Not Shown, Login to View]
[Mar 09, 2017]


How to Start Amazon affiliate marketing by [Not Shown, Login to View]
[Mar 06, 2017]


Can I Point my Paid domain to a free hosting account? by [Not Shown, Login to View]
[Mar 05, 2017]


How do I get a website by [Not Shown, Login to View]
[Mar 05, 2017]


GLAD TO BE BACK! by [Not Shown, Login to View]
[Feb 28, 2017]


Thoughts that run the world by [Not Shown, Login to View]
[Feb 09, 2017]


Adsense Acceptable Websites by [Not Shown, Login to View]
[Feb 08, 2017]


Retrieving Profile Picture Option by [Not Shown, Login to View]
[Feb 02, 2017]

Author Topic: Crawler and indexing and robots.txt  (Read 685 times)

0 Members and 1 Guest are viewing this topic.

Offline [Not Shown, Login to View]

  • Level 1 (Infant)
  • *
  • Posts: 38
  • Respect: +4
  • Gender: Male
  • Location: Osun state (osogbo)
  • 1st Chamber
  • My Rank: 0
Crawler and indexing and robots.txt
« on: Mar 31, 2013 »
0
 Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the robots file in text format and select from 'custom robot header tags'. Thanks



Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 337
  • Respect: +81
  • Gender: Female
  • Location: Port Harcourt
  • My Rank: 38
    • Chioma Andy's Blog
Re: Crawler and indexing
« Reply #1 on: Apr 01, 2013 »
0
if it is the one i know in Blogger, then i will advise that you do not temper with that area at all except you are well grounded in HTML.
Doing so will be putting your blog in danger.
for your daily scoop on Entertainment, News, and much more- You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 399
  • Respect: +42
  • Gender: Male
  • Location: Port Harcourt, Nigeria
  • You Won't Shrink if you can think.
  • My Rank: 60
    • http://hotbusinesslink.com
Re: Crawler and indexing
« Reply #2 on: Apr 01, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks



Addition to Chimummy have said, you don't have anything to do with the crawler and indexing in your  blog if you don't have any idea of HTML code.

or what exactly are you trying to do?
You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 4 (Dedicated)
  • ******
  • Posts: 1056
  • Respect: +267
  • Gender: Male
  • Location: Ibadan, Oyo State of Nigeria
  • 1st Chamber
  • My Rank: 86
Re: Crawler and indexing
« Reply #3 on: Apr 03, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks


@ Sunelpal3398 -  You should be guided accordingly.
Please don't  tamper with crawler and indexing if you are not
expert in HTML code.

Best regards,

Aare MacFally
Knowledge Is Power – Seek For It

Offline [Not Shown, Login to View]

  • Administrator
  • Level: Mentor
  • ******
  • Posts: 259568
  • Respect: +7989
  • Gender: Male
  • Location: Benin City
  • 18th Chamber
  • My Rank: 80
Re: Crawler and indexing
« Reply #4 on: Apr 12, 2013 »
0
Those settings and the robots.txt file are used to tell search engines what pages or links not to index. In most cases you do not need to change anything here so just as everyone else have suggested, do not change any of those settings.
Leave it for God, don't worry yourself. Leave it for God, don't cry no more.

 

Related Topics

  Subject / Started by Replies Last post
2 Replies
368 Views
Last post Feb 09, 2015
by [Not Shown, Login to View]
Google Indexing is Taking too long

Started by [Not Shown, Login to View] General Questions

3 Replies
520 Views
Last post Jan 26, 2016
by [Not Shown, Login to View]

TinyPortal © 2005-2011
SimplePortal 2.3.5 © 2008-2012, SimplePortal