!!

Welcome Guest

You are viewing this forum as a guest therefore You are Not Allowed to Post and Reply and You are not allowed to view links. Register or Login

collapse

* Search


* Recent Replies

I need help on my seo title and description by [Not Shown, Login to View]
[Jul 15, 2017]


Paypal and Gtb problem by [Not Shown, Login to View]
[Jul 15, 2017]


http versus https by [Not Shown, Login to View]
[Jul 07, 2017]


Identity Verification On amzon Associates account by [Not Shown, Login to View]
[Jul 06, 2017]


site to test my domain name by [Not Shown, Login to View]
[Jul 01, 2017]


how soon by [Not Shown, Login to View]
[Jun 24, 2017]


How to Apply for Payoneer Card and US Payment Service to Receive Amazon & others by [Not Shown, Login to View]
[Jun 19, 2017]


How to Withdraw from Paypal in Nigeria Using Payoneer Card by [Not Shown, Login to View]
[Jun 12, 2017]


linking a post to an external link by [Not Shown, Login to View]
[Jun 10, 2017]


Building with WordPress by [Not Shown, Login to View]
[Jun 09, 2017]


Payoneer card by [Not Shown, Login to View]
[Jun 08, 2017]


Create a blog by [Not Shown, Login to View]
[Jun 07, 2017]


Help on how to send bulk emails by [Not Shown, Login to View]
[Jun 04, 2017]


Facebook advert by [Not Shown, Login to View]
[May 31, 2017]


Hello sir by [Not Shown, Login to View]
[May 31, 2017]


Website Showcase - Drop Your Website Link(s) Here by [Not Shown, Login to View]
[May 28, 2017]


Is Hostnownow.com a reliable company for hosting and domain name registrstion? by [Not Shown, Login to View]
[May 28, 2017]


Practicing NVU by [Not Shown, Login to View]
[May 27, 2017]


Good Day by [Not Shown, Login to View]
[May 24, 2017]


changing domain name by [Not Shown, Login to View]
[May 13, 2017]


No place like home by [Not Shown, Login to View]
[May 13, 2017]


Google AdSense by [Not Shown, Login to View]
[May 09, 2017]


How To Change Dot blogspot to Dot com by [Not Shown, Login to View]
[May 08, 2017]


Meta Tag Error - The element type "meta" must be terminated by the matching end- by [Not Shown, Login to View]
[May 07, 2017]


Site for soccer news by [Not Shown, Login to View]
[May 04, 2017]


How do I know if my new blog is Live? by [Not Shown, Login to View]
[May 04, 2017]


Linking a web page to http://www.ng.com by [Not Shown, Login to View]
[May 03, 2017]


How Can I Set-up social network on my blog website? by [Not Shown, Login to View]
[Apr 24, 2017]


How to register and link my blog to Adsense by [Not Shown, Login to View]
[Apr 23, 2017]


fiverr backlinks by [Not Shown, Login to View]
[Apr 18, 2017]

Author Topic: Crawler and indexing and robots.txt  (Read 713 times)

0 Members and 1 Guest are viewing this topic.

Offline [Not Shown, Login to View]

  • Level 1 (Infant)
  • *
  • Posts: 38
  • Respect: +4
  • Gender: Male
  • Location: Osun state (osogbo)
  • 1st Chamber
  • My Rank: 0
Crawler and indexing and robots.txt
« on: Mar 31, 2013 »
0
 Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the robots file in text format and select from 'custom robot header tags'. Thanks



Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 337
  • Respect: +81
  • Gender: Female
  • Location: Port Harcourt
  • My Rank: 38
    • Chioma Andy's Blog
Re: Crawler and indexing
« Reply #1 on: Apr 01, 2013 »
0
if it is the one i know in Blogger, then i will advise that you do not temper with that area at all except you are well grounded in HTML.
Doing so will be putting your blog in danger.
for your daily scoop on Entertainment, News, and much more- You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 399
  • Respect: +42
  • Gender: Male
  • Location: Port Harcourt, Nigeria
  • You Won't Shrink if you can think.
  • My Rank: 60
    • http://hotbusinesslink.com
Re: Crawler and indexing
« Reply #2 on: Apr 01, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks



Addition to Chimummy have said, you don't have anything to do with the crawler and indexing in your  blog if you don't have any idea of HTML code.

or what exactly are you trying to do?
You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 4 (Dedicated)
  • ******
  • Posts: 1056
  • Respect: +267
  • Gender: Male
  • Location: Ibadan, Oyo State of Nigeria
  • 1st Chamber
  • My Rank: 86
Re: Crawler and indexing
« Reply #3 on: Apr 03, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks


@ Sunelpal3398 -  You should be guided accordingly.
Please don't  tamper with crawler and indexing if you are not
expert in HTML code.

Best regards,

Aare MacFally
Knowledge Is Power – Seek For It

Offline [Not Shown, Login to View]

  • Administrator
  • Level: Mentor
  • ******
  • Posts: 259596
  • Respect: +7996
  • Gender: Male
  • Location: Benin City
  • 18th Chamber
  • My Rank: 82
Re: Crawler and indexing
« Reply #4 on: Apr 12, 2013 »
0
Those settings and the robots.txt file are used to tell search engines what pages or links not to index. In most cases you do not need to change anything here so just as everyone else have suggested, do not change any of those settings.
Leave it for God, don't worry yourself. Leave it for God, don't cry no more.

 

Related Topics

  Subject / Started by Replies Last post
2 Replies
388 Views
Last post Feb 09, 2015
by [Not Shown, Login to View]
Google Indexing is Taking too long

Started by [Not Shown, Login to View] General Questions

3 Replies
541 Views
Last post Jan 26, 2016
by [Not Shown, Login to View]

TinyPortal © 2005-2011
SimplePortal 2.3.5 © 2008-2012, SimplePortal