!!

Welcome Guest

You are viewing this forum as a guest therefore You are Not Allowed to Post and Reply and You are not allowed to view links. Register or Login

collapse

* Search


* Recent Replies

How Can I Change Or Beautify My New YouTube Page by [Not Shown, Login to View]
[Oct 18, 2017]


Effective Paid Traffic Channel by [Not Shown, Login to View]
[Oct 18, 2017]


How long by [Not Shown, Login to View]
[Oct 18, 2017]


pdf (ebook) from laptop to gmail acoun by [Not Shown, Login to View]
[Oct 18, 2017]


facebook ads by [Not Shown, Login to View]
[Oct 18, 2017]


Website Traffic Season 12 - Amazing all-in-one tool for Google, Youtube, Amazon. by [Not Shown, Login to View]
[Oct 15, 2017]


Show/Hide Widgets in Blogspot Mobile Template by [Not Shown, Login to View]
[Oct 15, 2017]


How to Get Original Image For My Local News Blog by [Not Shown, Login to View]
[Oct 15, 2017]


how to create ebook covers by [Not Shown, Login to View]
[Oct 15, 2017]


Cheapest domain site and purchase with master card by [Not Shown, Login to View]
[Oct 05, 2017]


Amazon Identity Verification by [Not Shown, Login to View]
[Sep 28, 2017]


Any monthly charges from Paypal? by [Not Shown, Login to View]
[Sep 22, 2017]


Using RSS Gadget by [Not Shown, Login to View]
[Sep 22, 2017]


Old WordPress inbuilt themes by [Not Shown, Login to View]
[Sep 22, 2017]


how can i put html text and html tag into the notepad by [Not Shown, Login to View]
[Sep 18, 2017]


change from .blogspot.com to .com by [Not Shown, Login to View]
[Sep 17, 2017]


HTML code for Menu Buttons by [Not Shown, Login to View]
[Sep 17, 2017]


Buying Facebook group for traffic by [Not Shown, Login to View]
[Sep 16, 2017]


MBE 104_7_Building a Forum. by [Not Shown, Login to View]
[Sep 16, 2017]


Web Design Review by [Not Shown, Login to View]
[Sep 14, 2017]


Blogspot Label or page? by [Not Shown, Login to View]
[Sep 13, 2017]


Adding HTML Code to Blogspot by [Not Shown, Login to View]
[Sep 13, 2017]


My traffic sources by [Not Shown, Login to View]
[Sep 13, 2017]


Google Keyword Tool Asking for card details by [Not Shown, Login to View]
[Sep 04, 2017]


Alternative way to buy a domain and host by [Not Shown, Login to View]
[Aug 28, 2017]


The number of times to post new content in a blog by [Not Shown, Login to View]
[Aug 27, 2017]


Problem on Adding widget to feedburner by [Not Shown, Login to View]
[Aug 27, 2017]


wer to get good website content by [Not Shown, Login to View]
[Aug 24, 2017]


Relevance of my blog name to making money by [Not Shown, Login to View]
[Aug 24, 2017]


INSECURE PASSWORD WARNING by [Not Shown, Login to View]
[Aug 23, 2017]

Author Topic: Crawler and indexing and robots.txt  (Read 755 times)

0 Members and 1 Guest are viewing this topic.

Offline [Not Shown, Login to View]

  • Level 1 (Infant)
  • *
  • Posts: 38
  • Respect: +4
  • Gender: Male
  • Location: Osun state (osogbo)
  • 1st Chamber
  • My Rank: 0
Crawler and indexing and robots.txt
« on: Mar 31, 2013 »
0
 Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the robots file in text format and select from 'custom robot header tags'. Thanks



Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 337
  • Respect: +81
  • Gender: Female
  • Location: Port Harcourt
  • My Rank: 38
    • Chioma Andy's Blog
Re: Crawler and indexing
« Reply #1 on: Apr 01, 2013 »
0
if it is the one i know in Blogger, then i will advise that you do not temper with that area at all except you are well grounded in HTML.
Doing so will be putting your blog in danger.
for your daily scoop on Entertainment, News, and much more- You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 399
  • Respect: +42
  • Gender: Male
  • Location: Port Harcourt, Nigeria
  • You Won't Shrink if you can think.
  • My Rank: 61
    • http://hotbusinesslink.com
Re: Crawler and indexing
« Reply #2 on: Apr 01, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks



Addition to Chimummy have said, you don't have anything to do with the crawler and indexing in your  blog if you don't have any idea of HTML code.

or what exactly are you trying to do?
You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 4 (Dedicated)
  • ******
  • Posts: 1056
  • Respect: +267
  • Gender: Male
  • Location: Ibadan, Oyo State of Nigeria
  • 1st Chamber
  • My Rank: 86
Re: Crawler and indexing
« Reply #3 on: Apr 03, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks


@ Sunelpal3398 -  You should be guided accordingly.
Please don't  tamper with crawler and indexing if you are not
expert in HTML code.

Best regards,

Aare MacFally
Knowledge Is Power – Seek For It

Offline [Not Shown, Login to View]

  • Administrator
  • Level: Mentor
  • ******
  • Posts: 259671
  • Respect: +7996
  • Gender: Male
  • Location: Benin City
  • 18th Chamber
  • My Rank: 85
Re: Crawler and indexing
« Reply #4 on: Apr 12, 2013 »
0
Those settings and the robots.txt file are used to tell search engines what pages or links not to index. In most cases you do not need to change anything here so just as everyone else have suggested, do not change any of those settings.
Leave it for God, don't worry yourself. Leave it for God, don't cry no more.

 

Related Topics

  Subject / Started by Replies Last post
2 Replies
411 Views
Last post Feb 09, 2015
by [Not Shown, Login to View]
Google Indexing is Taking too long

Started by [Not Shown, Login to View] General Questions

3 Replies
571 Views
Last post Jan 26, 2016
by [Not Shown, Login to View]

TinyPortal © 2005-2011
SimplePortal 2.3.5 © 2008-2012, SimplePortal