!!

Welcome Guest

You are viewing this forum as a guest therefore You are Not Allowed to Post and Reply and You are not allowed to view links. Register or Login

collapse

* Search


* Recent Replies

General questions by [Not Shown, Login to View]
[Today at 05:17 AM]


Happy New Year by [Not Shown, Login to View]
[Yesterday at 09:24 PM]


About the ftp client Filezilla login details by [Not Shown, Login to View]
[Yesterday at 12:52 AM]


How to Do Niche / Keyword Research Without Any Tools by [Not Shown, Login to View]
[Jan 15, 2018]


See What Happen To My Payoneer Card by [Not Shown, Login to View]
[Jan 11, 2018]


Local wordpress or live wordpress?? by [Not Shown, Login to View]
[Jan 09, 2018]


PayPal issues by [Not Shown, Login to View]
[Dec 31, 2017]


Website design issUe by [Not Shown, Login to View]
[Dec 31, 2017]


Facebook Ads Payment by [Not Shown, Login to View]
[Dec 29, 2017]


Running a PPC Campaign in an Non-English Language Country by [Not Shown, Login to View]
[Dec 29, 2017]


Joint venture on a single site by [Not Shown, Login to View]
[Dec 25, 2017]


How to Apply for Payoneer Card and US Payment Service to Receive Amazon & others by [Not Shown, Login to View]
[Dec 16, 2017]


don't have a website but still wants to run the online marketin by [Not Shown, Login to View]
[Dec 09, 2017]


Webhost purchase by [Not Shown, Login to View]
[Dec 09, 2017]


Payoneer Application by [Not Shown, Login to View]
[Dec 09, 2017]


Bing Ads And Google Adwords Payment Methods by [Not Shown, Login to View]
[Dec 07, 2017]


Selling Ebooks At Amazon by [Not Shown, Login to View]
[Nov 26, 2017]


facebook fan page by [Not Shown, Login to View]
[Nov 26, 2017]


Pay Per Click Fraud. by [Not Shown, Login to View]
[Nov 20, 2017]


Amazon Images/Images from Amazon by [Not Shown, Login to View]
[Nov 19, 2017]


Amazon Tracking of associate IDs Faulty by [Not Shown, Login to View]
[Nov 18, 2017]


how can i put html text and html tag into the notepad by [Not Shown, Login to View]
[Nov 17, 2017]


Direct log in to blogger by [Not Shown, Login to View]
[Nov 15, 2017]


facebook ads by [Not Shown, Login to View]
[Nov 03, 2017]


How to make a 3D E-book Cover (E-Cover)? by [Not Shown, Login to View]
[Nov 01, 2017]


How Can I Change Or Beautify My New YouTube Page by [Not Shown, Login to View]
[Oct 31, 2017]


Any Free Wordpress Theme For uni/poly Portals? by [Not Shown, Login to View]
[Oct 31, 2017]


How long by [Not Shown, Login to View]
[Oct 30, 2017]


How do I continue? by [Not Shown, Login to View]
[Oct 30, 2017]


E-commerce Site by [Not Shown, Login to View]
[Oct 22, 2017]

Author Topic: Crawler and indexing and robots.txt  (Read 822 times)

0 Members and 1 Guest are viewing this topic.

Offline [Not Shown, Login to View]

  • Level 1 (Infant)
  • *
  • Posts: 38
  • Respect: +4
  • Gender: Male
  • Location: Osun state (osogbo)
  • 1st Chamber
  • My Rank: 0
Crawler and indexing and robots.txt
« on: Mar 31, 2013 »
0
 Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the robots file in text format and select from 'custom robot header tags'. Thanks



Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 340
  • Respect: +81
  • Gender: Female
  • Location: Port Harcourt
  • My Rank: 40
    • Chioma Andy's Blog
Re: Crawler and indexing
« Reply #1 on: Apr 01, 2013 »
0
if it is the one i know in Blogger, then i will advise that you do not temper with that area at all except you are well grounded in HTML.
Doing so will be putting your blog in danger.
for your daily scoop on Entertainment, News, and much more- You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 399
  • Respect: +42
  • Gender: Male
  • Location: Port Harcourt, Nigeria
  • You Won't Shrink if you can think.
  • My Rank: 61
    • http://hotbusinesslink.com
Re: Crawler and indexing
« Reply #2 on: Apr 01, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks



Addition to Chimummy have said, you don't have anything to do with the crawler and indexing in your  blog if you don't have any idea of HTML code.

or what exactly are you trying to do?
You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 4 (Dedicated)
  • ******
  • Posts: 1056
  • Respect: +267
  • Gender: Male
  • Location: Ibadan, Oyo State of Nigeria
  • 1st Chamber
  • My Rank: 86
Re: Crawler and indexing
« Reply #3 on: Apr 03, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks


@ Sunelpal3398 -  You should be guided accordingly.
Please don't  tamper with crawler and indexing if you are not
expert in HTML code.

Best regards,

Aare MacFally
Knowledge Is Power – Seek For It

Offline [Not Shown, Login to View]

  • Administrator
  • Level: Mentor
  • ******
  • Posts: 259722
  • Respect: +7997
  • Gender: Male
  • Location: Benin City
  • 18th Chamber
  • My Rank: 89
Re: Crawler and indexing
« Reply #4 on: Apr 12, 2013 »
0
Those settings and the robots.txt file are used to tell search engines what pages or links not to index. In most cases you do not need to change anything here so just as everyone else have suggested, do not change any of those settings.
Leave it for God, don't worry yourself. Leave it for God, don't cry no more.

 

Related Topics

  Subject / Started by Replies Last post
2 Replies
445 Views
Last post Feb 09, 2015
by [Not Shown, Login to View]
Google Indexing is Taking too long

Started by [Not Shown, Login to View] General Questions

3 Replies
611 Views
Last post Jan 26, 2016
by [Not Shown, Login to View]

TinyPortal © 2005-2011
SimplePortal 2.3.5 © 2008-2012, SimplePortal