!!

Welcome Guest

You are viewing this forum as a guest therefore You are Not Allowed to Post and Reply and You are not allowed to view links. Register or Login

collapse

* Search


* Recent Replies

Website Showcase - Drop Your Website Link(s) Here by [Not Shown, Login to View]
[Sep 19, 2018]


Site contributor click in Google Ads by [Not Shown, Login to View]
[Sep 19, 2018]


How to Apply for Payoneer Card and US Payment Service to Receive Amazon & others by [Not Shown, Login to View]
[Sep 19, 2018]


Ads plugins by [Not Shown, Login to View]
[Sep 14, 2018]


European Union laws by [Not Shown, Login to View]
[Sep 14, 2018]


price for a web design project by [Not Shown, Login to View]
[Sep 12, 2018]


my first website online by [Not Shown, Login to View]
[Sep 11, 2018]


WordPress on whogohost by [Not Shown, Login to View]
[Sep 07, 2018]


User ID Pageviews Plugin by [Not Shown, Login to View]
[Sep 07, 2018]


facebook ads by [Not Shown, Login to View]
[Sep 07, 2018]


How to Start Amazon affiliate marketing by [Not Shown, Login to View]
[Sep 07, 2018]


Possibility of Monetizing YouTube using a Nigerian postal address,etc ? by [Not Shown, Login to View]
[Sep 07, 2018]


Can I Build an Ecommerce Site Using Blogger? by [Not Shown, Login to View]
[Sep 04, 2018]


Creating public opinion poll on a website by [Not Shown, Login to View]
[Aug 17, 2018]


Add A Second Admin To Word press Site by [Not Shown, Login to View]
[Aug 17, 2018]


Google page ranking discontinued. by [Not Shown, Login to View]
[Aug 17, 2018]


Amazon registration in becoming an affiliate 2016 by [Not Shown, Login to View]
[Aug 17, 2018]


How to become a money maker agent by [Not Shown, Login to View]
[Aug 10, 2018]


Adding Widget to Feedburner by [Not Shown, Login to View]
[Aug 02, 2018]


Am sorry for my long break,am happy am back by [Not Shown, Login to View]
[Jul 18, 2018]


Another Course Update - Introducing Fast Track M.O.B by [Not Shown, Login to View]
[Jul 17, 2018]


Pop up ads wordpress plugin by [Not Shown, Login to View]
[Jul 14, 2018]


Information on Google Adwords by [Not Shown, Login to View]
[Jul 13, 2018]


Can I embed Images in my Blog Along With Adsense? by [Not Shown, Login to View]
[Jul 13, 2018]


Amount of Disc Space for A News Site by [Not Shown, Login to View]
[Jul 13, 2018]


Which Chamber, 1, 2 or 5? by [Not Shown, Login to View]
[Jul 13, 2018]


Amazon Identity Verification by [Not Shown, Login to View]
[Jul 13, 2018]


Building With WordPress: Can't find some plugins by [Not Shown, Login to View]
[Jul 13, 2018]


New Facebook page for every new business idea you want to promote? by [Not Shown, Login to View]
[Jul 13, 2018]


Growing Followers on Social Media by [Not Shown, Login to View]
[Jul 13, 2018]

Author Topic: Crawler and indexing and robots.txt  (Read 1135 times)

0 Members and 1 Guest are viewing this topic.

Offline [Not Shown, Login to View]

  • Level 1 (Infant)
  • *
  • Posts: 38
  • Respect: +4
  • Gender: Male
  • Location: Osun state (osogbo)
  • 1st Chamber
  • My Rank: 0
Crawler and indexing and robots.txt
« on: Mar 31, 2013 »
0
 Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the robots file in text format and select from 'custom robot header tags'. Thanks



Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 340
  • Respect: +81
  • Gender: Female
  • Location: Port Harcourt
  • My Rank: 40
    • Chioma Andy's Blog
Re: Crawler and indexing
« Reply #1 on: Apr 01, 2013 »
0
if it is the one i know in Blogger, then i will advise that you do not temper with that area at all except you are well grounded in HTML.
Doing so will be putting your blog in danger.
for your daily scoop on Entertainment, News, and much more- You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 399
  • Respect: +42
  • Gender: Male
  • Location: Port Harcourt, Nigeria
  • You Won't Shrink if you can think.
  • My Rank: 61
    • http://hotbusinesslink.com
Re: Crawler and indexing
« Reply #2 on: Apr 01, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks



Addition to Chimummy have said, you don't have anything to do with the crawler and indexing in your  blog if you don't have any idea of HTML code.

or what exactly are you trying to do?
You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 4 (Dedicated)
  • ******
  • Posts: 1056
  • Respect: +267
  • Gender: Male
  • Location: Ibadan, Oyo State of Nigeria
  • 1st Chamber
  • My Rank: 88
Re: Crawler and indexing
« Reply #3 on: Apr 03, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks


@ Sunelpal3398 -  You should be guided accordingly.
Please don't  tamper with crawler and indexing if you are not
expert in HTML code.

Best regards,

Aare MacFally
Knowledge Is Power – Seek For It

Offline [Not Shown, Login to View]

  • Administrator
  • Level: Mentor
  • ******
  • Posts: 259816
  • Respect: +8013
  • Gender: Male
  • Location: Benin City
  • 18th Chamber
  • My Rank: 97
Re: Crawler and indexing
« Reply #4 on: Apr 12, 2013 »
0
Those settings and the robots.txt file are used to tell search engines what pages or links not to index. In most cases you do not need to change anything here so just as everyone else have suggested, do not change any of those settings.
Leave it for God, don't worry yourself. Leave it for God, don't cry no more.

 

Related Topics

  Subject / Started by Replies Last post
2 Replies
626 Views
Last post Feb 09, 2015
by [Not Shown, Login to View]
Google Indexing is Taking too long

Started by [Not Shown, Login to View] General Questions

3 Replies
923 Views
Last post Jan 26, 2016
by [Not Shown, Login to View]

TinyPortal © 2005-2011
SimplePortal 2.3.5 © 2008-2012, SimplePortal