!!

Welcome Guest

You are viewing this forum as a guest therefore You are Not Allowed to Post and Reply and You are not allowed to view links. Register or Login

collapse

* Search


* Recent Replies

Increase in Adsense Earning by [Not Shown, Login to View]
[Yesterday at 09:23 PM]


my website is live now by [Not Shown, Login to View]
[Feb 15, 2019]


Website Showcase - Drop Your Website Link(s) Here by [Not Shown, Login to View]
[Feb 13, 2019]


MoneyMaker 2.0 is Ready!!! by [Not Shown, Login to View]
[Feb 13, 2019]


Wanted: Freelance Writers For Amazon Gift Ideas Articles (N750 Naira Per Article by [Not Shown, Login to View]
[Feb 11, 2019]


Lists Of Affiliate programs you can Promote as a Nigerian by [Not Shown, Login to View]
[Feb 10, 2019]


How to Promote Your MoneyMaker Link and Code Using the PLR EBook by [Not Shown, Login to View]
[Feb 10, 2019]


Please i Want a cross check on my website and ready for adenese approval by [Not Shown, Login to View]
[Feb 10, 2019]


Video Editing Softwares to Edit Videos Before Posting to Youtube by [Not Shown, Login to View]
[Jan 31, 2019]


Android Application Builder by [Not Shown, Login to View]
[Jan 31, 2019]


Google Adsense Identity Confirmation by [Not Shown, Login to View]
[Jan 31, 2019]


My Blog is Live! by [Not Shown, Login to View]
[Jan 28, 2019]


Website hosting by [Not Shown, Login to View]
[Jan 26, 2019]


How to get web design client by [Not Shown, Login to View]
[Jan 11, 2019]


compliments of the season by [Not Shown, Login to View]
[Jan 09, 2019]


Wordpress post to facebook page automation by [Not Shown, Login to View]
[Dec 20, 2018]


How to Set Up Display Advertising in Google Adword by [Not Shown, Login to View]
[Dec 17, 2018]


The Most Reliable Place To Buy Bitcoin in Nigeria by [Not Shown, Login to View]
[Nov 12, 2018]


How Can I Reset My Password On Windows 8, I forgot My Password? by [Not Shown, Login to View]
[Nov 06, 2018]


Creation of a Wordpress site that will allow users to login by [Not Shown, Login to View]
[Nov 05, 2018]


How to Change Site URL to Mobile Version by [Not Shown, Login to View]
[Nov 05, 2018]


Possibility of Monetizing YouTube using a Nigerian postal address,etc ? by [Not Shown, Login to View]
[Oct 24, 2018]


e-commerce website by [Not Shown, Login to View]
[Oct 19, 2018]


How To Get Web Traffic From Social Media by [Not Shown, Login to View]
[Oct 15, 2018]


Site contributor click in Google Ads by [Not Shown, Login to View]
[Oct 14, 2018]


my first website online by [Not Shown, Login to View]
[Sep 30, 2018]


How to Apply for Payoneer Card and US Payment Service to Receive Amazon & others by [Not Shown, Login to View]
[Sep 19, 2018]


Ads plugins by [Not Shown, Login to View]
[Sep 14, 2018]


European Union laws by [Not Shown, Login to View]
[Sep 14, 2018]


price for a web design project by [Not Shown, Login to View]
[Sep 12, 2018]

Author Topic: Crawler and indexing and robots.txt  (Read 1285 times)

0 Members and 1 Guest are viewing this topic.

Offline [Not Shown, Login to View]

  • Level 1 (Infant)
  • *
  • Posts: 38
  • Respect: +4
  • Gender: Male
  • Location: Osun state (osogbo)
  • 1st Chamber
  • My Rank: 0
Crawler and indexing and robots.txt
« on: Mar 31, 2013 »
0
 Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the robots file in text format and select from 'custom robot header tags'. Thanks



Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 341
  • Respect: +81
  • Gender: Female
  • Location: Port Harcourt
  • My Rank: 40
    • Chioma Andy's Blog
Re: Crawler and indexing
« Reply #1 on: Apr 01, 2013 »
0
if it is the one i know in Blogger, then i will advise that you do not temper with that area at all except you are well grounded in HTML.
Doing so will be putting your blog in danger.
for your daily scoop on Entertainment, News, and much more- You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 3 (Regular)
  • ******
  • Posts: 401
  • Respect: +42
  • Gender: Male
  • Location: Port Harcourt, Nigeria
  • You Won't Shrink if you can think.
  • My Rank: 61
    • http://hotbusinesslink.com
Re: Crawler and indexing
« Reply #2 on: Apr 01, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks



Addition to Chimummy have said, you don't have anything to do with the crawler and indexing in your  blog if you don't have any idea of HTML code.

or what exactly are you trying to do?
You are not allowed to view links. Register or Login

Offline [Not Shown, Login to View]

  • Forum Guide
  • Level 4 (Dedicated)
  • ******
  • Posts: 1056
  • Respect: +270
  • Gender: Male
  • Location: Ibadan, Oyo State of Nigeria
  • 1st Chamber
  • My Rank: 88
Re: Crawler and indexing
« Reply #3 on: Apr 03, 2013 »
0
You are not allowed to view links. Register or Login
Boss, what is the function of crawler and indexing? Also, how can i fill it in my blogger, bcos, i was warned not to play with it. So, to add the rebots file in text format and select from 'custom rebot header tags'. Thanks


@ Sunelpal3398 -  You should be guided accordingly.
Please don't  tamper with crawler and indexing if you are not
expert in HTML code.

Best regards,

Aare MacFally
Knowledge Is Power – Seek For It

Offline [Not Shown, Login to View]

  • Administrator
  • Level: Mentor
  • ******
  • Posts: 259839
  • Respect: +8025
  • Gender: Male
  • Location: Benin City
  • 18th Chamber
  • My Rank: 101
Re: Crawler and indexing
« Reply #4 on: Apr 12, 2013 »
0
Those settings and the robots.txt file are used to tell search engines what pages or links not to index. In most cases you do not need to change anything here so just as everyone else have suggested, do not change any of those settings.
Leave it for God, don't worry yourself. Leave it for God, don't cry no more.

 

Related Topics

  Subject / Started by Replies Last post
2 Replies
790 Views
Last post Feb 09, 2015
by [Not Shown, Login to View]
Google Indexing is Taking too long

Started by [Not Shown, Login to View] General Questions

3 Replies
1144 Views
Last post Jan 26, 2016
by [Not Shown, Login to View]

TinyPortal © 2005-2011
SimplePortal 2.3.5 © 2008-2012, SimplePortal