I have no idea why Baidu spider didn't follow robot.txt rules, finally I use iptables rules to block in and out ip address.
[Iptable rules]
iptables -p tcp -I INPUT -j DROP -s 119.63.192.x
iptables -p tcp -I INPUT -j DROP -s 123.125.64.x
iptables -p tcp -I INPUT -j DROP -s 180.76.0.x
iptables -p tcp -I INPUT -j DROP -s 220.181.0.x
[Reference]
http://blog.indeepnight.com/2012/03/how-to-block-web-spider-or-crawler.html
http://tools.dynamicdrive.com/userban/#.UphVwcQW2So
http://www.robotstxt.org/robotstxt.html
https://support.google.com/webmasters/answer/156449?hl=zh-Hant
http://forums.oscommerce.com/topic/382923-baiduspider-using-multiple-user-agents-how-to-stop-them/
http://baike.baidu.com/view/1847001.htm?noadapt=1#4
http://www.weithenn.org/cgi-bin/wiki.pl?Mysql_Apache_PHP-%E9%BB%83%E9%87%91%E6%9E%B6%E7%AB%99%E7%B5%84%E5%90%88#Heading43
I got a task to migrate 3.0.3 version to a new VM, just make a note.
Steps:
1. Install Ubuntu 11.04
2. Modified Sources.list
/etc/apt/sources.list
Replace us.archive.ubuntu.com to old-releases.ubuntu.com
3. Update modules
4. Copy certain folder to apache2 folder
5. Install Webmin
6. Import mysql database by Webmin
7. Modified custom template under ./template/en/custom
8. Rebuild Bugzilla3.0.3
9. Configuration apache and mysql than restart services.
------------------------------------------------------------------------------------------------------
Official document to move Installation
https://wiki.mozilla.org/Bugzilla:Move_Installation
Adding a New Disk Drive to an Ubuntu Linux System
Steps:
1. Install Ubuntu 11.04
2. Modified Sources.list
/etc/apt/sources.list
Replace us.archive.ubuntu.com to old-releases.ubuntu.com
3. Update modules
4. Copy certain folder to apache2 folder
5. Install Webmin
6. Import mysql database by Webmin
7. Modified custom template under ./template/en/custom
8. Rebuild Bugzilla3.0.3
9. Configuration apache and mysql than restart services.
------------------------------------------------------------------------------------------------------
Official document to move Installation
https://wiki.mozilla.org/Bugzilla:Move_Installation
Adding a New Disk Drive to an Ubuntu Linux System
http://www.techotopia.com/index.php/Adding_a_New_Disk_Drive_to_an_Ubuntu_Linux_System
Bugzilla with Gmail
http://rndm-snippets.blogspot.tw/2011/05/bugzilla-issue-tracking-send-mail.html
http://dawood.in/bugzilla-alerts-using-gmail/
Apache2 with mod_evasive to protect DDos attack
http://www.mmncs.com/2011/07/how-to-protect-apache-against-dos-ddos-or-brute-force-attacks-using-mod_evasive-and-mod_security-and-mod_qos-on-linux-ubuntu-11-04/
Webmin install
http://www.ubuntugeek.com/how-to-install-webmin-on-ubuntu-11-04-natty-server.html
Import database through webmin
Bugzilla with Gmail
http://rndm-snippets.blogspot.tw/2011/05/bugzilla-issue-tracking-send-mail.html
http://dawood.in/bugzilla-alerts-using-gmail/
Apache2 with mod_evasive to protect DDos attack
http://www.mmncs.com/2011/07/how-to-protect-apache-against-dos-ddos-or-brute-force-attacks-using-mod_evasive-and-mod_security-and-mod_qos-on-linux-ubuntu-11-04/
Webmin install
http://www.ubuntugeek.com/how-to-install-webmin-on-ubuntu-11-04-natty-server.html
Import database through webmin
http://www.webhostingtalk.com/showthread.php?t=871600
lftp backup
http://ezkuro.blogspot.tw/2007/03/lftp-mirror.html
vsftp install
https://help.ubuntu.com/10.04/serverguide/ftp-server.html
Bugzilla install prerequisites instance
https://wiki.mozilla.org/Bugzilla:Prerequisites#Ubuntu
apache2 mysql-server libappconfig-perl libdate-calc-perl libtemplate-perl libmime-perl build-essential libdatetime-timezone-perl libdatetime-perl libemail-send-perl libemail-mime-perl libemail-mime-modifier-perl libdbi-perl libdbd-mysql-perl libcgi-pm-perl libmath-random-isaac-perl libmath-random-isaac-xs-perl libtext-diff-perl
Optional
apache2-mpm-prefork libapache2-mod-perl2 libapache2-mod-perl2-dev libchart-perl libxml-perl libxml-twig-perl perlmagick libgd-graph-perl libtemplate-plugin-gd-perl libsoap-lite-perl libhtml-scrubber-perl libjson-rpc-perl libdaemon-generic-perl libtheschwartz-perl libtest-taint-perl libauthen-radius-perl libfile-slurp-perl libencode-detect-perl libmodule-build-perl libnet-ldap-perl libauthen-sasl-perl
lftp backup
http://ezkuro.blogspot.tw/2007/03/lftp-mirror.html
vsftp install
https://help.ubuntu.com/10.04/serverguide/ftp-server.html
Bugzilla install prerequisites instance
https://wiki.mozilla.org/Bugzilla:Prerequisites#Ubuntu
apache2 mysql-server libappconfig-perl libdate-calc-perl libtemplate-perl libmime-perl build-essential libdatetime-timezone-perl libdatetime-perl libemail-send-perl libemail-mime-perl libemail-mime-modifier-perl libdbi-perl libdbd-mysql-perl libcgi-pm-perl libmath-random-isaac-perl libmath-random-isaac-xs-perl libtext-diff-perl
Optional
apache2-mpm-prefork libapache2-mod-perl2 libapache2-mod-perl2-dev libchart-perl libxml-perl libxml-twig-perl perlmagick libgd-graph-perl libtemplate-plugin-gd-perl libsoap-lite-perl libhtml-scrubber-perl libjson-rpc-perl libdaemon-generic-perl libtheschwartz-perl libtest-taint-perl libauthen-radius-perl libfile-slurp-perl libencode-detect-perl libmodule-build-perl libnet-ldap-perl libauthen-sasl-perl
[Problem]
In bugzilla 3.0.3, when you using IE11 to search bugs, it will pop-up message as follow:
WARNING: YOUR BROWSER DOESN'T SUPPORT THIS SERVER-PUSH TECHNOLOGY. --------- =_aaaaaaaaaa0 Content-Type: text/html
...................
In Bugzilla 4.4, when you using IE 11 to search bugs, it sent the results back to IE11, which offered to save it to a file named buglist.cgi
In bugzilla 3.0.3, when you using IE11 to search bugs, it will pop-up message as follow:
WARNING: YOUR BROWSER DOESN'T SUPPORT THIS SERVER-PUSH TECHNOLOGY. --------- =_aaaaaaaaaa0 Content-Type: text/html
...................
In Bugzilla 4.4, when you using IE 11 to search bugs, it sent the results back to IE11, which offered to save it to a file named buglist.cgi
[Root Cause]
Bugzilla use HTML 4.01 Transitional, not HTML 5, and so doesn't support Server-Sent Events which is part of HTML5. And IE11 gets multipart/x-mixed-replace since it not follow older versions of IE.
[Solution]
Since IE 11 's string contains 'like Gecko', so add "Tridents" to detect IE.
Modified file buglist.cgi
Bugzilla 3.0.3 / Bugzilla 4.4
- && $ENV{'HTTP_USER_AGENT'} !~ /WebKit/
+ && $ENV{'HTTP_USER_AGENT'} !~ /(?:WebKit|Trident)/
[Reference]
Bugzilla
Server-sent Events
IE 11 capability
In this Moon festival, I'm practice to modified iOS game pocket planes 1.1.7, and it works on my iOS 7 environment with iPhone5
--------------------------------------------------------------------------------------------------
[Steps]
1. Find database position it under : /Documents/playerData/user-playerData.db
[DB]
/Documents/playerData/user-playerData.db
[Table]
playerMeta
[Columns]
b: => Money
c: => Gold
[Table]
planes
[Columns]
plane_info_id :=> Plane which you have Ex: 24 = = KANGEAROO-M
upgrades: => e: Full Tank, t: Engine, w: Carbon Fiber
[Table]
parts
[Columns]
plane_info_id: => Plane which you have Ex:7== BIRCHCRAFT-P
part_idx: 1: Engine ,2: Body,0: Control
--------------------------------------------------------------------------------------------------
[Steps]
1. Find database position it under : /Documents/playerData/user-playerData.db
2. Use SQLite browser to open .db
3. Modified database, you can refer to follow instruction:
[DB]
/Documents/playerData/user-playerData.db
[Table]
playerMeta
[Columns]
b: => Money
c: => Gold
[Table]
planes
[Columns]
plane_info_id :=> Plane which you have Ex: 24 = = KANGEAROO-M
upgrades: => e: Full Tank, t: Engine, w: Carbon Fiber
[Table]
parts
[Columns]
plane_info_id: => Plane which you have Ex:7== BIRCHCRAFT-P
part_idx: 1: Engine ,2: Body,0: Control
#! /bin/bash
U=userid
P=password
insert="insert into table_name(columns1, columns2) values (values1, values2)"
/usr/bin/mysql -u$U -p$P >> eof
$insert
>> sh ***.sh
----------------------------------------------------------------------------------------
table count
/usr/bin/mysql -u$U -p$P >> eof
$insert
>> sh ***.sh
----------------------------------------------------------------------------------------
table count
select count(*) from table_name
table numbers
可用 default value
[Reference]
backup: # mysqldump -u root -p[root_password] [database_name] > dumpfilename.sql
restore:# mysql -u root -p[root_password] [database_name] < dumpfilename.sql
[Reference]
