语源科技BlogJava-waterye

语源科技BlogJava-wateryehttp://www.blogjava.net/waterye/zh-cnMon, 27 Apr 2026 21:29:57 GMTMon, 27 Apr 2026 21:29:57 GMT60使用rsync+ssh同步n个文件http://www.blogjava.net/waterye/archive/2009/12/29/307678.htmlwateryewateryeTue, 29 Dec 2009 12:24:00 GMThttp://www.blogjava.net/waterye/archive/2009/12/29/307678.htmlhttp://www.blogjava.net/waterye/comments/307678.htmlhttp://www.blogjava.net/waterye/archive/2009/12/29/307678.html#Feedback0http://www.blogjava.net/waterye/comments/commentRss/307678.htmlhttp://www.blogjava.net/waterye/services/trackbacks/307678.html

waterye 2009-12-29 20:24 发表评论

]]>mysql备份http://www.blogjava.net/waterye/archive/2009/12/29/307677.htmlwateryewateryeTue, 29 Dec 2009 12:17:00 GMThttp://www.blogjava.net/waterye/archive/2009/12/29/307677.htmlhttp://www.blogjava.net/waterye/comments/307677.htmlhttp://www.blogjava.net/waterye/archive/2009/12/29/307677.html#Feedback0http://www.blogjava.net/waterye/comments/commentRss/307677.htmlhttp://www.blogjava.net/waterye/services/trackbacks/307677.html 参考mysql docs
2. 定期在slave上使用shell,mysqldump,sftp,crontab进行永久备份

#!/bin/sh
export d=`date +%Y%m%d%H%M%S`
mkdir -p /data/dbbak/baktables/$d
for i in `echo "show tables" | mysql -u bak -ppassword db|grep -v Tables`;
do
echo $i; mysqldump --add-drop-table --allow-keywords -q -a -c -u bak -ppasswod mbook_hd $i > backup/$d/$i.sql
done

tar czf backup/$d.tar.gz backup/$d/
rm -rf backup/$d/

lftp -e "cd /dbbak/; mput -c $d.tar.gz; quit" -u bak,password sftp://192.168.0.138

参考http://ocaoimh.ie/simple-mysql-backup/
10G级别的可以每天作一次备份，100G级别看带宽和硬盘，T级没有经验

waterye 2009-12-29 20:17 发表评论

]]>检查哪些文件以\n结束http://www.blogjava.net/waterye/archive/2009/02/19/255660.htmlwateryewateryeThu, 19 Feb 2009 14:33:00 GMThttp://www.blogjava.net/waterye/archive/2009/02/19/255660.htmlhttp://www.blogjava.net/waterye/comments/255660.htmlhttp://www.blogjava.net/waterye/archive/2009/02/19/255660.html#Feedback0http://www.blogjava.net/waterye/comments/commentRss/255660.htmlhttp://www.blogjava.net/waterye/services/trackbacks/255660.html#!/usr/bin/env python
import string, os, sys

dir = '/home/waterye/works/'

files = os.listdir(dir)
for f in files:
    if not os.path.isfile(dir+os.sep+f): continue
    linecount = 0
    fp = open(dir+os.sep+f,'r')
    for line in fp:
        linecount += 1
    fp = open(dir+os.sep+f,'r')
    for i,line in enumerate(fp):
        if (i==linecount-1 and line.endswith('\n')):
            print f
            print "--------------------------------"
* bash太难理解，还是用py看上去舒服，虽然不专业，但能完成任务就行

waterye 2009-02-19 22:33 发表评论

]]>perl millisecondshttp://www.blogjava.net/waterye/archive/2008/12/04/244469.htmlwateryewateryeThu, 04 Dec 2008 15:33:00 GMThttp://www.blogjava.net/waterye/archive/2008/12/04/244469.htmlhttp://www.blogjava.net/waterye/comments/244469.htmlhttp://www.blogjava.net/waterye/archive/2008/12/04/244469.html#Feedback0http://www.blogjava.net/waterye/comments/commentRss/244469.htmlhttp://www.blogjava.net/waterye/services/trackbacks/244469.html"perldoc DateTime" would have told you how to format milliseconds.

  use DateTime;
  use Time::HiRes qw(time);
  my $dt = DateTime->from_epoch( epoch => time() );
  print $dt->strftime('%Y-%m-%d %H-%M-%S-%3N'), "\n";

* sudo apt-get install libdatetime-perl

perl真麻烦

waterye 2008-12-04 23:33 发表评论

]]>memcached java clienthttp://www.blogjava.net/waterye/archive/2008/10/31/237880.htmlwateryewateryeFri, 31 Oct 2008 11:55:00 GMThttp://www.blogjava.net/waterye/archive/2008/10/31/237880.htmlhttp://www.blogjava.net/waterye/comments/237880.htmlhttp://www.blogjava.net/waterye/archive/2008/10/31/237880.html#Feedback2http://www.blogjava.net/waterye/comments/commentRss/237880.htmlhttp://www.blogjava.net/waterye/services/trackbacks/237880.html 2. http://code.google.com/p/spymemcached/ v2.2

a. 使用whalin版会导致File Descriptor leak,而使用spy版则不会，原因是whalin版没有使用selector管理socketchannel.

Thread.sleep(1000 * 30);
System.out.println("begin

");

        Selector selector = null;
        SocketChannel channel = null;
        try {
            String host = "192.168.0.74";
            int port = 11211;
            int timeout = 1000 * 60;

            selector = Selector.open();
            channel = SocketChannel.open();
            channel.configureBlocking(false);

            channel.connect(new InetSocketAddress(host, port));
            channel.register(selector, channel.validOps());

            try {
                selector.select();
            } catch (IOException e) {
                e.printStackTrace();
            }

            Iterator it = selector.selectedKeys().iterator();
            int i = 0;
            while (it.hasNext()) {
                i++;
                System.out.println(i);
                SelectionKey selKey = (SelectionKey) it.next();
                it.remove();

                try {
                    processSelectionKey(selKey);
                } catch (IOException e) {
                    e.printStackTrace();
                    selKey.cancel();
                }
            }

            System.out.println("unclose

");
            Thread.sleep(1000 * 30);
        } catch (Exception e) {
            e.printStackTrace();
        } finally {
            if (channel != null && channel.isOpen()) {
                try {
                    channel.close();
                } catch (Exception e) {
                    e.printStackTrace();
                }
            }
            if (selector!=null) {
                selector.close();      // not fd leak
            }
        }

        System.out.println("end

");
Thread.sleep(1000 * 30 * 1);

通过lsof -p pid | grep pipe可以观察是否有fd leak.

b. w版set 1000000 object 需要600s左右，s版只需150s左右

waterye 2008-10-31 19:55 发表评论

]]>cacti-memcachedhttp://www.blogjava.net/waterye/archive/2008/10/21/235571.htmlwateryewateryeMon, 20 Oct 2008 16:50:00 GMThttp://www.blogjava.net/waterye/archive/2008/10/21/235571.htmlhttp://www.blogjava.net/waterye/comments/235571.htmlhttp://www.blogjava.net/waterye/archive/2008/10/21/235571.html#Feedback0http://www.blogjava.net/waterye/comments/commentRss/235571.htmlhttp://www.blogjava.net/waterye/services/trackbacks/235571.html total_items:2002344 get_hits:3 uptime:50291 cmd_get:3 time:1224521129 bytes:58888890 curr_connections:1 connection_structures:8 bytes_written:16167008 limit_maxbytes:402653184 cmd_set:2002344 curr_items:1000000 rusage_user:101.730357 get_misses:0 rusage_system:199.092442 bytes_read:63849044 total_connections:314

waterye 2008-10-21 00:50 发表评论

]]>ubuntu查看网络流量http://www.blogjava.net/waterye/archive/2008/10/05/232565.htmlwateryewateryeSun, 05 Oct 2008 14:19:00 GMThttp://www.blogjava.net/waterye/archive/2008/10/05/232565.htmlhttp://www.blogjava.net/waterye/comments/232565.htmlhttp://www.blogjava.net/waterye/archive/2008/10/05/232565.html#Feedback3http://www.blogjava.net/waterye/comments/commentRss/232565.htmlhttp://www.blogjava.net/waterye/services/trackbacks/232565.html sudo apt-get install iftop
sudo iftop -i ppp0
2. slurm
sudo apt-get install slurm
slurm -i ppp0
3. vnstat
sudo apt-get install vnstat
sudo chmod o+x /usr/bin/vnstat
sudo chmod o+wx /var/lib/vnstat/
vnstat -u -i ppp0
vnstat -i ppp0
vnstat -l -i ppp0

因为不是server就没有用复杂的mrtg

waterye 2008-10-05 22:19 发表评论

]]>删除最后一行\nhttp://www.blogjava.net/waterye/archive/2008/09/28/231730.htmlwateryewateryeSun, 28 Sep 2008 11:58:00 GMThttp://www.blogjava.net/waterye/archive/2008/09/28/231730.htmlhttp://www.blogjava.net/waterye/comments/231730.htmlhttp://www.blogjava.net/waterye/archive/2008/09/28/231730.html#Feedback0http://www.blogjava.net/waterye/comments/commentRss/231730.htmlhttp://www.blogjava.net/waterye/services/trackbacks/231730.html

#!/usr/bin/env python
import sys

oldfile=sys.argv[1]
newfile=sys.argv[2]
print oldfile,newfile,
print
linecount = 0
str = ''
f = open(oldfile,'r')
for line in f:
    linecount += 1
f = open(oldfile,'r')
for i,line in enumerate(f):
    if (i==linecount-1):
        str += line.replace('\n','')
#        print line.replace('\n','')
    else:
        str += line
#        print line,
#print len(str),str
f2 = open(newfile, 'w')
f2.write(str)
quit()

waterye 2008-09-28 19:58 发表评论

]]>memory infohttp://www.blogjava.net/waterye/archive/2008/09/24/230974.htmlwateryewateryeWed, 24 Sep 2008 11:56:00 GMThttp://www.blogjava.net/waterye/archive/2008/09/24/230974.htmlhttp://www.blogjava.net/waterye/comments/230974.htmlhttp://www.blogjava.net/waterye/archive/2008/09/24/230974.html#Feedback0http://www.blogjava.net/waterye/comments/commentRss/230974.htmlhttp://www.blogjava.net/waterye/services/trackbacks/230974.htmlfree -lmt
cat /proc/meminfo
dmesg |grep [mM][eE][mM]
cat /proc/pid/status

waterye 2008-09-24 19:56 发表评论

]]>rm many file directoryhttp://www.blogjava.net/waterye/archive/2008/09/22/230498.htmlwateryewateryeMon, 22 Sep 2008 12:06:00 GMThttp://www.blogjava.net/waterye/archive/2008/09/22/230498.htmlhttp://www.blogjava.net/waterye/comments/230498.htmlhttp://www.blogjava.net/waterye/archive/2008/09/22/230498.html#Feedback0http://www.blogjava.net/waterye/comments/commentRss/230498.htmlhttp://www.blogjava.net/waterye/services/trackbacks/230498.html
2. nice -n 19 rm -rf directory

3. ls | xargs rm

4. find . -mtime +90 -type f -exec rm -v {} \;

采用第四种最好，把一些旧的文件先删除

waterye 2008-09-22 20:06 发表评论

]]>