2007年2月17日 #

Unit-testing Hibernate with HsqlDB

The Motivation

I've used lots of methods to transform data between databases and object code. From hand-coded SQL to JDO to EJB. I've never found a method I liked particularly well. This distaste has become especially acute since adopting test-driven development (TDD) as a guiding philosophy.

Unit-testing should have as few barriers as possible. For relational databases those barriers range from external dependencies (is the database running?) to speed to keeping the relational schema synchronized with your object model. For these reasons it is vital to keep database access code away from the core object model and to test as much as possible without touching a real database.

This has often led me to one of two patterns. The first is externalizing all data access to domain objects and their relationships to separate classes or interfaces. These are typically data store objects that can retrieve, edit, delete and add domain entities. This is the easiest to mock-out for unit-testing, but tends to leave your domain model objects as data-only objects with little or no related behavior. Ideally access to child records would be directly from the parent object rather than handing the parent object to some third-party class to determine the children.

The other method has been to have the domain objects have access to an interface into the data-mapping layer a la Martin Fowler’s Data Mapper pattern. This has the advantage of pushing object relationships inside the domain model where the object-relational interface can be expressed once. Classes that use the domain model are unaware of the persistence mechanism because it is internalized into the domain model itself. This keeps your code focused on the business problem you are trying to solve and less about the object-relational mapping mechanism.

My current project involves crunching a number of baseball statistics and running simulations with the data. Since the data was already in a relational database it was a chance for me to explore the Hibernate object-relational mapping system. I have been very impressed with Hibernate, but I ran into the problem was trying to insert a layer of indirection while using Hibernate as my data mapper for unit-testing. The extra layer was so flimsy that it felt embarrassing to write it. The real deployed version was simply a pass-through to a Hibernate-specific implementation. Even worse, the mock versions had more complexity in them than the real "production" version simply because they didn't have some of the basic object storage and mapping that came with Hibernate.

I also had enough complex Hibernate query usage that I wanted to unit-test this significat portion of the application. However, testing against a ‘live’ database is a bad idea, because it almost invariably introduces a maintenance nightmare. In addition, since tests are best when they are independent from each other, using the same obvious primary keys in test fixture data means you have to create code to clean the database before each test case, which is a real problem when lots of relationships are involved

By using HSQLDB and Hibernate's powerful schema-generation tool I was able to unit-test the mapping layer of the application and find numerous bugs in my object queries I would not have found as easily by manual testing. With the techniques outlines below I was able unit-test my entire application during development with no compromises in test coverage.

Setting up HSQLDB

I used version of HSQLDB. To use an in-memory version of the database you need to invoke the static loader for the org.hsqldb.jdbcDriver. Then when you get a JDBC connection you use JDBC url such as jdbc:hsqldb:mem:yourdb where 'yourdb' is the name of the in-memory database you want to use.

Since I'm using Hibernate (3.0 beta 4), I hardly ever need to touch real-live JDBC objects. Instead I can let Hibernate do the heavy lifting for me--including automatically creating the database schema from my Hibernate mapping files. Since Hibernate creates its own connection pool it will automatically load the HSQLDB JDBC driver based on the configuration code lives in a class called TestSchema. Below is the static initializer for the class.

 1 public class TestSchema {
 3     static {
 4         Configuration config = new Configuration().
 5             setProperty("hibernate.dialect""org.hibernate.dialect.HSQLDialect").
 6             setProperty("hibernate.connection.driver_class""org.hsqldb.jdbcDriver").
 7             setProperty("hibernate.connection.url""jdbc:hsqldb:mem:baseball").
 8             setProperty("hibernate.connection.username""sa").
 9             setProperty("hibernate.connection.password""").
10             setProperty("hibernate.connection.pool_size""1").
11             setProperty("hibernate.connection.autocommit""true").
12             setProperty("hibernate.cache.provider_class""org.hibernate.cache.HashtableCacheProvider").
13             setProperty("""create-drop").
14             setProperty("hibernate.show_sql""true").
15             addClass(Player.class).
16             addClass(BattingStint.class).
17             addClass(FieldingStint.class).
18             addClass(PitchingStint.class);
20         HibernateUtil.setSessionFactory(config.buildSessionFactory());
21     }

Hibernate provides a number of different ways to configure the framework, including programmatic configuration. The code above sets up the connection pool. Note that the user name 'sa' is required to use HSQLDB's in-memory database. Also be sure to specify a blank as the password. To enable Hibernate's automatic schema generation set the property to 'create-drop'.

Testing In Practice

My project is crunching a bunch of baseball statistics so I add the four classes that I'm mapping ( Player, PitchingStint, BattingStint and FieldingStint). Finally I create a Hibernate SessionFactory and insert it into the HibernateUtil class which simply provides a single access method for my entire application for Hibernate sessions. The code for the HibernateUtil is below:

 1 import org.hibernate.*;
 2 import org.hibernate.cfg.Configuration;
 4 public class HibernateUtil {
 6     private static SessionFactory factory;
 8     public static synchronized Session getSession() {
 9         if (factory == null) {
10             factory = new Configuration().configure().buildSessionFactory();
11         }
12         return factory.openSession();
13     }
15     public static void setSessionFactory(SessionFactory factory) {
16         HibernateUtil.factory = factory;
17     }
18 }

Since all of my code (production code as well as unit-tests) get their Hibernate sessions from the HibernateUtil I can configure it in one place. For unit-tests the first bit of code to access the TestSchema class will invoke the static initializer which will setup Hibernate and inject the test SessionFactory into the HibernateUtil. For production code the SessionFactory will be initialized lazily using the standard hibernate.cfg.xml configuration mechanism.

So what does this look like in the unit-tests? Below is a snippet of a test that checks the the logic for determining what positions a player is eligible to play at for a fantasy baseball league:

 1  public void testGetEligiblePositions() throws Exception {
 2         Player player = new Player("playerId");
 3         TestSchema.addPlayer(player);
 5         FieldingStint stint1 = new FieldingStint("playerId"2004"SEA", Position.CATCHER);
 6         stint1.setGames(20);
 7         TestSchema.addFieldingStint(stint1);
 9         Set<Position> positions = player.getEligiblePositions(2004);
10         assertEquals(1, positions.size());
11         assertTrue(positions.contains(Position.CATCHER));
12     }

I first create a new Player instance and add it to the TestSchema via the addPlayer() method. This step must occur first because the FieldingStint class has a foreign-key relationship to the Player class. If I didn't add this instance first I would get a foreign-key constraint violation when I try to add the FieldingStint. Once the test-fixture is in place I can test the getEligiblePositions() method to see that it retrieves the correct data. Below is the code for the addPlayer() method in the TestSchema. You will notice that Hibernate is used instead of bare-metal JDBC code:
 1 public static void addPlayer(Player player) {
 2         if (player.getPlayerId() == null) {
 3             throw new IllegalArgumentException("No primary key specified");
 4         }
 6         Session session = HibernateUtil.getSession();
 7         Transaction transaction = session.beginTransaction();
 8         try {
 9   , player.getPlayerId());
10             transaction.commit();
11         }
12         finally {
13             session.close();
14         }
15     }

One of the most important things in unit-testing is to keep your test-cases isolated. Since this method still involves a database, you need a way to clean your database prior to each test case. I have four tables in my schema so I wrote a reset() method on the TestSchema that removes all rows from the tables using JDBC. Note because HSQLDB knows about foreign keys, the order in which the tables are deleted is important. Here is the code:

 1 public static void reset() throws SchemaException {
 2         Session session = HibernateUtil.getSession();
 3         try {
 4             Connection connection = session.connection();
 5             try {
 6                 Statement statement = connection.createStatement();
 7                 try {
 8                     statement.executeUpdate("delete from Batting");
 9                     statement.executeUpdate("delete from Fielding");
10                     statement.executeUpdate("delete from Pitching");
11                     statement.executeUpdate("delete from Player");
12                     connection.commit();
13                 }
14                 finally {
15                     statement.close();
16                 }
17             }
18             catch (HibernateException e) {
19                 connection.rollback();
20                 throw new SchemaException(e);
21             }
22             catch (SQLException e) {
23                 connection.rollback();
24                 throw new SchemaException(e);
25             }
26         }
27         catch (SQLException e) {
28             throw new SchemaException(e);
29         }
30         finally {
31             session.close();
32         }
33     }

When bulk deletes become finalized in Hibernate 3.0 we should able to remove this last bit of direct JDBC from our application. Until then we have to get a Connection and issue direct SQL to the database.

Be sure not to close your Connection, closing the Session is sufficient for resource cleanup. Out of habits developed from writing lots of hand-crafted JDBC code, the first version closed the JDBC Connection. Since I configured Hibernate to create a connection pool with only one Connection I completely torpedoed any tests after the first one.Be sure to watch out for this!

Since you can never be sure what state the database may be in when your test class is running (imagine running all of your test cases), you should include database cleanup in your setUp() methods like so:

1 public void setUp() throws Exception {
2         TestSchema.reset();
3     }


Being able to test against a real-live RDBMS without all of the hassles of trying to run tests against your deployed database is essential, even when working with sophisticated O/R mappers like Hibernate. The example I showed here is not exclusive to Hibernate and could probably be made to work with JDO or TopLink, though Hibernate makes this kind of testing particularly easy since it has a built-in schema generation tool. With a setup like the one described above you don't ever have to leave the comfort of your IDE and still have extensive test coverage over your code.

posted @ 2007-03-13 14:05 满山红叶 阅读(327) | 评论 (0)编辑 收藏


l          是一个开放源代码的JAVA 数据库
l          具有标准的SQL 语法和JAVA 接口
l          HSQLDB 可以自由使用和分发
l          非常简洁和快速的
l          具有内存数据库,独立数据库和C/S 数据库三种方式
l          可是在APPLET 中使用
l          索引可以被创建和自动使用
l          支持事务处理
l          允许表关联
l          完整性引用和约束
l          支持JAVA存储过程和函数
l          数据库可以生成SQL脚本
l          使用用户名,密码,访问权限等安全机制
l          可以被JAVA1.1和JAVA2编译
建立在HypersonicSQL基础上的HSQLDB,是一个通用目的的数据库,非常的小,而且易于安装和使用。可以用于APPLETS中 ,测试中,应用系统中。
l          进程内模式(只用在同一个JVM里的应用程序才可以访问数据库)
l          C/S模式(多个计算机/系统可以访问同一个数据库)
C/S 访问模式
这种模式下数据库和应用程序不是运行在同一个JVM进程下,而是有自己独立的进程或者是独立的机器。 不需要客户端程序进入服务器的文件系统。这种模式下的数据库操作模式和一些大的数据库(比如SQL SERVER,ORACLE等)没什么区别的。可以在INTERNET或者INTRANET。
In all Server modes the actual database file name is specified in the Java command that starts the server. This can be the dot "." for all-in-memory operation or the path for the database name
l          SERVER
这种模式下的JDBC URL是:
l          WEBSERVER
l          SERVLET
这种模式和WEBSERVER模式很类似,数据库运行在一个SERVLET里,而SERVLET可以运行在几乎所有的WEBSERVER里。而且和JAVA SERVLETE API兼容(测试环境是J2DK2.1)。这是通过网络直接访问的。如果你的SERVLET不能直接访问这个数据库,就不要使用这种模式。
全内存访问(All-In-Memory )模式
l          在非日志模式下,这种模式稍微快些
l          可以在APPLET下使用
l          用来存储临时数据(应用系统的数据缓存)All-In-Memory
在这种模式下,数据库的改变会写入到硬盘中,这就意味着在数据库启动时,内存里的表会根据他们的数据重新创建。或者说,可以创建表来保存数据,在访问数据库时,只有少量记录时保存在内存里的。可以在创建的时候使用''''CREATE CACHED TABLE''''来代替''''CREATE TABLE''''。从而支持大表(这些表的记录相对于内存来说太大了)。被缓存的表的索引也可以保存到硬盘中。因此,数据库的大小就可以不受到内存大小的限制。进入缓存表要比从内存表里获取数据要慢些。从1.7.0版本开始,支持第三种模式:数据可以存储在文本文件(如CSV格式的文件)中。对应的语句时:''''CREATE TEXT TABLE''''。
l          事务处理
l          并发访问
l          数据库性能优化因素
l          每个statement的传输时间
l          以APPLET方式运行

posted @ 2007-03-13 14:01 满山红叶 阅读(250) | 评论 (0)编辑 收藏

vimtutor 乱码

iconv -f gb2312 /usr/share/vim/vim70/tutor/tutor.zh.euc -t utf-8 > tmp.txt
mv tmp.txt /usr/share/vim/vim70/tutor/tutor.zh.euc

posted @ 2007-02-28 19:06 满山红叶 阅读(207) | 评论 (0)编辑 收藏

ubuntu 6.10 edgy 安装与配置

sudo pppoeconf
(打开连接:pon dsl-provider; 关闭连接:poff dsl-provider)
先备份原有的安装源文件:sudo cp /etc/apt/sources.list /etc/apt/sources.list.bak
修改安装源:sudo vim /etc/apt/sources.list 用下面的源全部代替原来的(电信用户)
deb edgy main restricted universe multiverse
deb edgy-security main restricted universe multiverse
deb edgy-updates main restricted universe multiverse
deb edgy-proposed main restricted universe multiverse
deb edgy-backports main restricted universe multiverse
deb-src edgy main restricted universe multiverse
deb-src edgy-security main restricted universe multiverse
deb-src edgy-updates main restricted universe multiverse
deb-src edgy-proposed main restricted universe multiverse
deb-src edgy-backports main restricted universe multiverse
deb edgy main restricted universe multiverse
sudo apt-get update
sudo apt-get dist-upgrade
sudo apt-get install build-essentia
int main()
   printf("Hello Ubuntu!\n");
   return 0;
$ gcc testc.c -o testc
$ ./testc
Hello Ubuntu!
安装GTK环境只要安装一个 gnome- core-devel就可以了,里面集成了很多其他的包。除此之外还要转一些其他的东西,如libglib2.0-doc、 libgtk2.0-doc帮助文档,devhelp帮助文档查看,glade-gnome、glade-common、glade-doc图形界面设计 等。

sudo apt-get install gnome-core-devel
sudo apt-get install libglib2.0-doc libgtk2.0-doc
sudo apt-get install devhelp
sudo apt-get install glade-gnome glade-common glade-doc

void hello(GtkWidget *widget,gpointer data)
g_print("Hello Ubuntu!\n");
gint delete_event(GtkWidget *widget,GdkEvent *event,gpointer data)
g_print ("delete event occurred\n");
void destroy(GtkWidget *widget,gpointer data)
int main( int argc, char *argv[] )
GtkWidget *window;
GtkWidget *button;
gtk_init (
window=gtk_window_new (GTK_WINDOW_TOPLEVEL);
gtk_signal_connect (GTK_OBJECT(window),"delete_event",GTK_SIGNAL_FUNC(delete_event),NULL);
gtk_signal_connect (GTK_OBJECT (window), "destroy",GTK_SIGNAL_FUNC (destroy), NULL);
gtk_container_set_border_width (GTK_CONTAINER (window), 10);
button = gtk_button_new_with_label ("Hello Ubuntu!");
gtk_signal_connect (GTK_OBJECT (button), "clicked",GTK_SIGNAL_FUNC (hello), NULL);
gtk_signal_connect_object (GTK_OBJECT (button), "clicked",GTK_SIGNAL_FUNC (gtk_widget_destroy),GTK_OBJECT (window));
gtk_container_add (GTK_CONTAINER (window), button);
gtk_widget_show (button);
gtk_widget_show (window);   /*显示一个窗口*/
gtk_main();   /*进入主循环*/
$ gcc gtkhello.c -o gtktest `pkg-config --cflags --libs gtk+-2.0`
$ ./gtktest 
java 开发环境:
 sudo apt-get install sun-java5-jdk
安装完毕之后,选择默认 java:
sudo update-alternatives --config java 
 sudo vim /etc/environment 

posted @ 2007-02-17 14:34 满山红叶 阅读(637) | 评论 (16)编辑 收藏