Use commons-dbutils with hive-jdbc | デバッグライフ

hive-jdbcと一緒にcommons-dbutilsを使う場合。

環境
DbUtilsでgetParameterMetaDataの呼び出しをスキップ
参考リンク

環境

commons-dbutils 1.6
hive-jdbc-1.1.0-cdh5.7.1

DbUtilsでgetParameterMetaDataの呼び出しをスキップ

hive-jdbcと一緒にcommons-dbutilsを使う場合、hive-jdbcではjava.sql.PreparedStatement#getParameterMetaData()をサポートしていない（上記環境でのバージョン）ので、以下のようにQueryRunnerの初期化時にgetParameterMetaDataをサポートしていない旨を渡してあげる必要があります。

package sample;

import java.sql.Connection;
import java.sql.DriverManager;
import java.util.List;

import org.apache.commons.dbutils.QueryRunner;
import org.apache.commons.dbutils.ResultSetHandler;
import org.apache.commons.dbutils.handlers.ArrayListHandler;

public class HiveJdbcTool {
	static final String HIVE_URI = "jdbc:hive2://localhost:10000/default";

	static {
		try {
			Class.forName("org.apache.hive.jdbc.HiveDriver");
		} catch (ClassNotFoundException e) {
			throw new RuntimeException(e);
		}
	}
	public static void main(String[] args) throws Exception {
		try (Connection conn = DriverManager.getConnection(HIVE_URI, "hive", "")) {
			// "true" indicates that JDBC does not support "getParameterMetaData()" method.
			QueryRunner runner = new QueryRunner(true);
			ResultSetHandler<List<Object[]>> rsh = new ArrayListHandler();
			List<Object[]> results = runner.query(conn, "show databases", rsh);
			results.stream()
			  .map(columns -> columns[0])
			  .forEach(System.out::println);
		}
	}
}

package sample;

import java.sql.Connection;

import java.sql.DriverManager;

import java.util.List;

import org.apache.commons.dbutils.QueryRunner;

import org.apache.commons.dbutils.ResultSetHandler;

import org.apache.commons.dbutils.handlers.ArrayListHandler;

public class HiveJdbcTool {

static final String HIVE_URI = "jdbc:hive2://localhost:10000/default";

static {

try {

Class.forName("org.apache.hive.jdbc.HiveDriver");

} catch (ClassNotFoundException e) {

throw new RuntimeException(e);

}

public static void main(String[] args) throws Exception {

try (Connection conn = DriverManager.getConnection(HIVE_URI, "hive", "")) {

// "true" indicates that JDBC does not support "getParameterMetaData()" method.

QueryRunner runner = new QueryRunner(true);

ResultSetHandler<List<Object[]>> rsh = new ArrayListHandler();

List<Object[]> results = runner.query(conn, "show databases", rsh);

results.stream()

.map(columns -> columns[0])

.forEach(System.out::println);

}

以下は、org.apache.commons.dbutils.AbstractQueryRunner#fillStatementの呼び出し部分で、QueryRunner#queryメソッドの内部で呼ばれます。

...
    public void fillStatement(PreparedStatement stmt, Object... params)
            throws SQLException {

        // check the parameter count, if we can
        ParameterMetaData pmd = null;
        if (!pmdKnownBroken) { // trueでスキップ
            pmd = stmt.getParameterMetaData();
            int stmtCount = pmd.getParameterCount();
            int paramsCount = params == null ? 0 : params.length;

            if (stmtCount != paramsCount) {
                throw new SQLException("Wrong number of parameters: expected "
                        + stmtCount + ", was given " + paramsCount);
            }
        }
...

...

public void fillStatement(PreparedStatement stmt, Object... params)

throws SQLException {

// check the parameter count, if we can

ParameterMetaData pmd = null;

if (!pmdKnownBroken) { // trueでスキップ

pmd = stmt.getParameterMetaData();

int stmtCount = pmd.getParameterCount();

int paramsCount = params == null ? 0 : params.length;

if (stmtCount != paramsCount) {

throw new SQLException("Wrong number of parameters: expected "

+ stmtCount + ", was given " + paramsCount);

}

...

pmdKnownBrokenがtrueの場合はパラメータ数のチェック処理がスキップされます。QueryRunnerの初期化時に該当変数にtrueを指定しなかった場合、hive-jdbcではgetParameterMetaDataの呼び出しで例外がスローされ以下のようなエラーが表示されます。

Exception in thread "main" java.sql.SQLException: Method not supported Query: show databases Parameters: []
	at org.apache.commons.dbutils.AbstractQueryRunner.rethrow(AbstractQueryRunner.java:392)
	at org.apache.commons.dbutils.QueryRunner.query(QueryRunner.java:351)
	at org.apache.commons.dbutils.QueryRunner.query(QueryRunner.java:226)
	at sample.HiveJdbcTool.main(HiveJdbcTool.java:25)

Exception in thread "main" java.sql.SQLException: Method not supported Query: show databases Parameters: []

at org.apache.commons.dbutils.AbstractQueryRunner.rethrow(AbstractQueryRunner.java:392)

at org.apache.commons.dbutils.QueryRunner.query(QueryRunner.java:351)

at org.apache.commons.dbutils.QueryRunner.query(QueryRunner.java:226)

at sample.HiveJdbcTool.main(HiveJdbcTool.java:25)

参考リンク

https://commons.apache.org/proper/commons-dbutils/apidocs/index.html
https://issues.apache.org/jira/browse/HIVE-6992
https://github.com/apache/hive/blob/master/jdbc/src/java/org/apache/hive/jdbc/HivePreparedStatement.java#L209