org.apache.jackrabbit.core.data.db
Class DbDataStore

java.lang.Object
  org.apache.jackrabbit.core.data.db.DbDataStore

All Implemented Interfaces:

DataStore

public class DbDataStore
extends java.lang.Object
implements DataStore

A data store implementation that stores the records in a database using JDBC. Configuration:

 <DataStore class="org.apache.jackrabbit.core.data.db.DbDataStore">
     <param name="url" value="jdbc:postgresql:test"/>
     <param name="user" value="sa"/>
     <param name="password" value="sa"/>
     <param name="databaseType" value="postgresql"/>
     <param name="driver" value="org.postgresql.Driver"/>
     <param name="minRecordLength" value="1024"/>
     <param name="maxConnections" value="2"/>
     <param name="copyWhenReading" value="true"/>
     <param name="tablePrefix" value=""/>
 </DataStore>
 

Only URL, user name and password usually need to be set. The remaining settings are generated using the database URL sub-protocol from the database type resource file.

JNDI can be used to get the connection. In this case, use the javax.naming.InitialContext as the driver, and the JNDI name as the URL. If the user and password are configured in the JNDI resource, they should not be configured here. Example JNDI settings:

 <param name="driver" value="javax.naming.InitialContext" />
 <param name="url" value="java:comp/env/jdbc/Test" />
 

For Microsoft SQL Server 2005, there is a problem reading large BLOBs. You will need to use the JDBC driver version 1.2 or newer, and append ;responseBuffering=adaptive to the database URL. Don't append ;selectMethod=cursor, otherwise it can still run out of memory. Example database URL: jdbc:sqlserver://localhost:4220;DatabaseName=test;responseBuffering=adaptive

By default, the data is copied to a temp file when reading, to avoid problems when reading multiple blobs at the same time.

The tablePrefix can be used to specify a schema and / or catalog name: <param name="tablePrefix" value="ds.">

Field Summary

protected Pool	connectionPool A list of connections
protected boolean	copyWhenReading Copy the stream to a temp file before returning it.
protected java.lang.String	createTableSQL This is the property 'createTable' in the [databaseType].properties file, initialized with the default value.
protected java.lang.String	databaseType The database type used.
static int	DEFAULT_MAX_CONNECTIONS The default value for the maximum connections.
static int	DEFAULT_MIN_RECORD_LENGTH The default value for the minimum object size.
protected java.lang.String	deleteOlderSQL This is the property 'deleteOlder' in the [databaseType].properties file, initialized with the default value.
protected java.lang.String	deleteSQL This is the property 'delete' in the [databaseType].properties file, initialized with the default value.
protected static java.lang.String	DIGEST The digest algorithm used to uniquely identify records.
protected java.lang.String	driver The database driver.
protected java.lang.String	insertTempSQL This is the property 'insertTemp' in the [databaseType].properties file, initialized with the default value.
protected java.util.Map	inUse All data identifiers that are currently in use are in this set until they are garbage collected.
protected int	maxConnections The maximum number of open connections.
protected long	minModifiedDate The minimum modified date.
protected int	minRecordLength The minimum size of an object that should be stored in this data store.
protected java.lang.String	password The password
protected java.lang.String	selectAllSQL This is the property 'selectAll' in the [databaseType].properties file, initialized with the default value.
protected java.lang.String	selectDataSQL This is the property 'selectData' in the [databaseType].properties file, initialized with the default value.
protected java.lang.String	selectMetaSQL This is the property 'selectMeta' in the [databaseType].properties file, initialized with the default value.
static java.lang.String	STORE_SIZE_MAX Call PreparedStatement.setBinaryStream(..., Integer.MAX_VALUE)
static java.lang.String	STORE_SIZE_MINUS_ONE Call PreparedStatement.setBinaryStream(..., -1)
static java.lang.String	STORE_TEMP_FILE Write to a temporary file to get the length (slow, but always works).
protected java.lang.String	storeStream The stream storing mechanism used.
protected java.lang.String	tablePrefix The prefix for the datastore table, empty by default.
protected java.lang.String	tableSQL This is the property 'table' in the [databaseType].properties file, initialized with the default value.
protected static java.lang.String	TEMP_PREFIX The prefix used for temporary objects.
protected java.util.List	temporaryInUse The temporary identifiers that are currently in use.
protected java.lang.String	updateDataSQL This is the property 'updateData' in the [databaseType].properties file, initialized with the default value.
protected java.lang.String	updateLastModifiedSQL This is the property 'updateLastModified' in the [databaseType].properties file, initialized with the default value.
protected java.lang.String	updateSQL This is the property 'update' in the [databaseType].properties file, initialized with the default value.
protected java.lang.String	url The database URL used.
protected java.lang.String	user The user name.

Constructor Summary

DbDataStore()

Method Summary

DataRecord	addRecord(java.io.InputStream stream) Creates a new data record.
void	clearInUse() Clear the in-use list.
void	close() Close the data store
protected DataStoreException	convert(java.lang.String cause, java.lang.Exception e) Convert an exception to a data store exception.
ConnectionRecoveryManager	createNewConnection() Create a new connection.
int	deleteAllOlderThan(long min) Delete objects that have a modified date older than the specified date.
java.util.Iterator	getAllIdentifiers() Get all identifiers.
protected ConnectionRecoveryManager	getConnection()
boolean	getCopyWhenReading() Is a stream copied to a temporary file before returning?
java.lang.String	getDatabaseType() Get the database type (if set).
protected java.security.MessageDigest	getDigest()
java.lang.String	getDriver() Get the database driver
int	getMaxConnections() Get the maximum number of concurrent connections.
int	getMinRecordLength() Get the minimum size of an object that should be stored in this data store.
java.lang.String	getPassword() Get the password.
protected java.lang.String	getProperty(java.util.Properties prop, java.lang.String key, java.lang.String defaultValue) Get the expanded property value.
DataRecord	getRecord(DataIdentifier identifier) Returns the identified data record.
java.lang.String	getTablePrefix() Get the table prefix.
java.lang.String	getUrl() Get the database URL.
java.lang.String	getUser() Get the user name.
void	init(java.lang.String homeDir) Initialized the data store
protected void	initDatabaseType()
protected void	putBack(ConnectionRecoveryManager conn)
void	setCopyWhenReading(boolean copyWhenReading) The the copy setting.
void	setDatabaseType(java.lang.String databaseType) Set the database type.
void	setDriver(java.lang.String driver) Set the database driver class name.
void	setMaxConnections(int maxConnections) Set the maximum number of concurrent connections in the pool.
void	setMinRecordLength(int minRecordLength) Set the minimum object length.
void	setPassword(java.lang.String password) Set the password.
void	setTablePrefix(java.lang.String tablePrefix) Set the new table prefix.
void	setUrl(java.lang.String url) Set the database URL.
void	setUser(java.lang.String user) Set the user name.
void	updateModifiedDateOnAccess(long before) From now on, update the modified date of an object even when accessing it.
protected void	usesIdentifier(DataIdentifier identifier)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_MIN_RECORD_LENGTH

public static final int DEFAULT_MIN_RECORD_LENGTH

The default value for the minimum object size.

See Also:

Constant Field Values

DEFAULT_MAX_CONNECTIONS

public static final int DEFAULT_MAX_CONNECTIONS

The default value for the maximum connections.

See Also:

Constant Field Values

STORE_TEMP_FILE

public static final java.lang.String STORE_TEMP_FILE

Write to a temporary file to get the length (slow, but always works). This is the default setting.

See Also:

Constant Field Values

STORE_SIZE_MINUS_ONE

public static final java.lang.String STORE_SIZE_MINUS_ONE

Call PreparedStatement.setBinaryStream(..., -1)

See Also:

Constant Field Values

STORE_SIZE_MAX

public static final java.lang.String STORE_SIZE_MAX

Call PreparedStatement.setBinaryStream(..., Integer.MAX_VALUE)

See Also:

Constant Field Values

DIGEST

protected static final java.lang.String DIGEST

The digest algorithm used to uniquely identify records.

See Also:

Constant Field Values

TEMP_PREFIX

protected static final java.lang.String TEMP_PREFIX

The prefix used for temporary objects.

See Also:

Constant Field Values

minModifiedDate

protected long minModifiedDate

The minimum modified date. If a file is accessed (read or write) with a modified date older than this value, the modified date is updated to the current time.

url

protected java.lang.String url

The database URL used.

driver

protected java.lang.String driver

The database driver.

user

protected java.lang.String user

The user name.

password

protected java.lang.String password

The password

databaseType

protected java.lang.String databaseType

The database type used.

minRecordLength

protected int minRecordLength

The minimum size of an object that should be stored in this data store.

maxConnections

protected int maxConnections

The maximum number of open connections.

connectionPool

protected Pool connectionPool

A list of connections

tablePrefix

protected java.lang.String tablePrefix

The prefix for the datastore table, empty by default.

tableSQL

protected java.lang.String tableSQL

This is the property 'table' in the [databaseType].properties file, initialized with the default value.

createTableSQL

protected java.lang.String createTableSQL

This is the property 'createTable' in the [databaseType].properties file, initialized with the default value.

insertTempSQL

protected java.lang.String insertTempSQL

This is the property 'insertTemp' in the [databaseType].properties file, initialized with the default value.

updateDataSQL

protected java.lang.String updateDataSQL

This is the property 'updateData' in the [databaseType].properties file, initialized with the default value.

updateLastModifiedSQL

protected java.lang.String updateLastModifiedSQL

This is the property 'updateLastModified' in the [databaseType].properties file, initialized with the default value.

updateSQL

protected java.lang.String updateSQL

This is the property 'update' in the [databaseType].properties file, initialized with the default value.

deleteSQL

protected java.lang.String deleteSQL

This is the property 'delete' in the [databaseType].properties file, initialized with the default value.

deleteOlderSQL

protected java.lang.String deleteOlderSQL

This is the property 'deleteOlder' in the [databaseType].properties file, initialized with the default value.

selectMetaSQL

protected java.lang.String selectMetaSQL

This is the property 'selectMeta' in the [databaseType].properties file, initialized with the default value.

selectAllSQL

protected java.lang.String selectAllSQL

This is the property 'selectAll' in the [databaseType].properties file, initialized with the default value.

selectDataSQL

protected java.lang.String selectDataSQL

This is the property 'selectData' in the [databaseType].properties file, initialized with the default value.

storeStream

protected java.lang.String storeStream

The stream storing mechanism used.

copyWhenReading

protected boolean copyWhenReading

Copy the stream to a temp file before returning it. Enabled by default to support concurrent reads.

inUse

protected java.util.Map inUse

All data identifiers that are currently in use are in this set until they are garbage collected.

temporaryInUse

protected java.util.List temporaryInUse

The temporary identifiers that are currently in use.

Constructor Detail

DbDataStore

public DbDataStore()

Method Detail

addRecord

public DataRecord addRecord(java.io.InputStream stream)
                     throws DataStoreException

Creates a new data record. The given binary stream is consumed and a binary record containing the consumed stream is created and returned. If the same stream already exists in another record, then that record is returned instead of creating a new one.

The given stream is consumed and not closed by this method. It is the responsibility of the caller to close the stream. A typical call pattern would be:

     InputStream stream = ...;
     try {
         record = store.addRecord(stream);
     } finally {
         stream.close();
     }
 

Specified by:

addRecord in interface DataStore

Parameters:

stream - binary stream

Returns:

data record that contains the given stream

Throws:

DataStoreException - if the data store could not be accessed

deleteAllOlderThan

public int deleteAllOlderThan(long min)
                       throws DataStoreException

Delete objects that have a modified date older than the specified date.

Specified by:

deleteAllOlderThan in interface DataStore

Parameters:

min - the minimum time

Returns:

the number of data records deleted

Throws:

DataStoreException

getAllIdentifiers

public java.util.Iterator getAllIdentifiers()
                                     throws DataStoreException

Get all identifiers.

Specified by:

getAllIdentifiers in interface DataStore

Returns:

an iterator over all DataIdentifier objects

Throws:

DataStoreException - if the list could not be read

getMinRecordLength

public int getMinRecordLength()

Get the minimum size of an object that should be stored in this data store. Depending on the overhead and configuration, each store may return a different value.

Specified by:

getMinRecordLength in interface DataStore

Returns:

the minimum size in bytes

setMinRecordLength

public void setMinRecordLength(int minRecordLength)

Set the minimum object length. The maximum value is around 32000.

Parameters:

minRecordLength - the length

getRecord

public DataRecord getRecord(DataIdentifier identifier)
                     throws DataStoreException

Returns the identified data record. The given identifier should be the identifier of a previously saved data record. Since records are never removed, there should never be cases where the identified record is not found. Abnormal cases like that are treated as errors and handled by throwing an exception.

Specified by:

getRecord in interface DataStore

Parameters:

identifier - data identifier

Returns:

identified data record

Throws:

DataStoreException - if the data store could not be accessed, or if the given identifier is invalid

init

public void init(java.lang.String homeDir)
          throws DataStoreException

Initialized the data store

Specified by:

init in interface DataStore

Parameters:

homeDir - the home directory of the repository

Throws:

DataStoreException

initDatabaseType

protected void initDatabaseType()
                         throws DataStoreException

Throws:

DataStoreException

getProperty

protected java.lang.String getProperty(java.util.Properties prop,
                                       java.lang.String key,
                                       java.lang.String defaultValue)

Get the expanded property value. The following placeholders are supported: ${table}: the table name (the default is DATASTORE) and ${tablePrefix}: the prefix as set in the configuration (empty by default).

Parameters:

prop - the properties object

key - the key

defaultValue - the default value

Returns:

the property value (placeholders are replaced)

convert

protected DataStoreException convert(java.lang.String cause,
                                     java.lang.Exception e)

Convert an exception to a data store exception.

Parameters:

cause - the message

e - the root cause

Returns:

the data store exception

updateModifiedDateOnAccess

public void updateModifiedDateOnAccess(long before)

From now on, update the modified date of an object even when accessing it. Usually, the modified date is only updated when creating a new object, or when a new link is added to an existing object. When this setting is enabled, even getLength() will update the modified date.

Specified by:

updateModifiedDateOnAccess in interface DataStore

Parameters:

before - - update the modified date to the current time if it is older than this value

getDatabaseType

public java.lang.String getDatabaseType()

Get the database type (if set).

Returns:

the database type

setDatabaseType

public void setDatabaseType(java.lang.String databaseType)

Set the database type. By default the sub-protocol of the JDBC database URL is used if it is not set. It must match the resource file [databaseType].properties. Example: mysql.

Parameters:

databaseType -

getDriver

public java.lang.String getDriver()

Get the database driver

Returns:

the driver

setDriver

public void setDriver(java.lang.String driver)

Set the database driver class name. If not set, the default driver class name for the database type is used, as set in the [databaseType].properties resource; key 'driver'.

Parameters:

driver -

getPassword

public java.lang.String getPassword()

Get the password.

Returns:

the password

setPassword

public void setPassword(java.lang.String password)

Set the password.

Parameters:

password -

getUrl

public java.lang.String getUrl()

Get the database URL.

Returns:

the URL

setUrl

public void setUrl(java.lang.String url)

Set the database URL. Example: jdbc:postgresql:test

Parameters:

url -

getUser

public java.lang.String getUser()

Get the user name.

Returns:

the user name

setUser

public void setUser(java.lang.String user)

Set the user name.

Parameters:

user -

close

public void close()

Close the data store

Specified by:

close in interface DataStore

usesIdentifier

protected void usesIdentifier(DataIdentifier identifier)

clearInUse

public void clearInUse()

Clear the in-use list. This is only used for testing to make the the garbage collection think that objects are no longer in use.

Specified by:

clearInUse in interface DataStore

getDigest

protected java.security.MessageDigest getDigest()
                                         throws DataStoreException

Throws:

DataStoreException

getConnection

protected ConnectionRecoveryManager getConnection()
                                           throws DataStoreException

Throws:

DataStoreException

putBack

protected void putBack(ConnectionRecoveryManager conn)
                throws DataStoreException

Throws:

DataStoreException

getMaxConnections

public int getMaxConnections()

Get the maximum number of concurrent connections.

Returns:

the maximum number of connections.

setMaxConnections

public void setMaxConnections(int maxConnections)

Set the maximum number of concurrent connections in the pool. At least 3 connections are required if the garbage collection process is used.

Parameters:

maxConnections - the new value

createNewConnection

public ConnectionRecoveryManager createNewConnection()
                                              throws javax.jcr.RepositoryException

Create a new connection.

Returns:

the new connection

Throws:

javax.jcr.RepositoryException

getCopyWhenReading

public boolean getCopyWhenReading()

Is a stream copied to a temporary file before returning?

Returns:

the setting

setCopyWhenReading

public void setCopyWhenReading(boolean copyWhenReading)

The the copy setting. If enabled, a stream is always copied to a temporary file when reading a stream.

Parameters:

copyWhenReading - the new setting

getTablePrefix

public java.lang.String getTablePrefix()

Get the table prefix. The default is empty.

Returns:

the table prefix.

setTablePrefix

public void setTablePrefix(java.lang.String tablePrefix)

Set the new table prefix.

Parameters:

tablePrefix - the new value