Sample data create and import

Goal: creating sample data for the database.

The sample data should have

• many donors
• many recipients
• many donations

Current State

• names and addresses are created, and assembled
• putting these into the OpenPetra database is in progress (hopefully nearly finished)
• creating donations is not done yet

Steps:

1. create raw data as csv files (sufficiently complete!) -- done
2. import and put together raw data in temporary program (for creating relationships) --done
3. connect to petra server from temporary program, assemble data as OpenPetra TDS, save --in progress

Additionally:

1. create nant job to import data

Overview

Data creation and import is done in a two step process:

1. The 3rd-party data creation tool benedata benerator creates raw data (names, addresses, phone numbers...)
2. The OpenPetra SampleDataConstructor-tool is specifically built to take this data, assemble, and import it into OpenPetra

Related Bugtracking-Issues

• create sample data (issue #29)
• import this data (issue #220)

Installing third party software

Currently the only external software used is Benedata Benerator for creation of the raw data, but this in turn requires the java runtime enviroment.

Java

• Required: Java Runtime Environment only

Abridged Instructions

• Download the Java Runtime environment and install
• You might need to add the bin directory to your PATH:

PATH = ....; "C:\Program Files (x86)\Java\jre6\bin"

• Give it a quick test by opening a new command prompt / terminal and typing:

java -version

Example output:

java version "1.6.0_25"
Java(TM) SE Runtime Environment (build 1.6.0_25-b06)
Java HotSpot(TM) Client VM (build 20.0-b11, mixed mode, sharing)

Databene Benerator

• Project Website: http://databene.org/databene-benerator.html
• Note: The project is a java project
• Used version: 0.6.6 (as of 2011-July - but it may be advisable to use the recent one, we just use simple features anyway)
• Other requirements: Java Runtime Enviroment

These instructions are largely copied from benerator website and slightly abridged. The original instructions are more detailed and contain details about installing benerator on a Windows / Mac / Linux-System.

Abridged Instructions

• Download the Benerator distribution from SourceForge
• Unzip into a directory of your choice (e.g. C:\Program Files\Development\databene-benerator-0.6.6)
• Create an environment variable BENERATOR_HOME that points to the path you extracted benerator (example located below).
• Append BENERATOR_HOME/bin to your environment variable PATH (examples located below)
• Give benerator a quick test by just opening a new command prompt / terminal and typing

benerator -v

Example Output:

Local classpath: .; ...
Benerator 0.6.6 build 1255
Java version 1.6.0_25
JVM Java HotSpot(TM) Client VM 20.0-b11 (Sun Microsystems Inc.)
OS Windows 2003 5.2 (x86)
Installed JSR 223 Script Engines:
- Mozilla Rhino[js, rhino, JavaScript, javascript, ECMAScript, ecmascript]

Examples for Environment Variables

BENERATOR_HOME = C:\Program Files\Development\databene-benerator-0.6.6

PATH = C:\WINDOWS; ....; %BENERATOR_HOME%\bin

See also

• List of possible 3rd party 3rd-party Test Data Generators