Properties of 19 Appendix - Databases or Flat file Data stores

  1. Properties
  2. History
  3. Community
  4. Source
content

Appendix A

 

Databases or Flat file Data stores:

The data collector needs to temporary stores his extracted data, to provide them to the SNA component. The data collector can accomplish that in two ways, store them in a database or in separate flat file formats, like xml, CSV or an own simple data structure.

 

Advantages between the types of data stores systems:

Database

Flat file

Advantage

Description

Advantage

Description

Multi access, read & write

Multithreaded read and write access, managed by the database system.

No extra costs, except space

The flat files could be stored at the server hard disk.

Transaction save

Data stay consistent through several writes in the same table.

No access lib’s

Every common programming language provides native.

Relation between data

Relations can be queried, for example with the LDAP User ID.

-

-

Optimized data storing

Optimized data storage in a relational way.

-

-

 

Disadvantages between the types of data stores systems:

Database

Flat file

Disadvantage

Description

Disadvantage

Description

Extra costs

In administration and hardware.

Single access, write

Only on thread can read and write. – in Performance.

Extra connector lib’s needed

The disadvantages here are extra costs for commercial database connection libraries, but this only if commercial databases are used, for open source, it’s not a disadvantage.

Bottleneck

The Flat files create a bottleneck in focus on performance, because only one single thread could read and write at a time. For a more performance based read and writing service Flat files not very suited.

 


 

 

Conclusion:

As to see from the table, beside the extra costs compared with a flat file data store structure are only advantages to use an  database system for the data collector component to store his transformed data.

 

Decision:

The decision is based on the conclusion made before. The systems data collector component needs a Database system to store the raw data in a small, simple database table. A Database system brings more flexibility, security (Transaction save), data integrity, performance then a flat file structured data store.

contains knowledge about
Class
Name
19 Appendix - Databases or Flat file Data stores

Instances Linking Here

OntoWiki

Knowledge Bases

Login

  1. Local
  2. OpenID
  3. FOAF+SSL