= Aperture Overview =

Administrators: Christiaan Fluit & Leo Sauermann

Source Code: Interfaces and standard implementations of Aperture

The source will contain all relevant information about semantic data extraction, everything that is needed to get starting with a fulltext and metadata extraction framework. Our intent is that developers can download a single distribution file with a fully working environment, that also includes adapter and extractor implementations. Developers can use this package to fill their lucene-based applications or other data stores.

== Features ==

 * Easy to use: easy to learn, easy to code, easy to deploy in industrial projects
 * Extract fulltext from many common file formats and information systems like IMAP email servers
 * Extract metadata like author, date, subject and more from the data sources and file formats
 * Open data objects for viewing
 * Fully configurable framework, storing and editing config files is done through a SWING gui
 * Pluggable architecture: can be easily extended, can be easily integrated to other projects
 * Architecture based on industry standard OSGI
 * Compatible with RDF, but not solely based on it

== Components ==

 * !DataSource interface
 * !DataSource implementations for file systems, websites (or rather hypertextual sources in general) and IMAP servers
 * Near future work: !OutlookSource, !MozillaSource/ThunderbirdSource

 * !DataAccessor interface
 * !DataAccessor implementations for file, http(s) and imap schemes

 * !DataCrawler interface
 * One basic !DataCrawler implementation for every !DataSource type
 * Later maybe more specialized !DataCrawler implementations, e.g. a !WindowsFileSystemCrawler with OS-specific optimizations

 * Extractor interface
 * Extractor implementation for everything we can easily support: PDF, Word, Excel, HTML, plain text, ...
 * New domain for us but also probably very doable: PNG, JPG, AVI, ...

 * !ArchiveExtractor interface
 * !ArchiveExtractor implementations for Zip and Gzip

 * !LinkExtractor interface
 * !LinkExtractor implementation for HTML and XHTML
 * Later maybe PDF, Flash, ...

 * !MimetypeIdentifier interface
 * Badic !MimeTypeIdentifer implementation based on magic numbers; absolute necessity for choosing the right Extractor, !LinkExtractor or !ArchiveExtractor implementation for a given file

 * [http://www.osgi.org/ OSGi] bindings and connector code (can be realized so that code is also usable outside an OSGi-based application)
 * Configuration gui (what needs to be configured? isn't this very application-specific?)
 * Sample GUI appication showing how to use it. Can also be used as test application, e.g. when you are developing new Extractor implementations.
 * Metadata format descriptions (RDFS schema) and example metadata files

== Supported File Formats ==

Right from the beginning we will support these file formats:

 * Plain text
 * HTML
 * XML
 * PDF (Portable Document Format)
 * RTF (Rich Text Format)
 * Microsoft Word 97+
 * Microsoft Excel 97+
 * Microsoft Powerpoint 97+
 * Microsoft Works
 * !OpenOffice 1.0+: Writer, Calc, Impress, Draw
 * !StarOffice 6.0+: Writer, Calc, Impress, Draw
 * !OpenDocument (!OpenOffice 2.0+)
 * !WordPerfect 5.x
 * Emails (.eml files)