[Opensource] about eSearch Component

[Gaspar Gonzalez Oliva]

Hi,
 
First of all very thanks for your answer,

see my comments embedded below,

----- Original Message ----- 
From: "Peter A. Pilgrim" <peterp at xenonsoft.demon.co.uk>
To: <opensource at jcorporate.com>
Sent: Wednesday, July 09, 2003 12:57 AM
Subject: Re: [Opensource] about eSearch Component


> Gaspar Gonzalez Oliva wrote:
> > Hi All,
> > 
> > There is a work be in progress to integrate eSearch component with Lucene 1.2.
> > Some work about this was made by Peter Pilgrim for eForum component. We need to
> > extend/rewrite this work to do it a very generic eSearch component that we can
> > plug in Expresso Framework and can be used by any Web Application developer that
> > use Expresso Framework. The eSearch component actually not use Lucene for text
> > index & search but in the next version will be.
> 
> 
> The eForum search facility is a plugin factory, because we wanted to separate
> the forum from the search engine component. The default plugin is based on
> Lucene. Anyone can write a plugin that works with another Search Engine.
> The purpose of the plugin is to index eForum messages.
> 
> If you need to plug-in a generic search in Expresso Framework, you need
> to ask what are going to index. People can index any Java object they
> want. So how can you provide a generic interface?  Are you trying

As i see eSearch, it will do all index process *automatically*, without
eForum, eFAQ or other Expresso component intervention, eSearch
will work with Lucene and i don't see why abstract the use of Lucene,
to let that the user  use another Indexer/Search API.
eSearch will have a Crawler program, and this is the way I'm thinking
to make it generic. The first Crawler that i'm implementing is
DBObjectCrawler and in the future any developer will need to index 
*nothing*. eSearch and its Crawler do this Job automatically :).
In eForum you add the message to the index by hand, but in future
eSearch component will do this without Developer intervention.
With some administration task the admin will control this process.

No. The people can't index any Java Object. People only index 
*things* that are store on some medium RDB, Files, Web.

> to define a sort of higher level JAXP (Java for XML API ) that consolidates
> a standard interface to SAX parser and TRaX? I think this is harder,
> because you need to look at as many as Java Search Engine API as you
> can find on the Net and then try to abstract an interface for them?
> 

I don't want to do an eSearch component that take care of other Search
engine API and made some abstraction to take care of this other API. In
practice it only confuse Developers, we will use Lucene 1.2 and future
version of this API to do index & search operation. eSearch only do the part
that is missing on Lucene (the Crawler) see my diagram on Jcorporate site.
In future when this first part is finished, then we can improve some part of
Lucene.
In the practice the Developer work to do add search operation to their
site will be a bit :).

Gaspar

> > 
> > I encourage to all people interesting in this job that help us with any idea
> > about features needed, design idea, programming implementation and in general
> > any advice about this topic. The future eSearch diagram is on Jcorporate site
> > now on this URL.
> > 
> > http://www.jcorporate.com/econtent/Content.do?state=template&template=2&resource
> > =641&db=default.
> > 
> > or look for eSearch component under documentation link:
> > eSearch Architectural Diagram
> > 
> > We need that you put in this disccusion list any idea because maybe the next
> > week we need to begin to code the first prototype of eSearch 2.0.
> > 
> > Other documentation are in progress and some of this are:
> > - How eSearch work (white paper).
> > - Lucene UML diagram.
> > 
> > Gaspar
> 
> 
> 
> 
> -- 
> Peter Pilgrim
>             __ _____ _____ _____
>            / //__  // ___// ___/   +  Serverside Java
>           / /___/ // /__ / /__     +  Struts
>          / // ___// ___// ___/     +  Expresso Committer
>       __/ // /__ / /__ / /__       +  Independent Contractor
>      /___//____//____//____/       +  Intrinsic Motivation
> On Line Resume
>     ||
>     \\===>  `` http://www.xenonsoft.demon.co.uk/no-it-striker.html ''
> 
> _______________________________________________
> Opensource mailing list
> Opensource at jcorporate.com
> http://mail.jcorporate.com/mailman/listinfo/opensource
> Archives: http://mail.jcorporate.com/pipermail/opensource/