[Opensource] new "spider" test tool: Morebot

Thu Apr 17 10:16:31 PDT 2003

hi Helga,

the request should be contacting the jcorporate site, so if that is failing to connect, could it be that the machine has no IP connection?  or that you are behind a proxy server?   

larry

At 06:28 AM 4/17/2003, you wrote:
>Seems very useful to me. But  when I try to tun it I get the following error:
>java.net.ConnectException: Connection refused: connect
>       at java.net.PlainSocketImpl.socketConnect(Native Method)
>       at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:305)
>       at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:171)
>       at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:158)
>       at java.net.Socket.connect(Socket.java:426)
>       at java.net.Socket.connect(Socket.java:376)
>       at sun.net.NetworkClient.doConnect(NetworkClient.java:139)
>       at sun.net.www.http.HttpClient.openServer(HttpClient.java:386)
>       at sun.net.www.http.HttpClient.openServer(HttpClient.java:602)
>       at sun.net.www.http.HttpClient.<init>(HttpClient.java:303)
>       at sun.net.www.http.HttpClient.<init>(HttpClient.java:264)
>       at sun.net.www.http.HttpClient.New(HttpClient.java:336)
>       at sun.net.www.http.HttpClient.New(HttpClient.java:317)
>       at sun.net.www.http.HttpClient.New(HttpClient.java:312)
>       at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConne
>ction.java:481)
>       at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection
>.java:472)
>       at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
>nection.java:574)
>       at sun.net.www.protocol.http.HttpURLConnection.getHeaderFieldKey(HttpURL
>Connection.java:1208)
>       at com.meterware.httpunit.HttpWebResponse.loadHeaders(HttpWebResponse.ja
>va:191)
>       at com.meterware.httpunit.HttpWebResponse.readHeaders(HttpWebResponse.ja
>va:173)
>       at com.meterware.httpunit.HttpWebResponse.<init>(HttpWebResponse.java:53
>)
>       at com.meterware.httpunit.WebConversation.newResponse(WebConversation.ja
>va:60)
>       at com.meterware.httpunit.WebWindow.getResource(WebWindow.java:154)
>       at com.meterware.httpunit.WebWindow.getSubframeResponse(WebWindow.java:1
>17)
>       at com.meterware.httpunit.WebWindow.getResponse(WebWindow.java:110)
>       at com.meterware.httpunit.WebClient.getResponse(WebClient.java:113)
>       at com.codeguild.morebot.LoginCrawlTest.getGoodLogin(LoginCrawlTest.java
>:120)
>       at com.codeguild.morebot.LoginCrawlTest.suite(LoginCrawlTest.java:71)
>       at com.codeguild.morebot.LoginCrawlTest.main(LoginCrawlTest.java:51)
>Exception in thread "main" java.lang.NullPointerException
>       at junit.textui.TestRunner.doRun(TestRunner.java:116)
>       at junit.textui.TestRunner.doRun(TestRunner.java:109)
>       at com.codeguild.morebot.LoginCrawlTest.main(LoginCrawlTest.java:51)
>
>Any idea?
>Thanks,
>Helga
>>
>>hi,
>>
>>There's a new, free tool called "Morebot" that "spiders" an authenticated web site. In other words, it logs into your Expresso web application, and using that login, it follows all the links found and reports back on any problems. It is expressly developed for Expresso in its first iteration (the only reason it's not part of Expresso is that it has the potential to spider any web site, although only the Expresso login scheme is supported out-of-the-box right now).
>>
>>You can download binary and cvs source from http://morebot.sourceforge.net
>>
>>Below are a few more details from the homepage of Morebot.
>>
>>Can you check it out, and let me know if it's useful to you?
>>
>>larry
>>------------------------
>>
>>Morebot was created as a means to quickly test the loading of pages in web applications which require authentication. These pages cannot be reached without a login, but can be reached by a "spider" that starts in the right place(s) and has successfully logged in. Pages that would be reached by POSTing information to the server (e.g., the result page after submitting a form) are ignored by Morebot, unless you add custom code via the underlying httpunit library.
>>
>>Morebot needs to avoid certain pages, like logout links, and needs to recognize certain page elements as failure notifications, like a page which has the text "The function you requested did not complete". You can specify links to avoid, and failures to recognize, by making entries in a preference file for your site. Morebot uses this preference file, written in XML, to determine how and where to launch the spider. Like most spider tools, Morebot supports a list of "allowed hosts" which prevent the spider from escaping its intended boundaries to test the entire World Wide Web.
>>
>>No Java coding is necessary for testing a web site in this way, i.e., testing whether the pages load properly and have no obvious failure notifications.
>>
>>Morebot can be used as a load test by running many spiders simultaneously, and can be useful to "warm up" a JSP site, and confirm that JSP's compile nicely. It offers a special feature (single visits to each controller/state) for the Expresso  web development library.
>>
>>
>>_______________________________________________
>>Opensource mailing list
>>Opensource at jcorporate.com
>>http://mail.jcorporate.com/mailman/listinfo/opensource
>>Archives: http://mail.jcorporate.com/pipermail/opensource/
>
>
>_________________________________________________________________
>
>
>_______________________________________________
>Opensource mailing list
>Opensource at jcorporate.com
>http://mail.jcorporate.com/mailman/listinfo/opensource
>Archives: http://mail.jcorporate.com/pipermail/opensource/