Re: Real-Time Stock Data Info' via libwww
Axel Amthor (axel.amthor@interprise.de)
Fri, 09 Oct 1998 15:42:59 +0200
This is a multi-part message in MIME format.
--------------C9A77A0F663234D3D7F10769
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
And for now, completely off topic:
Fernando Levin wrote:
> Nick Busigin wrote:
> >
> > I have subscribed to a stock quote service that can provide real-time
> > data. Unfortunately, the real-time data access is only via a java-applet
> > that runs in my Netscape browser. I would like to be able to access this
> > data instead with a Perl program which obtains the data (via libwww
> > functions), analyzes it, and archives it (for further historical
> > analysis). So, what I am proposing to do is to mimic what the java-applet
> > is doing to obtain the data with a Perl program, and having obtained the
> > data, I am free to do what I want with it.
> >
> > The problem is, how do I determine the protocol between the
> > java-applet and the web server from which it obtains its data. I
> > appear to have 2 choices:
> >
> > 1) Obtain the protocol information from the company providing the
> > quotes.
> >
> > 2) Reverse-engineer this protocol by monitoring the TCP/IP
> > communications between the java-applet and the web server which
> > it grabs its information from.
> >
> > So far, I have struck out on (1), so I am contemplating choice (2).
> > What I would appreciate is some advice on which tools would be the
> > best ones to use for doing the reverse-engineering work.
> >
> > Thanks in advance!
> >
> > Nick
> >
> > --------------------------------------------------------------------------
> > Nick Busigin <Sent from my Debian/GNU Linux Machine> nick@xwing.org
> >
> > To obtain my pgp public key, email me with the subject: "get pgp-key"
> > --------------------------------------------------------------------------
>
> Your question is not strictly PERL.
> Anyway, here a couple of ways to do what you want:
> 1) Get yoursel a protocol analyser to put between your PC and the RS232
> port. You can make a rudimental one yourself with some cables and a
> second (fast!) PC with 2 serial ports and some SW to interpret the data.
> 2) Get SOFT-ICE or similar to trap system calls to socket APIs.
> The hard part would be to interpret the data, since many calls will be
> client-server and hence non-standard and probably coded in some way.
You may do this with an apache and/or squid hack. Just stop direct Internet Connection
to the remote site and put a proxy like apache or squid between both your client
and the server. You may now be able to "listen" to the transmitted Data. If that applet
connects using direct connection and short-cutting the proxy (i've seen your running
linux) try out tcpdump on the outer interface while the applet is sending/receiving data.
With some patience there must be a chance to get a complete dump of one entire
"session".
cu
--
Axel Amthor Interprise Network Computing GmbH
Witneystr. 1, 82008 Unterhaching
URL: http://www.interprise.de
Fone: +49 (0) 89 61 55 95 - 30
Fax: +49 (0) 89 61 55 95 - 29
--------------C9A77A0F663234D3D7F10769
Content-Type: text/x-vcard; charset=us-ascii;
name="axel.amthor.vcf"
Content-Transfer-Encoding: 7bit
Content-Description: Card for Axel Amthor
Content-Disposition: attachment;
filename="axel.amthor.vcf"
begin:vcard
n:Amthor;Axel
x-mozilla-html:TRUE
org:Interprise Network Computing
adr:;;;Unterhaching;;82008;Germany
version:2.1
email;internet:axel.amthor@interprise.de
title:E-Commerce Solutions
tel;fax:+49 (0) 89) 61 55 95 29
tel;home:+49 (0) 2951 9297 1
tel;work:+49 (0) 89) 61 55 95 30
note:http://www.interprise.de
x-mozilla-cpt:;2
fn:Amthor, Axel
end:vcard
--------------C9A77A0F663234D3D7F10769--