Re: R: [xml] very large XML docs

Date view Thread view Subject view Author view

From: Daniel Veillard (Daniel.Veillard@w3.org)
Date: Thu Oct 19 2000 - 10:00:48 EDT


On Thu, Oct 19, 2000 at 09:28:42AM -0400, David Doolin wrote:
>
> In message <00b701c039a7$34010e60$1000000a@icteam.it>, "Andrea LUCIANO" writes:
> >
> >I don't know and can't imagine your requirements, but just one question: is
> >it really necessary in your project to store a so long data stream in a tag?
> >Sometime it's better to use a property that specify a media reference that
> >provides data stream (i.e. a link to a file on your file system).
>
> HD5 is supposed to be using xml description now. They have
> probably already crossed this bridge. (HD5 is at NCSA, for
> ultra large data sets).

  yeah, libxml DOM tree is not adequate as is for very large files.
And the SAX API is a bit limited too ...
I have a bit less time now to hack on libxml, i don't know when I will be
able to try to code stuff. Here are at least some suggestions wich need
to be chewed upon for a while before adding more code anyway:

   - in the case of validating on top of SAX:
     defining a SAX plugin mechanism (i.e. a way ro register multiple
     SAX callbacks) seems architecturally the best way to extend SAX
     Then depending on the use the DOM tree building or validation or
     whatever specific processing. Might be a good solution to some of
     the modularity problems.
   - for saving very large data sets:
     James Hendridge suggested SAX like functions to save a document
     ie. call a function to open a new element with given attributes,
     write character data, close last element, etc
     sounds like a great idea !

  In the meantime the best solution to David Sacerdoti's problem
is probably to use lower level functions:
void xmlNodeDumpOutput(...)
in particular.
Sounds a bit like the previous problem exposed by Mike Cunningham
http://xmlsoft.org/messages/0759.html
http://xmlsoft.org/messages/0777.html
and associated threads

Daniel

-- 
Daniel.Veillard@w3.org | W3C, INRIA Rhone-Alpes  | libxml gnome XML toolkit
Tel : +33 476 615 257  | 655, avenue de l'Europe | http://xmlsoft.org/
Fax : +33 476 615 207  | 38330 Montbonnot FRANCE | Rpmfind search site
 http://www.w3.org/People/all#veillard%40w3.org  | http://rpmfind.net/
----
Message from the list xml@rpmfind.net
Archived at : http://xmlsoft.org/messages/
to unsubscribe: echo "unsubscribe xml" | mail  majordomo@rpmfind.net


Date view Thread view Subject view Author view

This archive was generated by hypermail 2b29 : Thu Oct 19 2000 - 10:47:34 EDT