From: David Doolin (doolin@cs.utk.edu)
Date: Thu Oct 19 2000 - 09:28:42 EDT
In message <00b701c039a7$34010e60$1000000a@icteam.it>, "Andrea LUCIANO" writes:
>
>I don't know and can't imagine your requirements, but just one question: is
>it really necessary in your project to store a so long data stream in a tag?
>Sometime it's better to use a property that specify a media reference that
>provides data stream (i.e. a link to a file on your file system).
HD5 is supposed to be using xml description now. They have
probably already crossed this bridge. (HD5 is at NCSA, for
ultra large data sets).
>
>Bye,
>A.L.
>
>
>----- Original Message -----
>From: F. David Sacerdoti <fds@cs.ucsd.edu>
>To: <xml@xmlsoft.org>
>Sent: Wednesday, October 18, 2000 9:53 PM
>Subject: [xml] very large XML docs
>
>
>>
>>
>> I am using libxml for a scientific library project here at UCSD in
>> conjunction with the San Diego Supercomputing Center. The library will
>> be running on supercomputer clusters (Blue Horizon), and is used in very
>> large calculations.
>>
>> I have a question about dealing with very large documents. Since I may
>> be creating tags with several hundred megabytes of data in them, I would
>> like to stream the xml doc to disk as it is created. This would allow me
>> to use a limited buffer size for these very large tags.
>>
>> I have seen xmlOutputBufferCreateFile() which can be used with
>> xmlOutputBufferWrite() to write a fixed length buffer to disk, but is it
>> true that the entire xml doc must be built in memory before any of it
>> can be written to disk?
>>
>> Would it be possible to write a partially created xml tree to disk,
>> allowing me to free some memory buffers, and then go on to compute and
>> write the rest of the tree?
>>
>> Thank you,
>> David Sacerdoti
>>
>> ----
>> Message from the list xml@rpmfind.net
>> Archived at : http://xmlsoft.org/messages/
>> to unsubscribe: echo "unsubscribe xml" | mail majordomo@rpmfind.net
>>
>
>----
>Message from the list xml@rpmfind.net
>Archived at : http://xmlsoft.org/messages/
>to unsubscribe: echo "unsubscribe xml" | mail majordomo@rpmfind.net
---- Message from the list xml@rpmfind.net Archived at : http://xmlsoft.org/messages/ to unsubscribe: echo "unsubscribe xml" | mail majordomo@rpmfind.net
This archive was generated by hypermail 2b29 : Thu Oct 19 2000 - 09:44:16 EDT