read from file

mki Joined: 09/23/07 Posts: 7

Posted: 09/24/07 23:10:11 Modified: 09/25/07 10:13:48 Hello, I want to read whitespace-separated strings from a file (I do not want to read the whole file into memory, the file might be quite big.). A fairly easy job one could believe, but I do not manage to get it working. It would be great if someone could give me a short example how to do this. Thanks!

Author	Message
kris Joined: 03/27/04 Posts: 581	Posted: 09/25/07 00:18:25 Here's one that splits on lines: http://dsource.org/projects/tango/wiki/LineExample The notion is similar, but you'd use one of the other Iterators provided. BTW, had you considered using virtual-files (memory-mapped files) for those cases where the file is enormous?
mki Joined: 09/23/07 Posts: 7	Posted: 09/25/07 09:15:28 Thanks for your answer! I already had a look at the different stream iterators, the API documentation lists: tango.text.stream.LineIterator? tango.text.stream.QuoteIterator? tango.text.stream.RegexIterator? tango.text.stream.SimpleIterator? tango.text.stream.StreamIterator? I can guess the function of LineIterator? and more or less of RegexIterator? (would be overkill here anyway); StreamIterator? seems to be a common base class for the other ones. But I have no clue how QuoteIterator? and SimpleIterator? work. The documentation pages http://dsource.org/projects/tango/docs/current/tango.text.stream.QuoteIterator.html and http://dsource.org/projects/tango/docs/current/tango.text.stream.SimpleIterator.html look almost the same, and give no specific information. Which Iterator is the right one for my purpose?
larsivi Joined: 03/27/04 Posts: 614	Posted: 09/25/07 10:34:05 QuoteIterator? is much the same as SimpleIterator?, with the only difference being that it will ignore delimiters between quotes. If you don't need that, use SimpleIterator? with the whitespace characters you want to split on passed as delims, ie auto delims = " \t\n"; or similar.
mki Joined: 09/23/07 Posts: 7	Posted: 09/26/07 01:05:12 Thanks for the explanation, it works for me now. Finally my problem came down to a mistake in the documentation http://www.dsource.org/projects/tango/docs/current/tango.text.stream.SimpleIterator.html I guess that the line # this(T[] delim, InputStream? stream = null); should read # this(InputStream? stream, T[] delim); Maybe someone could correct that.
larsivi Joined: 03/27/04 Posts: 614	Posted: 09/26/07 07:44:10 mki wrote: Thanks for the explanation, it works for me now. Finally my problem came down to a mistake in the documentation http://www.dsource.org/projects/tango/docs/current/tango.text.stream.SimpleIterator.html I guess that the line # this(T[] delim, InputStream? stream = null); should read # this(InputStream? stream, T[] delim); Maybe someone could correct that. Are you sure? The stream iterator docs are certainly not good, but the function signatures are automatically created from the source via DDoc and is as far as I can see correct, also in that case.
mki Joined: 09/23/07 Posts: 7	Posted: 09/26/07 08:40:30 This works for me: auto file = new FileConduit?(fileName); auto iter = new SimpleIterator?!(char)(file,"\n\t "); While this: auto iter = new SimpleIterator?!(char)("\n\t ", file); gives: constructor tango.text.stream.SimpleIterator?.SimpleIterator?!(char).SimpleIterator?.this (char[]) does not match parameter types (char[3u],FileConduit?) Error: cannot implicitly convert expression ("\x0a\x09 ") of type char[3u] to tango.io.model.IConduit.IConduit Error: cannot implicitly convert expression (file) of type tango.io.FileConduit?.FileConduit? to char[] I use tango 0.98 (newest version in Gentoo portage D overlay). Is it possible that the order of the parameters to SimpleIterator?.this(...) has changed since this version?
larsivi Joined: 03/27/04 Posts: 614	Posted: 09/26/07 10:06:49 Ah, yes, I think that was changed in 0.99. Tango currently has 0.99.1 as it's latest release. I haven't seen the Gentoo guys around for a while, not sure how things are moving along there.
mki Joined: 09/23/07 Posts: 7	Posted: 09/26/07 19:57:24 -- Modified: 09/26/07 19:58:33 by mki Ok, this explains a lot. I will ask the Gentoo people for an update. I dare to ask another newbie question: I can use my SimpleIterator? 'iter' to write a foreach loop over all whitespace-separated tokens in the input file. But this is quite restrictive, I want to read them one by some using a function which returns the next token. Something like this: char[] nextToken = iter.next(); Is it possible to do this somehow?
larsivi Joined: 03/27/04 Posts: 614	Posted: 09/26/07 21:18:56 Have you tried that code? It should work :)
mki Joined: 09/23/07 Posts: 7	Posted: 09/26/07 21:53:32 Now I have tried my code... :) If only more problems would dissapear as fast as this one...