AWARE [SYSTEMS]
AWare Systems, Home TIFF and LibTiff Mail List Archive

LibTiff Mailing List

TIFF and LibTiff Mailing List Archive
January 2016

Previous Thread
Next Thread

Previous by Thread
Next by Thread

Previous by Date
Next by Date

Contact

The TIFF Mailing List Homepage
Archive maintained by AWare Systems



New Datamatrix section



Valid HTML 4.01!



Thread

2016.01.25 18:25 "[Tiff] OpenMP enabled libtiff", by Aaron Boxer
[...]
2016.01.29 15:48 "Re: [Tiff] OpenMP enabled libtiff", by Aaron Boxer
2016.01.29 15:49 "Re: [Tiff] OpenMP enabled libtiff", by Aaron Boxer
2016.01.29 18:12 "Re: [Tiff] OpenMP enabled libtiff", by Bob Friesenhahn
[...]

2016.01.29 15:49 "Re: [Tiff] OpenMP enabled libtiff", by Aaron Boxer

On Fri, Jan 29, 2016 at 10:48 AM, Aaron Boxer <boxerab@gmail.com> wrote:

On Fri, Jan 29, 2016 at 9:46 AM, Bob Friesenhahn < bfriesen@simple.dallas.tx.us> wrote:

Thanks. This is exactly the work flow I am interested in: tens of thousands of ~10 MB TIFFs, accessed

>>> sequentially. Only 4 files would be open at a given time. So, even >>> though the files get closed, are you

suggesting I will see swapping in this case?

It would not be true swapping or paging-out (actually, there could be some paging out to swap), but there will be memory pressure since memory mapping behaves as a cache. The file data is still in memory (by default) after the file has been unmapped and memory pages are re-claimed (existing contents forgotten, and page re-purposed) for new activity based on new memory pressures, and the time the memory has remained inactive.

The actual behavior is highly OS implementation dependent.

On Unix type systems, the madvise() function can be used to help control behavior of memory-mapped data (e.g. MADV_DONTNEED), but again behavior is highly OS implementation dependent and the only way to know for sure is to test.

Thanks, Bob. On windows, since there is no madvise function, wouldn't reading a file and memory mapping the file both give the same result: the file gets cached in the OS file cache, causing memory pressure when the cache gets filled up?

By reading, I mean using the fopen/fread interface, vs memory mapping.