Re: [RFC PATCH 0/10] split anon and file LRUs

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Rik van Riel
Date: Tuesday, November 6, 2007 - 7:23 pm

On Tue, 6 Nov 2007 18:11:39 -0800 (PST)
Christoph Lameter <clameter@sgi.com> wrote:


http://linux-mm.org/PageReplacementDesign


Linus seems to have vetoed that (unless I am mistaken), so the
chances of that happening soon are probably not very large.

Also, a factor 16 increase in page size is not going to help
if memory sizes also increase by a factor 16, since we already 
have trouble with today's memory sizes.

 
Hence, this patch series.


For some workloads this is the most urgent change, indeed.
Since the patches for this already exist, integrating them
is at the top of my list.  Expect this to be integrated into
the split VM patch series by the end of this week.


See http://linux-mm.org/PageReplacementDesign


The current worst case is where we need to scan all of memory, 
just to find a few pages we can swap out.  With the effects of
lock contention figured in, this can take hours on huge systems.

In order to make the VM more scalable, we need to find acceptable
pages to swap out with low complexity in the VM.  The "worst case"
above refers to the upper bound on how much work the VM needs to
do in order to get something evicted from the page cache or swapped
out.

-- 
"Debugging is twice as hard as writing the code in the first place.
Therefore, if you write the code as cleverly as possible, you are,
by definition, not smart enough to debug it." - Brian W. Kernighan
-
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[RFC PATCH 0/10] split anon and file LRUs, Rik van Riel, (Sat Nov 3, 3:42 pm)
[RFC PATCH 1/10] move isolate_lru_page to vmscan.c, Rik van Riel, (Sat Nov 3, 3:54 pm)
[RFC PATCH 3/10] define page_file_cache, Rik van Riel, (Sat Nov 3, 3:55 pm)
[RFC PATCH 4/10] debug page_file_cache, Rik van Riel, (Sat Nov 3, 3:55 pm)
[RFC PATCH 6/10] split anon and file LRUs, Rik van Riel, (Sat Nov 3, 4:01 pm)
[RFC PATCH 7/10] clean up the LRU array arithmetic, Rik van Riel, (Sat Nov 3, 4:02 pm)
[RFC PATCH 9/10] split VM and memory controllers, Rik van Riel, (Sat Nov 3, 4:04 pm)
Re: [RFC PATCH 0/10] split anon and file LRUs, Christoph Lameter, (Tue Nov 6, 7:11 pm)
Re: [RFC PATCH 1/10] move isolate_lru_page to vmscan.c, Christoph Lameter, (Tue Nov 6, 7:13 pm)
Re: [RFC PATCH 0/10] split anon and file LRUs, Rik van Riel, (Tue Nov 6, 7:23 pm)
Re: [RFC PATCH 3/10] define page_file_cache, Christoph Lameter, (Tue Nov 6, 7:23 pm)
Re: [RFC PATCH 6/10] split anon and file LRUs, Christoph Lameter, (Tue Nov 6, 7:28 pm)
Re: [RFC PATCH 0/10] split anon and file LRUs, Christoph Lameter, (Tue Nov 6, 7:40 pm)
Re: [RFC PATCH 0/10] split anon and file LRUs, Rik van Riel, (Tue Nov 6, 7:51 pm)
Re: [RFC PATCH 3/10] define page_file_cache, Rik van Riel, (Tue Nov 6, 7:55 pm)
Re: [RFC PATCH 6/10] split anon and file LRUs, Rik van Riel, (Tue Nov 6, 8:00 pm)
Re: [RFC PATCH 3/10] define page_file_cache, Christoph Lameter, (Tue Nov 6, 8:02 pm)
Re: [RFC PATCH 3/10] define page_file_cache, Rik van Riel, (Tue Nov 6, 8:17 pm)
Re: [RFC PATCH 3/10] define page_file_cache, Christoph Lameter, (Tue Nov 6, 8:26 pm)
Re: [RFC PATCH 3/10] define page_file_cache, Rik van Riel, (Wed Nov 7, 7:35 am)
Re: [RFC PATCH 0/10] split anon and file LRUs, Andrew Morton, (Wed Nov 7, 10:59 am)
Re: [RFC PATCH 3/10] define page_file_cache, Christoph Lameter, (Wed Nov 7, 11:06 am)
Re: [RFC PATCH 0/10] split anon and file LRUs, Rik van Riel, (Wed Nov 7, 11:16 am)
Re: [RFC PATCH 3/10] define page_file_cache, Rik van Riel, (Wed Nov 7, 11:17 am)