Trace number 3386208

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (exit code) 835.531 212.636

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
MD5SUM48f03e5fbe31fc85b9a464480fc8aa5a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark752.735
Satisfiable
(Un)Satisfiability was proved
Number of variables1575206
Number of clauses8464620
Sum of the clauses size20118920
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 28393300
Number of clauses of size 3400
Number of clauses of size 41600
Number of clauses of size 54000
Number of clauses of size over 564600

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386208-1305579595/watcher-3386208-1305579595 -o /tmp/evaluation-result-3386208-1305579595/solver-3386208-1305579595 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386208-1305579595.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.08 9.14 9.04 6/398 26453
/proc/meminfo: memFree=16841616/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=43356 CPUtime=0 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 4172 0 0 0 0 0 0 0 22 0 1 0 669558232 44396544 4111 33554432000 4194304 4625164 140733700983008 18446744073709551615 4315093 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26453/statm: 10839 4113 291 106 0 6342 0

[startup+0.0456819 s]
/proc/loadavg: 9.08 9.14 9.04 6/398 26453
/proc/meminfo: memFree=16841616/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=55664 CPUtime=0.03 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 9596 0 0 0 3 0 0 0 22 0 1 0 669558232 56999936 9536 33554432000 4194304 4625164 140733700983008 18446744073709551615 4295708 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26453/statm: 13916 9558 291 106 0 9419 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 55664

[startup+0.100668 s]
/proc/loadavg: 9.08 9.14 9.04 6/398 26453
/proc/meminfo: memFree=16841616/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=347500 CPUtime=0.09 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 28479 0 0 0 6 3 0 0 22 0 1 0 669558232 355840000 28418 33554432000 4194304 4625164 140733700983008 18446744073709551615 232335892224 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26453/statm: 86875 28418 298 106 0 82378 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 347500

[startup+0.300634 s]
/proc/loadavg: 9.08 9.14 9.04 6/398 26453
/proc/meminfo: memFree=16841616/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=353044 CPUtime=0.29 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 31418 0 0 0 26 3 0 0 23 0 1 0 669558232 361517056 29617 33554432000 4194304 4625164 140733700983008 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26453/statm: 88261 29617 299 106 0 83764 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 353044

[startup+0.700562 s]
/proc/loadavg: 9.08 9.14 9.04 6/398 26453
/proc/meminfo: memFree=16841616/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=381220 CPUtime=0.69 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 45075 0 0 0 64 5 0 0 25 0 1 0 669558232 390369280 36061 33554432000 4194304 4625164 140733700983008 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26453/statm: 95305 36062 299 106 0 90808 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 381220

[startup+1.50042 s]
/proc/loadavg: 9.08 9.14 9.04 7/399 26454
/proc/meminfo: memFree=16639008/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=442180 CPUtime=1.49 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 77948 0 0 0 138 11 0 0 25 0 1 0 669558232 452792320 47580 33554432000 4194304 4625164 140733700983008 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26453/statm: 110545 47581 299 106 0 106048 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 442180

[startup+3.10014 s]
/proc/loadavg: 9.07 9.13 9.04 7/399 26454
/proc/meminfo: memFree=16538416/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=559116 CPUtime=3.09 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 139050 0 0 0 288 21 0 0 25 0 1 0 669558232 572534784 70747 33554432000 4194304 4625164 140733700983008 18446744073709551615 232335892224 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26453/statm: 139779 70747 299 106 0 135282 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 559116

[startup+6.30053 s]
/proc/loadavg: 9.07 9.13 9.04 10/402 26457
/proc/meminfo: memFree=15710344/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=1372964 CPUtime=14.7 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 303138 0 0 0 1433 37 0 0 25 0 4 0 669558232 1405915136 234160 33554432000 4194304 4625164 140733700983008 18446744073709551615 4390572 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 343241 234160 335 106 0 338744 0
[pid=26453/tid=26455] ppid=26451 vsize=1372964 CPUtime=2.8 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 4881 0 0 0 280 0 0 0 25 0 4 0 669558580 1405915136 234160 33554432000 4194304 4625164 140733700983008 18446744073709551615 4477965 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=1372964 CPUtime=2.8 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 5160 0 0 0 280 0 0 0 25 0 4 0 669558580 1405915136 234160 33554432000 4194304 4625164 140733700983008 18446744073709551615 4478009 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=1372964 CPUtime=2.78 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 8032 0 0 0 278 0 0 0 23 0 4 0 669558580 1405915136 234160 33554432000 4194304 4625164 140733700983008 18446744073709551615 4478002 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 14.7
Current children cumulated vsize (KiB) 1372964

[startup+12.7004 s]
/proc/loadavg: 9.06 9.13 9.04 10/402 26457
/proc/meminfo: memFree=15460748/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=1475452 CPUtime=40.22 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 315714 0 0 0 3982 40 0 0 25 0 4 0 669558232 1510862848 239915 33554432000 4194304 4625164 140733700983008 18446744073709551615 4392073 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 368863 239915 336 106 0 364366 0
[pid=26453/tid=26455] ppid=26451 vsize=1475452 CPUtime=9.21 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 6523 0 0 0 920 1 0 0 25 0 4 0 669558580 1510862848 239915 33554432000 4194304 4625164 140733700983008 18446744073709551615 4467199 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=1475452 CPUtime=9.2 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 6152 0 0 0 919 1 0 0 25 0 4 0 669558580 1510862848 239915 33554432000 4194304 4625164 140733700983008 18446744073709551615 4467219 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=1475452 CPUtime=9.09 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 9777 0 0 0 909 0 0 0 25 0 4 0 669558580 1510862848 239915 33554432000 4194304 4625164 140733700983008 18446744073709551615 4570672 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40.22
Current children cumulated vsize (KiB) 1475452

[startup+25.5011 s]
/proc/loadavg: 9.05 9.12 9.04 10/402 26458
/proc/meminfo: memFree=14496436/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=1940108 CPUtime=91.24 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 554888 0 0 0 9046 78 0 0 25 0 4 0 669558232 1986670592 343524 33554432000 4194304 4625164 140733700983008 18446744073709551615 4390864 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 485027 343524 336 106 0 480530 0
[pid=26453/tid=26455] ppid=26451 vsize=1940108 CPUtime=22 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 16305 0 0 0 2198 2 0 0 25 0 4 0 669558580 1986670592 343524 33554432000 4194304 4625164 140733700983008 18446744073709551615 4278657 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=1940108 CPUtime=22 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 11555 0 0 0 2198 2 0 0 25 0 4 0 669558580 1986670592 343524 33554432000 4194304 4625164 140733700983008 18446744073709551615 4464655 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=1940108 CPUtime=21.72 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 17865 0 0 0 2170 2 0 0 25 0 4 0 669558580 1986670592 343524 33554432000 4194304 4625164 140733700983008 18446744073709551615 4546825 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 91.24
Current children cumulated vsize (KiB) 1940108

[startup+51.1006 s]
/proc/loadavg: 8.85 9.08 9.03 7/396 26480
/proc/meminfo: memFree=19692440/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=3726224 CPUtime=193.26 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 1588000 0 0 0 19103 223 0 0 25 0 4 0 669558232 3815653376 706896 33554432000 4194304 4625164 140733700983008 18446744073709551615 4390435 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 931556 706896 347 106 0 927059 0
[pid=26453/tid=26455] ppid=26451 vsize=3726224 CPUtime=47.58 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 42570 0 0 0 4748 10 0 0 25 0 4 0 669558580 3815653376 706896 33554432000 4194304 4625164 140733700983008 18446744073709551615 4467243 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=3726224 CPUtime=47.55 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 13046 0 0 0 4751 4 0 0 25 0 4 0 669558580 3815653376 706896 33554432000 4194304 4625164 140733700983008 18446744073709551615 4317225 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=3726224 CPUtime=47 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 40325 0 0 0 4694 6 0 0 25 0 4 0 669558580 3815653376 706896 33554432000 4194304 4625164 140733700983008 18446744073709551615 4554736 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 193.26
Current children cumulated vsize (KiB) 3726224

[startup+102.315 s]
/proc/loadavg: 9.01 9.07 9.02 10/402 26500
/proc/meminfo: memFree=16367820/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=5397408 CPUtime=397.33 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 2514267 0 0 0 39359 374 0 0 25 0 4 0 669558232 5526945792 1161640 33554432000 4194304 4625164 140733700983008 18446744073709551615 4390549 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 1349352 1161641 337 106 0 1344855 0
[pid=26453/tid=26455] ppid=26451 vsize=5397408 CPUtime=98.75 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 92852 0 0 0 9852 23 0 0 25 0 4 0 669558580 5526945792 1161642 33554432000 4194304 4625164 140733700983008 18446744073709551615 4330590 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=5397408 CPUtime=98.71 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 16307 0 0 0 9865 6 0 0 25 0 4 0 669558580 5526945792 1161644 33554432000 4194304 4625164 140733700983008 18446744073709551615 4317360 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=5397408 CPUtime=97.55 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 75725 0 0 0 9744 11 0 0 25 0 4 0 669558580 5526945792 1161645 33554432000 4194304 4625164 140733700983008 18446744073709551615 4562224 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 397.33
Current children cumulated vsize (KiB) 5397408

[startup+162.301 s]
/proc/loadavg: 9.11 9.08 9.03 10/402 26501
/proc/meminfo: memFree=12103724/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=9578960 CPUtime=636.49 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 4945717 0 0 0 62930 719 0 0 25 0 4 0 669558232 9808855040 2001577 33554432000 4194304 4625164 140733700983008 18446744073709551615 4381976 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 2394740 2001577 337 106 0 2390243 0
[pid=26453/tid=26455] ppid=26451 vsize=9578960 CPUtime=158.74 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 93932 0 0 0 15851 23 0 0 25 0 4 0 669558580 9808855040 2001578 33554432000 4194304 4625164 140733700983008 18446744073709551615 4330976 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=9578960 CPUtime=158.68 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 28893 0 0 0 15859 9 0 0 25 0 4 0 669558580 9808855040 2001578 33554432000 4194304 4625164 140733700983008 18446744073709551615 4317935 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=9578960 CPUtime=156.76 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 113987 0 0 0 15659 17 0 0 25 0 4 0 669558580 9808855040 2001578 33554432000 4194304 4625164 140733700983008 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 636.49
Current children cumulated vsize (KiB) 9578960

Solver just ended. Dumping a history of the last processes samples

[startup+179.101 s]
/proc/loadavg: 9.08 9.08 9.03 10/402 26502
/proc/meminfo: memFree=10392644/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=15578148 CPUtime=703.47 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 5578533 0 0 0 69521 826 0 0 25 0 4 0 669558232 15952023552 2472064 33554432000 4194304 4625164 140733700983008 18446744073709551615 232335589845 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 3894537 2472085 337 106 0 3890040 0
[pid=26453/tid=26455] ppid=26451 vsize=15578148 CPUtime=175.54 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 94051 0 0 0 17531 23 0 0 25 0 4 0 669558580 15952023552 2472094 33554432000 4194304 4625164 140733700983008 18446744073709551615 4330590 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=15578148 CPUtime=175.47 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 29825 0 0 0 17538 9 0 0 25 0 4 0 669558580 15952023552 2472106 33554432000 4194304 4625164 140733700983008 18446744073709551615 4317197 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=15578148 CPUtime=173.35 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 122160 0 0 0 17317 18 0 0 25 0 4 0 669558580 15952023552 2472117 33554432000 4194304 4625164 140733700983008 18446744073709551615 4375424 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 703.47
Current children cumulated vsize (KiB) 15578148

[startup+191.901 s]
/proc/loadavg: 9.20 9.11 9.04 11/402 26502
/proc/meminfo: memFree=9540072/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=10983096 CPUtime=754.17 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 6821832 0 0 0 74404 1013 0 0 25 0 4 0 669558232 11246690304 2497923 33554432000 4194304 4625164 140733700983008 18446744073709551615 4390606 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 2745774 2497923 354 106 0 2741277 0
[pid=26453/tid=26455] ppid=26451 vsize=10983096 CPUtime=188.34 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 94093 0 0 0 18811 23 0 0 25 0 4 0 669558580 11246690304 2497923 33554432000 4194304 4625164 140733700983008 18446744073709551615 4330596 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=10983096 CPUtime=188.11 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 31489 0 0 0 18802 9 0 0 25 0 4 0 669558580 11246690304 2497923 33554432000 4194304 4625164 140733700983008 18446744073709551615 4317246 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=10983096 CPUtime=185.8 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 128298 0 0 0 18561 19 0 0 25 0 4 0 669558580 11246690304 2497923 33554432000 4194304 4625164 140733700983008 18446744073709551615 4334930 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 754.17
Current children cumulated vsize (KiB) 10983096

[startup+204.7 s]
/proc/loadavg: 9.17 9.10 9.04 10/402 26502
/proc/meminfo: memFree=8954040/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=11225004 CPUtime=805.2 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 6967243 0 0 0 79473 1047 0 0 25 0 4 0 669558232 11494404096 2617528 33554432000 4194304 4625164 140733700983008 18446744073709551615 4390540 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 2806251 2617528 337 106 0 2801754 0
[pid=26453/tid=26455] ppid=26451 vsize=11225004 CPUtime=201.14 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 94139 0 0 0 20091 23 0 0 25 0 4 0 669558580 11494404096 2617528 33554432000 4194304 4625164 140733700983008 18446744073709551615 4330822 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=11225004 CPUtime=200.91 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 31538 0 0 0 20082 9 0 0 25 0 4 0 669558580 11494404096 2617528 33554432000 4194304 4625164 140733700983008 18446744073709551615 4317246 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=11225004 CPUtime=198.43 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 134534 0 0 0 19824 19 0 0 25 0 4 0 669558580 11494404096 2617528 33554432000 4194304 4625164 140733700983008 18446744073709551615 4334254 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 805.2
Current children cumulated vsize (KiB) 11225004

[startup+207.915 s]
/proc/loadavg: 9.16 9.10 9.03 10/402 26503
/proc/meminfo: memFree=8822600/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=11356076 CPUtime=818.02 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 7003919 0 0 0 80745 1057 0 0 25 0 4 0 669558232 11628621824 2647180 33554432000 4194304 4625164 140733700983008 18446744073709551615 4278657 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 2839019 2647180 337 106 0 2834522 0
[pid=26453/tid=26455] ppid=26451 vsize=11356076 CPUtime=204.35 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 94203 0 0 0 20412 23 0 0 25 0 4 0 669558580 11628621824 2647180 33554432000 4194304 4625164 140733700983008 18446744073709551615 4330584 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=11356076 CPUtime=204.12 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 31538 0 0 0 20403 9 0 0 25 0 4 0 669558580 11628621824 2647180 33554432000 4194304 4625164 140733700983008 18446744073709551615 4317543 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=11356076 CPUtime=201.61 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 135914 0 0 0 20141 20 0 0 25 0 4 0 669558580 11628621824 2647180 33554432000 4194304 4625164 140733700983008 18446744073709551615 4554848 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 818.02
Current children cumulated vsize (KiB) 11356076

[startup+211.101 s]
/proc/loadavg: 9.16 9.10 9.03 10/402 26503
/proc/meminfo: memFree=8562572/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=11421612 CPUtime=830.78 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 7077034 0 0 0 82004 1074 0 0 25 0 4 0 669558232 11695730688 2708455 33554432000 4194304 4625164 140733700983008 18446744073709551615 232335553569 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 2855403 2708455 337 106 0 2850906 0
[pid=26453/tid=26455] ppid=26451 vsize=11421612 CPUtime=207.55 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 94217 0 0 0 20732 23 0 0 25 0 4 0 669558580 11695730688 2708455 33554432000 4194304 4625164 140733700983008 18446744073709551615 4330502 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=11421612 CPUtime=207.32 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 31538 0 0 0 20723 9 0 0 25 0 4 0 669558580 11695730688 2708455 33554432000 4194304 4625164 140733700983008 18446744073709551615 4317551 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=11421612 CPUtime=204.77 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 137849 0 0 0 20457 20 0 0 25 0 4 0 669558580 11695730688 2708455 33554432000 4194304 4625164 140733700983008 18446744073709551615 4554548 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 830.78
Current children cumulated vsize (KiB) 11421612

[startup+211.901 s]
/proc/loadavg: 9.16 9.10 9.03 10/402 26503
/proc/meminfo: memFree=8562572/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=11487148 CPUtime=833.92 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) R 26451 26453 25968 0 -1 4202496 7092825 0 0 0 82315 1077 0 0 25 0 4 0 669558232 11762839552 2721309 33554432000 4194304 4625164 140733700983008 18446744073709551615 4360345 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 2871787 2721314 337 106 0 2867290 0
[pid=26453/tid=26455] ppid=26451 vsize=11487148 CPUtime=208.34 cores=0,2,4,6
/proc/26453/task/26455/stat : 26455 (SArTagnan) R 26451 26453 25968 0 -1 4202560 94219 0 0 0 20811 23 0 0 25 0 4 0 669558580 11762839552 2721314 33554432000 4194304 4625164 140733700983008 18446744073709551615 4330590 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26453/tid=26456] ppid=26451 vsize=11487148 CPUtime=208.11 cores=0,2,4,6
/proc/26453/task/26456/stat : 26456 (SArTagnan) R 26451 26453 25968 0 -1 4202560 31538 0 0 0 20802 9 0 0 25 0 4 0 669558580 11762839552 2721314 33554432000 4194304 4625164 140733700983008 18446744073709551615 4317279 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=11487148 CPUtime=205.55 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4202560 138105 0 0 0 20535 20 0 0 25 0 4 0 669558580 11762839552 2721314 33554432000 4194304 4625164 140733700983008 18446744073709551615 4288743 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 833.92
Current children cumulated vsize (KiB) 11487148

[startup+212.315 s]
/proc/loadavg: 9.23 9.12 9.04 7/400 26503
/proc/meminfo: memFree=8715464/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=0 CPUtime=835.2 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) Z 26451 26453 25968 0 -1 4202524 7097506 0 0 0 82429 1091 0 0 25 0 2 0 669558232 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 0 0 0 0 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=0 CPUtime=205.96 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4203588 138108 0 0 0 20564 32 0 0 25 0 2 0 669558580 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 835.2
Current children cumulated vsize (KiB) 0

[startup+212.501 s]
/proc/loadavg: 9.23 9.12 9.04 7/400 26503
/proc/meminfo: memFree=8715464/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=0 CPUtime=835.38 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) Z 26451 26453 25968 0 -1 4202524 7097506 0 0 0 82429 1109 0 0 25 0 2 0 669558232 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 0 0 0 0 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=0 CPUtime=206.15 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4203588 138108 0 0 0 20564 51 0 0 25 0 2 0 669558580 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 835.38
Current children cumulated vsize (KiB) 0

[startup+212.601 s]
/proc/loadavg: 9.23 9.12 9.04 7/400 26503
/proc/meminfo: memFree=8715464/32951124 swapFree=65173164/67111528
[pid=26453] ppid=26451 vsize=0 CPUtime=835.48 cores=0,2,4,6
/proc/26453/stat : 26453 (SArTagnan) Z 26451 26453 25968 0 -1 4202524 7097506 0 0 0 82429 1119 0 0 25 0 2 0 669558232 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26453/statm: 0 0 0 0 0 0 0
[pid=26453/tid=26457] ppid=26451 vsize=0 CPUtime=206.25 cores=0,2,4,6
/proc/26453/task/26457/stat : 26457 (SArTagnan) R 26451 26453 25968 0 -1 4203588 138108 0 0 0 20564 61 0 0 25 0 2 0 669558580 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 835.48
Current children cumulated vsize (KiB) 0

Child status: 1
Real time (s): 212.636
CPU time (s): 835.531
CPU user time (s): 824.299
CPU system time (s): 11.2323
CPU usage (%): 392.939
Max. virtual memory (cumulated for all children) (KiB): 15578148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 824.299
system time used= 11.2323
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7097506
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2123
involuntary context switches= 12224

runsolver used 0.78388 second user time and 1.93571 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-16 23:00:01
IDJOB=3386208
IDBENCH=82388
IDSOLVER=1871
FILE ID=node132/3386208-1305579595
RUNJOBID= node132-1305576571-25986
PBS_JOBID= 13350206
Free space on /tmp= 73108 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386208-1305579595/watcher-3386208-1305579595 -o /tmp/evaluation-result-3386208-1305579595/solver-3386208-1305579595 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386208-1305579595.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 48f03e5fbe31fc85b9a464480fc8aa5a
RANDOM SEED=475571105

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16841648 kB
Buffers:        316564 kB
Cached:        3726048 kB
SwapCached:       9908 kB
Active:        9691640 kB
Inactive:      6071148 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16841648 kB
SwapTotal:    67111528 kB
SwapFree:     65173164 kB
Dirty:          170968 kB
Writeback:           0 kB
AnonPages:    11716768 kB
Mapped:          25244 kB
Slab:           228468 kB
PageTables:      51732 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 85707820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72940 MiB
End job on node132 at 2011-05-16 23:03:33