Trace number 3266482

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
rcl 2011-04-01? (TO) 1300.05 1300.01

General information on the benchmark

NameSAT02/handmade/simon/satex-challenges/
par32-3.shuffled.cnf
MD5SUM0115a0e26236f3f01aa829c2004452c1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.6469
Satisfiable
(Un)Satisfiability was proved
Number of variables3176
Number of clauses10297
Sum of the clauses size27581
Maximum clause length3
Minimum clause length1
Number of clauses of size 1141
Number of clauses of size 23028
Number of clauses of size 37128
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Parsing...
0.00/0.00	c ==============================================================================
0.00/0.00	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.00	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.00	c ==============================================================================
0.00/0.00	c |         0 |    9903    26592 |    2970       0        0     nan |  0.000 % |
0.00/0.02	c |         0 |    5117    18265 |      --       0       --      -- |     --   | -2195/-1159
0.00/0.02	c ==============================================================================
0.00/0.02	c Result  :   #vars: 866   #clauses: 5117   #literals: 18265
0.00/0.02	c CPU time:   0.022996 s
0.00/0.02	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3266482-1303578727/watcher-3266482-1303578727 -o /tmp/evaluation-result-3266482-1303578727/solver-3266482-1303578727 -C 2400 -W 1300 -M 7680 ./esg_static.sh HOME/instance-3266482-1303578727.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.12 3.81 3.86 4/186 2463
/proc/meminfo: memFree=12927784/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 328 0 0 0 0 0 0 0 23 0 1 0 469475027 8908800 249 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 249 209 178 0 68 0

[startup+0.0755649 s]
/proc/loadavg: 3.12 3.81 3.86 4/186 2463
/proc/meminfo: memFree=12927784/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 8700

[startup+0.100559 s]
/proc/loadavg: 3.12 3.81 3.86 4/186 2463
/proc/meminfo: memFree=12927784/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 8700

[startup+0.300522 s]
/proc/loadavg: 3.12 3.81 3.86 4/186 2463
/proc/meminfo: memFree=12927784/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 8700

[startup+0.700456 s]
/proc/loadavg: 3.12 3.81 3.86 4/186 2463
/proc/meminfo: memFree=12927784/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 8700

[startup+1.50037 s]
/proc/loadavg: 3.12 3.81 3.86 5/194 2478
/proc/meminfo: memFree=12916188/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=8612 CPUtime=1.46 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 636 0 0 0 146 0 0 0 25 0 1 0 469475030 8818688 546 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 2153 546 129 6 0 623 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 17312

[startup+3.10102 s]
/proc/loadavg: 3.12 3.81 3.86 5/194 2478
/proc/meminfo: memFree=12913336/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=9468 CPUtime=3.07 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 855 0 0 0 307 0 0 0 25 0 1 0 469475030 9695232 765 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208516 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 2367 765 130 6 0 837 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 18168

[startup+6.30044 s]
/proc/loadavg: 3.19 3.82 3.86 5/194 2478
/proc/meminfo: memFree=12906392/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=10428 CPUtime=6.26 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 1081 0 0 0 626 0 0 0 25 0 1 0 469475030 10678272 991 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 2607 991 130 6 0 1077 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 19128

[startup+12.7002 s]
/proc/loadavg: 3.26 3.82 3.86 5/194 2478
/proc/meminfo: memFree=12896736/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=11736 CPUtime=12.66 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 1416 0 0 0 1266 0 0 0 25 0 1 0 469475030 12017664 1326 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208464 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 2934 1326 131 6 0 1404 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 20436

[startup+25.5008 s]
/proc/loadavg: 3.42 3.83 3.86 5/194 2479
/proc/meminfo: memFree=12888036/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=14024 CPUtime=25.46 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 2020 0 0 0 2546 0 0 0 25 0 1 0 469475030 14360576 1900 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208532 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 3506 1900 131 6 0 1976 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 22724

[startup+51.101 s]
/proc/loadavg: 3.62 3.84 3.86 5/194 2479
/proc/meminfo: memFree=12875472/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=16584 CPUtime=51.06 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 2770 0 0 0 5106 0 0 0 25 0 1 0 469475030 16982016 2558 33554432000 4194304 4218580 140736738221376 18446744073709551615 4211905 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 4146 2558 131 6 0 2616 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 25284

[startup+102.307 s]
/proc/loadavg: 3.83 3.86 3.87 5/194 2481
/proc/meminfo: memFree=12857228/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=19104 CPUtime=102.27 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 3688 0 0 0 10226 1 0 0 25 0 1 0 469475030 19562496 3158 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 4776 3158 131 6 0 3246 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 27804

[startup+162.301 s]
/proc/loadavg: 3.97 3.90 3.88 5/194 2482
/proc/meminfo: memFree=12842460/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=23804 CPUtime=162.26 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 5267 0 0 0 16225 1 0 0 25 0 1 0 469475030 24375296 4364 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208521 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 5951 4364 131 6 0 4421 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 32504

[startup+222.301 s]
/proc/loadavg: 3.99 3.91 3.88 5/194 2484
/proc/meminfo: memFree=12836360/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=24496 CPUtime=222.27 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 5852 0 0 0 22225 2 0 0 25 0 1 0 469475030 25083904 4503 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208516 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 6124 4503 131 6 0 4594 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 33196

[startup+282.301 s]
/proc/loadavg: 3.99 3.93 3.89 5/194 2486
/proc/meminfo: memFree=12826916/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=25412 CPUtime=282.27 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 6500 0 0 0 28225 2 0 0 25 0 1 0 469475030 26021888 4738 33554432000 4194304 4218580 140736738221376 18446744073709551615 4211929 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 6353 4738 131 6 0 4823 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 34112

[startup+342.301 s]
/proc/loadavg: 3.99 3.94 3.89 5/194 2487
/proc/meminfo: memFree=12823040/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=26536 CPUtime=342.27 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 7209 0 0 0 34224 3 0 0 25 0 1 0 469475030 27172864 5043 33554432000 4194304 4218580 140736738221376 18446744073709551615 4211718 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 6634 5043 131 6 0 5104 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 35236

[startup+402.3 s]
/proc/loadavg: 3.99 3.95 3.90 5/194 2489
/proc/meminfo: memFree=12815836/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6

################
# More data... #
################

[pid=2466] ppid=2463 vsize=32024 CPUtime=522.28 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 9682 0 0 0 52224 4 0 0 25 0 1 0 469475030 32792576 6392 33554432000 4194304 4218580 140736738221376 18446744073709551615 4211905 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 8006 6392 131 6 0 6476 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 40724

[startup+582.3 s]
/proc/loadavg: 4.02 3.99 3.91 5/194 2494
/proc/meminfo: memFree=12802504/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=31996 CPUtime=582.28 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 10157 0 0 0 58224 4 0 0 25 0 1 0 469475030 32763904 6387 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 7999 6387 131 6 0 6469 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 40696

[startup+642.301 s]
/proc/loadavg: 4.01 3.99 3.91 5/194 2495
/proc/meminfo: memFree=12798144/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=33968 CPUtime=642.29 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 11057 0 0 0 64224 5 0 0 25 0 1 0 469475030 34783232 6907 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208546 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 8492 6907 131 6 0 6962 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 42668

[startup+702.301 s]
/proc/loadavg: 4.00 3.99 3.91 5/194 2497
/proc/meminfo: memFree=12773584/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=34108 CPUtime=702.29 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 11524 0 0 0 70224 5 0 0 25 0 1 0 469475030 34926592 6937 33554432000 4194304 4218580 140736738221376 18446744073709551615 4211905 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 8527 6937 131 6 0 6997 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 42808

[startup+762.307 s]
/proc/loadavg: 4.03 4.00 3.92 5/194 2498
/proc/meminfo: memFree=12763272/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=34716 CPUtime=762.3 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 12112 0 0 0 76224 6 0 0 25 0 1 0 469475030 35549184 7088 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208519 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 8679 7088 131 6 0 7149 0
Current children cumulated CPU time (s) 762.32
Current children cumulated vsize (KiB) 43416

[startup+822.301 s]
/proc/loadavg: 4.01 4.00 3.92 5/194 2500
/proc/meminfo: memFree=12751596/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=34524 CPUtime=822.29 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 12544 0 0 0 82223 6 0 0 25 0 1 0 469475030 35352576 7048 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 8631 7048 131 6 0 7101 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 43224

[startup+882.301 s]
/proc/loadavg: 4.00 4.00 3.92 5/194 2502
/proc/meminfo: memFree=12738300/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=35396 CPUtime=882.29 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 13084 0 0 0 88223 6 0 0 25 0 1 0 469475030 36245504 7261 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208408 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 8849 7261 131 6 0 7319 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 44096

[startup+942.301 s]
/proc/loadavg: 4.00 4.00 3.92 5/194 2503
/proc/meminfo: memFree=12726616/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=36232 CPUtime=942.29 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 13615 0 0 0 94223 6 0 0 25 0 1 0 469475030 37101568 7475 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 9058 7475 131 6 0 7528 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 44932

[startup+1002.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/194 2505
/proc/meminfo: memFree=12715320/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=38116 CPUtime=1002.3 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 14330 0 0 0 100223 7 0 0 25 0 1 0 469475030 39030784 7942 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 9529 7942 131 6 0 7999 0
Current children cumulated CPU time (s) 1002.32
Current children cumulated vsize (KiB) 46816

[startup+1062.3 s]
/proc/loadavg: 4.03 4.01 3.93 5/194 2506
/proc/meminfo: memFree=12705384/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=38820 CPUtime=1062.3 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 14744 0 0 0 106223 7 0 0 25 0 1 0 469475030 39751680 8122 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 9705 8122 131 6 0 8175 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 47520

[startup+1122.3 s]
/proc/loadavg: 4.01 4.01 3.93 5/194 2508
/proc/meminfo: memFree=12692216/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=39820 CPUtime=1122.3 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 15280 0 0 0 112223 7 0 0 25 0 1 0 469475030 40775680 8371 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 9955 8371 131 6 0 8425 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 48520

[startup+1182.3 s]
/proc/loadavg: 4.08 4.02 3.93 5/194 2510
/proc/meminfo: memFree=12683264/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=39856 CPUtime=1182.3 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 15714 0 0 0 118223 7 0 0 25 0 1 0 469475030 40812544 8376 33554432000 4194304 4218580 140736738221376 18446744073709551615 4211718 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 9964 8376 131 6 0 8434 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 48556

[startup+1242.3 s]
/proc/loadavg: 4.03 4.01 3.93 5/194 2511
/proc/meminfo: memFree=12674684/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=39580 CPUtime=1242.31 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 16144 0 0 0 124223 8 0 0 25 0 1 0 469475030 40529920 8312 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208418 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 9895 8312 131 6 0 8365 0
Current children cumulated CPU time (s) 1242.33
Current children cumulated vsize (KiB) 48280



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.01 4.00 3.93 3/189 2516
/proc/meminfo: memFree=12734108/32951124 swapFree=67111528/67111528
[pid=2463] ppid=2461 vsize=8700 CPUtime=0.02 cores=4,6
/proc/2463/stat : 2463 (esg_static.sh) S 2461 2463 504 0 -1 4202496 353 544 0 0 0 0 2 0 23 0 1 0 469475027 8908800 252 33554432000 4194304 4922060 140733486575184 18446744073709551615 212435836037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2463/statm: 2175 252 209 178 0 68 0
[pid=2466] ppid=2463 vsize=39772 CPUtime=1300.01 cores=4,6
/proc/2466/stat : 2466 (cdcl) R 2463 2463 504 0 -1 4202496 16581 0 0 0 129993 8 0 0 25 0 1 0 469475030 40726528 8357 33554432000 4194304 4218580 140736738221376 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/2466/statm: 9943 8357 131 6 0 8413 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 48472

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1300.01
CPU time (s): 1300.05
CPU user time (s): 1299.97
CPU system time (s): 0.087986
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 48664

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.97
system time used= 0.087986
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17691
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 1195

runsolver used 2.30365 second user time and 4.79327 second system time

The end

Launcher Data 

Begin job on node102 at 2011-04-23 19:12:07
IDJOB=3266482
IDBENCH=87739
IDSOLVER=1609
FILE ID=node102/3266482-1303578727
RUNJOBID= node102-1303578726-2428
PBS_JOBID= 13150307
Free space on /tmp= 70712 MiB

SOLVER NAME= rcl 2011-04-01
BENCH NAME= SAT02/handmade/simon/satex-challenges/par32-3.shuffled.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3266482-1303578727/watcher-3266482-1303578727 -o /tmp/evaluation-result-3266482-1303578727/solver-3266482-1303578727 -C 2400 -W 1300 -M 7680  ./esg_static.sh HOME/instance-3266482-1303578727.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 0115a0e26236f3f01aa829c2004452c1
RANDOM SEED=652617249

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12928072 kB
Buffers:       1838608 kB
Cached:       17559308 kB
SwapCached:          0 kB
Active:        9805448 kB
Inactive:      9660468 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12928072 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            3928 kB
Writeback:           0 kB
AnonPages:       67768 kB
Mapped:          15156 kB
Slab:           493996 kB
PageTables:       5104 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   236140 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 70712 MiB
End job on node102 at 2011-04-23 19:33:47