Trace number 1562916

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? 1199.94 608.977

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l43_lambda.cnf
MD5SUM040db958f11a89b7e62063379f36b96a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark5.05823
Satisfiable
(Un)Satisfiability was proved
Number of variables30771
Number of clauses153033
Sum of the clauses size440888
Maximum clause length9
Minimum clause length1
Number of clauses of size 14034
Number of clauses of size 238515
Number of clauses of size 389223
Number of clauses of size 414666
Number of clauses of size 56466
Number of clauses of size over 5129

Solver Data 

0.39/0.42	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1562916-1240998854.cnf 
0.39/0.42	c Using SATTIMEOUT of 1200
0.39/0.42	c Using SATRAM of 1800
0.39/0.42	c Size of subset node = 16
0.39/0.42	c Variables = 30771
0.39/0.42	c Clauses = 153033
0.39/0.42	c Literals = 440888
0.39/0.42	c Reduced size:
0.39/0.42	c Variables = 30771
0.39/0.42	c Clauses = 137658
0.39/0.42	c Literals = 402281
0.39/0.42	c a2
0.79/0.86	c a1
13.29/13.30	c Independent sub-problems = 1
13.29/13.30	c Sub-problem with 25829 variables and 137658 clauses
13.29/13.30	c using permutation method 4
13.29/13.30	c count = 1
13.29/13.30	c Ordering finished 13.220 seconds
13.29/13.30	c mapped 13.300 seconds
13.29/13.30	c permuted 13.300 seconds
13.29/13.30	c about to sort
13.29/13.35	c sorted
15.29/15.35	c clauses now 137658
15.29/15.35	c init finished 13.470 seconds
15.29/15.35	c tree built 15.340 seconds
15.29/15.35	c 
15.29/15.35	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
15.29/15.35	c ---------------------------------|----------------------------------|------------------------------------------------------
15.29/15.35	c ................................ | ..........                       |                       15.3           0.0             
15.29/15.35	c ................................ | ..........                     1 |                       15.3           0.1             
15.29/15.35	c ****************................ | ..........                     2 |                       15.3           0.1            1
15.29/15.35	c ****************................ | ..........                     3 |                       15.3           0.2            1
15.29/15.35	c ****************................ | ..........                     4 |                       15.3           0.3            1
15.29/15.35	c ****************................ | ..........                     5 |                       15.3           0.3            1
15.29/15.35	c ****************................ | ..........                     6 |                       15.3           0.4            1
15.29/15.37	c ****************................ | ..........                  1000 | 2                     15.4          65.1          136
23.81/19.69	c ****************................ | ..........                409000 | 13686                 24.0       17041.7       293702
47.96/31.73	c ****************................ | ..........                939000 | 42618                 48.0       19550.3      2736141
71.91/43.74	c ****************................ | ..........               1383000 | 67179                 72.0       19205.7      4689343
95.86/55.79	c ****************................ | ..........               1722000 | 85636                 96.1       17926.3      6278073
120.01/67.81	c ****************................ | *.........               2034000 | 102640               120.1       16941.5      7685133
143.95/79.83	c ****************................ | *.........               2423000 | 124865               144.0       16821.7      9365487
167.90/91.84	c ****************................ | *.........               2710000 | 139689               168.0       16130.0     10620893
191.86/103.86	c ****************................ | *.........               2942000 | 151797               192.0       15321.3     11498112
215.80/115.88	c ****************................ | *.........               3141000 | 161739               216.0       14541.0     12317016
239.94/127.91	c ****************................ | **........               3462000 | 177671               240.0       14424.4     13504371
263.90/139.99	c ****************................ | **........               3876000 | 198840               264.1       14675.1     15198229
287.85/151.98	c ****************................ | **........               4103000 | 210356               288.1       14244.1     16060933
312.00/164.01	c ****************................ | **........               4300000 | 220646               312.1       13778.5     16908402
335.95/176.03	c ****************................ | **........               4474000 | 229516               336.1       13313.1     17617488
359.90/188.07	c ****************................ | ***.......               4670000 | 239981               360.1       12968.6     18331663
384.05/200.12	c ****************................ | ***.......               4831000 | 248043               384.1       12575.8     18995894
407.79/212.09	c ****************................ | ***.......               4988000 | 255795               408.0       12224.3     19684550
431.94/224.10	c ****************................ | ***.......               5263000 | 269602               432.0       12182.3     20801289
455.89/236.19	c ****************................ | ***.......               5469000 | 279946               456.1       11989.5     21773043
479.84/248.16	c ****************................ | ****......               5605000 | 286905               480.0       11676.1     22354217
503.79/260.18	c ****************................ | ****......               5783000 | 295802               504.0       11473.5     23046998
527.74/272.20	c ****************................ | ****......               6005000 | 306570               528.0       11372.7     23819740
551.89/284.26	c ****************................ | ****......               6230000 | 317567               552.1       11284.2     24621539
575.83/296.25	c ****************................ | ****......               6448000 | 328382               576.0       11193.9     25432990
599.98/308.33	c ****************................ | *****.....               6580000 | 334675               600.1       10964.3     25940428
623.72/320.29	c ****************................ | *****.....               6718000 | 341271               624.0       10766.0     26392398
647.88/332.34	c ****************................ | *****.....               6856000 | 347901               648.1       10579.3     26793175
671.83/344.35	c ****************................ | *****.....               7034000 | 356319               672.0       10466.8     27436180
695.79/356.37	c ****************................ | *****.....               7310000 | 369772               696.0       10502.4     28335394
719.93/368.41	c ****************................ | ******....               7523000 | 380117               720.1       10447.7     29119902
743.88/380.44	c ****************................ | ******....               7673000 | 387349               744.1       10312.2     29657703
767.83/392.44	c ****************................ | ******....               7848000 | 395808               768.0       10218.5     30178212
791.77/404.45	c ****************................ | ******....               8040000 | 405210               792.0       10151.5     30727145
815.90/416.53	c ****************................ | ******....               8232000 | 414713               816.1       10087.2     31307572
839.85/428.53	c ****************................ | *******...               8426000 | 424227               840.0       10030.4     31868861
863.79/440.59	c ****************................ | *******...               8590000 | 432418               864.1        9940.9     32418674
887.74/452.56	c ****************................ | *******...               8722000 | 438690               888.0        9822.1     32849292
911.90/464.64	c ****************................ | *******...               8857000 | 445128               912.1        9710.5     33297512
935.84/476.68	c ****************................ | *******...               8990000 | 451446               936.2        9603.1     33768849
959.79/488.65	c ****************................ | ********..               9121000 | 457756               960.0        9500.7     34180174
983.94/500.72	c ****************................ | ********..               9268000 | 464852               984.1        9417.3     34680130
1007.88/512.72	c ****************................ | ********..               9402000 | 471194              1008.1        9326.6     35088185
1031.64/524.70	c ****************................ | ********..               9572000 | 479619              1032.0        9275.2     35664077
1055.79/536.80	c ****************................ | ********..               9758000 | 488773              1056.2        9239.2     36402560
1079.94/548.84	c ****************................ | *********.               9883000 | 494874              1080.2        9149.4     36878943
1103.88/560.84	c ****************................ | *********.               9994000 | 500372              1104.1        9051.4     37262458
1127.82/572.81	c ****************................ | *********.              10147000 | 507852              1128.0        8995.3     37798705
1151.78/584.85	c ****************................ | *********.              10297000 | 515136              1152.0        8938.0     38302753
1175.93/596.91	c ****************................ | *********.              10449000 | 522599              1176.1        8884.2     38829547
1199.68/608.87	c CPU limit (1200) reached
1199.68/608.87	c Time = 1200.00 seconds
1199.68/608.87	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1562916-1240998854/watcher-1562916-1240998854 -o /tmp/evaluation-result-1562916-1240998854/solver-1562916-1240998854 -C 1200 -W 1800 -M 1800 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1562916-1240998854.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 0.97 0.78 3/65 2569
/proc/meminfo: memFree=811696/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=1064 CPUtime=0
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4194304 151 0 0 0 0 0 0 0 20 0 1 0 127914677 1089536 135 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 266 135 77 176 0 88 0

[startup+0.0140199 s]
/proc/loadavg: 1.00 0.97 0.78 3/65 2569
/proc/meminfo: memFree=811696/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=1468 CPUtime=0.01
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4194304 241 0 0 0 1 0 0 0 20 0 1 0 127914677 1503232 225 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 367 225 78 176 0 189 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 1468

[startup+0.101029 s]
/proc/loadavg: 1.00 0.97 0.78 3/65 2569
/proc/meminfo: memFree=811696/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=4636 CPUtime=0.09
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4194304 1042 0 0 0 9 0 0 0 20 0 1 0 127914677 4747264 1026 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 1159 1026 78 176 0 981 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4636

[startup+0.301048 s]
/proc/loadavg: 1.00 0.97 0.78 3/65 2569
/proc/meminfo: memFree=811696/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=11532 CPUtime=0.29
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4194304 2674 0 0 0 28 1 0 0 22 0 1 0 127914677 11808768 2658 1992294400 134512640 135237372 4294956192 18446744073709551615 134534067 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 2883 2658 78 176 0 2705 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 11532

[startup+0.70109 s]
/proc/loadavg: 1.00 0.97 0.78 3/65 2569
/proc/meminfo: memFree=811696/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=22236 CPUtime=0.69
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4194304 5258 0 0 0 67 2 0 0 25 0 1 0 127914677 22769664 5241 1992294400 134512640 135237372 4294956192 18446744073709551615 134680484 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 5559 5241 79 176 0 5381 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 22236

[startup+1.50117 s]
/proc/loadavg: 1.00 0.97 0.78 2/66 2570
/proc/meminfo: memFree=790952/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=26084 CPUtime=1.48
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4194304 6776 0 0 0 146 2 0 0 25 0 1 0 127914677 26710016 6347 1992294400 134512640 135237372 4294956192 18446744073709551615 134599426 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 6521 6347 80 176 0 6343 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 26084

[startup+3.10134 s]
/proc/loadavg: 1.00 0.97 0.78 2/66 2570
/proc/meminfo: memFree=786408/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=26376 CPUtime=3.08
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4194304 6799 0 0 0 306 2 0 0 25 0 1 0 127914677 27009024 6370 1992294400 134512640 135237372 4294956192 18446744073709551615 134600960 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 6594 6370 80 176 0 6416 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 26376

[startup+6.30167 s]
/proc/loadavg: 1.00 0.97 0.78 2/66 2570
/proc/meminfo: memFree=785960/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=26376 CPUtime=6.29
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4194304 6844 0 0 0 626 3 0 0 25 0 1 0 127914677 27009024 6415 1992294400 134512640 135237372 4294956192 18446744073709551615 134600718 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 6594 6415 80 176 0 6416 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 26376

[startup+12.7013 s]
/proc/loadavg: 1.00 0.97 0.79 2/66 2570
/proc/meminfo: memFree=785840/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=26508 CPUtime=12.69
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4194304 6866 0 0 0 1266 3 0 0 25 0 1 0 127914677 27144192 6437 1992294400 134512640 135237372 4294956192 18446744073709551615 134600718 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 6627 6437 80 176 0 6449 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 26508

[startup+25.5017 s]
/proc/loadavg: 1.15 1.00 0.80 3/68 2572
/proc/meminfo: memFree=695776/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=137276 CPUtime=35.59
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 29854 0 0 0 3545 14 0 0 25 0 3 0 127914677 140570624 29155 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 34319 29155 98 176 0 34141 0
[pid=2569/tid=2571] ppid=2567 vsize=137276 CPUtime=10.14
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 5965 0 0 0 1011 3 0 0 25 0 3 0 127916213 140570624 29155 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=137276 CPUtime=10.1
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 1566 0 0 0 1009 1 0 0 25 0 3 0 127916213 140570624 29155 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 35.59
Current children cumulated vsize (KiB) 137276

[startup+51.1013 s]
/proc/loadavg: 1.44 1.08 0.83 3/68 2572
/proc/meminfo: memFree=634528/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=199024 CPUtime=86.68
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 45208 0 0 0 8645 23 0 0 25 0 3 0 127914677 203800576 44509 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 49756 44509 98 176 0 49578 0
[pid=2569/tid=2571] ppid=2567 vsize=199024 CPUtime=35.73
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 19483 0 0 0 3564 9 0 0 25 0 3 0 127916213 203800576 44509 1992294400 134512640 135237372 4294956192 18446744073709551615 134589554 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=199024 CPUtime=35.6
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 3402 0 0 0 3556 4 0 0 25 0 3 0 127916213 203800576 44509 1992294400 134512640 135237372 4294956192 18446744073709551615 134562287 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 86.68
Current children cumulated vsize (KiB) 199024

[startup+102.307 s]
/proc/loadavg: 1.77 1.23 0.89 3/68 2572
/proc/meminfo: memFree=543840/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=290068 CPUtime=188.86
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 67588 0 0 0 18848 38 0 0 25 0 3 0 127914677 297029632 66889 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 72517 66889 98 176 0 72339 0
[pid=2569/tid=2571] ppid=2567 vsize=290068 CPUtime=86.92
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 39652 0 0 0 8670 22 0 0 25 0 3 0 127916213 297029632 66889 1992294400 134512640 135237372 4294956192 18446744073709551615 134562309 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=290068 CPUtime=86.59
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 5613 0 0 0 8653 6 0 0 25 0 3 0 127916213 297029632 66889 1992294400 134512640 135237372 4294956192 18446744073709551615 134590740 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 188.86
Current children cumulated vsize (KiB) 290068

[startup+162.302 s]
/proc/loadavg: 1.91 1.36 0.95 3/68 2572
/proc/meminfo: memFree=460064/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=378588 CPUtime=308.61
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 88682 0 0 0 30808 53 0 0 25 0 3 0 127914677 387674112 87983 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 94647 87983 98 176 0 94469 0
[pid=2569/tid=2571] ppid=2567 vsize=378588 CPUtime=146.89
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 58896 0 0 0 14655 34 0 0 25 0 3 0 127916213 387674112 87983 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=378588 CPUtime=146.35
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 7463 0 0 0 14627 8 0 0 25 0 3 0 127916213 387674112 87983 1992294400 134512640 135237372 4294956192 18446744073709551615 134562300 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 308.61
Current children cumulated vsize (KiB) 378588

[startup+222.301 s]
/proc/loadavg: 1.97 1.48 1.02 3/68 2572
/proc/meminfo: memFree=400416/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=440068 CPUtime=428.34
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 103439 0 0 0 42771 63 0 0 25 0 3 0 127914677 450629632 102740 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 110017 102740 98 176 0 109839 0
[pid=2569/tid=2571] ppid=2567 vsize=440068 CPUtime=206.88
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 70472 0 0 0 20646 42 0 0 25 0 3 0 127916213 450629632 102740 1992294400 134512640 135237372 4294956192 18446744073709551615 134749353 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=440068 CPUtime=206.1
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 10644 0 0 0 20599 11 0 0 25 0 3 0 127916213 450629632 102740 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 428.34
Current children cumulated vsize (KiB) 440068

[startup+282.301 s]
/proc/loadavg: 1.98 1.57 1.08 3/68 2572
/proc/meminfo: memFree=338272/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=503464 CPUtime=548.09
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 118963 0 0 0 54733 76 0 0 25 0 3 0 127914677 515547136 118264 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 125866 118264 98 176 0 125688 0
[pid=2569/tid=2571] ppid=2567 vsize=503464 CPUtime=266.86
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 83258 0 0 0 26635 51 0 0 25 0 3 0 127916213 515547136 118264 1992294400 134512640 135237372 4294956192 18446744073709551615 134680376 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=503464 CPUtime=265.87
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 13382 0 0 0 26573 14 0 0 25 0 3 0 127916213 515547136 118264 1992294400 134512640 135237372 4294956192 18446744073709551615 134562384 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 548.09
Current children cumulated vsize (KiB) 503464

[startup+342.302 s]
/proc/loadavg: 1.99 1.65 1.14 3/68 2572
/proc/meminfo: memFree=294688/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=547700 CPUtime=667.84
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 129805 0 0 0 66701 83 0 0 25 0 3 0 127914677 560844800 129106 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 136925 129106 98 176 0 136747 0
[pid=2569/tid=2571] ppid=2567 vsize=547700 CPUtime=326.85
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 92005 0 0 0 32628 57 0 0 25 0 3 0 127916213 560844800 129106 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=547700 CPUtime=325.62
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 15477 0 0 0 32546 16 0 0 25 0 3 0 127916213 560844800 129106 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 667.84
Current children cumulated vsize (KiB) 547700

[startup+402.303 s]
/proc/loadavg: 1.99 1.71 1.18 3/68 2572
/proc/meminfo: memFree=242592/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=600184 CPUtime=787.59
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 142863 0 0 0 78664 95 0 0 25 0 3 0 127914677 614588416 142164 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 150046 142164 98 176 0 149868 0
[pid=2569/tid=2571] ppid=2567 vsize=600184 CPUtime=386.83
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 103332 0 0 0 38617 66 0 0 25 0 3 0 127916213 614588416 142164 1992294400 134512640 135237372 4294956192 18446744073709551615 134562413 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=600184 CPUtime=385.38
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 17208 0 0 0 38520 18 0 0 25 0 3 0 127916213 614588416 142164 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 787.59
Current children cumulated vsize (KiB) 600184

[startup+462.303 s]
/proc/loadavg: 1.99 1.76 1.23 3/68 2578
/proc/meminfo: memFree=201376/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=643960 CPUtime=907.3
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 153037 0 0 0 90627 103 0 0 25 0 3 0 127914677 659415040 152338 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 160990 152338 98 176 0 160812 0
[pid=2569/tid=2571] ppid=2567 vsize=643960 CPUtime=446.82
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 111436 0 0 0 44610 72 0 0 25 0 3 0 127916213 659415040 152338 1992294400 134512640 135237372 4294956192 18446744073709551615 134590497 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=643960 CPUtime=445.12
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 19278 0 0 0 44491 21 0 0 25 0 3 0 127916213 659415040 152338 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 907.3
Current children cumulated vsize (KiB) 643960

[startup+522.302 s]
/proc/loadavg: 1.99 1.80 1.28 3/68 2578
/proc/meminfo: memFree=166496/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=681712 CPUtime=1027.05
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 161835 0 0 0 102596 109 0 0 25 0 3 0 127914677 698073088 161136 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 170428 161136 98 176 0 170250 0
[pid=2569/tid=2571] ppid=2567 vsize=681712 CPUtime=506.8
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 118471 0 0 0 50604 76 0 0 25 0 3 0 127916213 698073088 161136 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=681712 CPUtime=504.89
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 21041 0 0 0 50466 23 0 0 25 0 3 0 127916213 698073088 161136 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1027.05
Current children cumulated vsize (KiB) 681712

[startup+582.302 s]
/proc/loadavg: 1.99 1.83 1.32 3/68 2578
/proc/meminfo: memFree=123488/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=724332 CPUtime=1146.79
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 172497 0 0 0 114563 116 0 0 25 0 3 0 127914677 741715968 171798 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 181083 171798 98 176 0 180905 0
[pid=2569/tid=2571] ppid=2567 vsize=724332 CPUtime=566.79
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 127705 0 0 0 56597 82 0 0 25 0 3 0 127916213 741715968 171798 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=724332 CPUtime=564.65
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 22469 0 0 0 56441 24 0 0 25 0 3 0 127916213 741715968 171798 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1146.79
Current children cumulated vsize (KiB) 724332

Solver just ended. Dumping a history of the last processes samples

[startup+588.702 s]
/proc/loadavg: 1.99 1.84 1.32 3/68 2578
/proc/meminfo: memFree=118624/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=729264 CPUtime=1159.56
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 173619 0 0 0 115839 117 0 0 25 0 3 0 127914677 746766336 172920 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 182316 172920 98 176 0 182138 0
[pid=2569/tid=2571] ppid=2567 vsize=729264 CPUtime=573.18
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 128683 0 0 0 57235 83 0 0 25 0 3 0 127916213 746766336 172920 1992294400 134512640 135237372 4294956192 18446744073709551615 134589646 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=729264 CPUtime=571.02
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 22613 0 0 0 57078 24 0 0 25 0 3 0 127916213 746766336 172920 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1159.56
Current children cumulated vsize (KiB) 729264

[startup+601.501 s]
/proc/loadavg: 1.99 1.84 1.33 3/68 2578
/proc/meminfo: memFree=109152/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=739084 CPUtime=1185.1
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 176172 0 0 0 118392 118 0 0 25 0 3 0 127914677 756822016 175473 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 184771 175473 98 176 0 184593 0
[pid=2569/tid=2571] ppid=2567 vsize=739084 CPUtime=585.98
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 130914 0 0 0 58514 84 0 0 25 0 3 0 127916213 756822016 175473 1992294400 134512640 135237372 4294956192 18446744073709551615 134593478 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=739084 CPUtime=583.77
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 22935 0 0 0 58353 24 0 0 25 0 3 0 127916213 756822016 175473 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1185.1
Current children cumulated vsize (KiB) 739084

[startup+604.702 s]
/proc/loadavg: 1.99 1.84 1.33 3/68 2578
/proc/meminfo: memFree=105504/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=743712 CPUtime=1191.49
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 177167 0 0 0 119030 119 0 0 25 0 3 0 127914677 761561088 176468 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 185928 176468 98 176 0 185750 0
[pid=2569/tid=2571] ppid=2567 vsize=743712 CPUtime=589.17
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 131824 0 0 0 58833 84 0 0 25 0 3 0 127916213 761561088 176468 1992294400 134512640 135237372 4294956192 18446744073709551615 134562351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=743712 CPUtime=586.96
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 23020 0 0 0 58671 25 0 0 25 0 3 0 127916213 761561088 176468 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1191.49
Current children cumulated vsize (KiB) 743712

[startup+606.302 s]
/proc/loadavg: 1.99 1.84 1.33 3/68 2578
/proc/meminfo: memFree=102176/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=746064 CPUtime=1194.69
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 177787 0 0 0 119349 120 0 0 25 0 3 0 127914677 763969536 177088 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 186516 177088 98 176 0 186338 0
[pid=2569/tid=2571] ppid=2567 vsize=746064 CPUtime=590.78
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 132401 0 0 0 58993 85 0 0 25 0 3 0 127916213 763969536 177088 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=746064 CPUtime=588.55
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 23063 0 0 0 58830 25 0 0 25 0 3 0 127916213 763969536 177088 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1194.69
Current children cumulated vsize (KiB) 746064

[startup+607.903 s]
/proc/loadavg: 1.99 1.85 1.34 3/68 2578
/proc/meminfo: memFree=100576/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=748412 CPUtime=1197.88
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 178409 0 0 0 119668 120 0 0 25 0 3 0 127914677 766373888 177710 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 187103 177710 98 176 0 186925 0
[pid=2569/tid=2571] ppid=2567 vsize=748412 CPUtime=592.38
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 132980 0 0 0 59153 85 0 0 25 0 3 0 127916213 766373888 177710 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=748412 CPUtime=590.15
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 23106 0 0 0 58990 25 0 0 25 0 3 0 127916213 766373888 177710 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1197.88
Current children cumulated vsize (KiB) 748412

[startup+608.702 s]
/proc/loadavg: 1.99 1.85 1.34 3/68 2578
/proc/meminfo: memFree=98720/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=749868 CPUtime=1199.48
/proc/2569/stat : 2569 (ttsth-5-0) S 2567 2569 2448 0 -1 4194304 178795 0 0 0 119828 120 0 0 25 0 3 0 127914677 767864832 178096 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2569/statm: 187467 178096 98 176 0 187289 0
[pid=2569/tid=2571] ppid=2567 vsize=749868 CPUtime=593.17
/proc/2569/task/2571/stat : 2571 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 133347 0 0 0 59232 85 0 0 25 0 3 0 127916213 767864832 178096 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2569/tid=2572] ppid=2567 vsize=749868 CPUtime=590.95
/proc/2569/task/2572/stat : 2572 (ttsth-5-0) R 2567 2569 2448 0 -1 4194368 23125 0 0 0 59070 25 0 0 25 0 3 0 127916213 767864832 178096 1992294400 134512640 135237372 4294956192 18446744073709551615 134680484 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1199.48
Current children cumulated vsize (KiB) 749868

[startup+608.902 s]
/proc/loadavg: 1.99 1.85 1.34 3/68 2578
/proc/meminfo: memFree=98720/2055924 swapFree=4181464/4192956
[pid=2569] ppid=2567 vsize=0 CPUtime=1199.85
/proc/2569/stat : 2569 (ttsth-5-0) R 2567 2569 2448 0 -1 4195332 178865 0 0 0 119862 123 0 0 17 0 1 0 127914677 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/2569/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1199.85
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 608.977
CPU time (s): 1199.94
CPU user time (s): 1198.63
CPU system time (s): 1.3098
CPU usage (%): 197.041
Max. virtual memory (cumulated for all children) (KiB): 749868

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1198.63
system time used= 1.3098
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 178865
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 50
involuntary context switches= 9160

runsolver used 0.599908 second user time and 1.62575 second system time

The end

Launcher Data 

Begin job on node83 at 2009-04-29 11:54:14
IDJOB=1562916
IDBENCH=70943
IDSOLVER=549
FILE ID=node83/1562916-1240998854
PBS_JOBID= 9204789
Free space on /tmp= 66140 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l43_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1562916-1240998854/watcher-1562916-1240998854 -o /tmp/evaluation-result-1562916-1240998854/solver-1562916-1240998854 -C 1200 -W 1800 -M 1800  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1562916-1240998854.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= 040db958f11a89b7e62063379f36b96a
RANDOM SEED=514285944

node83.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.222
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.222
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055924 kB
MemFree:        812112 kB
Buffers:         90684 kB
Cached:        1052856 kB
SwapCached:       5388 kB
Active:         439380 kB
Inactive:       713164 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055924 kB
LowFree:        812112 kB
SwapTotal:     4192956 kB
SwapFree:      4181464 kB
Dirty:            3680 kB
Writeback:           0 kB
Mapped:          13564 kB
Slab:            77260 kB
Committed_AS:   546776 kB
PageTables:       1384 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66140 MiB
End job on node83 at 2009-04-29 12:04:23