Trace number 1779853

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1021.52 487.039

General information on the benchmark

NameAPPLICATIONS/aprove09/
AProVE09-11.cnf
MD5SUM0f6b435a3aa045f7fe1d5c154e2f0953
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.94
Satisfiable
(Un)Satisfiability was proved
Number of variables20192
Number of clauses78082
Sum of the clauses size207558
Maximum clause length224
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 238969
Number of clauses of size 334065
Number of clauses of size 42452
Number of clauses of size 5405
Number of clauses of size over 52190

Solver Data 

0.10/0.14	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779853-1243680150.cnf 
0.10/0.14	c Using SATTIMEOUT of 10000
0.10/0.14	c Using SATRAM of 2047
0.10/0.14	c Size of subset node = 16
0.10/0.14	c Variables = 20192
0.10/0.14	c Clauses = 78082
0.10/0.14	c Literals = 207558
0.10/0.14	c Reduced size:
0.10/0.14	c Variables = 20192
0.10/0.14	c Clauses = 77131
0.10/0.14	c Literals = 205200
0.10/0.14	c a2
0.30/0.31	c a1
3.70/3.77	c Independent sub-problems = 1
3.70/3.77	c Sub-problem with 19942 variables and 77131 clauses
3.70/3.77	c using permutation method 4
3.70/3.77	c count = 1
3.70/3.77	c Ordering finished 3.730 seconds
3.70/3.77	c mapped 3.760 seconds
3.70/3.77	c permuted 3.760 seconds
3.70/3.77	c about to sort
3.70/3.78	c sorted
10.09/10.15	c clauses now 77131
10.09/10.15	c init finished 3.910 seconds
10.09/10.15	c tree built 10.150 seconds
10.09/10.15	c 
10.09/10.15	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
10.09/10.15	c ---------------------------------|----------------------------------|------------------------------------------------------
10.09/10.15	c ................................ | ..........                       |                       10.2           0.0             
10.09/10.15	c ................................ | ..........                     1 |                       10.2           0.1             
10.09/10.15	c ................................ | ..........                     2 |                       10.2           0.2             
10.09/10.15	c ................................ | ..........                     3 |                       10.2           0.3             
10.09/10.15	c ................................ | ..........                     4 |                       10.2           0.4             
10.09/10.15	c ................................ | ..........                     5 |                       10.2           0.5             
10.09/10.16	c ................................ | ..........                  1000 | 41                    10.2          98.5          752
200.06/99.36	c ................................ | ..........               6816000 | 423475               200.2       34051.1     24652636
400.00/192.52	c ................................ | ..........              10707000 | 676414               400.0       26766.8     44857131
599.85/289.47	c ................................ | ..........              13679000 | 891666               600.0       22798.3     69215414
800.03/377.52	c ................................ | ..........              16090000 | 1079651              800.0       20111.2     92891180
1000.20/476.33	c ................................ | *.........              18651000 | 1279447             1000.2       18646.5    115941783

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1779853-1243680150/watcher-1779853-1243680150 -o /tmp/evaluation-result-1779853-1243680150/solver-1779853-1243680150 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779853-1243680150.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.64 6.45 5.87 5/117 16767
/proc/meminfo: memFree=3071100/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=1272 CPUtime=0.01
/proc/16767/stat : 16767 (ttsth-5-0) R 16765 16767 10612 0 -1 4202496 228 0 0 0 1 0 0 0 19 0 1 0 1132677774 1302528 183 4294967295 134512640 135237372 3220251232 3220250100 134885056 0 0 0 0 0 0 0 17 2 0 0 0
/proc/16767/statm: 318 183 75 177 0 140 0

[startup+0.077973 s]
/proc/loadavg: 6.64 6.45 5.87 5/117 16767
/proc/meminfo: memFree=3071100/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=4304 CPUtime=0.07
/proc/16767/stat : 16767 (ttsth-5-0) R 16765 16767 10612 0 -1 4202496 966 0 0 0 7 0 0 0 19 0 1 0 1132677774 4407296 921 4294967295 134512640 135237372 3220251232 3220250028 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/16767/statm: 1076 921 75 177 0 898 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 4304

[startup+0.107966 s]
/proc/loadavg: 6.64 6.45 5.87 5/117 16767
/proc/meminfo: memFree=3071100/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=5744 CPUtime=0.1
/proc/16767/stat : 16767 (ttsth-5-0) R 16765 16767 10612 0 -1 4202496 1301 0 0 0 9 1 0 0 19 0 1 0 1132677774 5881856 1256 4294967295 134512640 135237372 3220251232 3220249756 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/16767/statm: 1436 1256 75 177 0 1258 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 5744

[startup+0.307955 s]
/proc/loadavg: 6.64 6.45 5.87 5/117 16767
/proc/meminfo: memFree=3071100/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=12140 CPUtime=0.3
/proc/16767/stat : 16767 (ttsth-5-0) R 16765 16767 10612 0 -1 4202496 2846 0 0 0 28 2 0 0 20 0 1 0 1132677774 12431360 2800 4294967295 134512640 135237372 3220251232 3220250288 134680727 0 0 0 0 0 0 0 17 2 0 0 0
/proc/16767/statm: 3035 2800 76 177 0 2857 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 12140

[startup+0.707934 s]
/proc/loadavg: 6.64 6.45 5.87 5/117 16767
/proc/meminfo: memFree=3071100/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=15036 CPUtime=0.7
/proc/16767/stat : 16767 (ttsth-5-0) R 16765 16767 10612 0 -1 4202496 3808 0 0 0 68 2 0 0 21 0 1 0 1132677774 15396864 3564 4294967295 134512640 135237372 3220251232 3220250560 134555272 0 0 0 0 0 0 0 17 2 0 0 0
/proc/16767/statm: 3759 3564 77 177 0 3581 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 15036

[startup+1.50789 s]
/proc/loadavg: 6.64 6.45 5.87 4/118 16768
/proc/meminfo: memFree=3057536/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=15036 CPUtime=1.5
/proc/16767/stat : 16767 (ttsth-5-0) R 16765 16767 10612 0 -1 4202496 3820 0 0 0 147 3 0 0 23 0 1 0 1132677774 15396864 3576 4294967295 134512640 135237372 3220251232 3220250592 134600544 0 0 0 0 0 0 0 17 2 0 0 0
/proc/16767/statm: 3759 3576 77 177 0 3581 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 15036

[startup+3.10781 s]
/proc/loadavg: 6.35 6.39 5.85 4/118 16772
/proc/meminfo: memFree=3056204/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=15996 CPUtime=3.1
/proc/16767/stat : 16767 (ttsth-5-0) R 16765 16767 10612 0 -1 4202496 4004 0 0 0 307 3 0 0 25 0 1 0 1132677774 16379904 3760 4294967295 134512640 135237372 3220251232 3220250560 134555272 0 0 0 0 0 0 0 17 2 0 0 0
/proc/16767/statm: 3999 3760 77 177 0 3821 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 15996

[startup+6.30764 s]
/proc/loadavg: 6.35 6.39 5.85 4/118 16776
/proc/meminfo: memFree=2978732/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=93288 CPUtime=6.3
/proc/16767/stat : 16767 (ttsth-5-0) R 16765 16767 10612 0 -1 4202496 23374 0 0 0 622 8 0 0 25 0 1 0 1132677774 95526912 23054 4294967295 134512640 135237372 3220251232 3220158000 134551480 0 0 0 0 0 0 0 17 2 0 0 0
/proc/16767/statm: 23322 23054 88 177 0 23144 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 93288

[startup+12.7073 s]
/proc/loadavg: 6.39 6.39 5.86 9/123 16804
/proc/meminfo: memFree=2961724/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=149260 CPUtime=15.22
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 29753 0 0 0 1508 14 0 0 25 0 5 0 1132677774 152842240 29433 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 37315 29433 95 177 0 37137 0
[pid=16767/tid=16782] ppid=16765 vsize=149260 CPUtime=1.65
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 942 0 0 0 165 0 0 0 25 0 5 0 1132678790 152842240 29433 4294967295 134512640 135237372 3220251232 3082069412 134636382 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=149260 CPUtime=0.89
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 693 0 0 0 87 2 0 0 25 0 5 0 1132678790 152842240 29433 4294967295 134512640 135237372 3220251232 3074725856 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=149260 CPUtime=1.47
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 980 0 0 0 144 3 0 0 25 0 5 0 1132678790 152842240 29433 4294967295 134512640 135237372 3220251232 3065772516 134636382 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=149260 CPUtime=1.06
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 1155 0 0 0 105 1 0 0 25 0 5 0 1132678793 152842240 29433 4294967295 134512640 135237372 3220251232 3055768176 134588131 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15.22
Current children cumulated vsize (KiB) 149260

[startup+25.5067 s]
/proc/loadavg: 6.49 6.41 5.87 9/122 16993
/proc/meminfo: memFree=2865264/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=239416 CPUtime=40.95
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 52085 0 0 0 4068 27 0 0 25 0 5 0 1132677774 245161984 51765 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 59854 51765 95 177 0 59676 0
[pid=16767/tid=16782] ppid=16765 vsize=239416 CPUtime=9.35
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 5634 0 0 0 934 1 0 0 25 0 5 0 1132678790 245161984 51765 4294967295 134512640 135237372 3220251232 3082607904 134551008 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=239416 CPUtime=6.96
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 7201 0 0 0 689 7 0 0 25 0 5 0 1132678790 245161984 51765 4294967295 134512640 135237372 3220251232 3074534192 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=239416 CPUtime=7.94
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 6900 0 0 0 786 8 0 0 25 0 5 0 1132678790 245161984 51765 4294967295 134512640 135237372 3220251232 3065776140 134636382 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=239416 CPUtime=6.55
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 6367 0 0 0 652 3 0 0 25 0 5 0 1132678793 245161984 51765 4294967295 134512640 135237372 3220251232 3055721664 134587949 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40.95
Current children cumulated vsize (KiB) 239416

[startup+51.1153 s]
/proc/loadavg: 6.45 6.41 5.88 8/122 17031
/proc/meminfo: memFree=2755648/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=353964 CPUtime=97.13
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 79757 0 0 0 9674 39 0 0 25 0 5 0 1132677774 362459136 79437 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 88491 79437 95 177 0 88313 0
[pid=16767/tid=16782] ppid=16765 vsize=353964 CPUtime=24.03
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 11699 0 0 0 2400 3 0 0 25 0 5 0 1132678790 362459136 79437 4294967295 134512640 135237372 3220251232 3081076384 134587936 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=353964 CPUtime=18.83
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 14509 0 0 0 1873 10 0 0 25 0 5 0 1132678790 362459136 79437 4294967295 134512640 135237372 3220251232 3074031680 134680229 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=353964 CPUtime=25.62
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 15637 0 0 0 2550 12 0 0 25 0 5 0 1132678790 362459136 79437 4294967295 134512640 135237372 3220251232 3064963260 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=353964 CPUtime=18.5
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 11929 0 0 0 1844 6 0 0 25 0 5 0 1132678793 362459136 79437 4294967295 134512640 135237372 3220251232 3055741932 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 97.13
Current children cumulated vsize (KiB) 353964

[startup+102.313 s]
/proc/loadavg: 6.75 6.51 5.94 7/122 17294
/proc/meminfo: memFree=2561304/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=552780 CPUtime=206.06
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 127601 0 0 0 20544 62 0 0 25 0 5 0 1132677774 566046720 127281 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 138195 127281 95 177 0 138017 0
[pid=16767/tid=16782] ppid=16765 vsize=552780 CPUtime=56.78
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 28282 0 0 0 5668 10 0 0 25 0 5 0 1132678790 566046720 127281 4294967295 134512640 135237372 3220251232 3082587744 134562341 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=552780 CPUtime=43.07
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 29245 0 0 0 4289 18 0 0 25 0 5 0 1132678790 566046720 127281 4294967295 134512640 135237372 3220251232 3074130224 134591065 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=552780 CPUtime=52.71
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 25638 0 0 0 5256 15 0 0 25 0 5 0 1132678790 566046720 127281 4294967295 134512640 135237372 3220251232 3064328768 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=552780 CPUtime=43.35
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 18453 0 0 0 4324 11 0 0 25 0 5 0 1132678793 566046720 127281 4294967295 134512640 135237372 3220251232 3055999264 134562328 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 206.06
Current children cumulated vsize (KiB) 552780

[startup+162.31 s]
/proc/loadavg: 6.77 6.54 5.99 7/122 17570
/proc/meminfo: memFree=2357512/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=767804 CPUtime=327.83
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 179192 0 0 0 32694 89 0 0 25 0 5 0 1132677774 786231296 178872 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 191951 178872 95 177 0 191773 0
[pid=16767/tid=16782] ppid=16765 vsize=767804 CPUtime=89.23
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 42205 0 0 0 8911 12 0 0 25 0 5 0 1132678790 786231296 178872 4294967295 134512640 135237372 3220251232 3082352800 134562311 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=767804 CPUtime=72.77
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 40645 0 0 0 7246 31 0 0 25 0 5 0 1132678790 786231296 178872 4294967295 134512640 135237372 3220251232 3072929360 134562341 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=767804 CPUtime=84.01
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 40039 0 0 0 8380 21 0 0 25 0 5 0 1132678790 786231296 178872 4294967295 134512640 135237372 3220251232 3065883120 134562366 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=767804 CPUtime=71.67
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 30320 0 0 0 7150 17 0 0 25 0 5 0 1132678793 786231296 178872 4294967295 134512640 135237372 3220251232 3055367856 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 327.83
Current children cumulated vsize (KiB) 767804

[startup+222.306 s]
/proc/loadavg: 6.79 6.56 6.03 8/122 17844
/proc/meminfo: memFree=2111120/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=1024412 CPUtime=463.6
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 240315 0 0 0 46241 119 0 0 25 0 5 0 1132677774 1048997888 239995 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 256103 239995 95 177 0 255925 0
[pid=16767/tid=16782] ppid=16765 vsize=1024412 CPUtime=121.66
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 55506 0 0 0 12150 16 0 0 25 0 5 0 1132678790 1048997888 239995 4294967295 134512640 135237372 3220251232 3080741376 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=1024412 CPUtime=107.72
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 61170 0 0 0 10734 38 0 0 25 0 5 0 1132678790 1048997888 239995 4294967295 134512640 135237372 3220251232 3074270320 134565853 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=1024412 CPUtime=124.11
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 55912 0 0 0 12377 34 0 0 25 0 5 0 1132678790 1048997888 239995 4294967295 134512640 135237372 3220251232 3065941888 134680273 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=1024412 CPUtime=99.96
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 41744 0 0 0 9973 23 0 0 25 0 5 0 1132678793 1048997888 239995 4294967295 134512640 135237372 3220251232 3054238080 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 463.6
Current children cumulated vsize (KiB) 1024412

[startup+282.303 s]
/proc/loadavg: 6.98 6.66 6.09 7/122 18125
/proc/meminfo: memFree=1886688/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=1261412 CPUtime=585.65
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 296631 0 0 0 58422 143 0 0 25 0 5 0 1132677774 1291685888 296311 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 315353 296311 95 177 0 315175 0
[pid=16767/tid=16782] ppid=16765 vsize=1261412 CPUtime=152.47
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 66515 0 0 0 15228 19 0 0 25 0 5 0 1132678790 1291685888 296311 4294967295 134512640 135237372 3220251232 3081463092 134634688 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=1261412 CPUtime=140.52
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) S 16765 16767 10612 0 -1 4202560 74650 0 0 0 14006 46 0 0 25 0 5 0 1132678790 1291685888 296311 4294967295 134512640 135237372 3220251232 3073074484 134634454 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=1261412 CPUtime=153.19
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 73094 0 0 0 15274 45 0 0 25 0 5 0 1132678790 1291685888 296311 4294967295 134512640 135237372 3220251232 3066293424 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=1261412 CPUtime=129.32
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 56389 0 0 0 12907 25 0 0 25 0 5 0 1132678793 1291685888 296311 4294967295 134512640 135237372 3220251232 3056202336 134587177 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 585.65
Current children cumulated vsize (KiB) 1261412

[startup+342.31 s]
/proc/loadavg: 6.93 6.69 6.13 8/122 18401
/proc/meminfo: memFree=1635316/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=1524044 CPUtime=716.91
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 359167 0 0 0 71528 163 0 0 25 0 5 0 1132677774 1560621056 358847 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 381011 358847 95 177 0 380833 0
[pid=16767/tid=16782] ppid=16765 vsize=1524044 CPUtime=185.07
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 81439 0 0 0 18484 23 0 0 25 0 5 0 1132678790 1560621056 358847 4294967295 134512640 135237372 3220251232 3081506848 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=1524044 CPUtime=174.42
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 88935 0 0 0 17393 49 0 0 25 0 5 0 1132678790 1560621056 358847 4294967295 134512640 135237372 3220251232 3073077600 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=1524044 CPUtime=184.63
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 83837 0 0 0 18412 51 0 0 25 0 5 0 1132678790 1560621056 358847 4294967295 134512640 135237372 3220251232 3065835488 134562341 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=1524044 CPUtime=162.65
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 78973 0 0 0 16233 32 0 0 25 0 5 0 1132678793 1560621056 358847 4294967295 134512640 135237372 3220251232 3056260864 134562380 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 716.91
Current children cumulated vsize (KiB) 1524044

[startup+402.317 s]
/proc/loadavg: 6.70 6.64 6.15 8/123 18667
/proc/meminfo: memFree=1389388/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=1785000 CPUtime=849.54
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 421055 0 0 0 84766 188 0 0 25 0 5 0 1132677774 1827840000 420735 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 446250 420735 95 177 0 446072 0
[pid=16767/tid=16782] ppid=16765 vsize=1785000 CPUtime=222.93
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 96659 0 0 0 22264 29 0 0 25 0 5 0 1132678790 1827840000 420735 4294967295 134512640 135237372 3220251232 3081481280 134551002 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=1785000 CPUtime=204.24
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 103253 0 0 0 20369 55 0 0 25 0 5 0 1132678790 1827840000 420735 4294967295 134512640 135237372 3220251232 3074686064 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=1785000 CPUtime=220.11
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 98798 0 0 0 21953 58 0 0 25 0 5 0 1132678790 1827840000 420735 4294967295 134512640 135237372 3220251232 3065798240 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=1785000 CPUtime=192.11
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 96362 0 0 0 19173 38 0 0 25 0 5 0 1132678793 1827840000 420735 4294967295 134512640 135237372 3220251232 3055369872 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 849.54
Current children cumulated vsize (KiB) 1785000

[startup+462.314 s]
/proc/loadavg: 6.68 6.63 6.17 9/123 18896
/proc/meminfo: memFree=1168868/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=2014944 CPUtime=971.95
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 475817 0 0 0 96975 220 0 0 25 0 5 0 1132677774 2063302656 475497 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 503736 475497 95 177 0 503558 0
[pid=16767/tid=16782] ppid=16765 vsize=2014944 CPUtime=253.33
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 114897 0 0 0 25294 39 0 0 25 0 5 0 1132678790 2063302656 475498 4294967295 134512640 135237372 3220251232 3081538288 134680282 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=2014944 CPUtime=234.9
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 121162 0 0 0 23429 61 0 0 25 0 5 0 1132678790 2063302656 475498 4294967295 134512640 135237372 3220251232 3073095248 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=2014944 CPUtime=249.81
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 109795 0 0 0 24913 68 0 0 25 0 5 0 1132678790 2063302656 475498 4294967295 134512640 135237372 3220251232 3064685424 134562344 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=2014944 CPUtime=223.76
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 103981 0 0 0 22332 44 0 0 25 0 5 0 1132678793 2063302656 475498 4294967295 134512640 135237372 3220251232 3056015328 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 971.95
Current children cumulated vsize (KiB) 2014944



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+486.913 s]
/proc/loadavg: 6.71 6.64 6.19 7/124 18996
/proc/meminfo: memFree=1089524/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=2096828 CPUtime=1021.4
/proc/16767/stat : 16767 (ttsth-5-0) S 16765 16767 10612 0 -1 4202496 495024 0 0 0 101916 224 0 0 25 0 5 0 1132677774 2147151872 494704 4294967295 134512640 135237372 3220251232 3220250828 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16767/statm: 524207 494704 95 177 0 524029 0
[pid=16767/tid=16782] ppid=16765 vsize=2096828 CPUtime=265.92
/proc/16767/task/16782/stat : 16782 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 121386 0 0 0 26551 41 0 0 25 0 5 0 1132678790 2147151872 494706 4294967295 134512640 135237372 3220251232 3081291616 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16783] ppid=16765 vsize=2096828 CPUtime=247.27
/proc/16767/task/16783/stat : 16783 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 126409 0 0 0 24665 62 0 0 25 0 5 0 1132678790 2147151872 494706 4294967295 134512640 135237372 3220251232 3073071328 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16767/tid=16784] ppid=16765 vsize=2096828 CPUtime=261.91
/proc/16767/task/16784/stat : 16784 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 114537 0 0 0 26122 69 0 0 25 0 5 0 1132678790 2147151872 494706 4294967295 134512640 135237372 3220251232 3066150064 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16767/tid=16787] ppid=16765 vsize=2096828 CPUtime=236.15
/proc/16767/task/16787/stat : 16787 (ttsth-5-0) R 16765 16767 10612 0 -1 4202560 106711 0 0 0 23571 44 0 0 25 0 5 0 1132678793 2147151872 494706 4294967295 134512640 135237372 3220251232 3055319392 134562331 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1021.4
Current children cumulated vsize (KiB) 2096828

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+487.033 s]
/proc/loadavg: 6.71 6.64 6.19 7/124 18996
/proc/meminfo: memFree=1089524/3368532 swapFree=1959840/1959888
[pid=16767] ppid=16765 vsize=0 CPUtime=1021.52
/proc/16767/stat : 16767 (ttsth-5-0) R 16765 16767 10612 0 -1 4203524 495045 0 0 0 101918 234 0 0 18 0 1 0 1132677774 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0
/proc/16767/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1021.52
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16767 and gives
#  childrusage.ru_utime.tv_sec=1019
#  childrusage.ru_utime.tv_usec=180000
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=340000
# CPU time returned by wait4() is 1021.52
# while last known CPU time is 1021.52
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 487.039
CPU time (s): 1021.52
CPU user time (s): 1019.18
CPU system time (s): 2.34
CPU usage (%): 209.741
Max. virtual memory (cumulated for all children) (KiB): 2096828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1019.18
system time used= 2.34
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 495045
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1439
involuntary context switches= 32844

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 12:42:30
IDJOB=1779853
IDBENCH=70904
IDSOLVER=632
FILE ID=/1779853-1243680150
PBS_JOBID=
Free space on /tmp= 7981 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/aprove09/AProVE09-11.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1779853-1243680150/watcher-1779853-1243680150 -o /tmp/evaluation-result-1779853-1243680150/solver-1779853-1243680150 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779853-1243680150.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 0f6b435a3aa045f7fe1d5c154e2f0953
RANDOM SEED= 1943132067

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3071100 kB
Buffers:         93004 kB
Cached:          88192 kB
SwapCached:          0 kB
Active:         128968 kB
Inactive:        74504 kB
HighTotal:     2489216 kB
HighFree:      2379120 kB
LowTotal:       879316 kB
LowFree:        691980 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:            2392 kB
Writeback:           0 kB
AnonPages:       22056 kB
Mapped:           8252 kB
Slab:            84168 kB
SReclaimable:    72044 kB
SUnreclaim:      12124 kB
PageTables:        804 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   123552 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 7981 MiB
End job on  at 2009-05-30 12:50:39