Trace number 1781398

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 652.35 350.034

General information on the benchmark

Namesimon-s02b-dp11u10.cnf
MD5SUMbd35ccd857138682818061a3fbcb7546
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark134.7
Satisfiable
(Un)Satisfiability was proved
Number of variables8513
Number of clauses25271
Sum of the clauses size59561
Maximum clause length11
Minimum clause length1
Number of clauses of size 122
Number of clauses of size 216216
Number of clauses of size 39032
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51

Solver Data 

0.05/0.14	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781398-1243686965.cnf 
0.05/0.14	c Using SATTIMEOUT of 10000
0.05/0.14	c Using SATRAM of 2047
0.05/0.14	c Size of subset node = 16
0.05/0.14	c Variables = 9197
0.05/0.14	c Clauses = 25271
0.05/0.14	c Literals = 59561
0.05/0.14	c Reduced size:
0.05/0.14	c Variables = 8513
0.05/0.14	c Clauses = 22371
0.05/0.14	c Literals = 52215
0.05/0.14	c a2
0.05/0.18	c a1
0.13/0.29	c Independent sub-problems = 2
0.13/0.29	c Sub-problem with 49 variables and 138 clauses
0.13/0.29	c using permutation method 3
0.13/0.29	c Ordering finished 0.220 seconds
0.13/0.29	c mapped 0.220 seconds
0.13/0.29	c permuted 0.220 seconds
0.13/0.29	c about to sort
0.13/0.29	c sorted
0.13/0.29	c clauses now 138
0.13/0.29	c init finished 0.220 seconds
0.13/0.29	c tree built 0.220 seconds
0.13/0.29	c 
0.13/0.29	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
0.13/0.29	c ---------------------------------|----------------------------------|------------------------------------------------------
0.13/0.29	c ................................ | ..........                       |                        0.2           0.0             
0.13/0.29	c ................................ | ..........                     1 |                        0.2           4.5             
0.13/0.29	c ................................ | ..........                     2 |                        0.2           9.1             
0.13/0.29	c ................................ | ..........                     3 |                        0.2          13.6             
0.13/0.29	c ................................ | ..........                     4 |                        0.2          18.2             
0.13/0.29	c ................................ | ..........                     5 |                        0.2          22.7             
1.42/2.66	c Satisfiable sub-problem
1.42/2.66	c Sub-problem with 7766 variables and 22233 clauses
1.42/2.66	c using permutation method 4
1.42/2.66	c count = 1
1.42/2.66	c Ordering finished 1.450 seconds
1.42/2.66	c mapped 1.460 seconds
1.42/2.66	c permuted 1.460 seconds
1.42/2.66	c about to sort
1.42/2.66	c sorted
1.62/3.08	c clauses now 22233
1.62/3.08	c init finished 1.540 seconds
1.62/3.08	c tree built 1.690 seconds
1.62/3.08	c 
1.62/3.08	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
1.62/3.08	c ---------------------------------|----------------------------------|------------------------------------------------------
1.62/3.08	c ................................ | ..........                    79 | 4                      1.7          46.7           27
1.62/3.08	c ................................ | ..........                    80 | 4                      1.7          47.3           27
1.62/3.08	c ................................ | ..........                    81 | 4                      1.7          47.9           27
1.62/3.08	c ................................ | ..........                    82 | 4                      1.7          48.5           27
1.62/3.08	c ................................ | ..........                    83 | 4                      1.7          49.1           27
1.62/3.08	c ................................ | ..........                    84 | 4                      1.7          49.7           27
1.62/3.09	c ................................ | ..........                  1000 | 22                     1.7         591.7          425
199.84/114.58	c ................................ | ..........               2140000 | 151861               200.0       10697.9     47815091
399.99/219.79	c ................................ | ..........               3904000 | 291659               400.1        9758.8     84848484
600.17/323.20	c ................................ | ..........               5606000 | 416551               600.2        9339.9    118623432

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781398-1243686965/watcher-1781398-1243686965 -o /tmp/evaluation-result-1781398-1243686965/solver-1781398-1243686965 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781398-1243686965.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.00 6.75 7.57 6/114 29942
/proc/meminfo: memFree=2551640/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=1144 CPUtime=0.01
/proc/29942/stat : 29942 (ttsth-5-0) R 29940 29942 14986 0 -1 4202496 182 0 0 0 1 0 0 0 18 0 1 0 1122833781 1171456 138 4294967295 134512640 135237372 3213659152 3213658600 134732614 0 0 0 0 0 0 0 17 2 0 0 0
/proc/29942/statm: 286 138 75 177 0 108 0

[startup+0.134153 s]
/proc/loadavg: 6.00 6.75 7.57 6/114 29942
/proc/meminfo: memFree=2551640/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=2752 CPUtime=0.05
/proc/29942/stat : 29942 (ttsth-5-0) R 29940 29942 14986 0 -1 4202496 576 0 0 0 5 0 0 0 18 0 1 0 1122833781 2818048 532 4294967295 134512640 135237372 3213659152 3213658844 134533950 0 0 0 0 0 0 0 17 2 0 0 0
/proc/29942/statm: 688 532 75 177 0 510 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 2752

[startup+0.21414 s]
/proc/loadavg: 6.00 6.75 7.57 6/114 29942
/proc/meminfo: memFree=2551640/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=4712 CPUtime=0.13
/proc/29942/stat : 29942 (ttsth-5-0) R 29940 29942 14986 0 -1 4202496 1055 0 0 0 13 0 0 0 18 0 1 0 1122833781 4825088 1011 4294967295 134512640 135237372 3213659152 3213658208 134601489 0 0 0 0 0 0 0 17 2 0 0 0
/proc/29942/statm: 1178 1011 81 177 0 1000 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 4712

[startup+0.314133 s]
/proc/loadavg: 6.00 6.75 7.57 6/114 29942
/proc/meminfo: memFree=2551640/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=37876 CPUtime=0.23
/proc/29942/stat : 29942 (ttsth-5-0) R 29940 29942 14986 0 -1 4202496 1226 0 0 0 23 0 0 0 19 0 1 0 1122833781 38785024 1182 4294967295 134512640 135237372 3213659152 3213658280 134732614 0 0 0 0 0 0 0 17 2 0 0 0
/proc/29942/statm: 9469 1182 112 177 0 9291 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 37876

[startup+0.714105 s]
/proc/loadavg: 6.00 6.75 7.57 6/114 29942
/proc/meminfo: memFree=2551640/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=38536 CPUtime=0.51
/proc/29942/stat : 29942 (ttsth-5-0) R 29940 29942 14986 0 -1 4202496 1379 0 0 0 51 0 0 0 19 0 1 0 1122833781 39460864 1335 4294967295 134512640 135237372 3213659152 3213658480 134555272 0 0 0 0 0 0 0 17 2 0 0 0
/proc/29942/statm: 9634 1335 112 177 0 9456 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 38536

[startup+1.51404 s]
/proc/loadavg: 6.00 6.75 7.57 6/114 29949
/proc/meminfo: memFree=2546848/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=38836 CPUtime=0.91
/proc/29942/stat : 29942 (ttsth-5-0) R 29940 29942 14986 0 -1 4202496 1425 0 0 0 91 0 0 0 19 0 1 0 1122833781 39768064 1381 4294967295 134512640 135237372 3213659152 3213658480 134555296 0 0 0 0 0 0 0 17 2 0 0 0
/proc/29942/statm: 9709 1381 112 177 0 9531 0
Current children cumulated CPU time (s) 0.91
Current children cumulated vsize (KiB) 38836

[startup+3.11391 s]
/proc/loadavg: 6.00 6.75 7.57 6/114 29949
/proc/meminfo: memFree=2546552/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=65688 CPUtime=1.71
/proc/29942/stat : 29942 (ttsth-5-0) R 29940 29942 14986 0 -1 4202496 8215 0 0 0 169 2 0 0 21 0 3 0 1122833781 67264512 8171 4294967295 134512640 135237372 3213659152 3213658656 134762516 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 16422 8171 112 177 0 16244 0
Current children cumulated CPU time (s) 1.71
Current children cumulated vsize (KiB) 65688
heavy processes:
  %CPU=83 pid=12341 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=83 pid=12739 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=84 pid=13124 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R
  %CPU=85 pid=13512 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R

[startup+6.31367 s]
/proc/loadavg: 5.92 6.72 7.55 9/118 29954
/proc/meminfo: memFree=2509468/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=79736 CPUtime=5.8
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 12225 0 0 0 578 2 0 0 21 0 5 0 1122833781 81649664 12181 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 19934 12181 112 177 0 19756 0
[pid=29942/tid=29950] ppid=29940 vsize=79736 CPUtime=1.12
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 1036 0 0 0 112 0 0 0 25 0 5 0 1122834090 81649664 12181 4294967295 134512640 135237372 3213659152 3060973600 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=79736 CPUtime=1.14
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 1156 0 0 0 114 0 0 0 25 0 5 0 1122834090 81649664 12181 4294967295 134512640 135237372 3213659152 3069494396 134680506 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=79736 CPUtime=0.95
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 1005 0 0 0 95 0 0 0 25 0 5 0 1122834103 81649664 12181 4294967295 134512640 135237372 3213659152 3077856400 134680340 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=79736 CPUtime=0.9
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 913 0 0 0 90 0 0 0 25 0 5 0 1122834103 81649664 12181 4294967295 134512640 135237372 3213659152 3086245192 134636382 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.8
Current children cumulated vsize (KiB) 79736

[startup+12.7132 s]
/proc/loadavg: 6.17 6.76 7.56 9/118 29955
/proc/meminfo: memFree=2464980/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=124140 CPUtime=17.32
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 23136 0 0 0 1724 8 0 0 21 0 5 0 1122833781 127119360 23092 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 31035 23092 112 177 0 30857 0
[pid=29942/tid=29950] ppid=29940 vsize=124140 CPUtime=4.22
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 3935 0 0 0 418 4 0 0 25 0 5 0 1122834090 127119360 23092 4294967295 134512640 135237372 3213659152 3061204136 134519944 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=124140 CPUtime=4.21
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 4640 0 0 0 421 0 0 0 25 0 5 0 1122834090 127119360 23092 4294967295 134512640 135237372 3213659152 3069510496 134592302 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=124140 CPUtime=3.87
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 3898 0 0 0 385 2 0 0 25 0 5 0 1122834103 127119360 23092 4294967295 134512640 135237372 3213659152 3077926128 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=124140 CPUtime=3.33
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 2548 0 0 0 333 0 0 0 25 0 5 0 1122834103 127119360 23092 4294967295 134512640 135237372 3213659152 3086352588 134562272 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 17.32
Current children cumulated vsize (KiB) 124140

[startup+25.5122 s]
/proc/loadavg: 6.64 6.83 7.57 9/118 29956
/proc/meminfo: memFree=2378000/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=208528 CPUtime=40.11
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 44208 0 0 0 3991 20 0 0 21 0 5 0 1122833781 213532672 44164 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 52132 44164 112 177 0 51954 0
[pid=29942/tid=29950] ppid=29940 vsize=208528 CPUtime=10.22
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 9945 0 0 0 1014 8 0 0 25 0 5 0 1122834090 213532672 44164 4294967295 134512640 135237372 3213659152 3061238384 134590777 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=208528 CPUtime=9.91
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 9453 0 0 0 990 1 0 0 25 0 5 0 1122834090 213532672 44164 4294967295 134512640 135237372 3213659152 3069645136 134592447 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=208528 CPUtime=9.55
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 9788 0 0 0 948 7 0 0 25 0 5 0 1122834103 213532672 44164 4294967295 134512640 135237372 3213659152 3077967792 134587833 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=208528 CPUtime=8.74
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 6907 0 0 0 872 2 0 0 25 0 5 0 1122834103 213532672 44164 4294967295 134512640 135237372 3213659152 3086366144 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40.11
Current children cumulated vsize (KiB) 208528

[startup+51.1102 s]
/proc/loadavg: 7.18 6.94 7.59 9/118 30140
/proc/meminfo: memFree=2193552/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=394280 CPUtime=85.35
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 90681 0 0 0 8501 34 0 0 21 0 5 0 1122833781 403742720 90637 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 98570 90637 112 177 0 98392 0
[pid=29942/tid=29950] ppid=29940 vsize=394280 CPUtime=21.92
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 20826 0 0 0 2181 11 0 0 25 0 5 0 1122834090 403742720 90637 4294967295 134512640 135237372 3213659152 3061400640 134550994 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=394280 CPUtime=21.08
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 20952 0 0 0 2104 4 0 0 25 0 5 0 1122834090 403742720 90638 4294967295 134512640 135237372 3213659152 3069672604 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=394280 CPUtime=21.01
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 23629 0 0 0 2090 11 0 0 25 0 5 0 1122834103 403742720 90639 4294967295 134512640 135237372 3213659152 3078209328 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=394280 CPUtime=19.65
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 17160 0 0 0 1959 6 0 0 25 0 5 0 1122834103 403742720 90639 4294967295 134512640 135237372 3213659152 3086311580 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 85.35
Current children cumulated vsize (KiB) 394280

[startup+102.306 s]
/proc/loadavg: 7.85 7.16 7.63 10/119 30179
/proc/meminfo: memFree=1823268/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=760400 CPUtime=178.3
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 182174 0 0 0 17769 61 0 0 21 0 5 0 1122833781 778649600 182130 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 190100 182130 112 177 0 189922 0
[pid=29942/tid=29950] ppid=29940 vsize=760400 CPUtime=45.22
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 42048 0 0 0 4508 14 0 0 25 0 5 0 1122834090 778649600 182130 4294967295 134512640 135237372 3213659152 3061410536 134519944 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=760400 CPUtime=44.21
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 43109 0 0 0 4411 10 0 0 25 0 5 0 1122834090 778649600 182130 4294967295 134512640 135237372 3213659152 3069806096 134562290 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=760400 CPUtime=44.25
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 48076 0 0 0 4406 19 0 0 25 0 5 0 1122834103 778649600 182130 4294967295 134512640 135237372 3213659152 3078210768 134562278 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=760400 CPUtime=42.93
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 40826 0 0 0 4277 16 0 0 25 0 5 0 1122834103 778649600 182130 4294967295 134512640 135237372 3213659152 3086500256 134593185 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 178.3
Current children cumulated vsize (KiB) 760400

[startup+162.312 s]
/proc/loadavg: 8.15 7.39 7.67 10/119 30364
/proc/meminfo: memFree=1431384/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=1153436 CPUtime=290.64
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 280402 0 0 0 28960 104 0 0 21 0 5 0 1122833781 1181118464 280358 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 288359 280358 112 177 0 288181 0
[pid=29942/tid=29950] ppid=29940 vsize=1153436 CPUtime=73.35
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 70815 0 0 0 7313 22 0 0 25 0 5 0 1122834090 1181118464 280358 4294967295 134512640 135237372 3213659152 3061361744 134562459 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=1153436 CPUtime=72.61
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 68850 0 0 0 7235 26 0 0 25 0 5 0 1122834090 1181118464 280358 4294967295 134512640 135237372 3213659152 3069516992 134562344 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=1153436 CPUtime=72.39
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 69212 0 0 0 7209 30 0 0 25 0 5 0 1122834103 1181118464 280358 4294967295 134512640 135237372 3213659152 3078193008 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=1153436 CPUtime=70.61
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 63410 0 0 0 7037 24 0 0 25 0 5 0 1122834103 1181118464 280358 4294967295 134512640 135237372 3213659152 3086297036 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 290.64
Current children cumulated vsize (KiB) 1153436

[startup+222.307 s]
/proc/loadavg: 8.31 7.57 7.72 11/119 30538
/proc/meminfo: memFree=1125964/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=1455140 CPUtime=405.14
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 355890 0 0 0 40378 136 0 0 21 0 5 0 1122833781 1490063360 355846 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 363785 355846 112 177 0 363607 0
[pid=29942/tid=29950] ppid=29940 vsize=1455140 CPUtime=102.32
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 93365 0 0 0 10204 28 0 0 25 0 5 0 1122834090 1490063360 355846 4294967295 134512640 135237372 3213659152 3061142912 134586955 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=1455140 CPUtime=100.41
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 85242 0 0 0 10004 37 0 0 25 0 5 0 1122834090 1490063360 355846 4294967295 134512640 135237372 3213659152 3069572368 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=1455140 CPUtime=100.95
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 87558 0 0 0 10059 36 0 0 25 0 5 0 1122834103 1490063360 355846 4294967295 134512640 135237372 3213659152 3078212368 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=1455140 CPUtime=99.77
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 81610 0 0 0 9944 33 0 0 25 0 5 0 1122834103 1490063360 355846 4294967295 134512640 135237372 3213659152 3086294192 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 405.14
Current children cumulated vsize (KiB) 1455140

[startup+282.312 s]
/proc/loadavg: 8.30 7.72 7.76 10/119 30752
/proc/meminfo: memFree=806432/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=1776460 CPUtime=520.48
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 436172 0 0 0 51877 171 0 0 21 0 5 0 1122833781 1819095040 436128 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 444115 436128 112 177 0 443937 0
[pid=29942/tid=29950] ppid=29940 vsize=1776460 CPUtime=131.02
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 114508 0 0 0 13064 38 0 0 25 0 5 0 1122834090 1819095040 436128 4294967295 134512640 135237372 3213659152 3061252544 134562311 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=1776460 CPUtime=129.21
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 105759 0 0 0 12875 46 0 0 25 0 5 0 1122834090 1819095040 436129 4294967295 134512640 135237372 3213659152 3069780688 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=1776460 CPUtime=130.63
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 108288 0 0 0 13016 47 0 0 25 0 5 0 1122834103 1819095040 436129 4294967295 134512640 135237372 3213659152 3078183312 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=1776460 CPUtime=127.93
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 99503 0 0 0 12755 38 0 0 25 0 5 0 1122834103 1819095040 436129 4294967295 134512640 135237372 3213659152 3086350464 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 520.48
Current children cumulated vsize (KiB) 1776460

[startup+342.318 s]
/proc/loadavg: 8.45 7.87 7.81 10/119 30938
/proc/meminfo: memFree=519132/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=2061740 CPUtime=637.42
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 507468 0 0 0 63547 195 0 0 21 0 5 0 1122833781 2111221760 507424 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 515435 507425 112 177 0 515257 0
[pid=29942/tid=29950] ppid=29940 vsize=2061740 CPUtime=160.12
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 132705 0 0 0 15971 41 0 0 25 0 5 0 1122834090 2111221760 507425 4294967295 134512640 135237372 3213659152 3061323392 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=2061740 CPUtime=158.65
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 126912 0 0 0 15810 55 0 0 25 0 5 0 1122834090 2111221760 507425 4294967295 134512640 135237372 3213659152 3069602224 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=2061740 CPUtime=159.93
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 124558 0 0 0 15941 52 0 0 25 0 5 0 1122834103 2111221760 507425 4294967295 134512640 135237372 3213659152 3078410208 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=2061740 CPUtime=157.03
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 115179 0 0 0 15658 45 0 0 25 0 5 0 1122834103 2111221760 507425 4294967295 134512640 135237372 3213659152 3086425348 134680212 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 637.42
Current children cumulated vsize (KiB) 2061740



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+349.717 s]
/proc/loadavg: 8.45 7.89 7.81 10/118 31083
/proc/meminfo: memFree=482376/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=2096300 CPUtime=652.22
/proc/29942/stat : 29942 (ttsth-5-0) S 29940 29942 14986 0 -1 4202496 516151 0 0 0 65016 206 0 0 21 0 5 0 1122833781 2146611200 516107 4294967295 134512640 135237372 3213659152 3213658748 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 524075 516107 112 177 0 523897 0
[pid=29942/tid=29950] ppid=29940 vsize=2096300 CPUtime=163.24
/proc/29942/task/29950/stat : 29950 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 134107 0 0 0 16279 45 0 0 25 0 5 0 1122834090 2146611200 516107 4294967295 134512640 135237372 3213659152 3061243600 134562420 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=2096300 CPUtime=163.31
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 129635 0 0 0 16271 60 0 0 25 0 5 0 1122834090 2146611200 516107 4294967295 134512640 135237372 3213659152 3069597536 134562344 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29942/tid=29952] ppid=29940 vsize=2096300 CPUtime=163.45
/proc/29942/task/29952/stat : 29952 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 127990 0 0 0 16292 53 0 0 25 0 5 0 1122834103 2146611200 516107 4294967295 134512640 135237372 3213659152 3077959072 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29942/tid=29953] ppid=29940 vsize=2096300 CPUtime=160.53
/proc/29942/task/29953/stat : 29953 (ttsth-5-0) R 29940 29942 14986 0 -1 4202560 116304 0 0 0 16007 46 0 0 25 0 5 0 1122834103 2146611200 516107 4294967295 134512640 135237372 3213659152 3086403056 134562463 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 652.22
Current children cumulated vsize (KiB) 2096300

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+349.917 s]
/proc/loadavg: 8.45 7.89 7.81 7/116 31084
/proc/meminfo: memFree=817680/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=0 CPUtime=652.33
/proc/29942/stat : 29942 (ttsth-5-0) Z 29940 29942 14986 0 -1 4203524 516156 0 0 0 65018 215 0 0 18 0 2 0 1122833781 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 0 0 0 0 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=0 CPUtime=163.4
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4203588 129635 0 0 0 16271 69 0 0 25 0 2 0 1122834090 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 652.33
Current children cumulated vsize (KiB) 0

[startup+350.017 s]
/proc/loadavg: 8.45 7.89 7.81 7/116 31084
/proc/meminfo: memFree=817680/3368532 swapFree=1953000/1959888
[pid=29942] ppid=29940 vsize=0 CPUtime=652.34
/proc/29942/stat : 29942 (ttsth-5-0) Z 29940 29942 14986 0 -1 4203524 516156 0 0 0 65018 216 0 0 18 0 2 0 1122833781 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29942/statm: 0 0 0 0 0 0 0
[pid=29942/tid=29951] ppid=29940 vsize=0 CPUtime=163.41
/proc/29942/task/29951/stat : 29951 (ttsth-5-0) R 29940 29942 14986 0 -1 4203588 129635 0 0 0 16271 70 0 0 25 0 2 0 1122834090 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 652.34
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 350.034
CPU time (s): 652.35
CPU user time (s): 650.18
CPU system time (s): 2.17
CPU usage (%): 186.368
Max. virtual memory (cumulated for all children) (KiB): 2096300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 650.18
system time used= 2.17
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 516156
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1061
involuntary context switches= 17813

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi45 at 2009-05-30 14:36:05
IDJOB=1781398
IDBENCH=71741
IDSOLVER=632
FILE ID=tipi45/1781398-1243686965
PBS_JOBID=
Free space on /tmp= 15501 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT_RACE06/simon-s02b-dp11u10.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781398-1243686965/watcher-1781398-1243686965 -o /tmp/evaluation-result-1781398-1243686965/solver-1781398-1243686965 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781398-1243686965.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= bd35ccd857138682818061a3fbcb7546
RANDOM SEED= 913455288

Linux tipi45 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2551492 kB
Buffers:         43664 kB
Cached:         204724 kB
SwapCached:       1856 kB
Active:         640816 kB
Inactive:        93372 kB
HighTotal:     2489216 kB
HighFree:      1813096 kB
LowTotal:       879316 kB
LowFree:        738396 kB
SwapTotal:     1959888 kB
SwapFree:      1953000 kB
Dirty:            7744 kB
Writeback:           0 kB
AnonPages:      484732 kB
Mapped:           6580 kB
Slab:            69120 kB
SReclaimable:    57636 kB
SUnreclaim:      11484 kB
PageTables:       1124 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   573212 kB
VmallocTotal:   114680 kB
VmallocUsed:     17900 kB
VmallocChunk:    96244 kB

Free space on /tmp at the end= 15501 MiB
End job on tipi45 at 2009-05-30 14:41:57