Trace number 1780020

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (16 threads)? (MO) 2596.92 178.9

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l48_lambda.cnf
MD5SUMe7c28f6a200a1c1912fbaacfb3572515
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark417.27
Satisfiable
(Un)Satisfiability was proved
Number of variables34656
Number of clauses174528
Sum of the clauses size503708
Maximum clause length9
Minimum clause length1
Number of clauses of size 14424
Number of clauses of size 242805
Number of clauses of size 3103458
Number of clauses of size 416481
Number of clauses of size 57216
Number of clauses of size over 5144

Solver Data 

0.28/0.33	c Command: HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780020-1244959090.cnf 
0.28/0.33	c Using SATTIMEOUT of 10000
0.28/0.33	c Using SATRAM of 2047
0.28/0.33	c Size of subset node = 16
0.28/0.33	c Variables = 34656
0.28/0.33	c Clauses = 174528
0.28/0.33	c Literals = 503708
0.28/0.33	c Reduced size:
0.28/0.33	c Variables = 34656
0.28/0.33	c Clauses = 157923
0.28/0.33	c Literals = 462041
0.28/0.33	c a2
0.58/0.61	c a1
12.10/12.12	c Independent sub-problems = 1
12.10/12.12	c Sub-problem with 29324 variables and 157923 clauses
12.10/12.12	c using permutation method 4
12.10/12.12	c count = 1
12.10/12.12	c Ordering finished 12.050 seconds
12.10/12.12	c mapped 12.110 seconds
12.10/12.12	c permuted 12.110 seconds
12.10/12.12	c about to sort
12.10/12.16	c sorted
14.60/14.61	c clauses now 157923
14.60/14.61	c init finished 12.720 seconds
14.60/14.61	c tree built 14.590 seconds
14.60/14.61	c 
14.60/14.61	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
14.60/14.61	c ---------------------------------|----------------------------------|------------------------------------------------------
14.60/14.61	c ................................ | ..........                       |                       14.6           0.0            3
14.60/14.61	c ................................ | ..........                     1 |                       14.6           0.1            3
14.60/14.61	c ****************................ | ..........                     2 | 1                     14.6           0.1            3
14.60/14.61	c ****************................ | ..........                     3 | 1                     14.6           0.2            3
14.60/14.61	c ****************................ | ..........                     4 | 1                     14.6           0.3            3
14.60/14.61	c ****************................ | ..........                     5 | 1                     14.6           0.3            3
14.60/14.61	c ****************................ | ..........                     6 | 1                     14.6           0.4            3
17.49/14.87	c ****************................ | ..........                  1000 | 4                     16.6          60.1         1605
273.22/31.22	c ****************................ | ..........                755000 | 33204                200.3        3770.1      6814401
531.31/47.75	c ****************................ | ..........               1188000 | 47054                400.4        2967.4     14412007
769.38/62.94	c ****************................ | ..........               1513000 | 57162                600.4        2520.0     23254587
1007.66/78.15	c ****************................ | ..........               1813000 | 66348                800.5        2264.7     29999273
1233.64/92.52	c ****************................ | *.........               2105000 | 77274               1000.5        2104.1     37712872
1452.28/106.46	c ****************................ | *.........               2377000 | 88656               1200.8        1979.6     45791715
1662.32/119.79	c ****************................ | *.........               2610000 | 98783               1400.2        1864.0     54814565
1871.25/132.94	c ****************................ | *.........               2840000 | 108973              1600.2        1774.8     63534962
2084.52/146.42	c ****************................ | *.........               3064000 | 116737              1800.3        1702.0     71514896
2293.40/159.62	c ****************................ | **........               3247000 | 123347              2000.5        1623.1     78723723

Verifier Data 

sh: BIN/SAT-verifier: No such file or directory

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780020-1244959090/watcher-1780020-1244959090 -o /tmp/evaluation-result-1780020-1244959090/solver-1780020-1244959090 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780020-1244959090.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 15.74 15.17 15.10 2/184 26511
/proc/meminfo: memFree=19040840/36427776 swapFree=3764/7112
[pid=26511] ppid=26509 vsize=1548 CPUtime=0
/proc/26511/stat : 26511 (ttsth-5-0) R 26509 26511 15497 0 -1 4202496 275 0 0 0 0 0 0 0 20 0 1 0 655215408 1585152 232 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134732614 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 387 233 75 177 0 209 0

[startup+0.076001 s]
/proc/loadavg: 15.74 15.17 15.10 2/184 26511
/proc/meminfo: memFree=19040840/36427776 swapFree=3764/7112
[pid=26511] ppid=26509 vsize=5628 CPUtime=0.06
/proc/26511/stat : 26511 (ttsth-5-0) R 26509 26511 15497 0 -1 4202496 1268 0 0 0 6 0 0 0 20 0 1 0 655215408 5763072 1225 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134732614 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 1407 1226 75 177 0 1229 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 5628

[startup+0.103995 s]
/proc/loadavg: 15.74 15.17 15.10 2/184 26511
/proc/meminfo: memFree=19040840/36427776 swapFree=3764/7112
[pid=26511] ppid=26509 vsize=7260 CPUtime=0.1
/proc/26511/stat : 26511 (ttsth-5-0) R 26509 26511 15497 0 -1 4202496 1680 0 0 0 10 0 0 0 20 0 1 0 655215408 7434240 1637 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134886129 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 1815 1638 75 177 0 1637 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 7260

[startup+0.304035 s]
/proc/loadavg: 15.74 15.17 15.10 2/184 26511
/proc/meminfo: memFree=19040840/36427776 swapFree=3764/7112
[pid=26511] ppid=26509 vsize=12980 CPUtime=0.28
/proc/26511/stat : 26511 (ttsth-5-0) R 26509 26511 15497 0 -1 4202496 3056 0 0 0 28 0 0 0 20 0 1 0 655215408 13291520 3013 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134534262 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 3245 3013 75 177 0 3067 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 12980

[startup+0.704082 s]
/proc/loadavg: 15.74 15.17 15.10 2/184 26511
/proc/meminfo: memFree=19040840/36427776 swapFree=3764/7112
[pid=26511] ppid=26509 vsize=24432 CPUtime=0.68
/proc/26511/stat : 26511 (ttsth-5-0) R 26509 26511 15497 0 -1 4202496 6469 0 0 0 66 2 0 0 20 0 1 0 655215408 25018368 5885 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134600146 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 6108 5885 77 177 0 5930 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 24432

[startup+1.50011 s]
/proc/loadavg: 15.74 15.17 15.10 2/185 26512
/proc/meminfo: memFree=19012912/36427776 swapFree=4040/35668
[pid=26511] ppid=26509 vsize=29868 CPUtime=1.5
/proc/26511/stat : 26511 (ttsth-5-0) R 26509 26511 15497 0 -1 4202496 7838 0 0 0 146 4 0 0 20 0 1 0 655215408 30584832 7254 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134555272 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 7467 7254 77 177 0 7289 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 29868

[startup+3.10028 s]
/proc/loadavg: 15.74 15.17 15.10 2/185 26512
/proc/meminfo: memFree=19011416/36427776 swapFree=3824/36616
[pid=26511] ppid=26509 vsize=30128 CPUtime=3.1
/proc/26511/stat : 26511 (ttsth-5-0) R 26509 26511 15497 0 -1 4202496 7871 0 0 0 306 4 0 0 20 0 1 0 655215408 30851072 7287 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134600718 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 7532 7287 77 177 0 7354 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 30128

[startup+6.30453 s]
/proc/loadavg: 14.56 14.94 15.03 3/185 26512
/proc/meminfo: memFree=19009596/36427776 swapFree=4620/38296
[pid=26511] ppid=26509 vsize=30584 CPUtime=6.3
/proc/26511/stat : 26511 (ttsth-5-0) R 26509 26511 15497 0 -1 4202496 7960 0 0 0 626 4 0 0 20 0 1 0 655215408 31318016 7376 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134600728 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 7646 7376 77 177 0 7468 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 30584

[startup+12.7011 s]
/proc/loadavg: 13.47 14.70 14.95 2/185 26512
/proc/meminfo: memFree=19009264/36427776 swapFree=4620/38612
[pid=26511] ppid=26509 vsize=303208 CPUtime=12.68
/proc/26511/stat : 26511 (ttsth-5-0) R 26509 26511 15497 0 -1 4202496 76333 0 0 0 1238 30 0 0 20 0 1 0 655215408 310484992 75594 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134550999 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 75802 75600 88 177 0 75624 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 303208

[startup+25.5046 s]
/proc/loadavg: 13.02 14.53 14.89 17/201 26528
/proc/meminfo: memFree=18582560/36427776 swapFree=4692/468472
[pid=26511] ppid=26509 vsize=589160 CPUtime=184.16
/proc/26511/stat : 26511 (ttsth-5-0) S 26509 26511 15497 0 -1 4202496 116767 0 0 0 9515 8901 0 0 20 0 17 0 655215408 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 147290 115744 95 177 0 147112 0
[pid=26511/tid=26513] ppid=26509 vsize=589160 CPUtime=10.94
/proc/26511/task/26513/stat : 26513 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 3825 0 0 0 1062 32 0 0 20 0 17 0 655216868 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134751534 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26511/tid=26514] ppid=26509 vsize=589160 CPUtime=10.58
/proc/26511/task/26514/stat : 26514 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1715 0 0 0 470 588 0 0 20 0 17 0 655216868 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134551012 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=26511/tid=26515] ppid=26509 vsize=589160 CPUtime=10.58
/proc/26511/task/26515/stat : 26515 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1379 0 0 0 444 614 0 0 20 0 17 0 655216868 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26511/tid=26516] ppid=26509 vsize=589160 CPUtime=10.6
/proc/26511/task/26516/stat : 26516 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1247 0 0 0 490 570 0 0 20 0 17 0 655216868 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26511/tid=26517] ppid=26509 vsize=589160 CPUtime=10.58
/proc/26511/task/26517/stat : 26517 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1250 0 0 0 442 616 0 0 20 0 17 0 655216868 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26511/tid=26518] ppid=26509 vsize=589160 CPUtime=10.6
/proc/26511/task/26518/stat : 26518 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1174 0 0 0 480 580 0 0 20 0 17 0 655216868 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26511/tid=26519] ppid=26509 vsize=589160 CPUtime=10.54
/proc/26511/task/26519/stat : 26519 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1100 0 0 0 452 602 0 0 20 0 17 0 655216868 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26511/tid=26520] ppid=26509 vsize=589160 CPUtime=10.58
/proc/26511/task/26520/stat : 26520 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1529 0 0 0 462 596 0 0 20 0 17 0 655216868 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26511/tid=26521] ppid=26509 vsize=589160 CPUtime=10.58
/proc/26511/task/26521/stat : 26521 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 911 0 0 0 440 618 0 0 20 0 17 0 655216868 603299840 115744 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26511/tid=26522] ppid=26509 vsize=589160 CPUtime=10.6
/proc/26511/task/26522/stat : 26522 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1418 0 0 0 460 600 0 0 20 0 17 0 655216868 603299840 115745 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134592483 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26511/tid=26523] ppid=26509 vsize=589160 CPUtime=10.62
/proc/26511/task/26523/stat : 26523 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1399 0 0 0 470 592 0 0 20 0 17 0 655216868 603299840 115745 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26511/tid=26524] ppid=26509 vsize=589160 CPUtime=10.6
/proc/26511/task/26524/stat : 26524 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 903 0 0 0 466 594 0 0 20 0 17 0 655216869 603299840 115746 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26511/tid=26525] ppid=26509 vsize=589160 CPUtime=10.32
/proc/26511/task/26525/stat : 26525 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1252 0 0 0 462 570 0 0 20 0 17 0 655216869 603299840 115746 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26511/tid=26526] ppid=26509 vsize=589160 CPUtime=10.54
/proc/26511/task/26526/stat : 26526 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1640 0 0 0 476 578 0 0 20 0 17 0 655216869 603299840 115746 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26511/tid=26527] ppid=26509 vsize=589160 CPUtime=10.62
/proc/26511/task/26527/stat : 26527 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 2094 0 0 0 524 538 0 0 20 0 17 0 655216869 603299840 115746 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26511/tid=26528] ppid=26509 vsize=589160 CPUtime=10.54
/proc/26511/task/26528/stat : 26528 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 1414 0 0 0 482 572 0 0 20 0 17 0 655216869 603299840 115746 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 184.16
Current children cumulated vsize (KiB) 589160

[startup+51.1046 s]
/proc/loadavg: 13.96 14.63 14.91 17/201 26528
/proc/meminfo: memFree=18378208/36427776 swapFree=4692/672252
[pid=26511] ppid=26509 vsize=807240 CPUtime=584.54
/proc/26511/stat : 26511 (ttsth-5-0) S 26509 26511 15497 0 -1 4202496 168322 0 0 0 34369 24085 0 0 20 0 17 0 655215408 826613760 167299 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 201810 167300 95 177 0 201632 0
[pid=26511/tid=26513] ppid=26509 vsize=807240 CPUtime=36.44
/proc/26511/task/26513/stat : 26513 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 9392 0 0 0 3610 34 0 0 20 0 17 0 655216868 826613760 167300 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134751534 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26511/tid=26514] ppid=26509 vsize=807240 CPUtime=35.64
/proc/26511/task/26514/stat : 26514 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 5186 0 0 0 2058 1506 0 0 20 0 17 0 655216868 826613760 167300 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=26511/tid=26515] ppid=26509 vsize=807240 CPUtime=35.56
/proc/26511/task/26515/stat : 26515 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 5067 0 0 0 1966 1590 0 0 20 0 17 0 655216868 826613760 167301 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26511/tid=26516] ppid=26509 vsize=807240 CPUtime=35.54
/proc/26511/task/26516/stat : 26516 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 4477 0 0 0 1858 1696 0 0 20 0 17 0 655216868 826613760 167301 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26511/tid=26517] ppid=26509 vsize=807240 CPUtime=35.52
/proc/26511/task/26517/stat : 26517 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 4574 0 0 0 1802 1750 0 0 20 0 17 0 655216868 826613760 167301 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26511/tid=26518] ppid=26509 vsize=807240 CPUtime=35.56
/proc/26511/task/26518/stat : 26518 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 4276 0 0 0 1852 1704 0 0 20 0 17 0 655216868 826613760 167301 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26511/tid=26519] ppid=26509 vsize=807240 CPUtime=35.58
/proc/26511/task/26519/stat : 26519 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 4402 0 0 0 1976 1582 0 0 20 0 17 0 655216868 826613760 167302 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26511/tid=26520] ppid=26509 vsize=807240 CPUtime=35.62
/proc/26511/task/26520/stat : 26520 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 4133 0 0 0 1944 1618 0 0 20 0 17 0 655216868 826613760 167302 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26511/tid=26521] ppid=26509 vsize=807240 CPUtime=35.78
/proc/26511/task/26521/stat : 26521 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 4452 0 0 0 2152 1426 0 0 20 0 17 0 655216868 826613760 167302 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26511/tid=26522] ppid=26509 vsize=807240 CPUtime=35.72
/proc/26511/task/26522/stat : 26522 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 4301 0 0 0 2014 1558 0 0 20 0 17 0 655216868 826613760 167302 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26511/tid=26523] ppid=26509 vsize=807240 CPUtime=35.74
/proc/26511/task/26523/stat : 26523 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 4430 0 0 0 2018 1556 0 0 20 0 17 0 655216868 826613760 167302 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26511/tid=26524] ppid=26509 vsize=807240 CPUtime=35.7
/proc/26511/task/26524/stat : 26524 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 2517 0 0 0 1920 1650 0 0 20 0 17 0 655216869 826613760 167302 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26511/tid=26525] ppid=26509 vsize=807240 CPUtime=34.72
/proc/26511/task/26525/stat : 26525 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 4248 0 0 0 1844 1628 0 0 20 0 17 0 655216869 826613760 167302 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134590501 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26511/tid=26526] ppid=26509 vsize=807240 CPUtime=35.52
/proc/26511/task/26526/stat : 26526 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 3557 0 0 0 2020 1532 0 0 20 0 17 0 655216869 826613760 167302 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134587921 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26511/tid=26527] ppid=26509 vsize=807240 CPUtime=35.6
/proc/26511/task/26527/stat : 26527 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 5370 0 0 0 1916 1644 0 0 20 0 17 0 655216869 826613760 167303 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26511/tid=26528] ppid=26509 vsize=807240 CPUtime=35.52
/proc/26511/task/26528/stat : 26528 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 5424 0 0 0 1984 1568 0 0 20 0 17 0 655216869 826613760 167304 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 584.54
Current children cumulated vsize (KiB) 807240

[startup+102.318 s]
/proc/loadavg: 15.11 14.84 14.96 17/201 26528
/proc/meminfo: memFree=17933928/36427776 swapFree=4692/1117440
[pid=26511] ppid=26509 vsize=1275884 CPUtime=1387.95
/proc/26511/stat : 26511 (ttsth-5-0) S 26509 26511 15497 0 -1 4202496 278376 0 0 0 96561 42234 0 0 20 0 17 0 655215408 1306505216 277353 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 318971 277354 95 177 0 318793 0
[pid=26511/tid=26513] ppid=26509 vsize=1275884 CPUtime=87.63
/proc/26511/task/26513/stat : 26513 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 19611 0 0 0 8711 52 0 0 20 0 17 0 655216868 1306505216 277354 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26511/tid=26514] ppid=26509 vsize=1275884 CPUtime=85.56
/proc/26511/task/26514/stat : 26514 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 8371 0 0 0 5750 2806 0 0 20 0 17 0 655216868 1306505216 277354 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=26511/tid=26515] ppid=26509 vsize=1275884 CPUtime=85.73
/proc/26511/task/26515/stat : 26515 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 14006 0 0 0 5749 2824 0 0 20 0 17 0 655216868 1306505216 277354 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134590146 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26511/tid=26516] ppid=26509 vsize=1275884 CPUtime=85.75
/proc/26511/task/26516/stat : 26516 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 16559 0 0 0 5687 2888 0 0 20 0 17 0 655216868 1306505216 277354 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26511/tid=26517] ppid=26509 vsize=1275884 CPUtime=85.51
/proc/26511/task/26517/stat : 26517 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 11645 0 0 0 5315 3236 0 0 20 0 17 0 655216868 1306505216 277355 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134589526 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26511/tid=26518] ppid=26509 vsize=1275884 CPUtime=85.54
/proc/26511/task/26518/stat : 26518 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 10509 0 0 0 5354 3200 0 0 20 0 17 0 655216868 1306505216 277355 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26511/tid=26519] ppid=26509 vsize=1275884 CPUtime=85.89
/proc/26511/task/26519/stat : 26519 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 12110 0 0 0 5783 2806 0 0 20 0 17 0 655216868 1306505216 277355 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26511/tid=26520] ppid=26509 vsize=1275884 CPUtime=86.03
/proc/26511/task/26520/stat : 26520 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 10060 0 0 0 5961 2642 0 0 20 0 17 0 655216868 1306505216 277355 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134634454 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26511/tid=26521] ppid=26509 vsize=1275884 CPUtime=86.33
/proc/26511/task/26521/stat : 26521 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 10028 0 0 0 6279 2354 0 0 20 0 17 0 655216868 1306505216 277355 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26511/tid=26522] ppid=26509 vsize=1275884 CPUtime=86.16
/proc/26511/task/26522/stat : 26522 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 10210 0 0 0 6050 2566 0 0 20 0 17 0 655216868 1306505216 277355 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26511/tid=26523] ppid=26509 vsize=1275884 CPUtime=85.89
/proc/26511/task/26523/stat : 26523 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 11028 0 0 0 5701 2888 0 0 20 0 17 0 655216868 1306505216 277355 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134634688 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26511/tid=26524] ppid=26509 vsize=1275884 CPUtime=86.03
/proc/26511/task/26524/stat : 26524 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 5316 0 0 0 5709 2894 0 0 20 0 17 0 655216869 1306505216 277355 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26511/tid=26525] ppid=26509 vsize=1275884 CPUtime=83.93
/proc/26511/task/26525/stat : 26525 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 9826 0 0 0 5683 2710 0 0 20 0 17 0 655216869 1306505216 277355 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134593204 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26511/tid=26526] ppid=26509 vsize=1275884 CPUtime=85.94
/proc/26511/task/26526/stat : 26526 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 9236 0 0 0 6146 2448 0 0 20 0 17 0 655216869 1306505216 277356 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134589655 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26511/tid=26527] ppid=26509 vsize=1275884 CPUtime=85.57
/proc/26511/task/26527/stat : 26527 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 10503 0 0 0 5497 3060 0 0 20 0 17 0 655216869 1306505216 277356 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134588158 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26511/tid=26528] ppid=26509 vsize=1275884 CPUtime=85.73
/proc/26511/task/26528/stat : 26528 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 16842 0 0 0 5757 2816 0 0 20 0 17 0 655216869 1306505216 277356 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1387.95
Current children cumulated vsize (KiB) 1275884

[startup+162.308 s]
/proc/loadavg: 15.61 15.03 15.02 17/201 26533
/proc/meminfo: memFree=17334820/36427776 swapFree=4692/1713836
[pid=26511] ppid=26509 vsize=1920344 CPUtime=2336.25
/proc/26511/stat : 26511 (ttsth-5-0) S 26509 26511 15497 0 -1 4202496 429444 0 0 0 183582 50043 0 0 20 0 17 0 655215408 1966432256 428421 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 480086 428422 95 177 0 479908 0
[pid=26511/tid=26513] ppid=26509 vsize=1920344 CPUtime=147.61
/proc/26511/task/26513/stat : 26513 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 30103 0 0 0 14683 78 0 0 20 0 17 0 655216868 1966432256 428422 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26511/tid=26514] ppid=26509 vsize=1920344 CPUtime=144.47
/proc/26511/task/26514/stat : 26514 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 13288 0 0 0 10928 3519 0 0 20 0 17 0 655216868 1966432256 428422 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=26511/tid=26515] ppid=26509 vsize=1920344 CPUtime=145.02
/proc/26511/task/26515/stat : 26515 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 29705 0 0 0 11156 3346 0 0 20 0 17 0 655216868 1966432256 428422 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26511/tid=26516] ppid=26509 vsize=1920344 CPUtime=144.97
/proc/26511/task/26516/stat : 26516 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 28731 0 0 0 10987 3510 0 0 20 0 17 0 655216868 1966432256 428422 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26511/tid=26517] ppid=26509 vsize=1920344 CPUtime=144.66
/proc/26511/task/26517/stat : 26517 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 34324 0 0 0 10600 3866 0 0 20 0 17 0 655216868 1966432256 428422 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26511/tid=26518] ppid=26509 vsize=1920344 CPUtime=144.66
/proc/26511/task/26518/stat : 26518 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 21332 0 0 0 10553 3913 0 0 20 0 17 0 655216868 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26511/tid=26519] ppid=26509 vsize=1920344 CPUtime=145.24
/proc/26511/task/26519/stat : 26519 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 20259 0 0 0 11177 3347 0 0 20 0 17 0 655216868 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26511/tid=26520] ppid=26509 vsize=1920344 CPUtime=145.57
/proc/26511/task/26520/stat : 26520 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 18634 0 0 0 11519 3038 0 0 20 0 17 0 655216868 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26511/tid=26521] ppid=26509 vsize=1920344 CPUtime=145.89
/proc/26511/task/26521/stat : 26521 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 17465 0 0 0 11931 2658 0 0 20 0 17 0 655216868 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134732535 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26511/tid=26522] ppid=26509 vsize=1920344 CPUtime=145.64
/proc/26511/task/26522/stat : 26522 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 16611 0 0 0 11506 3058 0 0 20 0 17 0 655216868 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562344 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26511/tid=26523] ppid=26509 vsize=1920344 CPUtime=145.11
/proc/26511/task/26523/stat : 26523 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 18176 0 0 0 11102 3409 0 0 20 0 17 0 655216868 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134591304 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26511/tid=26524] ppid=26509 vsize=1920344 CPUtime=145.52
/proc/26511/task/26524/stat : 26524 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 11548 0 0 0 11261 3291 0 0 20 0 17 0 655216869 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26511/tid=26525] ppid=26509 vsize=1920344 CPUtime=142.03
/proc/26511/task/26525/stat : 26525 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 15778 0 0 0 11075 3128 0 0 20 0 17 0 655216869 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26511/tid=26526] ppid=26509 vsize=1920344 CPUtime=145.45
/proc/26511/task/26526/stat : 26526 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 15359 0 0 0 11787 2758 0 0 20 0 17 0 655216869 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26511/tid=26527] ppid=26509 vsize=1920344 CPUtime=144.7
/proc/26511/task/26527/stat : 26527 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 19730 0 0 0 10723 3747 0 0 20 0 17 0 655216869 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26511/tid=26528] ppid=26509 vsize=1920344 CPUtime=144.96
/proc/26511/task/26528/stat : 26528 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 25885 0 0 0 11160 3336 0 0 20 0 17 0 655216869 1966432256 428423 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2336.25
Current children cumulated vsize (KiB) 1920344



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+178.705 s]
/proc/loadavg: 15.64 15.08 15.04 18/201 26533
/proc/meminfo: memFree=17161044/36427776 swapFree=4692/1886108
[pid=26511] ppid=26509 vsize=2097400 CPUtime=2596.57
/proc/26511/stat : 26511 (ttsth-5-0) S 26509 26511 15497 0 -1 4202496 470734 0 0 0 208629 51028 0 0 20 0 17 0 655215408 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 524350 469711 95 177 0 524172 0
[pid=26511/tid=26513] ppid=26509 vsize=2097400 CPUtime=164.03
/proc/26511/task/26513/stat : 26513 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 31809 0 0 0 16319 84 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134549905 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26511/tid=26514] ppid=26509 vsize=2097400 CPUtime=160.79
/proc/26511/task/26514/stat : 26514 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 15162 0 0 0 12524 3555 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=26511/tid=26515] ppid=26509 vsize=2097400 CPUtime=161.29
/proc/26511/task/26515/stat : 26515 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 32412 0 0 0 12725 3404 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26511/tid=26516] ppid=26509 vsize=2097400 CPUtime=161.22
/proc/26511/task/26516/stat : 26516 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 30511 0 0 0 12547 3575 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134590285 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26511/tid=26517] ppid=26509 vsize=2097400 CPUtime=160.94
/proc/26511/task/26517/stat : 26517 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 44401 0 0 0 12131 3963 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26511/tid=26518] ppid=26509 vsize=2097400 CPUtime=160.87
/proc/26511/task/26518/stat : 26518 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 24648 0 0 0 12058 4029 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26511/tid=26519] ppid=26509 vsize=2097400 CPUtime=161.48
/proc/26511/task/26519/stat : 26519 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 23499 0 0 0 12709 3439 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26511/tid=26520] ppid=26509 vsize=2097400 CPUtime=161.87
/proc/26511/task/26520/stat : 26520 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 21321 0 0 0 13099 3088 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134591211 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26511/tid=26521] ppid=26509 vsize=2097400 CPUtime=162.22
/proc/26511/task/26521/stat : 26521 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 18644 0 0 0 13528 2694 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26511/tid=26522] ppid=26509 vsize=2097400 CPUtime=161.93
/proc/26511/task/26522/stat : 26522 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 18553 0 0 0 13065 3128 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26511/tid=26523] ppid=26509 vsize=2097400 CPUtime=161.39
/proc/26511/task/26523/stat : 26523 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 20392 0 0 0 12649 3490 0 0 20 0 17 0 655216868 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26511/tid=26524] ppid=26509 vsize=2097400 CPUtime=161.88
/proc/26511/task/26524/stat : 26524 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 13566 0 0 0 12857 3331 0 0 20 0 17 0 655216869 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26511/tid=26525] ppid=26509 vsize=2097400 CPUtime=157.97
/proc/26511/task/26525/stat : 26525 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 17459 0 0 0 12607 3190 0 0 20 0 17 0 655216869 2147737600 469711 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26511/tid=26526] ppid=26509 vsize=2097400 CPUtime=161.79
/proc/26511/task/26526/stat : 26526 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 16966 0 0 0 13389 2790 0 0 20 0 17 0 655216869 2147737600 469712 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26511/tid=26527] ppid=26509 vsize=2097400 CPUtime=160.92
/proc/26511/task/26527/stat : 26527 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 21461 0 0 0 12233 3859 0 0 20 0 17 0 655216869 2147737600 469712 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26511/tid=26528] ppid=26509 vsize=2097400 CPUtime=161.26
/proc/26511/task/26528/stat : 26528 (ttsth-5-0) R 26509 26511 15497 0 -1 4202560 27412 0 0 0 12756 3370 0 0 20 0 17 0 655216869 2147737600 469712 18446744073709551615 134512640 135237372 4287463344 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2596.57
Current children cumulated vsize (KiB) 2097400

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+178.824 s]
/proc/loadavg: 15.64 15.08 15.04 18/201 26533
/proc/meminfo: memFree=17161044/36427776 swapFree=4692/1886108
[pid=26511] ppid=26509 vsize=0 CPUtime=2596.85
/proc/26511/stat : 26511 (ttsth-5-0) Z 26509 26511 15497 0 -1 4203532 470753 0 0 0 208647 51038 0 0 20 0 2 0 655215408 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/26511/statm: 0 0 0 0 0 0 0
[pid=26511/tid=26528] ppid=26509 vsize=0 CPUtime=161.35
/proc/26511/task/26528/stat : 26528 (ttsth-5-0) R 26509 26511 15497 0 -1 4203588 27413 0 0 0 12756 3379 0 0 20 0 2 0 655216869 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2596.85
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 178.9
CPU time (s): 2596.92
CPU user time (s): 2086.47
CPU system time (s): 510.456
CPU usage (%): 1451.61
Max. virtual memory (cumulated for all children) (KiB): 2097400

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2086.47
system time used= 510.456
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 470753
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 338665
involuntary context switches= 5404

runsolver used 0.840052 second user time and 2.55616 second system time

The end

Launcher Data 

Begin job on xenhost3-49 at 2009-06-14 07:58:10
IDJOB=1780020
IDBENCH=70947
IDSOLVER=634
FILE ID=xenhost3-49/1780020-1244959090
PBS_JOBID=
Free space on /tmp= 7021 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (16 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l48_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780020-1244959090/watcher-1780020-1244959090 -o /tmp/evaluation-result-1780020-1244959090/solver-1780020-1244959090 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780020-1244959090.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 16

MD5SUM BENCH= e7c28f6a200a1c1912fbaacfb3572515
RANDOM SEED= 326592408

Linux xenhost3-49 2.6.27.5 #1 SMP Mon Mar 30 10:34:22 CEST 2009 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 8
initial apicid	: 8
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 24
initial apicid	: 24
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 10
initial apicid	: 10
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 26
initial apicid	: 26
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 9
initial apicid	: 9
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 25
initial apicid	: 25
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 11
initial apicid	: 11
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 27
initial apicid	: 27
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:     36427776 kB
MemFree:      19040840 kB
Buffers:        484476 kB
Cached:       14120156 kB
SwapCached:          0 kB
Active:        4130488 kB
Inactive:     10482604 kB
SwapTotal:    25398692 kB
SwapFree:     25398692 kB
Dirty:            4008 kB
Writeback:           0 kB
AnonPages:        7112 kB
Mapped:           3764 kB
Slab:           721768 kB
SReclaimable:   694956 kB
SUnreclaim:      26812 kB
PageTables:          0 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
WritebackTmp:        0 kB
CommitLimit:  43612580 kB
Committed_AS:    29376 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    275248 kB
VmallocChunk: 34359462839 kB
DirectMap4k:  99216660 kB
DirectMap2M:         0 kB

Free space on /tmp at the end= 7020 MiB
End job on xenhost3-49 at 2009-06-14 08:01:11