Trace number 1780950

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (16 threads)? (MO) 1609.12 109.221

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_21_SAT.cnf
MD5SUM03a36a0e1b9af8e7c30a29a92e02302e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark65.2441
Satisfiable
(Un)Satisfiability was proved
Number of variables4466
Number of clauses542457
Sum of the clauses size1621186
Maximum clause length22
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 26774
Number of clauses of size 3535652
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data 

0.58/0.63	c Command: HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780950-1244979683.cnf 
0.58/0.63	c Using SATTIMEOUT of 10000
0.58/0.63	c Using SATRAM of 2047
0.58/0.63	c Size of subset node = 16
0.58/0.63	c Variables = 4466
0.58/0.63	c Clauses = 542457
0.58/0.63	c Literals = 1621186
0.58/0.63	c Reduced size:
0.58/0.63	c Variables = 4466
0.58/0.63	c Clauses = 542457
0.58/0.63	c Literals = 1621186
0.58/0.63	c a2
1.58/1.67	c a1
4.08/4.11	c Independent sub-problems = 1
4.08/4.11	c Sub-problem with 4466 variables and 542457 clauses
4.08/4.11	c using permutation method 4
4.08/4.11	c count = 1
4.08/4.11	c Ordering finished 3.920 seconds
4.08/4.11	c mapped 4.100 seconds
4.08/4.11	c permuted 4.100 seconds
4.08/4.11	c about to sort
4.18/4.23	c sorted
8.18/8.25	c clauses now 542457
8.18/8.25	c init finished 4.340 seconds
8.18/8.25	c tree built 8.250 seconds
8.18/8.25	c 
8.18/8.25	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
8.18/8.25	c ---------------------------------|----------------------------------|------------------------------------------------------
8.18/8.25	c ................................ | ..........                       |                        8.2           0.0             
8.18/8.25	c ................................ | ..........                     1 |                        8.2           0.1             
8.18/8.25	c ................................ | ..........                     2 |                        8.2           0.2             
8.18/8.25	c ................................ | ..........                     3 |                        8.2           0.4             
8.18/8.25	c ................................ | ..........                     4 |                        8.2           0.5             
8.18/8.25	c ................................ | ..........                     5 |                        8.2           0.6             
11.79/8.56	c ................................ | ..........                  1000 |                       10.6          94.7         6976
219.68/21.75	c ................................ | ..........                185000 | 4584                 201.1         919.8     11517093
424.45/34.61	c ................................ | ..........                319000 | 7893                 400.3         796.9     25349759
627.82/47.46	c ................................ | ..........                424000 | 10444                600.3         706.3     38992504
832.92/60.31	c ................................ | ..........                523000 | 13017                801.1         652.9     52536383
1033.55/73.00	c ................................ | *.........                615000 | 15288               1000.7         614.6     65746125
1235.79/85.69	c ................................ | *.........                706000 | 17651               1200.5         588.1     78618681
1438.14/98.34	c ................................ | *.........                788000 | 19985               1400.1         562.8     90823416

Verifier Data 

sh: BIN/SAT-verifier: No such file or directory

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780950-1244979683/watcher-1780950-1244979683 -o /tmp/evaluation-result-1780950-1244979683/solver-1780950-1244979683 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780950-1244979683.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 14.69 15.23 13.17 2/184 29883
/proc/meminfo: memFree=18980792/36427776 swapFree=4524/8332
[pid=29883] ppid=29881 vsize=1540 CPUtime=0
/proc/29883/stat : 29883 (ttsth-5-0) R 29881 29883 15497 0 -1 4202496 280 0 0 0 0 0 0 0 20 0 1 0 657274724 1576960 237 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134639534 0 0 1 0 0 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 385 238 75 177 0 207 0

[startup+0.0342 s]
/proc/loadavg: 14.69 15.23 13.17 2/184 29883
/proc/meminfo: memFree=18980792/36427776 swapFree=4524/8332
[pid=29883] ppid=29881 vsize=3024 CPUtime=0.02
/proc/29883/stat : 29883 (ttsth-5-0) R 29881 29883 15497 0 -1 4202496 638 0 0 0 2 0 0 0 20 0 1 0 657274724 3096576 595 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134732614 0 0 1 0 0 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 756 596 75 177 0 578 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 3024

[startup+0.102216 s]
/proc/loadavg: 14.69 15.23 13.17 2/184 29883
/proc/meminfo: memFree=18980792/36427776 swapFree=4524/8332
[pid=29883] ppid=29881 vsize=7232 CPUtime=0.1
/proc/29883/stat : 29883 (ttsth-5-0) R 29881 29883 15497 0 -1 4202496 1672 0 0 0 10 0 0 0 20 0 1 0 657274724 7405568 1630 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134732614 0 0 1 0 0 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 1808 1630 75 177 0 1630 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 7232

[startup+0.302254 s]
/proc/loadavg: 14.69 15.23 13.17 2/184 29883
/proc/meminfo: memFree=18980792/36427776 swapFree=4524/8332
[pid=29883] ppid=29881 vsize=19864 CPUtime=0.28
/proc/29883/stat : 29883 (ttsth-5-0) R 29881 29883 15497 0 -1 4202496 4706 0 0 0 26 2 0 0 20 0 1 0 657274724 20340736 4663 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134732614 0 0 1 0 0 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 4966 4664 75 177 0 4788 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 19864

[startup+0.702307 s]
/proc/loadavg: 14.69 15.23 13.17 2/184 29883
/proc/meminfo: memFree=18980792/36427776 swapFree=4524/8332
[pid=29883] ppid=29881 vsize=49248 CPUtime=0.68
/proc/29883/stat : 29883 (ttsth-5-0) R 29881 29883 15497 0 -1 4202496 11831 0 0 0 66 2 0 0 20 0 1 0 657274724 50429952 11788 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134554919 0 0 1 0 0 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 12312 11798 76 177 0 12134 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 49248

[startup+1.50233 s]
/proc/loadavg: 14.69 15.23 13.17 2/185 29884
/proc/meminfo: memFree=18912848/36427776 swapFree=4584/77060
[pid=29883] ppid=29881 vsize=73296 CPUtime=1.48
/proc/29883/stat : 29883 (ttsth-5-0) R 29881 29883 15497 0 -1 4202496 17157 0 0 0 144 4 0 0 20 0 1 0 657274724 75055104 17113 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134749343 0 0 1 0 0 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 18324 17113 76 177 0 18146 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 73296

[startup+3.10249 s]
/proc/loadavg: 14.69 15.23 13.17 2/185 29884
/proc/meminfo: memFree=18911468/36427776 swapFree=4424/78132
[pid=29883] ppid=29881 vsize=77180 CPUtime=3.08
/proc/29883/stat : 29883 (ttsth-5-0) R 29881 29883 15497 0 -1 4202496 20250 0 0 0 304 4 0 0 20 0 1 0 657274724 79032320 19146 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134732614 0 0 1 0 0 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 19295 19146 77 177 0 19117 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 77180

[startup+6.30275 s]
/proc/loadavg: 13.60 14.99 13.11 2/185 29884
/proc/meminfo: memFree=18860480/36427776 swapFree=4664/127952
[pid=29883] ppid=29881 vsize=132264 CPUtime=6.28
/proc/29883/stat : 29883 (ttsth-5-0) R 29881 29883 15497 0 -1 4202496 34508 0 0 0 618 10 0 0 20 0 1 0 657274724 135438336 32776 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134551515 0 0 1 0 0 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 33066 32776 88 177 0 32888 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 132264

[startup+12.7033 s]
/proc/loadavg: 12.59 14.76 13.04 16/201 29900
/proc/meminfo: memFree=18754752/36427776 swapFree=4692/238092
[pid=29883] ppid=29881 vsize=372536 CPUtime=77.3
/proc/29883/stat : 29883 (ttsth-5-0) S 29881 29883 15497 0 -1 4202496 62741 0 0 0 5740 1990 0 0 20 0 17 0 657274724 381476864 60351 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 93134 60352 95 177 0 92956 0
[pid=29883/tid=29885] ppid=29881 vsize=372536 CPUtime=4.6
/proc/29883/task/29885/stat : 29885 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1539 0 0 0 376 84 0 0 20 0 17 0 657275549 381476864 60352 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134564210 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29883/tid=29886] ppid=29881 vsize=372536 CPUtime=4.3
/proc/29883/task/29886/stat : 29886 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 882 0 0 0 302 128 0 0 20 0 17 0 657275549 381476864 60352 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134591221 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29883/tid=29887] ppid=29881 vsize=372536 CPUtime=4.28
/proc/29883/task/29887/stat : 29887 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1208 0 0 0 312 116 0 0 20 0 17 0 657275549 381476864 60352 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134590501 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29883/tid=29888] ppid=29881 vsize=372536 CPUtime=4.32
/proc/29883/task/29888/stat : 29888 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1082 0 0 0 308 124 0 0 20 0 17 0 657275549 381476864 60352 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29883/tid=29889] ppid=29881 vsize=372536 CPUtime=4.28
/proc/29883/task/29889/stat : 29889 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1310 0 0 0 308 120 0 0 20 0 17 0 657275549 381476864 60353 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29883/tid=29890] ppid=29881 vsize=372536 CPUtime=4.28
/proc/29883/task/29890/stat : 29890 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 901 0 0 0 290 138 0 0 20 0 17 0 657275549 381476864 60353 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29883/tid=29891] ppid=29881 vsize=372536 CPUtime=4.32
/proc/29883/task/29891/stat : 29891 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 876 0 0 0 312 120 0 0 20 0 17 0 657275549 381476864 60353 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29883/tid=29892] ppid=29881 vsize=372536 CPUtime=4.26
/proc/29883/task/29892/stat : 29892 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 819 0 0 0 296 130 0 0 20 0 17 0 657275549 381476864 60355 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134590501 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29883/tid=29893] ppid=29881 vsize=372536 CPUtime=4.3
/proc/29883/task/29893/stat : 29893 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1354 0 0 0 306 124 0 0 20 0 17 0 657275549 381476864 60355 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29883/tid=29894] ppid=29881 vsize=372536 CPUtime=4.3
/proc/29883/task/29894/stat : 29894 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 557 0 0 0 302 128 0 0 20 0 17 0 657275549 381476864 60356 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29883/tid=29895] ppid=29881 vsize=372536 CPUtime=4.32
/proc/29883/task/29895/stat : 29895 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1265 0 0 0 312 120 0 0 20 0 17 0 657275549 381476864 60357 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29883/tid=29896] ppid=29881 vsize=372536 CPUtime=4.3
/proc/29883/task/29896/stat : 29896 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 756 0 0 0 300 130 0 0 20 0 17 0 657275549 381476864 60357 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29883/tid=29897] ppid=29881 vsize=372536 CPUtime=4.22
/proc/29883/task/29897/stat : 29897 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1204 0 0 0 290 132 0 0 20 0 17 0 657275549 381476864 60357 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134587506 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29883/tid=29898] ppid=29881 vsize=372536 CPUtime=4.32
/proc/29883/task/29898/stat : 29898 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1076 0 0 0 312 120 0 0 20 0 17 0 657275549 381476864 60357 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29883/tid=29899] ppid=29881 vsize=372536 CPUtime=4.28
/proc/29883/task/29899/stat : 29899 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1441 0 0 0 294 134 0 0 20 0 17 0 657275550 381476864 60357 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29883/tid=29900] ppid=29881 vsize=372536 CPUtime=4.26
/proc/29883/task/29900/stat : 29900 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 1067 0 0 0 302 124 0 0 20 0 17 0 657275551 381476864 60357 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
Current children cumulated CPU time (s) 77.3
Current children cumulated vsize (KiB) 372536

[startup+25.5025 s]
/proc/loadavg: 13.34 14.82 13.09 17/201 29900
/proc/meminfo: memFree=18533592/36427776 swapFree=4692/458976
[pid=29883] ppid=29881 vsize=597968 CPUtime=279.95
/proc/29883/stat : 29883 (ttsth-5-0) S 29881 29883 15497 0 -1 4202496 116287 0 0 0 24516 3479 0 0 20 0 17 0 657274724 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 149492 113896 95 177 0 149314 0
[pid=29883/tid=29885] ppid=29881 vsize=597968 CPUtime=17.38
/proc/29883/task/29885/stat : 29885 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 5249 0 0 0 1654 84 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29883/tid=29886] ppid=29881 vsize=597968 CPUtime=16.96
/proc/29883/task/29886/stat : 29886 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 2538 0 0 0 1464 232 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134591221 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29883/tid=29887] ppid=29881 vsize=597968 CPUtime=16.94
/proc/29883/task/29887/stat : 29887 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 5962 0 0 0 1472 222 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29883/tid=29888] ppid=29881 vsize=597968 CPUtime=16.94
/proc/29883/task/29888/stat : 29888 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 3690 0 0 0 1484 210 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29883/tid=29889] ppid=29881 vsize=597968 CPUtime=16.96
/proc/29883/task/29889/stat : 29889 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 5106 0 0 0 1478 218 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29883/tid=29890] ppid=29881 vsize=597968 CPUtime=16.96
/proc/29883/task/29890/stat : 29890 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 4020 0 0 0 1468 228 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29883/tid=29891] ppid=29881 vsize=597968 CPUtime=17
/proc/29883/task/29891/stat : 29891 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 3842 0 0 0 1482 218 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29883/tid=29892] ppid=29881 vsize=597968 CPUtime=16.9
/proc/29883/task/29892/stat : 29892 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 3670 0 0 0 1450 240 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29883/tid=29893] ppid=29881 vsize=597968 CPUtime=16.98
/proc/29883/task/29893/stat : 29893 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 6234 0 0 0 1452 246 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29883/tid=29894] ppid=29881 vsize=597968 CPUtime=16.98
/proc/29883/task/29894/stat : 29894 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 2761 0 0 0 1462 236 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29883/tid=29895] ppid=29881 vsize=597968 CPUtime=17.02
/proc/29883/task/29895/stat : 29895 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 3568 0 0 0 1498 204 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134591221 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29883/tid=29896] ppid=29881 vsize=597968 CPUtime=16.98
/proc/29883/task/29896/stat : 29896 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 2833 0 0 0 1470 228 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29883/tid=29897] ppid=29881 vsize=597968 CPUtime=16.66
/proc/29883/task/29897/stat : 29897 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 4937 0 0 0 1442 224 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29883/tid=29898] ppid=29881 vsize=597968 CPUtime=17.02
/proc/29883/task/29898/stat : 29898 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 3955 0 0 0 1490 212 0 0 20 0 17 0 657275549 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134591433 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29883/tid=29899] ppid=29881 vsize=597968 CPUtime=16.94
/proc/29883/task/29899/stat : 29899 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 8001 0 0 0 1458 236 0 0 20 0 17 0 657275550 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134590140 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29883/tid=29900] ppid=29881 vsize=597968 CPUtime=16.96
/proc/29883/task/29900/stat : 29900 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 4513 0 0 0 1474 222 0 0 20 0 17 0 657275551 612319232 113896 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
Current children cumulated CPU time (s) 279.95
Current children cumulated vsize (KiB) 597968

[startup+51.1048 s]
/proc/loadavg: 14.18 14.90 13.16 17/201 29900
/proc/meminfo: memFree=18080336/36427776 swapFree=4692/909516
[pid=29883] ppid=29881 vsize=1082904 CPUtime=686.58
/proc/29883/stat : 29883 (ttsth-5-0) S 29881 29883 15497 0 -1 4202496 230455 0 0 0 63179 5479 0 0 20 0 17 0 657274724 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 270726 228064 95 177 0 270548 0
[pid=29883/tid=29885] ppid=29881 vsize=1082904 CPUtime=42.85
/proc/29883/task/29885/stat : 29885 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 13036 0 0 0 4201 84 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29883/tid=29886] ppid=29881 vsize=1082904 CPUtime=42.4
/proc/29883/task/29886/stat : 29886 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 6188 0 0 0 3852 388 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134590501 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29883/tid=29887] ppid=29881 vsize=1082904 CPUtime=42.34
/proc/29883/task/29887/stat : 29887 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 13983 0 0 0 3870 364 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134592184 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29883/tid=29888] ppid=29881 vsize=1082904 CPUtime=42.39
/proc/29883/task/29888/stat : 29888 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 10157 0 0 0 3907 332 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134591174 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29883/tid=29889] ppid=29881 vsize=1082904 CPUtime=42.43
/proc/29883/task/29889/stat : 29889 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 11775 0 0 0 3903 340 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134590285 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29883/tid=29890] ppid=29881 vsize=1082904 CPUtime=42.4
/proc/29883/task/29890/stat : 29890 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 10798 0 0 0 3864 376 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29883/tid=29891] ppid=29881 vsize=1082904 CPUtime=42.46
/proc/29883/task/29891/stat : 29891 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 17031 0 0 0 3892 354 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29883/tid=29892] ppid=29881 vsize=1082904 CPUtime=42.32
/proc/29883/task/29892/stat : 29892 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 11035 0 0 0 3856 376 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29883/tid=29893] ppid=29881 vsize=1082904 CPUtime=42.43
/proc/29883/task/29893/stat : 29893 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 13369 0 0 0 3851 392 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29883/tid=29894] ppid=29881 vsize=1082904 CPUtime=42.46
/proc/29883/task/29894/stat : 29894 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 7033 0 0 0 3892 354 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134680346 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29883/tid=29895] ppid=29881 vsize=1082904 CPUtime=42.48
/proc/29883/task/29895/stat : 29895 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 11137 0 0 0 3922 326 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134680470 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29883/tid=29896] ppid=29881 vsize=1082904 CPUtime=42.41
/proc/29883/task/29896/stat : 29896 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 5872 0 0 0 3887 354 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29883/tid=29897] ppid=29881 vsize=1082904 CPUtime=41.6
/proc/29883/task/29897/stat : 29897 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 12644 0 0 0 3810 350 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134550019 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29883/tid=29898] ppid=29881 vsize=1082904 CPUtime=42.51
/proc/29883/task/29898/stat : 29898 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 10469 0 0 0 3915 336 0 0 20 0 17 0 657275549 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29883/tid=29899] ppid=29881 vsize=1082904 CPUtime=42.37
/proc/29883/task/29899/stat : 29899 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 20110 0 0 0 3859 378 0 0 20 0 17 0 657275550 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134730240 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29883/tid=29900] ppid=29881 vsize=1082904 CPUtime=42.4
/proc/29883/task/29900/stat : 29900 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 10410 0 0 0 3888 352 0 0 20 0 17 0 657275551 1108893696 228064 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
Current children cumulated CPU time (s) 686.58
Current children cumulated vsize (KiB) 1082904

[startup+102.314 s]
/proc/loadavg: 15.21 15.06 13.31 17/201 29900
/proc/meminfo: memFree=17225596/36427776 swapFree=4692/1764088
[pid=29883] ppid=29881 vsize=1983044 CPUtime=1501.99
/proc/29883/stat : 29883 (ttsth-5-0) S 29881 29883 15497 0 -1 4202496 442034 0 0 0 142231 7968 0 0 20 0 17 0 657274724 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 495761 439643 95 177 0 495583 0
[pid=29883/tid=29885] ppid=29881 vsize=1983044 CPUtime=93.93
/proc/29883/task/29885/stat : 29885 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 26813 0 0 0 9301 92 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29883/tid=29886] ppid=29881 vsize=1983044 CPUtime=93.42
/proc/29883/task/29886/stat : 29886 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 12184 0 0 0 8778 564 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29883/tid=29887] ppid=29881 vsize=1983044 CPUtime=93.32
/proc/29883/task/29887/stat : 29887 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 32587 0 0 0 8776 556 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29883/tid=29888] ppid=29881 vsize=1983044 CPUtime=93.39
/proc/29883/task/29888/stat : 29888 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 23128 0 0 0 8841 498 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134562401 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29883/tid=29889] ppid=29881 vsize=1983044 CPUtime=93.47
/proc/29883/task/29889/stat : 29889 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 27236 0 0 0 8845 502 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134591181 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29883/tid=29890] ppid=29881 vsize=1983044 CPUtime=93.44
/proc/29883/task/29890/stat : 29890 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 26278 0 0 0 8814 530 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134591529 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29883/tid=29891] ppid=29881 vsize=1983044 CPUtime=93.49
/proc/29883/task/29891/stat : 29891 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 33872 0 0 0 8815 534 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29883/tid=29892] ppid=29881 vsize=1983044 CPUtime=93.3
/proc/29883/task/29892/stat : 29892 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 24394 0 0 0 8772 558 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134591433 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29883/tid=29893] ppid=29881 vsize=1983044 CPUtime=93.43
/proc/29883/task/29893/stat : 29893 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 27024 0 0 0 8787 556 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134593204 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29883/tid=29894] ppid=29881 vsize=1983044 CPUtime=93.48
/proc/29883/task/29894/stat : 29894 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 15319 0 0 0 8842 506 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29883/tid=29895] ppid=29881 vsize=1983044 CPUtime=93.51
/proc/29883/task/29895/stat : 29895 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 26576 0 0 0 8887 464 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29883/tid=29896] ppid=29881 vsize=1983044 CPUtime=93.4
/proc/29883/task/29896/stat : 29896 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 11207 0 0 0 8808 532 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29883/tid=29897] ppid=29881 vsize=1983044 CPUtime=91.62
/proc/29883/task/29897/stat : 29897 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 25835 0 0 0 8644 518 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134680285 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29883/tid=29898] ppid=29881 vsize=1983044 CPUtime=93.57
/proc/29883/task/29898/stat : 29898 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 22797 0 0 0 8883 474 0 0 20 0 17 0 657275549 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29883/tid=29899] ppid=29881 vsize=1983044 CPUtime=93.4
/proc/29883/task/29899/stat : 29899 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 37252 0 0 0 8812 528 0 0 20 0 17 0 657275550 2030637056 439643 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29883/tid=29900] ppid=29881 vsize=1983044 CPUtime=93.4
/proc/29883/task/29900/stat : 29900 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 24124 0 0 0 8808 532 0 0 20 0 17 0 657275551 2030637056 439644 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
Current children cumulated CPU time (s) 1501.99
Current children cumulated vsize (KiB) 1983044



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+109.003 s]
/proc/loadavg: 15.33 15.09 13.33 17/201 29900
/proc/meminfo: memFree=17115960/36427776 swapFree=4692/1873292
[pid=29883] ppid=29881 vsize=2097448 CPUtime=1608.75
/proc/29883/stat : 29883 (ttsth-5-0) S 29881 29883 15497 0 -1 4202496 468677 0 0 0 152662 8213 0 0 20 0 17 0 657274724 2147786752 466286 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 524362 466286 95 177 0 524184 0
[pid=29883/tid=29885] ppid=29881 vsize=2097448 CPUtime=100.63
/proc/29883/task/29885/stat : 29885 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 28840 0 0 0 9967 96 0 0 20 0 17 0 657275549 2147786752 466286 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134592184 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29883/tid=29886] ppid=29881 vsize=2097448 CPUtime=100.1
/proc/29883/task/29886/stat : 29886 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 13079 0 0 0 9430 580 0 0 20 0 17 0 657275549 2147786752 466286 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134552732 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29883/tid=29887] ppid=29881 vsize=2097448 CPUtime=100.01
/proc/29883/task/29887/stat : 29887 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 35396 0 0 0 9421 580 0 0 20 0 17 0 657275549 2147786752 466286 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29883/tid=29888] ppid=29881 vsize=2097448 CPUtime=100.07
/proc/29883/task/29888/stat : 29888 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 24685 0 0 0 9491 516 0 0 20 0 17 0 657275549 2147786752 466287 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29883/tid=29889] ppid=29881 vsize=2097448 CPUtime=100.16
/proc/29883/task/29889/stat : 29889 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 28975 0 0 0 9498 518 0 0 20 0 17 0 657275549 2147786752 466287 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29883/tid=29890] ppid=29881 vsize=2097448 CPUtime=100.12
/proc/29883/task/29890/stat : 29890 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 28445 0 0 0 9470 542 0 0 20 0 17 0 657275549 2147786752 466287 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29883/tid=29891] ppid=29881 vsize=2097448 CPUtime=100.18
/proc/29883/task/29891/stat : 29891 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 35216 0 0 0 9468 550 0 0 20 0 17 0 657275549 2147786752 466287 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29883/tid=29892] ppid=29881 vsize=2097448 CPUtime=99.98
/proc/29883/task/29892/stat : 29892 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 25606 0 0 0 9422 576 0 0 20 0 17 0 657275549 2147786752 466287 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29883/tid=29893] ppid=29881 vsize=2097448 CPUtime=100.12
/proc/29883/task/29893/stat : 29893 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 28314 0 0 0 9440 572 0 0 20 0 17 0 657275549 2147786752 466287 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134562380 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29883/tid=29894] ppid=29881 vsize=2097448 CPUtime=100.16
/proc/29883/task/29894/stat : 29894 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 16277 0 0 0 9498 518 0 0 20 0 17 0 657275549 2147786752 466288 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29883/tid=29895] ppid=29881 vsize=2097448 CPUtime=100.21
/proc/29883/task/29895/stat : 29895 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 28822 0 0 0 9541 480 0 0 20 0 17 0 657275549 2147786752 466288 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134591177 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29883/tid=29896] ppid=29881 vsize=2097448 CPUtime=100.08
/proc/29883/task/29896/stat : 29896 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 11978 0 0 0 9456 552 0 0 20 0 17 0 657275549 2147786752 466288 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29883/tid=29897] ppid=29881 vsize=2097448 CPUtime=98.15
/proc/29883/task/29897/stat : 29897 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 28119 0 0 0 9279 536 0 0 20 0 17 0 657275549 2147786752 466288 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134551475 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29883/tid=29898] ppid=29881 vsize=2097448 CPUtime=100.26
/proc/29883/task/29898/stat : 29898 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 24834 0 0 0 9540 486 0 0 20 0 17 0 657275549 2147786752 466288 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134562344 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29883/tid=29899] ppid=29881 vsize=2097448 CPUtime=100.08
/proc/29883/task/29899/stat : 29899 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 38901 0 0 0 9466 542 0 0 20 0 17 0 657275550 2147786752 466288 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29883/tid=29900] ppid=29881 vsize=2097448 CPUtime=100.09
/proc/29883/task/29900/stat : 29900 (ttsth-5-0) R 29881 29883 15497 0 -1 4202560 25783 0 0 0 9457 552 0 0 20 0 17 0 657275551 2147786752 466288 18446744073709551615 134512640 135237372 4287418272 18446744073709551615 134593204 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
Current children cumulated CPU time (s) 1608.75
Current children cumulated vsize (KiB) 2097448

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+109.203 s]
/proc/loadavg: 15.33 15.09 13.33 17/201 29900
/proc/meminfo: memFree=17115960/36427776 swapFree=4692/1873292
[pid=29883] ppid=29881 vsize=0 CPUtime=1609.09
/proc/29883/stat : 29883 (ttsth-5-0) Z 29881 29883 15497 0 -1 4203532 468725 0 0 0 152676 8233 0 0 20 0 2 0 657274724 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/29883/statm: 0 0 0 0 0 0 0
[pid=29883/tid=29899] ppid=29881 vsize=0 CPUtime=100.28
/proc/29883/task/29899/stat : 29899 (ttsth-5-0) R 29881 29883 15497 0 -1 4203588 38903 0 0 0 9466 562 0 0 20 0 2 0 657275550 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1609.09
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 109.221
CPU time (s): 1609.12
CPU user time (s): 1526.78
CPU system time (s): 82.3371
CPU usage (%): 1473.26
Max. virtual memory (cumulated for all children) (KiB): 2097448

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1526.78
system time used= 82.3371
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 468725
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 109182
involuntary context switches= 3781

runsolver used 0.508031 second user time and 1.5761 second system time

The end

Launcher Data 

Begin job on xenhost3-49 at 2009-06-14 13:41:23
IDJOB=1780950
IDBENCH=71081
IDSOLVER=634
FILE ID=xenhost3-49/1780950-1244979683
PBS_JOBID=
Free space on /tmp= 7014 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (16 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_21_SAT.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780950-1244979683/watcher-1780950-1244979683 -o /tmp/evaluation-result-1780950-1244979683/solver-1780950-1244979683 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780950-1244979683.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 16

MD5SUM BENCH= 03a36a0e1b9af8e7c30a29a92e02302e
RANDOM SEED= 229612714

Linux xenhost3-49 2.6.27.5 #1 SMP Mon Mar 30 10:34:22 CEST 2009 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 8
initial apicid	: 8
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 24
initial apicid	: 24
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 10
initial apicid	: 10
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 26
initial apicid	: 26
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 9
initial apicid	: 9
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 25
initial apicid	: 25
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 11
initial apicid	: 11
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 27
initial apicid	: 27
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:     36427776 kB
MemFree:      18980792 kB
Buffers:        524816 kB
Cached:       14127240 kB
SwapCached:          0 kB
Active:        4171100 kB
Inactive:     10489180 kB
SwapTotal:    25398692 kB
SwapFree:     25398692 kB
Dirty:            9992 kB
Writeback:           0 kB
AnonPages:        8332 kB
Mapped:           3860 kB
Slab:           733996 kB
SReclaimable:   706968 kB
SUnreclaim:      27028 kB
PageTables:          0 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
WritebackTmp:        0 kB
CommitLimit:  43612580 kB
Committed_AS:    29616 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    275248 kB
VmallocChunk: 34359462839 kB
DirectMap4k:  99216660 kB
DirectMap2M:         0 kB

Free space on /tmp at the end= 7014 MiB
End job on xenhost3-49 at 2009-06-14 13:43:15