Trace number 1780005

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (16 threads)? (MO) 3259.02 218.399

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l47_lambda.cnf
MD5SUMed7689c65135a913d97feca3ab3874eb
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark390.06
Satisfiable
(Un)Satisfiability was proved
Number of variables33871
Number of clauses170161
Sum of the clauses size490938
Maximum clause length9
Minimum clause length1
Number of clauses of size 14346
Number of clauses of size 241947
Number of clauses of size 3100545
Number of clauses of size 416116
Number of clauses of size 57066
Number of clauses of size over 5141

Solver Data 

0.28/0.32	c Command: HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780005-1244958870.cnf 
0.28/0.32	c Using SATTIMEOUT of 10000
0.28/0.32	c Using SATRAM of 2047
0.28/0.32	c Size of subset node = 16
0.28/0.32	c Variables = 33871
0.28/0.32	c Clauses = 170161
0.28/0.32	c Literals = 490938
0.28/0.32	c Reduced size:
0.28/0.32	c Variables = 33871
0.28/0.32	c Clauses = 153802
0.28/0.32	c Literals = 449883
0.28/0.32	c a2
0.48/0.59	c a1
11.02/11.07	c Independent sub-problems = 1
11.02/11.07	c Sub-problem with 28617 variables and 153802 clauses
11.02/11.07	c using permutation method 4
11.02/11.07	c count = 1
11.02/11.07	c Ordering finished 11.020 seconds
11.02/11.07	c mapped 11.060 seconds
11.02/11.07	c permuted 11.060 seconds
11.02/11.07	c about to sort
11.10/11.11	c sorted
13.40/13.45	c clauses now 153802
13.40/13.45	c init finished 11.650 seconds
13.40/13.45	c tree built 13.440 seconds
13.40/13.45	c 
13.40/13.45	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
13.40/13.45	c ---------------------------------|----------------------------------|------------------------------------------------------
13.40/13.45	c ................................ | ..........                       |                       13.5           0.0            3
13.40/13.45	c ................................ | ..........                     1 |                       13.5           0.1            3
13.40/13.45	c ****************................ | ..........                     2 | 1                     13.5           0.1            3
13.40/13.45	c ****************................ | ..........                     3 | 1                     13.5           0.2            3
13.40/13.45	c ****************................ | ..........                     4 | 1                     13.5           0.3            3
13.40/13.45	c ****************................ | ..........                     5 | 1                     13.5           0.4            3
13.40/13.45	c ****************................ | ..........                     6 | 1                     13.5           0.4            3
15.61/13.61	c ****************................ | ..........                  1000 | 4                     14.7          67.9          154
236.09/27.71	c ****************................ | ..........                435000 | 25337                200.1        2173.8      7764902
452.09/41.41	c ****************................ | ..........                659000 | 35383                400.0        1647.5     13587555
668.06/55.15	c ****************................ | ..........                882000 | 45526                600.8        1468.0     20465466
881.32/68.61	c ****************................ | ..........               1092000 | 55040                800.4        1364.4     26838919
1093.09/82.05	c ****************................ | *.........               1301000 | 64445               1000.4        1300.5     33114600
1302.21/95.21	c ****************................ | *.........               1498000 | 73357               1200.3        1248.0     39198658
1506.98/108.14	c ****************................ | *.........               1682000 | 81640               1400.4        1201.1     44542472
1712.22/121.02	c ****************................ | *.........               1846000 | 89171               1600.8        1153.2     49947739
1915.49/133.86	c ****************................ | *.........               2014000 | 96743               1800.4        1118.6     55597070
2121.94/146.87	c ****************................ | **........               2183000 | 104358              2001.4        1090.7     61707680

Verifier Data 

sh: BIN/SAT-verifier: No such file or directory

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780005-1244958870/watcher-1780005-1244958870 -o /tmp/evaluation-result-1780005-1244958870/solver-1780005-1244958870 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780005-1244958870.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 14.55 15.20 15.15 2/184 26451
/proc/meminfo: memFree=19040752/36427776 swapFree=3616/8220
[pid=26451] ppid=26449 vsize=1548 CPUtime=0
/proc/26451/stat : 26451 (ttsth-5-0) R 26449 26451 15497 0 -1 4202496 277 0 0 0 0 0 0 0 20 0 1 0 655193362 1585152 233 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134639534 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 387 234 75 177 0 209 0

[startup+0.022272 s]
/proc/loadavg: 14.55 15.20 15.15 2/184 26451
/proc/meminfo: memFree=19040752/36427776 swapFree=3616/8220
[pid=26451] ppid=26449 vsize=2228 CPUtime=0.02
/proc/26451/stat : 26451 (ttsth-5-0) R 26449 26451 15497 0 -1 4202496 463 0 0 0 2 0 0 0 20 0 1 0 655193362 2281472 419 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134887194 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 590 420 75 177 0 412 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 2228

[startup+0.102261 s]
/proc/loadavg: 14.55 15.20 15.15 2/184 26451
/proc/meminfo: memFree=19040752/36427776 swapFree=3616/8220
[pid=26451] ppid=26449 vsize=7128 CPUtime=0.08
/proc/26451/stat : 26451 (ttsth-5-0) R 26449 26451 15497 0 -1 4202496 1654 0 0 0 8 0 0 0 20 0 1 0 655193362 7299072 1610 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134732614 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 1815 1611 75 177 0 1637 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 7128

[startup+0.302311 s]
/proc/loadavg: 14.55 15.20 15.15 2/184 26451
/proc/meminfo: memFree=19040752/36427776 swapFree=3616/8220
[pid=26451] ppid=26449 vsize=12848 CPUtime=0.28
/proc/26451/stat : 26451 (ttsth-5-0) R 26449 26451 15497 0 -1 4202496 2991 0 0 0 28 0 0 0 20 0 1 0 655193362 13156352 2947 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134534665 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 3212 2947 75 177 0 3034 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 12848

[startup+0.702337 s]
/proc/loadavg: 14.55 15.20 15.15 2/184 26451
/proc/meminfo: memFree=19040752/36427776 swapFree=3616/8220
[pid=26451] ppid=26449 vsize=23920 CPUtime=0.68
/proc/26451/stat : 26451 (ttsth-5-0) R 26449 26451 15497 0 -1 4202496 6328 0 0 0 68 0 0 0 20 0 1 0 655193362 24494080 5756 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134555272 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 5980 5756 77 177 0 5802 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 23920

[startup+1.50241 s]
/proc/loadavg: 14.55 15.20 15.15 2/185 26452
/proc/meminfo: memFree=19013336/36427776 swapFree=4292/35836
[pid=26451] ppid=26449 vsize=29212 CPUtime=1.48
/proc/26451/stat : 26451 (ttsth-5-0) R 26449 26451 15497 0 -1 4202496 7663 0 0 0 146 2 0 0 20 0 1 0 655193362 29913088 7091 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134553897 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 7303 7091 77 177 0 7125 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 29212

[startup+3.10255 s]
/proc/loadavg: 14.55 15.20 15.15 2/185 26452
/proc/meminfo: memFree=19011800/36427776 swapFree=4224/36828
[pid=26451] ppid=26449 vsize=29456 CPUtime=3.08
/proc/26451/stat : 26451 (ttsth-5-0) R 26449 26451 15497 0 -1 4202496 7719 0 0 0 306 2 0 0 20 0 1 0 655193362 30162944 7147 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134600718 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 7364 7147 77 177 0 7186 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 29456

[startup+6.30281 s]
/proc/loadavg: 13.46 14.96 15.08 2/185 26452
/proc/meminfo: memFree=19010480/36427776 swapFree=4620/37676
[pid=26451] ppid=26449 vsize=29912 CPUtime=6.32
/proc/26451/stat : 26451 (ttsth-5-0) R 26449 26451 15497 0 -1 4202496 7785 0 0 0 628 4 0 0 20 0 1 0 655193362 30629888 7213 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134600738 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 7478 7213 77 177 0 7300 0
Current children cumulated CPU time (s) 6.32
Current children cumulated vsize (KiB) 29912

[startup+12.7034 s]
/proc/loadavg: 12.47 14.73 15.00 2/185 26452
/proc/meminfo: memFree=18737160/36427776 swapFree=4676/310816
[pid=26451] ppid=26449 vsize=322620 CPUtime=12.7
/proc/26451/stat : 26451 (ttsth-5-0) R 26449 26451 15497 0 -1 4202496 81170 0 0 0 1242 28 0 0 20 0 1 0 655193362 330362880 80447 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134732535 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 80655 80448 91 177 0 80477 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 322620

[startup+25.5048 s]
/proc/loadavg: 12.23 14.55 14.94 16/201 26468
/proc/meminfo: memFree=18546700/36427776 swapFree=4692/503492
[pid=26451] ppid=26449 vsize=628268 CPUtime=201.33
/proc/26451/stat : 26451 (ttsth-5-0) S 26449 26451 15497 0 -1 4202496 125811 0 0 0 14462 5671 0 0 20 0 17 0 655193362 643346432 124808 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 157067 124808 95 177 0 156889 0
[pid=26451/tid=26453] ppid=26449 vsize=628268 CPUtime=11.98
/proc/26451/task/26453/stat : 26453 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 3143 0 0 0 1162 36 0 0 20 0 17 0 655194707 643346432 124808 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134551012 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26451/tid=26454] ppid=26449 vsize=628268 CPUtime=11.72
/proc/26451/task/26454/stat : 26454 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 1720 0 0 0 796 376 0 0 20 0 17 0 655194707 643346432 124808 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26451/tid=26455] ppid=26449 vsize=628268 CPUtime=11.76
/proc/26451/task/26455/stat : 26455 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 1862 0 0 0 788 388 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26451/tid=26456] ppid=26449 vsize=628268 CPUtime=11.76
/proc/26451/task/26456/stat : 26456 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 2194 0 0 0 792 384 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26451/tid=26457] ppid=26449 vsize=628268 CPUtime=11.72
/proc/26451/task/26457/stat : 26457 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 2114 0 0 0 806 366 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134591217 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26451/tid=26458] ppid=26449 vsize=628268 CPUtime=11.78
/proc/26451/task/26458/stat : 26458 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 1697 0 0 0 824 354 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26451/tid=26459] ppid=26449 vsize=628268 CPUtime=11.7
/proc/26451/task/26459/stat : 26459 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 1749 0 0 0 784 386 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26451/tid=26460] ppid=26449 vsize=628268 CPUtime=11.8
/proc/26451/task/26460/stat : 26460 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 3713 0 0 0 842 338 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134591132 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26451/tid=26461] ppid=26449 vsize=628268 CPUtime=11.78
/proc/26451/task/26461/stat : 26461 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 2818 0 0 0 800 378 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26451/tid=26462] ppid=26449 vsize=628268 CPUtime=11.78
/proc/26451/task/26462/stat : 26462 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 2274 0 0 0 818 360 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26451/tid=26463] ppid=26449 vsize=628268 CPUtime=11.7
/proc/26451/task/26463/stat : 26463 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 1828 0 0 0 818 352 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26451/tid=26464] ppid=26449 vsize=628268 CPUtime=11.74
/proc/26451/task/26464/stat : 26464 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 2039 0 0 0 808 366 0 0 20 0 17 0 655194707 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26451/tid=26465] ppid=26449 vsize=628268 CPUtime=11.66
/proc/26451/task/26465/stat : 26465 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 2309 0 0 0 764 402 0 0 20 0 17 0 655194708 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26451/tid=26466] ppid=26449 vsize=628268 CPUtime=11.44
/proc/26451/task/26466/stat : 26466 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 2108 0 0 0 732 412 0 0 20 0 17 0 655194708 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26451/tid=26467] ppid=26449 vsize=628268 CPUtime=11.64
/proc/26451/task/26467/stat : 26467 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 1926 0 0 0 762 402 0 0 20 0 17 0 655194708 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26451/tid=26468] ppid=26449 vsize=628268 CPUtime=11.78
/proc/26451/task/26468/stat : 26468 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 2006 0 0 0 848 330 0 0 20 0 17 0 655194708 643346432 124809 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 201.33
Current children cumulated vsize (KiB) 628268

[startup+51.1066 s]
/proc/loadavg: 13.52 14.67 14.96 17/201 26473
/proc/meminfo: memFree=18353076/36427776 swapFree=4692/698736
[pid=26451] ppid=26449 vsize=838208 CPUtime=604.89
/proc/26451/stat : 26451 (ttsth-5-0) S 26449 26451 15497 0 -1 4202496 174911 0 0 0 49173 11316 0 0 20 0 17 0 655193362 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 209552 173908 95 177 0 209374 0
[pid=26451/tid=26453] ppid=26449 vsize=838208 CPUtime=37.58
/proc/26451/task/26453/stat : 26453 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 8377 0 0 0 3716 42 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134591529 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26451/tid=26454] ppid=26449 vsize=838208 CPUtime=37
/proc/26451/task/26454/stat : 26454 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 4536 0 0 0 2938 762 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134680502 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26451/tid=26455] ppid=26449 vsize=838208 CPUtime=36.8
/proc/26451/task/26455/stat : 26455 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 4695 0 0 0 2844 836 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26451/tid=26456] ppid=26449 vsize=838208 CPUtime=37.02
/proc/26451/task/26456/stat : 26456 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 5703 0 0 0 2914 788 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134564176 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26451/tid=26457] ppid=26449 vsize=838208 CPUtime=36.9
/proc/26451/task/26457/stat : 26457 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 4313 0 0 0 2890 800 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134564210 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26451/tid=26458] ppid=26449 vsize=838208 CPUtime=36.96
/proc/26451/task/26458/stat : 26458 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 4460 0 0 0 2952 744 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26451/tid=26459] ppid=26449 vsize=838208 CPUtime=36.84
/proc/26451/task/26459/stat : 26459 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 5107 0 0 0 2838 846 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134591181 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26451/tid=26460] ppid=26449 vsize=838208 CPUtime=37.24
/proc/26451/task/26460/stat : 26460 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 9886 0 0 0 3096 628 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26451/tid=26461] ppid=26449 vsize=838208 CPUtime=37.1
/proc/26451/task/26461/stat : 26461 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 5348 0 0 0 2990 720 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134591177 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26451/tid=26462] ppid=26449 vsize=838208 CPUtime=37.16
/proc/26451/task/26462/stat : 26462 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 5632 0 0 0 3058 658 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26451/tid=26463] ppid=26449 vsize=838208 CPUtime=36.72
/proc/26451/task/26463/stat : 26463 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 3730 0 0 0 2912 760 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26451/tid=26464] ppid=26449 vsize=838208 CPUtime=37.06
/proc/26451/task/26464/stat : 26464 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 4527 0 0 0 3012 694 0 0 20 0 17 0 655194707 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26451/tid=26465] ppid=26449 vsize=838208 CPUtime=36.74
/proc/26451/task/26465/stat : 26465 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 5353 0 0 0 2872 802 0 0 20 0 17 0 655194708 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26451/tid=26466] ppid=26449 vsize=838208 CPUtime=36.3
/proc/26451/task/26466/stat : 26466 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 4067 0 0 0 2942 688 0 0 20 0 17 0 655194708 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134549888 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26451/tid=26467] ppid=26449 vsize=838208 CPUtime=36.76
/proc/26451/task/26467/stat : 26467 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 4590 0 0 0 2822 854 0 0 20 0 17 0 655194708 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26451/tid=26468] ppid=26449 vsize=838208 CPUtime=37.1
/proc/26451/task/26468/stat : 26468 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 4275 0 0 0 3056 654 0 0 20 0 17 0 655194708 858324992 173908 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 604.89
Current children cumulated vsize (KiB) 838208

[startup+102.314 s]
/proc/loadavg: 14.75 14.81 15.00 17/201 26473
/proc/meminfo: memFree=17962288/36427776 swapFree=4692/1087116
[pid=26451] ppid=26449 vsize=1246896 CPUtime=1415.12
/proc/26451/stat : 26451 (ttsth-5-0) S 26449 26451 15497 0 -1 4202496 270946 0 0 0 122518 18994 0 0 20 0 17 0 655193362 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 311724 269943 95 177 0 311546 0
[pid=26451/tid=26453] ppid=26449 vsize=1246896 CPUtime=88.77
/proc/26451/task/26453/stat : 26453 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 17876 0 0 0 8815 62 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26451/tid=26454] ppid=26449 vsize=1246896 CPUtime=87.71
/proc/26451/task/26454/stat : 26454 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 9806 0 0 0 7483 1288 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26451/tid=26455] ppid=26449 vsize=1246896 CPUtime=87.68
/proc/26451/task/26455/stat : 26455 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 11823 0 0 0 7580 1188 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134590501 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26451/tid=26456] ppid=26449 vsize=1246896 CPUtime=87.63
/proc/26451/task/26456/stat : 26456 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 11690 0 0 0 7407 1356 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134680346 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26451/tid=26457] ppid=26449 vsize=1246896 CPUtime=87.74
/proc/26451/task/26457/stat : 26457 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 7744 0 0 0 7520 1254 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134590133 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26451/tid=26458] ppid=26449 vsize=1246896 CPUtime=87.49
/proc/26451/task/26458/stat : 26458 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 9289 0 0 0 7391 1358 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26451/tid=26459] ppid=26449 vsize=1246896 CPUtime=87.56
/proc/26451/task/26459/stat : 26459 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 11773 0 0 0 7446 1310 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26451/tid=26460] ppid=26449 vsize=1246896 CPUtime=88.12
/proc/26451/task/26460/stat : 26460 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 17353 0 0 0 7726 1086 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26451/tid=26461] ppid=26449 vsize=1246896 CPUtime=87.73
/proc/26451/task/26461/stat : 26461 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 15378 0 0 0 7505 1268 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134680474 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26451/tid=26462] ppid=26449 vsize=1246896 CPUtime=87.64
/proc/26451/task/26462/stat : 26462 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 9964 0 0 0 7474 1290 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26451/tid=26463] ppid=26449 vsize=1246896 CPUtime=87.24
/proc/26451/task/26463/stat : 26463 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 7858 0 0 0 7418 1306 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26451/tid=26464] ppid=26449 vsize=1246896 CPUtime=87.9
/proc/26451/task/26464/stat : 26464 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 9454 0 0 0 7742 1048 0 0 20 0 17 0 655194707 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134590166 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26451/tid=26465] ppid=26449 vsize=1246896 CPUtime=87.08
/proc/26451/task/26465/stat : 26465 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 13062 0 0 0 7296 1412 0 0 20 0 17 0 655194708 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134519944 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26451/tid=26466] ppid=26449 vsize=1246896 CPUtime=86.03
/proc/26451/task/26466/stat : 26466 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 8301 0 0 0 7437 1166 0 0 20 0 17 0 655194708 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26451/tid=26467] ppid=26449 vsize=1246896 CPUtime=87.53
/proc/26451/task/26467/stat : 26467 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 9769 0 0 0 7437 1316 0 0 20 0 17 0 655194708 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26451/tid=26468] ppid=26449 vsize=1246896 CPUtime=87.69
/proc/26451/task/26468/stat : 26468 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 9494 0 0 0 7525 1244 0 0 20 0 17 0 655194708 1276821504 269943 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1415.12
Current children cumulated vsize (KiB) 1246896

[startup+162.303 s]
/proc/loadavg: 15.46 15.01 15.05 17/201 26473
/proc/meminfo: memFree=17540152/36427776 swapFree=4692/1508044
[pid=26451] ppid=26449 vsize=1701704 CPUtime=2368.53
/proc/26451/stat : 26451 (ttsth-5-0) S 26449 26451 15497 0 -1 4202496 377381 0 0 0 213378 23475 0 0 20 0 17 0 655193362 1742544896 376378 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 425426 376378 95 177 0 425248 0
[pid=26451/tid=26453] ppid=26449 vsize=1701704 CPUtime=148.75
/proc/26451/task/26453/stat : 26453 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 27717 0 0 0 14791 84 0 0 20 0 17 0 655194707 1742544896 376378 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134749351 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26451/tid=26454] ppid=26449 vsize=1701704 CPUtime=147.43
/proc/26451/task/26454/stat : 26454 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 16516 0 0 0 13173 1570 0 0 20 0 17 0 655194707 1742544896 376378 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134593217 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26451/tid=26455] ppid=26449 vsize=1701704 CPUtime=147.42
/proc/26451/task/26455/stat : 26455 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 18666 0 0 0 13334 1408 0 0 20 0 17 0 655194707 1742544896 376378 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134562341 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26451/tid=26456] ppid=26449 vsize=1701704 CPUtime=147.27
/proc/26451/task/26456/stat : 26456 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 18602 0 0 0 13037 1690 0 0 20 0 17 0 655194707 1742544896 376378 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134680499 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26451/tid=26457] ppid=26449 vsize=1701704 CPUtime=147.43
/proc/26451/task/26457/stat : 26457 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 14819 0 0 0 13191 1552 0 0 20 0 17 0 655194707 1742544896 376379 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26451/tid=26458] ppid=26449 vsize=1701704 CPUtime=147.21
/proc/26451/task/26458/stat : 26458 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 16606 0 0 0 13121 1600 0 0 20 0 17 0 655194707 1742544896 376379 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134591163 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26451/tid=26459] ppid=26449 vsize=1701704 CPUtime=147.22
/proc/26451/task/26459/stat : 26459 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 19517 0 0 0 13162 1560 0 0 20 0 17 0 655194707 1742544896 376379 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26451/tid=26460] ppid=26449 vsize=1701704 CPUtime=147.83
/proc/26451/task/26460/stat : 26460 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 24847 0 0 0 13425 1358 0 0 20 0 17 0 655194707 1742544896 376380 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26451/tid=26461] ppid=26449 vsize=1701704 CPUtime=147.33
/proc/26451/task/26461/stat : 26461 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 20109 0 0 0 13109 1624 0 0 20 0 17 0 655194707 1742544896 376381 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134590501 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26451/tid=26462] ppid=26449 vsize=1701704 CPUtime=147
/proc/26451/task/26462/stat : 26462 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 15844 0 0 0 12984 1716 0 0 20 0 17 0 655194707 1742544896 376381 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26451/tid=26463] ppid=26449 vsize=1701704 CPUtime=146.85
/proc/26451/task/26463/stat : 26463 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 12126 0 0 0 13067 1618 0 0 20 0 17 0 655194707 1742544896 376381 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26451/tid=26464] ppid=26449 vsize=1701704 CPUtime=147.66
/proc/26451/task/26464/stat : 26464 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 16461 0 0 0 13470 1296 0 0 20 0 17 0 655194707 1742544896 376381 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26451/tid=26465] ppid=26449 vsize=1701704 CPUtime=146.8
/proc/26451/task/26465/stat : 26465 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 21819 0 0 0 13014 1666 0 0 20 0 17 0 655194708 1742544896 376381 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26451/tid=26466] ppid=26449 vsize=1701704 CPUtime=144.28
/proc/26451/task/26466/stat : 26466 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 12664 0 0 0 12920 1508 0 0 20 0 17 0 655194708 1742544896 376381 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26451/tid=26467] ppid=26449 vsize=1701704 CPUtime=147.17
/proc/26451/task/26467/stat : 26467 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 15271 0 0 0 13113 1604 0 0 20 0 17 0 655194708 1742544896 376381 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134591181 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26451/tid=26468] ppid=26449 vsize=1701704 CPUtime=147.24
/proc/26451/task/26468/stat : 26468 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 15488 0 0 0 13144 1580 0 0 20 0 17 0 655194708 1742544896 376381 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134591529 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2368.53
Current children cumulated vsize (KiB) 1701704



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+218.205 s]
/proc/loadavg: 15.72 15.16 15.10 18/201 26473
/proc/meminfo: memFree=17164916/36427776 swapFree=4692/1882560
[pid=26451] ppid=26449 vsize=2097272 CPUtime=3258.64
/proc/26451/stat : 26451 (ttsth-5-0) S 26449 26451 15497 0 -1 4202496 469659 0 0 0 299769 26095 0 0 20 0 17 0 655193362 2147606528 468656 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 524318 468656 95 177 0 524140 0
[pid=26451/tid=26453] ppid=26449 vsize=2097272 CPUtime=204.66
/proc/26451/task/26453/stat : 26453 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 36238 0 0 0 20364 102 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26451/tid=26454] ppid=26449 vsize=2097272 CPUtime=202.97
/proc/26451/task/26454/stat : 26454 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 21959 0 0 0 18531 1766 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134680329 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26451/tid=26455] ppid=26449 vsize=2097272 CPUtime=203.19
/proc/26451/task/26455/stat : 26455 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 24814 0 0 0 18769 1550 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26451/tid=26456] ppid=26449 vsize=2097272 CPUtime=202.93
/proc/26451/task/26456/stat : 26456 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 25745 0 0 0 18407 1886 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26451/tid=26457] ppid=26449 vsize=2097272 CPUtime=203.17
/proc/26451/task/26457/stat : 26457 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 22130 0 0 0 18607 1710 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26451/tid=26458] ppid=26449 vsize=2097272 CPUtime=202.91
/proc/26451/task/26458/stat : 26458 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 20385 0 0 0 18545 1746 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26451/tid=26459] ppid=26449 vsize=2097272 CPUtime=203.03
/proc/26451/task/26459/stat : 26459 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 25032 0 0 0 18625 1678 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26451/tid=26460] ppid=26449 vsize=2097272 CPUtime=203.57
/proc/26451/task/26460/stat : 26460 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 31972 0 0 0 18827 1530 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26451/tid=26461] ppid=26449 vsize=2097272 CPUtime=202.95
/proc/26451/task/26461/stat : 26461 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 24300 0 0 0 18451 1844 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134590238 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26451/tid=26462] ppid=26449 vsize=2097272 CPUtime=202.69
/proc/26451/task/26462/stat : 26462 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 20643 0 0 0 18357 1912 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26451/tid=26463] ppid=26449 vsize=2097272 CPUtime=202.57
/proc/26451/task/26463/stat : 26463 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 17911 0 0 0 18459 1798 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26451/tid=26464] ppid=26449 vsize=2097272 CPUtime=203.47
/proc/26451/task/26464/stat : 26464 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 21280 0 0 0 18923 1424 0 0 20 0 17 0 655194707 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26451/tid=26465] ppid=26449 vsize=2097272 CPUtime=202.41
/proc/26451/task/26465/stat : 26465 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 27611 0 0 0 18399 1842 0 0 20 0 17 0 655194708 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134591082 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26451/tid=26466] ppid=26449 vsize=2097272 CPUtime=198.75
/proc/26451/task/26466/stat : 26466 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 18085 0 0 0 18171 1704 0 0 20 0 17 0 655194708 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134562344 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26451/tid=26467] ppid=26449 vsize=2097272 CPUtime=202.85
/proc/26451/task/26467/stat : 26467 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 20442 0 0 0 18475 1810 0 0 20 0 17 0 655194708 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26451/tid=26468] ppid=26449 vsize=2097272 CPUtime=202.95
/proc/26451/task/26468/stat : 26468 (ttsth-5-0) R 26449 26451 15497 0 -1 4202560 20801 0 0 0 18539 1756 0 0 20 0 17 0 655194708 2147606528 468657 18446744073709551615 134512640 135237372 4293543296 18446744073709551615 134589523 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3258.64
Current children cumulated vsize (KiB) 2097272

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+218.326 s]
/proc/loadavg: 15.72 15.16 15.10 18/201 26473
/proc/meminfo: memFree=17164916/36427776 swapFree=4692/1882560
[pid=26451] ppid=26449 vsize=0 CPUtime=3258.93
/proc/26451/stat : 26451 (ttsth-5-0) Z 26449 26451 15497 0 -1 4203532 469673 0 0 0 299785 26108 0 0 20 0 2 0 655193362 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26451/statm: 0 0 0 0 0 0 0
[pid=26451/tid=26468] ppid=26449 vsize=0 CPUtime=203.05
/proc/26451/task/26468/stat : 26468 (ttsth-5-0) R 26449 26451 15497 0 -1 4203588 20802 0 0 0 18539 1766 0 0 20 0 2 0 655194708 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3258.93
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 218.399
CPU time (s): 3259.02
CPU user time (s): 2997.86
CPU system time (s): 261.152
CPU usage (%): 1492.23
Max. virtual memory (cumulated for all children) (KiB): 2097272

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2997.86
system time used= 261.152
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 469673
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 287041
involuntary context switches= 7030

runsolver used 1.12807 second user time and 3.00019 second system time

The end

Launcher Data 

Begin job on xenhost3-49 at 2009-06-14 07:54:30
IDJOB=1780005
IDBENCH=70946
IDSOLVER=634
FILE ID=xenhost3-49/1780005-1244958870
PBS_JOBID=
Free space on /tmp= 7021 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (16 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l47_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780005-1244958870/watcher-1780005-1244958870 -o /tmp/evaluation-result-1780005-1244958870/solver-1780005-1244958870 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780005-1244958870.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 16

MD5SUM BENCH= ed7689c65135a913d97feca3ab3874eb
RANDOM SEED= 1499661079

Linux xenhost3-49 2.6.27.5 #1 SMP Mon Mar 30 10:34:22 CEST 2009 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 8
initial apicid	: 8
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 24
initial apicid	: 24
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 10
initial apicid	: 10
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 26
initial apicid	: 26
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 9
initial apicid	: 9
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 25
initial apicid	: 25
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 11
initial apicid	: 11
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 27
initial apicid	: 27
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:     36427776 kB
MemFree:      19040752 kB
Buffers:        484472 kB
Cached:       14120160 kB
SwapCached:          0 kB
Active:        4131512 kB
Inactive:     10482608 kB
SwapTotal:    25398692 kB
SwapFree:     25398692 kB
Dirty:            4048 kB
Writeback:           0 kB
AnonPages:        8220 kB
Mapped:           3616 kB
Slab:           721852 kB
SReclaimable:   694960 kB
SUnreclaim:      26892 kB
PageTables:          0 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
WritebackTmp:        0 kB
CommitLimit:  43612580 kB
Committed_AS:    29736 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    275248 kB
VmallocChunk: 34359462839 kB
DirectMap4k:  99216660 kB
DirectMap2M:         0 kB

Free space on /tmp at the end= 7021 MiB
End job on xenhost3-49 at 2009-06-14 07:58:10