Trace number 1780800

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (16 threads)? (MO) 1584.63 108.32

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_22_SAT.cnf
MD5SUM0370c302d744cf5297e07b7d8a6a8190
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.68
Satisfiable
(Un)Satisfiability was proved
Number of variables4692
Number of clauses582514
Sum of the clauses size1741093
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 27069
Number of clauses of size 3575414
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data 

0.58/0.69	c Command: HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780800-1244978428.cnf 
0.58/0.69	c Using SATTIMEOUT of 10000
0.58/0.69	c Using SATRAM of 2047
0.58/0.69	c Size of subset node = 16
0.58/0.69	c Variables = 4692
0.58/0.69	c Clauses = 582514
0.58/0.69	c Literals = 1741093
0.58/0.69	c Reduced size:
0.58/0.69	c Variables = 4692
0.58/0.69	c Clauses = 582514
0.58/0.69	c Literals = 1741093
0.58/0.69	c a2
1.68/1.79	c a1
4.40/4.44	c Independent sub-problems = 1
4.40/4.44	c Sub-problem with 4692 variables and 582514 clauses
4.40/4.44	c using permutation method 4
4.40/4.44	c count = 1
4.40/4.44	c Ordering finished 4.240 seconds
4.40/4.44	c mapped 4.440 seconds
4.40/4.44	c permuted 4.440 seconds
4.40/4.44	c about to sort
4.48/4.58	c sorted
8.70/8.80	c clauses now 582514
8.70/8.80	c init finished 4.690 seconds
8.70/8.80	c tree built 8.790 seconds
8.70/8.80	c 
8.70/8.80	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
8.70/8.80	c ---------------------------------|----------------------------------|------------------------------------------------------
8.70/8.80	c ................................ | ..........                       |                        8.8           0.0             
8.70/8.80	c ................................ | ..........                     1 |                        8.8           0.1             
8.70/8.80	c ................................ | ..........                     2 |                        8.8           0.2             
8.70/8.80	c ................................ | ..........                     3 |                        8.8           0.3             
8.70/8.80	c ................................ | ..........                     4 |                        8.8           0.5             
8.70/8.80	c ................................ | ..........                     5 |                        8.8           0.6             
11.68/9.10	c ................................ | ..........                  1000 |                       11.1          90.5         6266
221.88/22.49	c ................................ | ..........                358000 | 92652                200.5        1785.2     14792151
429.61/35.51	c ................................ | ..........                549000 | 145378               400.6        1370.5     29446074
634.51/48.43	c ................................ | ..........                721000 | 190558               600.4        1200.8     43344035
839.38/61.32	c ................................ | ..........                861000 | 227090               800.9        1075.0     56607384
1042.95/74.10	c ................................ | *.........                983000 | 256569              1000.9         982.1     68123310
1245.27/86.87	c ................................ | *.........               1110000 | 289622              1201.1         924.2     80727424
1447.23/99.59	c ................................ | *.........               1223000 | 320013              1401.0         873.0     92760660

Verifier Data 

sh: BIN/SAT-verifier: No such file or directory

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780800-1244978428/watcher-1780800-1244978428 -o /tmp/evaluation-result-1780800-1244978428/solver-1780800-1244978428 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780800-1244978428.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 15.85 13.19 7.37 2/184 29313
/proc/meminfo: memFree=18980432/36427776 swapFree=5020/7816
[pid=29313] ppid=29311 vsize=1540 CPUtime=0
/proc/29313/stat : 29313 (ttsth-5-0) R 29311 29313 15497 0 -1 4202496 281 0 0 0 0 0 0 0 20 0 1 0 657149166 1576960 237 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134732614 0 0 1 0 0 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 385 237 75 177 0 207 0

[startup+0.05687 s]
/proc/loadavg: 15.85 13.19 7.37 2/184 29313
/proc/meminfo: memFree=18980432/36427776 swapFree=5020/7816
[pid=29313] ppid=29311 vsize=4424 CPUtime=0.04
/proc/29313/stat : 29313 (ttsth-5-0) R 29311 29313 15497 0 -1 4202496 990 0 0 0 4 0 0 0 20 0 1 0 657149166 4530176 946 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134732614 0 0 1 0 0 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 1106 948 75 177 0 928 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 4424

[startup+0.100862 s]
/proc/loadavg: 15.85 13.19 7.37 2/184 29313
/proc/meminfo: memFree=18980432/36427776 swapFree=5020/7816
[pid=29313] ppid=29311 vsize=7232 CPUtime=0.1
/proc/29313/stat : 29313 (ttsth-5-0) R 29311 29313 15497 0 -1 4202496 1652 0 0 0 10 0 0 0 20 0 1 0 657149166 7405568 1608 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134738950 0 0 1 0 0 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 1808 1609 75 177 0 1630 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 7232

[startup+0.300906 s]
/proc/loadavg: 15.85 13.19 7.37 2/184 29313
/proc/meminfo: memFree=18980432/36427776 swapFree=5020/7816
[pid=29313] ppid=29311 vsize=19124 CPUtime=0.3
/proc/29313/stat : 29313 (ttsth-5-0) R 29311 29313 15497 0 -1 4202496 4688 0 0 0 28 2 0 0 20 0 1 0 657149166 19582976 4644 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134544681 0 0 1 0 0 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 4781 4645 75 177 0 4603 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 19124

[startup+0.700961 s]
/proc/loadavg: 15.85 13.19 7.37 2/184 29313
/proc/meminfo: memFree=18980432/36427776 swapFree=5020/7816
[pid=29313] ppid=29311 vsize=38608 CPUtime=0.68
/proc/29313/stat : 29313 (ttsth-5-0) R 29311 29313 15497 0 -1 4202496 9420 0 0 0 66 2 0 0 20 0 1 0 657149166 39534592 9376 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134732614 0 0 1 0 0 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 9652 9377 76 177 0 9474 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 38608

[startup+1.50098 s]
/proc/loadavg: 15.85 13.19 7.37 2/185 29314
/proc/meminfo: memFree=18906668/36427776 swapFree=5348/81332
[pid=29313] ppid=29311 vsize=78600 CPUtime=1.48
/proc/29313/stat : 29313 (ttsth-5-0) R 29311 29313 15497 0 -1 4202496 18554 0 0 0 140 8 0 0 20 0 1 0 657149166 80486400 18509 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134519968 0 0 1 0 0 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 19650 18509 76 177 0 19472 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 78600

[startup+3.10111 s]
/proc/loadavg: 15.85 13.19 7.37 2/185 29314
/proc/meminfo: memFree=18905960/36427776 swapFree=4920/82176
[pid=29313] ppid=29311 vsize=78404 CPUtime=3.1
/proc/29313/stat : 29313 (ttsth-5-0) R 29311 29313 15497 0 -1 4202496 20645 0 0 0 300 10 0 0 20 0 1 0 657149166 80285696 19462 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134732614 0 0 1 0 0 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 19634 19466 77 177 0 19456 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 78404

[startup+6.30537 s]
/proc/loadavg: 14.66 12.98 7.34 2/185 29314
/proc/meminfo: memFree=18859392/36427776 swapFree=4652/129420
[pid=29313] ppid=29311 vsize=133020 CPUtime=6.3
/proc/29313/stat : 29313 (ttsth-5-0) R 29311 29313 15497 0 -1 4202496 34852 0 0 0 612 18 0 0 20 0 1 0 657149166 136212480 33002 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134551480 0 0 1 0 0 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 33255 33002 88 177 0 33077 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 133020

[startup+12.7065 s]
/proc/loadavg: 13.57 12.78 7.30 17/201 29330
/proc/meminfo: memFree=18741496/36427776 swapFree=4692/249820
[pid=29313] ppid=29311 vsize=391956 CPUtime=69.09
/proc/29313/stat : 29313 (ttsth-5-0) S 29311 29313 15497 0 -1 4202496 67441 0 0 0 4722 2187 0 0 20 0 17 0 657149166 401362944 64889 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 97989 64890 95 177 0 97811 0
[pid=29313/tid=29315] ppid=29311 vsize=391956 CPUtime=3.94
/proc/29313/task/29315/stat : 29315 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 3907 0 0 0 338 56 0 0 20 0 17 0 657150046 401362944 64890 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29313/tid=29316] ppid=29311 vsize=391956 CPUtime=3.74
/proc/29313/task/29316/stat : 29316 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 1033 0 0 0 222 152 0 0 20 0 17 0 657150046 401362944 64891 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134592435 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29313/tid=29317] ppid=29311 vsize=391956 CPUtime=3.76
/proc/29313/task/29317/stat : 29317 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 1465 0 0 0 246 130 0 0 20 0 17 0 657150046 401362944 64891 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29313/tid=29318] ppid=29311 vsize=391956 CPUtime=3.76
/proc/29313/task/29318/stat : 29318 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 1739 0 0 0 240 136 0 0 20 0 17 0 657150046 401362944 64891 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29313/tid=29319] ppid=29311 vsize=391956 CPUtime=3.76
/proc/29313/task/29319/stat : 29319 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 1420 0 0 0 232 144 0 0 20 0 17 0 657150046 401362944 64891 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590501 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29313/tid=29320] ppid=29311 vsize=391956 CPUtime=3.78
/proc/29313/task/29320/stat : 29320 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 895 0 0 0 240 138 0 0 20 0 17 0 657150047 401362944 64891 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590777 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29313/tid=29321] ppid=29311 vsize=391956 CPUtime=3.76
/proc/29313/task/29321/stat : 29321 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 563 0 0 0 228 148 0 0 20 0 17 0 657150047 401362944 64891 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29313/tid=29322] ppid=29311 vsize=391956 CPUtime=3.74
/proc/29313/task/29322/stat : 29322 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 1246 0 0 0 232 142 0 0 20 0 17 0 657150047 401362944 64892 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590501 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29313/tid=29323] ppid=29311 vsize=391956 CPUtime=3.76
/proc/29313/task/29323/stat : 29323 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 728 0 0 0 238 138 0 0 20 0 17 0 657150047 401362944 64892 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29313/tid=29324] ppid=29311 vsize=391956 CPUtime=3.76
/proc/29313/task/29324/stat : 29324 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 1022 0 0 0 252 124 0 0 20 0 17 0 657150047 401362944 64894 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29313/tid=29325] ppid=29311 vsize=391956 CPUtime=3.74
/proc/29313/task/29325/stat : 29325 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 775 0 0 0 232 142 0 0 20 0 17 0 657150047 401362944 64894 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590170 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29313/tid=29326] ppid=29311 vsize=391956 CPUtime=3.72
/proc/29313/task/29326/stat : 29326 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 820 0 0 0 230 142 0 0 20 0 17 0 657150047 401362944 64894 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29313/tid=29327] ppid=29311 vsize=391956 CPUtime=3.76
/proc/29313/task/29327/stat : 29327 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 844 0 0 0 236 140 0 0 20 0 17 0 657150047 401362944 64894 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29313/tid=29328] ppid=29311 vsize=391956 CPUtime=3.68
/proc/29313/task/29328/stat : 29328 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 1131 0 0 0 236 132 0 0 20 0 17 0 657150047 401362944 64894 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590241 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29313/tid=29329] ppid=29311 vsize=391956 CPUtime=3.74
/proc/29313/task/29329/stat : 29329 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 1015 0 0 0 218 156 0 0 20 0 17 0 657150047 401362944 64894 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590275 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29313/tid=29330] ppid=29311 vsize=391956 CPUtime=3.76
/proc/29313/task/29330/stat : 29330 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 1008 0 0 0 240 136 0 0 20 0 17 0 657150047 401362944 64894 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
Current children cumulated CPU time (s) 69.09
Current children cumulated vsize (KiB) 391956

[startup+25.503 s]
/proc/loadavg: 14.11 12.94 7.44 17/201 29330
/proc/meminfo: memFree=18474992/36427776 swapFree=4692/517100
[pid=29313] ppid=29311 vsize=661008 CPUtime=270.94
/proc/29313/stat : 29313 (ttsth-5-0) S 29311 29313 15497 0 -1 4202496 131326 0 0 0 23063 4031 0 0 20 0 17 0 657149166 676872192 128774 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 165252 128774 95 177 0 165074 0
[pid=29313/tid=29315] ppid=29311 vsize=661008 CPUtime=16.64
/proc/29313/task/29315/stat : 29315 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 13181 0 0 0 1608 56 0 0 20 0 17 0 657150046 676872192 128774 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29313/tid=29316] ppid=29311 vsize=661008 CPUtime=16.34
/proc/29313/task/29316/stat : 29316 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 4281 0 0 0 1344 290 0 0 20 0 17 0 657150046 676872192 128775 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590129 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29313/tid=29317] ppid=29311 vsize=661008 CPUtime=16.38
/proc/29313/task/29317/stat : 29317 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 5167 0 0 0 1386 252 0 0 20 0 17 0 657150046 676872192 128775 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29313/tid=29318] ppid=29311 vsize=661008 CPUtime=16.42
/proc/29313/task/29318/stat : 29318 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 8207 0 0 0 1380 262 0 0 20 0 17 0 657150046 676872192 128775 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29313/tid=29319] ppid=29311 vsize=661008 CPUtime=16.36
/proc/29313/task/29319/stat : 29319 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 5885 0 0 0 1346 290 0 0 20 0 17 0 657150046 676872192 128775 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29313/tid=29320] ppid=29311 vsize=661008 CPUtime=16.4
/proc/29313/task/29320/stat : 29320 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 3403 0 0 0 1378 262 0 0 20 0 17 0 657150047 676872192 128776 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134591065 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29313/tid=29321] ppid=29311 vsize=661008 CPUtime=16.4
/proc/29313/task/29321/stat : 29321 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 3184 0 0 0 1360 280 0 0 20 0 17 0 657150047 676872192 128776 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29313/tid=29322] ppid=29311 vsize=661008 CPUtime=16.36
/proc/29313/task/29322/stat : 29322 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 4680 0 0 0 1370 266 0 0 20 0 17 0 657150047 676872192 128776 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29313/tid=29323] ppid=29311 vsize=661008 CPUtime=16.4
/proc/29313/task/29323/stat : 29323 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 3386 0 0 0 1390 250 0 0 20 0 17 0 657150047 676872192 128776 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29313/tid=29324] ppid=29311 vsize=661008 CPUtime=16.38
/proc/29313/task/29324/stat : 29324 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 5514 0 0 0 1404 234 0 0 20 0 17 0 657150047 676872192 128777 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29313/tid=29325] ppid=29311 vsize=661008 CPUtime=16.32
/proc/29313/task/29325/stat : 29325 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 3773 0 0 0 1358 274 0 0 20 0 17 0 657150047 676872192 128777 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134680502 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29313/tid=29326] ppid=29311 vsize=661008 CPUtime=16.34
/proc/29313/task/29326/stat : 29326 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 4027 0 0 0 1378 256 0 0 20 0 17 0 657150047 676872192 128777 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29313/tid=29327] ppid=29311 vsize=661008 CPUtime=16.4
/proc/29313/task/29327/stat : 29327 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 3968 0 0 0 1392 248 0 0 20 0 17 0 657150047 676872192 128777 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134549878 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29313/tid=29328] ppid=29311 vsize=661008 CPUtime=16.06
/proc/29313/task/29328/stat : 29328 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 3785 0 0 0 1350 256 0 0 20 0 17 0 657150047 676872192 128777 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29313/tid=29329] ppid=29311 vsize=661008 CPUtime=16.36
/proc/29313/task/29329/stat : 29329 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 6123 0 0 0 1362 274 0 0 20 0 17 0 657150047 676872192 128777 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29313/tid=29330] ppid=29311 vsize=661008 CPUtime=16.42
/proc/29313/task/29330/stat : 29330 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 4932 0 0 0 1392 250 0 0 20 0 17 0 657150047 676872192 128777 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
Current children cumulated CPU time (s) 270.94
Current children cumulated vsize (KiB) 661008

[startup+51.1031 s]
/proc/loadavg: 14.75 13.19 7.67 17/201 29330
/proc/meminfo: memFree=18010876/36427776 swapFree=4692/979080
[pid=29313] ppid=29311 vsize=1158316 CPUtime=677.27
/proc/29313/stat : 29313 (ttsth-5-0) S 29311 29313 15497 0 -1 4202496 248253 0 0 0 61426 6301 0 0 20 0 17 0 657149166 1186115584 245701 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 289579 245703 95 177 0 289401 0
[pid=29313/tid=29315] ppid=29311 vsize=1158316 CPUtime=42.22
/proc/29313/task/29315/stat : 29315 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 22966 0 0 0 4152 70 0 0 20 0 17 0 657150046 1186115584 245703 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134749345 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29313/tid=29316] ppid=29311 vsize=1158316 CPUtime=41.7
/proc/29313/task/29316/stat : 29316 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 10895 0 0 0 3724 446 0 0 20 0 17 0 657150046 1186115584 245703 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590129 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29313/tid=29317] ppid=29311 vsize=1158316 CPUtime=41.81
/proc/29313/task/29317/stat : 29317 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 12263 0 0 0 3777 404 0 0 20 0 17 0 657150046 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134680285 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29313/tid=29318] ppid=29311 vsize=1158316 CPUtime=41.85
/proc/29313/task/29318/stat : 29318 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 16776 0 0 0 3749 436 0 0 20 0 17 0 657150046 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29313/tid=29319] ppid=29311 vsize=1158316 CPUtime=41.8
/proc/29313/task/29319/stat : 29319 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 14284 0 0 0 3718 462 0 0 20 0 17 0 657150046 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29313/tid=29320] ppid=29311 vsize=1158316 CPUtime=41.83
/proc/29313/task/29320/stat : 29320 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 8405 0 0 0 3773 410 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29313/tid=29321] ppid=29311 vsize=1158316 CPUtime=41.84
/proc/29313/task/29321/stat : 29321 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 9568 0 0 0 3744 440 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29313/tid=29322] ppid=29311 vsize=1158316 CPUtime=41.78
/proc/29313/task/29322/stat : 29322 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 11061 0 0 0 3778 400 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29313/tid=29323] ppid=29311 vsize=1158316 CPUtime=41.84
/proc/29313/task/29323/stat : 29323 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 9782 0 0 0 3794 390 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590514 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29313/tid=29324] ppid=29311 vsize=1158316 CPUtime=41.79
/proc/29313/task/29324/stat : 29324 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 16250 0 0 0 3785 394 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29313/tid=29325] ppid=29311 vsize=1158316 CPUtime=41.72
/proc/29313/task/29325/stat : 29325 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 10491 0 0 0 3740 432 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29313/tid=29326] ppid=29311 vsize=1158316 CPUtime=41.73
/proc/29313/task/29326/stat : 29326 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 13272 0 0 0 3757 416 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29313/tid=29327] ppid=29311 vsize=1158316 CPUtime=41.8
/proc/29313/task/29327/stat : 29327 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 9189 0 0 0 3796 384 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29313/tid=29328] ppid=29311 vsize=1158316 CPUtime=41.02
/proc/29313/task/29328/stat : 29328 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 10863 0 0 0 3716 386 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590140 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29313/tid=29329] ppid=29311 vsize=1158316 CPUtime=41.78
/proc/29313/task/29329/stat : 29329 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 14169 0 0 0 3752 426 0 0 20 0 17 0 657150047 1186115584 245704 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29313/tid=29330] ppid=29311 vsize=1158316 CPUtime=41.88
/proc/29313/task/29330/stat : 29330 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 10190 0 0 0 3812 376 0 0 20 0 17 0 657150047 1186115584 245705 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
Current children cumulated CPU time (s) 677.27
Current children cumulated vsize (KiB) 1158316

[startup+102.319 s]
/proc/loadavg: 15.46 13.62 8.10 17/201 29330
/proc/meminfo: memFree=17198460/36427776 swapFree=4692/1792392
[pid=29313] ppid=29311 vsize=2013608 CPUtime=1492.01
/proc/29313/stat : 29313 (ttsth-5-0) S 29311 29313 15497 0 -1 4202496 448968 0 0 0 139853 9348 0 0 20 0 17 0 657149166 2061934592 446416 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 503402 446417 95 177 0 503224 0
[pid=29313/tid=29315] ppid=29311 vsize=2013608 CPUtime=93.43
/proc/29313/task/29315/stat : 29315 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 32888 0 0 0 9251 92 0 0 20 0 17 0 657150046 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29313/tid=29316] ppid=29311 vsize=2013608 CPUtime=92.6
/proc/29313/task/29316/stat : 29316 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 23159 0 0 0 8600 660 0 0 20 0 17 0 657150046 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29313/tid=29317] ppid=29311 vsize=2013608 CPUtime=92.79
/proc/29313/task/29317/stat : 29317 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 24855 0 0 0 8677 602 0 0 20 0 17 0 657150046 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134680270 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29313/tid=29318] ppid=29311 vsize=2013608 CPUtime=92.79
/proc/29313/task/29318/stat : 29318 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 30883 0 0 0 8603 676 0 0 20 0 17 0 657150046 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134591076 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29313/tid=29319] ppid=29311 vsize=2013608 CPUtime=92.75
/proc/29313/task/29319/stat : 29319 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 28367 0 0 0 8591 684 0 0 20 0 17 0 657150046 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134519944 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29313/tid=29320] ppid=29311 vsize=2013608 CPUtime=92.83
/proc/29313/task/29320/stat : 29320 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 20469 0 0 0 8689 594 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29313/tid=29321] ppid=29311 vsize=2013608 CPUtime=92.82
/proc/29313/task/29321/stat : 29321 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 20431 0 0 0 8634 648 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29313/tid=29322] ppid=29311 vsize=2013608 CPUtime=92.74
/proc/29313/task/29322/stat : 29322 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 21947 0 0 0 8676 598 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134680285 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29313/tid=29323] ppid=29311 vsize=2013608 CPUtime=92.85
/proc/29313/task/29323/stat : 29323 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 21002 0 0 0 8699 586 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29313/tid=29324] ppid=29311 vsize=2013608 CPUtime=92.77
/proc/29313/task/29324/stat : 29324 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 33353 0 0 0 8685 592 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134591221 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29313/tid=29325] ppid=29311 vsize=2013608 CPUtime=92.62
/proc/29313/task/29325/stat : 29325 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 21200 0 0 0 8618 644 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134591221 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29313/tid=29326] ppid=29311 vsize=2013608 CPUtime=92.68
/proc/29313/task/29326/stat : 29326 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 34066 0 0 0 8636 632 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29313/tid=29327] ppid=29311 vsize=2013608 CPUtime=92.73
/proc/29313/task/29327/stat : 29327 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 16410 0 0 0 8661 612 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29313/tid=29328] ppid=29311 vsize=2013608 CPUtime=91.02
/proc/29313/task/29328/stat : 29328 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 21149 0 0 0 8556 546 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590285 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29313/tid=29329] ppid=29311 vsize=2013608 CPUtime=92.76
/proc/29313/task/29329/stat : 29329 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 31141 0 0 0 8666 610 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29313/tid=29330] ppid=29311 vsize=2013608 CPUtime=92.9
/proc/29313/task/29330/stat : 29330 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 19817 0 0 0 8748 542 0 0 20 0 17 0 657150047 2061934592 446417 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134591184 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
Current children cumulated CPU time (s) 1492.01
Current children cumulated vsize (KiB) 2013608



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+108.103 s]
/proc/loadavg: 15.54 13.70 8.19 17/201 29330
/proc/meminfo: memFree=17117012/36427776 swapFree=4692/1875184
[pid=29313] ppid=29311 vsize=2098996 CPUtime=1584.25
/proc/29313/stat : 29313 (ttsth-5-0) S 29311 29313 15497 0 -1 4202496 468818 0 0 0 148778 9647 0 0 20 0 17 0 657149166 2149371904 466266 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 524749 466266 95 177 0 524571 0
[pid=29313/tid=29315] ppid=29311 vsize=2098996 CPUtime=99.21
/proc/29313/task/29315/stat : 29315 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 33655 0 0 0 9827 94 0 0 20 0 17 0 657150046 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29313/tid=29316] ppid=29311 vsize=2098996 CPUtime=98.38
/proc/29313/task/29316/stat : 29316 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 24760 0 0 0 9154 684 0 0 20 0 17 0 657150046 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29313/tid=29317] ppid=29311 vsize=2098996 CPUtime=98.56
/proc/29313/task/29317/stat : 29317 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 25366 0 0 0 9230 626 0 0 20 0 17 0 657150046 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29313/tid=29318] ppid=29311 vsize=2098996 CPUtime=98.56
/proc/29313/task/29318/stat : 29318 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 31885 0 0 0 9160 696 0 0 20 0 17 0 657150046 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134737752 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29313/tid=29319] ppid=29311 vsize=2098996 CPUtime=98.52
/proc/29313/task/29319/stat : 29319 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 30226 0 0 0 9148 704 0 0 20 0 17 0 657150046 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134591181 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29313/tid=29320] ppid=29311 vsize=2098996 CPUtime=98.61
/proc/29313/task/29320/stat : 29320 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 21866 0 0 0 9251 610 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134549950 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29313/tid=29321] ppid=29311 vsize=2098996 CPUtime=98.59
/proc/29313/task/29321/stat : 29321 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 22052 0 0 0 9189 670 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29313/tid=29322] ppid=29311 vsize=2098996 CPUtime=98.51
/proc/29313/task/29322/stat : 29322 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 22948 0 0 0 9229 622 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29313/tid=29323] ppid=29311 vsize=2098996 CPUtime=98.63
/proc/29313/task/29323/stat : 29323 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 21785 0 0 0 9253 610 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29313/tid=29324] ppid=29311 vsize=2098996 CPUtime=98.54
/proc/29313/task/29324/stat : 29324 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 34797 0 0 0 9242 612 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590170 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29313/tid=29325] ppid=29311 vsize=2098996 CPUtime=98.39
/proc/29313/task/29325/stat : 29325 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 22587 0 0 0 9175 664 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134562410 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29313/tid=29326] ppid=29311 vsize=2098996 CPUtime=98.45
/proc/29313/task/29326/stat : 29326 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 35654 0 0 0 9189 656 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29313/tid=29327] ppid=29311 vsize=2098996 CPUtime=98.5
/proc/29313/task/29327/stat : 29327 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 17242 0 0 0 9220 630 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134591065 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29313/tid=29328] ppid=29311 vsize=2098996 CPUtime=96.69
/proc/29313/task/29328/stat : 29328 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 22304 0 0 0 9111 558 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29313/tid=29329] ppid=29311 vsize=2098996 CPUtime=98.52
/proc/29313/task/29329/stat : 29329 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 33252 0 0 0 9228 624 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134580209 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29313/tid=29330] ppid=29311 vsize=2098996 CPUtime=98.68
/proc/29313/task/29330/stat : 29330 (ttsth-5-0) R 29311 29313 15497 0 -1 4202560 20608 0 0 0 9310 558 0 0 20 0 17 0 657150047 2149371904 466267 18446744073709551615 134512640 135237372 4287600592 18446744073709551615 134590140 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
Current children cumulated CPU time (s) 1584.25
Current children cumulated vsize (KiB) 2098996

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+108.226 s]
/proc/loadavg: 15.54 13.70 8.19 17/201 29330
/proc/meminfo: memFree=17117012/36427776 swapFree=4692/1875184
[pid=29313] ppid=29311 vsize=0 CPUtime=1584.53
/proc/29313/stat : 29313 (ttsth-5-0) Z 29311 29313 15497 0 -1 4203532 468840 0 0 0 148794 9659 0 0 20 0 2 0 657149166 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 0 0 0 0 0 0 0
[pid=29313/tid=29330] ppid=29311 vsize=0 CPUtime=98.79
/proc/29313/task/29330/stat : 29330 (ttsth-5-0) R 29311 29313 15497 0 -1 4203588 20611 0 0 0 9311 568 0 0 20 0 2 0 657150047 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
Current children cumulated CPU time (s) 1584.53
Current children cumulated vsize (KiB) 0

[startup+108.302 s]
/proc/loadavg: 15.54 13.70 8.19 17/201 29330
/proc/meminfo: memFree=17117012/36427776 swapFree=4692/1875184
[pid=29313] ppid=29311 vsize=0 CPUtime=1584.6
/proc/29313/stat : 29313 (ttsth-5-0) Z 29311 29313 15497 0 -1 4203532 468840 0 0 0 148794 9666 0 0 20 0 2 0 657149166 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 8 0 0 0 0 0
/proc/29313/statm: 0 0 0 0 0 0 0
[pid=29313/tid=29330] ppid=29311 vsize=0 CPUtime=98.85
/proc/29313/task/29330/stat : 29330 (ttsth-5-0) R 29311 29313 15497 0 -1 4203588 20611 0 0 0 9311 574 0 0 20 0 2 0 657150047 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
Current children cumulated CPU time (s) 1584.6
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 108.32
CPU time (s): 1584.63
CPU user time (s): 1487.95
CPU system time (s): 96.678
CPU usage (%): 1462.92
Max. virtual memory (cumulated for all children) (KiB): 2098996

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1487.95
system time used= 96.678
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 468840
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 129775
involuntary context switches= 3387

runsolver used 0.512032 second user time and 1.51209 second system time

The end

Launcher Data 

Begin job on xenhost3-49 at 2009-06-14 13:20:28
IDJOB=1780800
IDBENCH=71067
IDSOLVER=634
FILE ID=xenhost3-49/1780800-1244978428
PBS_JOBID=
Free space on /tmp= 7013 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (16 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_22_SAT.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780800-1244978428/watcher-1780800-1244978428 -o /tmp/evaluation-result-1780800-1244978428/solver-1780800-1244978428 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780800-1244978428.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 16

MD5SUM BENCH= 0370c302d744cf5297e07b7d8a6a8190
RANDOM SEED= 1050800513

Linux xenhost3-49 2.6.27.5 #1 SMP Mon Mar 30 10:34:22 CEST 2009 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 8
initial apicid	: 8
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 24
initial apicid	: 24
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 10
initial apicid	: 10
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 26
initial apicid	: 26
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 9
initial apicid	: 9
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 25
initial apicid	: 25
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 11
initial apicid	: 11
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 27
initial apicid	: 27
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:     36427776 kB
MemFree:      18980432 kB
Buffers:        524780 kB
Cached:       14127976 kB
SwapCached:          0 kB
Active:        4171716 kB
Inactive:     10490124 kB
SwapTotal:    25398692 kB
SwapFree:     25398692 kB
Dirty:           10652 kB
Writeback:           0 kB
AnonPages:        7816 kB
Mapped:           5020 kB
Slab:           733652 kB
SReclaimable:   706676 kB
SUnreclaim:      26976 kB
PageTables:          0 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
WritebackTmp:        0 kB
CommitLimit:  43612580 kB
Committed_AS:    29736 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    275248 kB
VmallocChunk: 34359462839 kB
DirectMap4k:  99216660 kB
DirectMap2M:         0 kB

Free space on /tmp at the end= 7013 MiB
End job on xenhost3-49 at 2009-06-14 13:22:18