Trace number 1779900

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (16 threads)? (MO) 3580.31 235.197

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l42_lambda.cnf
MD5SUMf7e4b8eacc29c0297225e4db3860ba3b
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark32.55
Satisfiable
(Un)Satisfiability was proved
Number of variables30006
Number of clauses148836
Sum of the clauses size428633
Maximum clause length9
Minimum clause length1
Number of clauses of size 13956
Number of clauses of size 237657
Number of clauses of size 386475
Number of clauses of size 414306
Number of clauses of size 56316
Number of clauses of size over 5126

Solver Data 

0.20/0.28	c Command: HOME/ttsth-5-0 -num-threads 16 HOME/instance-1779900-1244957077.cnf 
0.20/0.28	c Using SATTIMEOUT of 10000
0.20/0.28	c Using SATRAM of 2047
0.20/0.28	c Size of subset node = 16
0.20/0.28	c Variables = 30006
0.20/0.28	c Clauses = 148836
0.20/0.28	c Literals = 428633
0.20/0.28	c Reduced size:
0.20/0.28	c Variables = 30006
0.20/0.28	c Clauses = 133707
0.20/0.28	c Literals = 390638
0.20/0.28	c a2
0.50/0.51	c a1
8.20/8.25	c Independent sub-problems = 1
8.20/8.25	c Sub-problem with 25142 variables and 133707 clauses
8.20/8.25	c using permutation method 4
8.20/8.25	c count = 1
8.20/8.25	c Ordering finished 8.200 seconds
8.20/8.25	c mapped 8.240 seconds
8.20/8.25	c permuted 8.240 seconds
8.20/8.25	c about to sort
8.20/8.28	c sorted
10.10/10.12	c clauses now 133707
10.10/10.12	c init finished 8.760 seconds
10.10/10.12	c tree built 10.100 seconds
10.10/10.12	c 
10.10/10.12	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
10.10/10.12	c ---------------------------------|----------------------------------|------------------------------------------------------
10.10/10.12	c ................................ | ..........                       |                       10.1           0.0            3
10.10/10.12	c ................................ | ..........                     1 |                       10.1           0.1            3
10.10/10.12	c ****************................ | ..........                     2 | 1                     10.1           0.2            3
10.10/10.12	c ****************................ | ..........                     3 | 1                     10.1           0.3            3
10.10/10.12	c ****************................ | ..........                     4 | 1                     10.1           0.4            3
10.10/10.12	c ****************................ | ..........                     5 | 1                     10.1           0.5            3
10.10/10.12	c ****************................ | ..........                     6 | 1                     10.1           0.6            3
12.70/10.33	c ****************................ | ..........                  1000 | 3                     11.8          84.8         1312
259.45/26.20	c ****************................ | ..........                623000 | 14383                200.2        3112.2      5505895
475.40/39.87	c ****************................ | ..........                936000 | 22950                400.4        2337.6     12348617
682.96/52.92	c ****************................ | ..........               1175000 | 29979                600.7        1956.1     18774152
886.14/65.76	c ****************................ | ..........               1360000 | 34208                800.2        1699.5     24399136
1089.52/78.59	c ****************................ | *.........               1536000 | 38147               1000.2        1535.6     29613585
1294.67/91.42	c ****************................ | *.........               1713000 | 43209               1201.1        1426.2     35038128
1496.70/104.13	c ****************................ | *.........               1872000 | 47468               1400.5        1336.7     40223150
1698.87/116.88	c ****************................ | *.........               2038000 | 51455               1600.9        1273.0     44844246
1900.96/129.58	c ****************................ | *.........               2200000 | 54989               1800.5        1221.9     49767190
2104.66/142.33	c ****************................ | **........               2367000 | 58498               2000.5        1183.2     54761629

Verifier Data 

sh: BIN/SAT-verifier: No such file or directory

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1779900-1244957077/watcher-1779900-1244957077 -o /tmp/evaluation-result-1779900-1244957077/solver-1779900-1244957077 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 16 HOME/instance-1779900-1244957077.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 14.31 14.64 14.51 2/184 26036
/proc/meminfo: memFree=19042128/36427776 swapFree=4232/7520
[pid=26036] ppid=26034 vsize=1548 CPUtime=0
/proc/26036/stat : 26036 (ttsth-5-0) R 26034 26036 15497 0 -1 4202496 277 0 0 0 0 0 0 0 20 0 1 0 655014112 1585152 233 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134732614 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 387 234 75 177 0 209 0

[startup+0.025903 s]
/proc/loadavg: 14.31 14.64 14.51 2/184 26036
/proc/meminfo: memFree=19042128/36427776 swapFree=4232/7520
[pid=26036] ppid=26034 vsize=2492 CPUtime=0.02
/proc/26036/stat : 26036 (ttsth-5-0) R 26034 26036 15497 0 -1 4202496 518 0 0 0 2 0 0 0 20 0 1 0 655014112 2551808 474 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134732614 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 623 475 75 177 0 445 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 2492

[startup+0.101902 s]
/proc/loadavg: 14.31 14.64 14.51 2/184 26036
/proc/meminfo: memFree=19042128/36427776 swapFree=4232/7520
[pid=26036] ppid=26034 vsize=7128 CPUtime=0.1
/proc/26036/stat : 26036 (ttsth-5-0) R 26034 26036 15497 0 -1 4202496 1645 0 0 0 8 2 0 0 20 0 1 0 655014112 7299072 1601 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134732614 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 1782 1602 75 177 0 1604 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 7128

[startup+0.30197 s]
/proc/loadavg: 14.31 14.64 14.51 2/184 26036
/proc/meminfo: memFree=19042128/36427776 swapFree=4232/7520
[pid=26036] ppid=26034 vsize=16636 CPUtime=0.3
/proc/26036/stat : 26036 (ttsth-5-0) R 26034 26036 15497 0 -1 4202496 3900 0 0 0 26 4 0 0 20 0 1 0 655014112 17035264 3856 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134554919 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 4159 3856 76 177 0 3981 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 16636

[startup+0.701951 s]
/proc/loadavg: 14.31 14.64 14.51 2/184 26036
/proc/meminfo: memFree=19042128/36427776 swapFree=4232/7520
[pid=26036] ppid=26034 vsize=21164 CPUtime=0.7
/proc/26036/stat : 26036 (ttsth-5-0) R 26034 26036 15497 0 -1 4202496 5529 0 0 0 66 4 0 0 20 0 1 0 655014112 21671936 5083 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134732614 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 5291 5084 77 177 0 5113 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 21164

[startup+1.50202 s]
/proc/loadavg: 14.31 14.64 14.51 2/185 26037
/proc/meminfo: memFree=19017780/36427776 swapFree=4984/31972
[pid=26036] ppid=26034 vsize=25524 CPUtime=1.5
/proc/26036/stat : 26036 (ttsth-5-0) R 26034 26036 15497 0 -1 4202496 6619 0 0 0 144 6 0 0 20 0 1 0 655014112 26136576 6173 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134600975 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 6381 6173 77 177 0 6203 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 25524

[startup+3.10215 s]
/proc/loadavg: 14.31 14.64 14.51 2/185 26037
/proc/meminfo: memFree=19015836/36427776 swapFree=4628/33640
[pid=26036] ppid=26034 vsize=25820 CPUtime=3.12
/proc/26036/stat : 26036 (ttsth-5-0) R 26034 26036 15497 0 -1 4202496 6673 0 0 0 306 6 0 0 20 0 1 0 655014112 26439680 6227 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134600718 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 6455 6227 77 177 0 6277 0
Current children cumulated CPU time (s) 3.12
Current children cumulated vsize (KiB) 25820

[startup+6.30244 s]
/proc/loadavg: 13.24 14.42 14.44 2/185 26037
/proc/meminfo: memFree=19015472/36427776 swapFree=4620/33984
[pid=26036] ppid=26034 vsize=25820 CPUtime=6.3
/proc/26036/stat : 26036 (ttsth-5-0) R 26034 26036 15497 0 -1 4202496 6698 0 0 0 624 6 0 0 20 0 1 0 655014112 26439680 6252 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134600738 0 0 1 0 0 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 6455 6252 77 177 0 6277 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 25820

[startup+12.7031 s]
/proc/loadavg: 12.26 14.19 14.36 17/201 26053
/proc/meminfo: memFree=18707764/36427776 swapFree=4692/344188
[pid=26036] ppid=26034 vsize=466468 CPUtime=50.08
/proc/26036/stat : 26036 (ttsth-5-0) S 26034 26036 15497 0 -1 4202496 86466 0 0 0 2590 2418 0 0 20 0 17 0 655014112 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 116617 85692 95 177 0 116439 0
[pid=26036/tid=26038] ppid=26034 vsize=466468 CPUtime=2.6
/proc/26036/task/26038/stat : 26038 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 853 0 0 0 236 24 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134550980 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26036/tid=26039] ppid=26034 vsize=466468 CPUtime=2.48
/proc/26036/task/26039/stat : 26039 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 546 0 0 0 92 156 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26036/tid=26040] ppid=26034 vsize=466468 CPUtime=2.48
/proc/26036/task/26040/stat : 26040 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 501 0 0 0 86 162 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26036/tid=26041] ppid=26034 vsize=466468 CPUtime=2.5
/proc/26036/task/26041/stat : 26041 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 477 0 0 0 98 152 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26036/tid=26042] ppid=26034 vsize=466468 CPUtime=2.48
/proc/26036/task/26042/stat : 26042 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 474 0 0 0 98 150 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26036/tid=26043] ppid=26034 vsize=466468 CPUtime=2.5
/proc/26036/task/26043/stat : 26043 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 473 0 0 0 102 148 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134550399 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26036/tid=26044] ppid=26034 vsize=466468 CPUtime=2.5
/proc/26036/task/26044/stat : 26044 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 460 0 0 0 96 154 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26036/tid=26045] ppid=26034 vsize=466468 CPUtime=2.48
/proc/26036/task/26045/stat : 26045 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 397 0 0 0 86 162 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26036/tid=26046] ppid=26034 vsize=466468 CPUtime=2.5
/proc/26036/task/26046/stat : 26046 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 503 0 0 0 96 154 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26036/tid=26047] ppid=26034 vsize=466468 CPUtime=2.5
/proc/26036/task/26047/stat : 26047 (ttsth-5-0) S 26034 26036 15497 0 -1 4202560 368 0 0 0 88 162 0 0 20 0 17 0 655015124 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636382 0 0 1 0 18446744071564503368 0 0 -1 15 0 0 0 0 0
[pid=26036/tid=26048] ppid=26034 vsize=466468 CPUtime=2.44
/proc/26036/task/26048/stat : 26048 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 460 0 0 0 86 158 0 0 20 0 17 0 655015125 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26036/tid=26049] ppid=26034 vsize=466468 CPUtime=2.48
/proc/26036/task/26049/stat : 26049 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 422 0 0 0 94 154 0 0 20 0 17 0 655015125 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26036/tid=26050] ppid=26034 vsize=466468 CPUtime=2.48
/proc/26036/task/26050/stat : 26050 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 433 0 0 0 88 160 0 0 20 0 17 0 655015125 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26036/tid=26051] ppid=26034 vsize=466468 CPUtime=2.48
/proc/26036/task/26051/stat : 26051 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 412 0 0 0 76 172 0 0 20 0 17 0 655015125 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26036/tid=26052] ppid=26034 vsize=466468 CPUtime=2.48
/proc/26036/task/26052/stat : 26052 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 376 0 0 0 74 174 0 0 20 0 17 0 655015125 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26036/tid=26053] ppid=26034 vsize=466468 CPUtime=2.48
/proc/26036/task/26053/stat : 26053 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 585 0 0 0 100 148 0 0 20 0 17 0 655015125 477663232 85692 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.08
Current children cumulated vsize (KiB) 466468

[startup+25.5024 s]
/proc/loadavg: 13.09 14.28 14.39 17/201 26058
/proc/meminfo: memFree=18618564/36427776 swapFree=4692/432208
[pid=26036] ppid=26034 vsize=553796 CPUtime=250.03
/proc/26036/stat : 26036 (ttsth-5-0) S 26034 26036 15497 0 -1 4202496 107191 0 0 0 14808 10195 0 0 20 0 17 0 655014112 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 138449 106417 95 177 0 138271 0
[pid=26036/tid=26038] ppid=26034 vsize=553796 CPUtime=15.34
/proc/26036/task/26038/stat : 26038 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 3026 0 0 0 1510 24 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134561567 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26036/tid=26039] ppid=26034 vsize=553796 CPUtime=14.98
/proc/26036/task/26039/stat : 26039 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1761 0 0 0 844 654 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26036/tid=26040] ppid=26034 vsize=553796 CPUtime=14.96
/proc/26036/task/26040/stat : 26040 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1611 0 0 0 816 680 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26036/tid=26041] ppid=26034 vsize=553796 CPUtime=14.98
/proc/26036/task/26041/stat : 26041 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1768 0 0 0 816 682 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26036/tid=26042] ppid=26034 vsize=553796 CPUtime=15
/proc/26036/task/26042/stat : 26042 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1640 0 0 0 870 630 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134519944 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26036/tid=26043] ppid=26034 vsize=553796 CPUtime=15.02
/proc/26036/task/26043/stat : 26043 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1805 0 0 0 828 674 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26036/tid=26044] ppid=26034 vsize=553796 CPUtime=15.04
/proc/26036/task/26044/stat : 26044 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1660 0 0 0 870 634 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26036/tid=26045] ppid=26034 vsize=553796 CPUtime=15
/proc/26036/task/26045/stat : 26045 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1501 0 0 0 778 722 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26036/tid=26046] ppid=26034 vsize=553796 CPUtime=15.02
/proc/26036/task/26046/stat : 26046 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1646 0 0 0 806 696 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26036/tid=26047] ppid=26034 vsize=553796 CPUtime=15.04
/proc/26036/task/26047/stat : 26047 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1720 0 0 0 814 690 0 0 20 0 17 0 655015124 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26036/tid=26048] ppid=26034 vsize=553796 CPUtime=14.64
/proc/26036/task/26048/stat : 26048 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1907 0 0 0 774 690 0 0 20 0 17 0 655015125 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26036/tid=26049] ppid=26034 vsize=553796 CPUtime=14.96
/proc/26036/task/26049/stat : 26049 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1656 0 0 0 814 682 0 0 20 0 17 0 655015125 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26036/tid=26050] ppid=26034 vsize=553796 CPUtime=15
/proc/26036/task/26050/stat : 26050 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1838 0 0 0 864 636 0 0 20 0 17 0 655015125 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26036/tid=26051] ppid=26034 vsize=553796 CPUtime=14.94
/proc/26036/task/26051/stat : 26051 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1577 0 0 0 804 690 0 0 20 0 17 0 655015125 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26036/tid=26052] ppid=26034 vsize=553796 CPUtime=14.96
/proc/26036/task/26052/stat : 26052 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1493 0 0 0 802 694 0 0 20 0 17 0 655015125 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26036/tid=26053] ppid=26034 vsize=553796 CPUtime=14.94
/proc/26036/task/26053/stat : 26053 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 1856 0 0 0 806 688 0 0 20 0 17 0 655015125 567087104 106417 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 250.03
Current children cumulated vsize (KiB) 553796

[startup+51.1064 s]
/proc/loadavg: 14.08 14.42 14.43 17/201 26058
/proc/meminfo: memFree=18409696/36427776 swapFree=4692/640820
[pid=26036] ppid=26034 vsize=778604 CPUtime=654.48
/proc/26036/stat : 26036 (ttsth-5-0) S 26034 26036 15497 0 -1 4202496 160253 0 0 0 52006 13442 0 0 20 0 17 0 655014112 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 194651 159479 95 177 0 194473 0
[pid=26036/tid=26038] ppid=26034 vsize=778604 CPUtime=40.92
/proc/26036/task/26038/stat : 26038 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 6530 0 0 0 4064 28 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26036/tid=26039] ppid=26034 vsize=778604 CPUtime=40.24
/proc/26036/task/26039/stat : 26039 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 4032 0 0 0 3130 894 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26036/tid=26040] ppid=26034 vsize=778604 CPUtime=40.2
/proc/26036/task/26040/stat : 26040 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 4966 0 0 0 3104 916 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134680308 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26036/tid=26041] ppid=26034 vsize=778604 CPUtime=40.2
/proc/26036/task/26041/stat : 26041 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 5622 0 0 0 3104 916 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134680474 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26036/tid=26042] ppid=26034 vsize=778604 CPUtime=40.32
/proc/26036/task/26042/stat : 26042 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 4460 0 0 0 3208 824 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134591217 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26036/tid=26043] ppid=26034 vsize=778604 CPUtime=40.34
/proc/26036/task/26043/stat : 26043 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 5306 0 0 0 3150 884 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26036/tid=26044] ppid=26034 vsize=778604 CPUtime=40.36
/proc/26036/task/26044/stat : 26044 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 4745 0 0 0 3172 864 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134590777 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26036/tid=26045] ppid=26034 vsize=778604 CPUtime=40.32
/proc/26036/task/26045/stat : 26045 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 4944 0 0 0 3112 920 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134590072 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26036/tid=26046] ppid=26034 vsize=778604 CPUtime=40.4
/proc/26036/task/26046/stat : 26046 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 4650 0 0 0 3180 860 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26036/tid=26047] ppid=26034 vsize=778604 CPUtime=40.36
/proc/26036/task/26047/stat : 26047 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 5584 0 0 0 3106 930 0 0 20 0 17 0 655015124 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134590501 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26036/tid=26048] ppid=26034 vsize=778604 CPUtime=39.4
/proc/26036/task/26048/stat : 26048 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 5631 0 0 0 3044 896 0 0 20 0 17 0 655015125 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26036/tid=26049] ppid=26034 vsize=778604 CPUtime=40.18
/proc/26036/task/26049/stat : 26049 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 4881 0 0 0 3110 908 0 0 20 0 17 0 655015125 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26036/tid=26050] ppid=26034 vsize=778604 CPUtime=40.35
/proc/26036/task/26050/stat : 26050 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 4691 0 0 0 3213 822 0 0 20 0 17 0 655015125 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134591206 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26036/tid=26051] ppid=26034 vsize=778604 CPUtime=40.2
/proc/26036/task/26051/stat : 26051 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 4433 0 0 0 3118 902 0 0 20 0 17 0 655015125 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26036/tid=26052] ppid=26034 vsize=778604 CPUtime=40.26
/proc/26036/task/26052/stat : 26052 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 5844 0 0 0 3126 900 0 0 20 0 17 0 655015125 797290496 159479 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0

################
# More data... #
################

/proc/26036/task/26041/stat : 26041 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 9318 0 0 0 7985 1124 0 0 20 0 17 0 655015124 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134549885 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26036/tid=26042] ppid=26034 vsize=1147508 CPUtime=91.23
/proc/26036/task/26042/stat : 26042 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 7969 0 0 0 8115 1008 0 0 20 0 17 0 655015124 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26036/tid=26043] ppid=26034 vsize=1147508 CPUtime=91.24
/proc/26036/task/26043/stat : 26043 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 10986 0 0 0 8064 1060 0 0 20 0 17 0 655015124 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26036/tid=26044] ppid=26034 vsize=1147508 CPUtime=91.32
/proc/26036/task/26044/stat : 26044 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 10861 0 0 0 8140 992 0 0 20 0 17 0 655015124 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134590275 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26036/tid=26045] ppid=26034 vsize=1147508 CPUtime=91.28
/proc/26036/task/26045/stat : 26045 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 12932 0 0 0 8050 1078 0 0 20 0 17 0 655015124 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26036/tid=26046] ppid=26034 vsize=1147508 CPUtime=91.33
/proc/26036/task/26046/stat : 26046 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 8518 0 0 0 8119 1014 0 0 20 0 17 0 655015124 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134591433 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26036/tid=26047] ppid=26034 vsize=1147508 CPUtime=91.34
/proc/26036/task/26047/stat : 26047 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 12042 0 0 0 8050 1084 0 0 20 0 17 0 655015124 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134680720 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26036/tid=26048] ppid=26034 vsize=1147508 CPUtime=89.3
/proc/26036/task/26048/stat : 26048 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 11399 0 0 0 7894 1036 0 0 20 0 17 0 655015125 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134591177 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26036/tid=26049] ppid=26034 vsize=1147508 CPUtime=91.09
/proc/26036/task/26049/stat : 26049 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 9985 0 0 0 8031 1078 0 0 20 0 17 0 655015125 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26036/tid=26050] ppid=26034 vsize=1147508 CPUtime=91.23
/proc/26036/task/26050/stat : 26050 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 9234 0 0 0 8117 1006 0 0 20 0 17 0 655015125 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134592308 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26036/tid=26051] ppid=26034 vsize=1147508 CPUtime=91.12
/proc/26036/task/26051/stat : 26051 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 8075 0 0 0 8066 1046 0 0 20 0 17 0 655015125 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562344 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26036/tid=26052] ppid=26034 vsize=1147508 CPUtime=91.23
/proc/26036/task/26052/stat : 26052 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 13076 0 0 0 8065 1058 0 0 20 0 17 0 655015125 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26036/tid=26053] ppid=26034 vsize=1147508 CPUtime=91
/proc/26036/task/26053/stat : 26053 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 13344 0 0 0 7962 1138 0 0 20 0 17 0 655015125 1175048192 246332 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1468.32
Current children cumulated vsize (KiB) 1147508

[startup+162.304 s]
/proc/loadavg: 15.66 14.89 14.60 17/201 26058
/proc/meminfo: memFree=17690816/36427776 swapFree=4692/1358600
[pid=26036] ppid=26034 vsize=1543524 CPUtime=2423.01
/proc/26036/stat : 26036 (ttsth-5-0) S 26034 26036 15497 0 -1 4202496 339549 0 0 0 223705 18596 0 0 20 0 17 0 655014112 1580568576 338775 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 385881 338775 95 177 0 385703 0
[pid=26036/tid=26038] ppid=26034 vsize=1543524 CPUtime=152.1
/proc/26036/task/26038/stat : 26038 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 16978 0 0 0 15152 58 0 0 20 0 17 0 655015124 1580568576 338775 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26036/tid=26039] ppid=26034 vsize=1543524 CPUtime=150.83
/proc/26036/task/26039/stat : 26039 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 12315 0 0 0 13841 1242 0 0 20 0 17 0 655015124 1580568576 338775 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134681659 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26036/tid=26040] ppid=26034 vsize=1543524 CPUtime=150.71
/proc/26036/task/26040/stat : 26040 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 15799 0 0 0 13729 1342 0 0 20 0 17 0 655015124 1580568576 338775 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134590777 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26036/tid=26041] ppid=26034 vsize=1543524 CPUtime=150.72
/proc/26036/task/26041/stat : 26041 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 14424 0 0 0 13744 1328 0 0 20 0 17 0 655015124 1580568576 338775 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26036/tid=26042] ppid=26034 vsize=1543524 CPUtime=150.94
/proc/26036/task/26042/stat : 26042 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 13504 0 0 0 13888 1206 0 0 20 0 17 0 655015124 1580568576 338776 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26036/tid=26043] ppid=26034 vsize=1543524 CPUtime=150.98
/proc/26036/task/26043/stat : 26043 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 15199 0 0 0 13860 1238 0 0 20 0 17 0 655015124 1580568576 338776 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134591433 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26036/tid=26044] ppid=26034 vsize=1543524 CPUtime=151.09
/proc/26036/task/26044/stat : 26044 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 17700 0 0 0 13959 1150 0 0 20 0 17 0 655015124 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26036/tid=26045] ppid=26034 vsize=1543524 CPUtime=151.03
/proc/26036/task/26045/stat : 26045 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 21691 0 0 0 13849 1254 0 0 20 0 17 0 655015124 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26036/tid=26046] ppid=26034 vsize=1543524 CPUtime=151.1
/proc/26036/task/26046/stat : 26046 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 13399 0 0 0 13932 1178 0 0 20 0 17 0 655015124 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562344 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26036/tid=26047] ppid=26034 vsize=1543524 CPUtime=151.12
/proc/26036/task/26047/stat : 26047 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 17528 0 0 0 13874 1238 0 0 20 0 17 0 655015124 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26036/tid=26048] ppid=26034 vsize=1543524 CPUtime=147.86
/proc/26036/task/26048/stat : 26048 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 17286 0 0 0 13592 1194 0 0 20 0 17 0 655015125 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26036/tid=26049] ppid=26034 vsize=1543524 CPUtime=150.78
/proc/26036/task/26049/stat : 26049 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 13990 0 0 0 13830 1248 0 0 20 0 17 0 655015125 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26036/tid=26050] ppid=26034 vsize=1543524 CPUtime=150.95
/proc/26036/task/26050/stat : 26050 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 14756 0 0 0 13913 1182 0 0 20 0 17 0 655015125 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26036/tid=26051] ppid=26034 vsize=1543524 CPUtime=150.82
/proc/26036/task/26051/stat : 26051 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 14486 0 0 0 13880 1202 0 0 20 0 17 0 655015125 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134590491 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26036/tid=26052] ppid=26034 vsize=1543524 CPUtime=151.01
/proc/26036/task/26052/stat : 26052 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 20307 0 0 0 13917 1184 0 0 20 0 17 0 655015125 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134680273 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26036/tid=26053] ppid=26034 vsize=1543524 CPUtime=150.69
/proc/26036/task/26053/stat : 26053 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 21462 0 0 0 13745 1324 0 0 20 0 17 0 655015125 1580568576 338777 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562416 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2423.01
Current children cumulated vsize (KiB) 1543524

[startup+222.305 s]
/proc/loadavg: 15.87 15.09 14.68 17/201 26058
/proc/meminfo: memFree=17257128/36427776 swapFree=4692/1792984
[pid=26036] ppid=26034 vsize=2003532 CPUtime=3377.64
/proc/26036/stat : 26036 (ttsth-5-0) S 26034 26036 15497 0 -1 4202496 447410 0 0 0 316378 21386 0 0 20 0 17 0 655014112 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 500883 446636 95 177 0 500705 0
[pid=26036/tid=26038] ppid=26034 vsize=2003532 CPUtime=212.11
/proc/26036/task/26038/stat : 26038 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 27663 0 0 0 21129 82 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26036/tid=26039] ppid=26034 vsize=2003532 CPUtime=210.61
/proc/26036/task/26039/stat : 26039 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 17829 0 0 0 19641 1420 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26036/tid=26040] ppid=26034 vsize=2003532 CPUtime=210.33
/proc/26036/task/26040/stat : 26040 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 23092 0 0 0 19465 1568 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134680720 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26036/tid=26041] ppid=26034 vsize=2003532 CPUtime=210.41
/proc/26036/task/26041/stat : 26041 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 20878 0 0 0 19535 1506 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26036/tid=26042] ppid=26034 vsize=2003532 CPUtime=210.69
/proc/26036/task/26042/stat : 26042 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 19472 0 0 0 19681 1388 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26036/tid=26043] ppid=26034 vsize=2003532 CPUtime=210.72
/proc/26036/task/26043/stat : 26043 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 17867 0 0 0 19638 1434 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26036/tid=26044] ppid=26034 vsize=2003532 CPUtime=210.82
/proc/26036/task/26044/stat : 26044 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 23786 0 0 0 19758 1324 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26036/tid=26045] ppid=26034 vsize=2003532 CPUtime=210.81
/proc/26036/task/26045/stat : 26045 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 30263 0 0 0 19647 1434 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134590358 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26036/tid=26046] ppid=26034 vsize=2003532 CPUtime=210.91
/proc/26036/task/26046/stat : 26046 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 19146 0 0 0 19767 1324 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26036/tid=26047] ppid=26034 vsize=2003532 CPUtime=210.85
/proc/26036/task/26047/stat : 26047 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 24464 0 0 0 19647 1438 0 0 20 0 17 0 655015124 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26036/tid=26048] ppid=26034 vsize=2003532 CPUtime=206.3
/proc/26036/task/26048/stat : 26048 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 26558 0 0 0 19234 1396 0 0 20 0 17 0 655015125 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134590285 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26036/tid=26049] ppid=26034 vsize=2003532 CPUtime=210.35
/proc/26036/task/26049/stat : 26049 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 21843 0 0 0 19543 1492 0 0 20 0 17 0 655015125 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26036/tid=26050] ppid=26034 vsize=2003532 CPUtime=210.7
/proc/26036/task/26050/stat : 26050 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 21511 0 0 0 19714 1356 0 0 20 0 17 0 655015125 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26036/tid=26051] ppid=26034 vsize=2003532 CPUtime=210.53
/proc/26036/task/26051/stat : 26051 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 19558 0 0 0 19653 1400 0 0 20 0 17 0 655015125 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26036/tid=26052] ppid=26034 vsize=2003532 CPUtime=210.82
/proc/26036/task/26052/stat : 26052 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 27054 0 0 0 19758 1324 0 0 20 0 17 0 655015125 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26036/tid=26053] ppid=26034 vsize=2003532 CPUtime=210.48
/proc/26036/task/26053/stat : 26053 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 27700 0 0 0 19578 1470 0 0 20 0 17 0 655015125 2051616768 446636 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3377.64
Current children cumulated vsize (KiB) 2003532



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+235.002 s]
/proc/loadavg: 15.90 15.13 14.70 18/201 26058
/proc/meminfo: memFree=17167548/36427776 swapFree=4692/1880836
[pid=26036] ppid=26034 vsize=2096872 CPUtime=3579.94
/proc/26036/stat : 26036 (ttsth-5-0) S 26034 26036 15497 0 -1 4202496 469296 0 0 0 336088 21906 0 0 20 0 17 0 655014112 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 524218 468522 95 177 0 524040 0
[pid=26036/tid=26038] ppid=26034 vsize=2096872 CPUtime=224.8
/proc/26036/task/26038/stat : 26038 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 29251 0 0 0 22392 88 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=26036/tid=26039] ppid=26034 vsize=2096872 CPUtime=223.29
/proc/26036/task/26039/stat : 26039 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 18751 0 0 0 20879 1450 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=26036/tid=26040] ppid=26034 vsize=2096872 CPUtime=222.96
/proc/26036/task/26040/stat : 26040 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 24905 0 0 0 20692 1604 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134680208 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=26036/tid=26041] ppid=26034 vsize=2096872 CPUtime=223.08
/proc/26036/task/26041/stat : 26041 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 21959 0 0 0 20774 1534 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=26036/tid=26042] ppid=26034 vsize=2096872 CPUtime=223.36
/proc/26036/task/26042/stat : 26042 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 20401 0 0 0 20920 1416 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=26036/tid=26043] ppid=26034 vsize=2096872 CPUtime=223.36
/proc/26036/task/26043/stat : 26043 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 18828 0 0 0 20860 1476 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134549882 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=26036/tid=26044] ppid=26034 vsize=2096872 CPUtime=223.49
/proc/26036/task/26044/stat : 26044 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 24617 0 0 0 20997 1352 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=26036/tid=26045] ppid=26034 vsize=2096872 CPUtime=223.47
/proc/26036/task/26045/stat : 26045 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 32047 0 0 0 20879 1468 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=26036/tid=26046] ppid=26034 vsize=2096872 CPUtime=223.58
/proc/26036/task/26046/stat : 26046 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 19890 0 0 0 21000 1358 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562444 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=26036/tid=26047] ppid=26034 vsize=2096872 CPUtime=223.51
/proc/26036/task/26047/stat : 26047 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 25878 0 0 0 20875 1476 0 0 20 0 17 0 655015124 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=26036/tid=26048] ppid=26034 vsize=2096872 CPUtime=218.69
/proc/26036/task/26048/stat : 26048 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 29628 0 0 0 20429 1440 0 0 20 0 17 0 655015125 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134749337 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=26036/tid=26049] ppid=26034 vsize=2096872 CPUtime=222.97
/proc/26036/task/26049/stat : 26049 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 23586 0 0 0 20757 1540 0 0 20 0 17 0 655015125 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=26036/tid=26050] ppid=26034 vsize=2096872 CPUtime=223.35
/proc/26036/task/26050/stat : 26050 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 22547 0 0 0 20947 1388 0 0 20 0 17 0 655015125 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=26036/tid=26051] ppid=26034 vsize=2096872 CPUtime=223.2
/proc/26036/task/26051/stat : 26051 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 20785 0 0 0 20886 1434 0 0 20 0 17 0 655015125 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134562430 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=26036/tid=26052] ppid=26034 vsize=2096872 CPUtime=223.49
/proc/26036/task/26052/stat : 26052 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 28513 0 0 0 20997 1352 0 0 20 0 17 0 655015125 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=26036/tid=26053] ppid=26034 vsize=2096872 CPUtime=223.16
/proc/26036/task/26053/stat : 26053 (ttsth-5-0) R 26034 26036 15497 0 -1 4202560 28984 0 0 0 20816 1500 0 0 20 0 17 0 655015125 2147196928 468522 18446744073709551615 134512640 135237372 4291509136 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3579.94
Current children cumulated vsize (KiB) 2096872

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+235.126 s]
/proc/loadavg: 15.90 15.13 14.70 18/201 26058
/proc/meminfo: memFree=17167548/36427776 swapFree=4692/1880836
[pid=26036] ppid=26034 vsize=0 CPUtime=3580.22
/proc/26036/stat : 26036 (ttsth-5-0) Z 26034 26036 15497 0 -1 4203532 469305 0 0 0 336102 21920 0 0 20 0 2 0 655014112 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/26036/statm: 0 0 0 0 0 0 0
[pid=26036/tid=26053] ppid=26034 vsize=0 CPUtime=223.26
/proc/26036/task/26053/stat : 26053 (ttsth-5-0) R 26034 26036 15497 0 -1 4203588 28984 0 0 0 20816 1510 0 0 20 0 2 0 655015125 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3580.22
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 235.197
CPU time (s): 3580.31
CPU user time (s): 3361.03
CPU system time (s): 219.278
CPU usage (%): 1522.26
Max. virtual memory (cumulated for all children) (KiB): 2096872

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3361.03
system time used= 219.278
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 469305
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 271594
involuntary context switches= 7404

runsolver used 1.12807 second user time and 3.35621 second system time

The end

Launcher Data 

Begin job on xenhost3-49 at 2009-06-14 07:24:37
IDJOB=1779900
IDBENCH=70939
IDSOLVER=634
FILE ID=xenhost3-49/1779900-1244957077
PBS_JOBID=
Free space on /tmp= 7021 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (16 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l42_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1779900-1244957077/watcher-1779900-1244957077 -o /tmp/evaluation-result-1779900-1244957077/solver-1779900-1244957077 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 16 HOME/instance-1779900-1244957077.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 16

MD5SUM BENCH= f7e4b8eacc29c0297225e4db3860ba3b
RANDOM SEED= 1621694018

Linux xenhost3-49 2.6.27.5 #1 SMP Mon Mar 30 10:34:22 CEST 2009 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 8
initial apicid	: 8
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 24
initial apicid	: 24
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 10
initial apicid	: 10
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 26
initial apicid	: 26
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 9
initial apicid	: 9
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 25
initial apicid	: 25
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 11
initial apicid	: 11
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 27
initial apicid	: 27
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:     36427776 kB
MemFree:      19042128 kB
Buffers:        484460 kB
Cached:       14119424 kB
SwapCached:          0 kB
Active:        4130964 kB
Inactive:     10481788 kB
SwapTotal:    25398692 kB
SwapFree:     25398692 kB
Dirty:            3348 kB
Writeback:           0 kB
AnonPages:        7520 kB
Mapped:           4232 kB
Slab:           721744 kB
SReclaimable:   694920 kB
SUnreclaim:      26824 kB
PageTables:          0 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
WritebackTmp:        0 kB
CommitLimit:  43612580 kB
Committed_AS:    29736 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    275248 kB
VmallocChunk: 34359462839 kB
DirectMap4k:  99216660 kB
DirectMap2M:         0 kB

Free space on /tmp at the end= 7021 MiB
End job on xenhost3-49 at 2009-06-14 07:28:35