Trace number 1781278

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (TO) 2152.9 1000.12

General information on the benchmark

Namegoldb-heqc-i10mul.cnf
MD5SUM80e15f28c8e2d72627ec75fe75757317
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark299.46
Satisfiable
(Un)Satisfiability was proved
Number of variables12998
Number of clauses77941
Sum of the clauses size262272
Maximum clause length448
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 217756
Number of clauses of size 337304
Number of clauses of size 40
Number of clauses of size 522880
Number of clauses of size over 51

Solver Data 

0.12/0.14	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781278-1243686666.cnf 
0.12/0.14	c Using SATTIMEOUT of 10000
0.12/0.14	c Using SATRAM of 2047
0.12/0.14	c Size of subset node = 16
0.12/0.14	c Variables = 12998
0.12/0.14	c Clauses = 77941
0.12/0.14	c Literals = 262272
0.12/0.14	c Reduced size:
0.12/0.14	c Variables = 12998
0.12/0.14	c Clauses = 77941
0.12/0.14	c Literals = 262272
0.12/0.14	c a2
0.42/0.42	c a1
2.21/2.23	c Independent sub-problems = 1
2.21/2.23	c Sub-problem with 12998 variables and 77941 clauses
2.21/2.23	c using permutation method 4
2.21/2.23	c count = 1
2.21/2.23	c Ordering finished 2.180 seconds
2.21/2.23	c mapped 2.230 seconds
2.21/2.23	c permuted 2.230 seconds
2.21/2.23	c about to sort
2.21/2.27	c sorted
2.71/2.74	c clauses now 77941
2.71/2.74	c init finished 2.350 seconds
2.71/2.74	c tree built 2.730 seconds
2.71/2.74	c 
2.71/2.74	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
2.71/2.74	c ---------------------------------|----------------------------------|------------------------------------------------------
2.71/2.74	c ................................ | ..........                       |                        2.7           0.0             
2.71/2.74	c ................................ | ..........                     1 |                        2.7           0.4             
2.71/2.74	c ................................ | ..........                     2 |                        2.7           0.7             
2.71/2.74	c ................................ | ..........                     3 |                        2.7           1.1             
2.71/2.74	c ................................ | ..........                     4 |                        2.7           1.5             
2.71/2.74	c ................................ | ..........                     5 |                        2.7           1.8             
2.71/2.75	c ................................ | ..........                  1000 | 67                     2.8         363.6         3608
200.04/96.26	c ................................ | ..........               4484000 | 218463               200.1       22404.3      9206611
399.90/190.55	c ................................ | ..........               8278000 | 401526               400.0       20694.0     15721434
600.02/284.63	c ................................ | ..........              11683000 | 588380               600.1       19469.7     21531268
800.01/371.07	c ................................ | ..........              14019000 | 707657               800.1       17521.3     29775061
1000.18/460.06	c ................................ | *.........              16014000 | 811350              1000.3       16009.4     39322543
1200.12/559.79	c ................................ | *.........              18119000 | 920578              1200.3       15095.5     47342598
1400.02/653.72	c ................................ | *.........              20239000 | 1033643             1400.1       14455.8     55260959
1599.94/743.44	c ................................ | *.........              22760000 | 1170778             1600.0       14224.9     63395158
1799.84/838.89	c ................................ | *.........              24699000 | 1269696             1800.0       13721.5     70337696
2000.07/933.01	c ................................ | **........              26675000 | 1375748             2000.1       13336.8     76360574

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781278-1243686666/watcher-1781278-1243686666 -o /tmp/evaluation-result-1781278-1243686666/solver-1781278-1243686666 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781278-1243686666.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.15 6.47 6.18 4/117 14418
/proc/meminfo: memFree=2978556/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=2260 CPUtime=0.03
/proc/14418/stat : 14418 (ttsth-5-0) R 14416 14418 10612 0 -1 4202496 437 0 0 0 2 1 0 0 19 0 1 0 1133329417 2314240 392 4294967295 134512640 135237372 3218397328 3218395852 134639534 0 0 0 0 0 0 0 17 0 0 0 0
/proc/14418/statm: 565 392 75 177 0 387 0

[startup+0.097182 s]
/proc/loadavg: 6.15 6.47 6.18 4/117 14418
/proc/meminfo: memFree=2978556/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=4748 CPUtime=0.1
/proc/14418/stat : 14418 (ttsth-5-0) R 14416 14418 10612 0 -1 4202496 1085 0 0 0 9 1 0 0 21 0 1 0 1133329417 4861952 1040 4294967295 134512640 135237372 3218397328 3218396124 134639534 0 0 0 0 0 0 0 17 0 0 0 0
/proc/14418/statm: 1187 1040 75 177 0 1009 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 4748

[startup+0.117181 s]
/proc/loadavg: 6.15 6.47 6.18 4/117 14418
/proc/meminfo: memFree=2978556/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=5660 CPUtime=0.12
/proc/14418/stat : 14418 (ttsth-5-0) R 14416 14418 10612 0 -1 4202496 1277 0 0 0 11 1 0 0 21 0 1 0 1133329417 5795840 1232 4294967295 134512640 135237372 3218397328 3218395852 134639534 0 0 0 0 0 0 0 17 0 0 0 0
/proc/14418/statm: 1415 1232 75 177 0 1237 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 5660

[startup+0.31717 s]
/proc/loadavg: 6.15 6.47 6.18 4/117 14418
/proc/meminfo: memFree=2978556/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=15284 CPUtime=0.32
/proc/14418/stat : 14418 (ttsth-5-0) R 14416 14418 10612 0 -1 4202496 3658 0 0 0 30 2 0 0 22 0 1 0 1133329417 15650816 3612 4294967295 134512640 135237372 3218397328 3218396048 134680367 0 0 0 0 0 0 0 17 0 0 0 0
/proc/14418/statm: 3821 3612 76 177 0 3643 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 15284

[startup+0.717149 s]
/proc/loadavg: 6.15 6.47 6.18 4/117 14418
/proc/meminfo: memFree=2978556/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=15776 CPUtime=0.72
/proc/14418/stat : 14418 (ttsth-5-0) R 14416 14418 10612 0 -1 4202496 3974 0 0 0 70 2 0 0 24 0 1 0 1133329417 16154624 3774 4294967295 134512640 135237372 3218397328 3218396400 134555275 0 0 0 0 0 0 0 17 0 0 0 0
/proc/14418/statm: 3944 3774 77 177 0 3766 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 15776

[startup+1.51711 s]
/proc/loadavg: 6.15 6.47 6.18 4/118 14419
/proc/meminfo: memFree=2964792/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=16152 CPUtime=1.52
/proc/14418/stat : 14418 (ttsth-5-0) R 14416 14418 10612 0 -1 4202496 4084 0 0 0 150 2 0 0 25 0 1 0 1133329417 16539648 3884 4294967295 134512640 135237372 3218397328 3218396656 134555272 0 0 0 0 0 0 0 17 0 0 0 0
/proc/14418/statm: 4038 3884 77 177 0 3860 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 16152

[startup+3.11703 s]
/proc/loadavg: 6.15 6.47 6.18 4/118 14419
/proc/meminfo: memFree=2964460/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=105976 CPUtime=3.46
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 18594 0 0 0 337 9 0 0 25 0 5 0 1133329417 108519424 18317 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 26494 18317 95 177 0 26316 0
Current children cumulated CPU time (s) 3.46
Current children cumulated vsize (KiB) 105976

[startup+6.31687 s]
/proc/loadavg: 6.14 6.46 6.18 8/122 14431
/proc/meminfo: memFree=2899620/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=116740 CPUtime=11.29
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 21480 0 0 0 1118 11 0 0 25 0 5 0 1133329417 119541760 21203 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 29185 21203 95 177 0 29007 0
[pid=14418/tid=14424] ppid=14416 vsize=116740 CPUtime=2.46
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 913 0 0 0 246 0 0 0 25 0 5 0 1133329691 119541760 21203 4294967295 134512640 135237372 3218397328 3083818944 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=116740 CPUtime=1.66
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 522 0 0 0 166 0 0 0 25 0 5 0 1133329691 119541760 21203 4294967295 134512640 135237372 3218397328 3075263728 134587151 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=116740 CPUtime=3.02
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 1319 0 0 0 300 2 0 0 25 0 5 0 1133329692 119541760 21203 4294967295 134512640 135237372 3218397328 3066869040 134680374 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=116740 CPUtime=1.43
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 1000 0 0 0 143 0 0 0 25 0 5 0 1133329692 119541760 21203 4294967295 134512640 135237372 3218397328 3058080640 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.29
Current children cumulated vsize (KiB) 116740

[startup+12.7165 s]
/proc/loadavg: 6.13 6.45 6.18 7/122 14445
/proc/meminfo: memFree=2873408/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=139812 CPUtime=24.56
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 27206 0 0 0 2438 18 0 0 25 0 5 0 1133329417 143167488 26929 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 34953 26929 95 177 0 34775 0
[pid=14418/tid=14424] ppid=14416 vsize=139812 CPUtime=6.83
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 1721 0 0 0 679 4 0 0 25 0 5 0 1133329691 143167488 26929 4294967295 134512640 135237372 3218397328 3083572416 134590472 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=139812 CPUtime=4.68
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 1764 0 0 0 468 0 0 0 25 0 5 0 1133329691 143167488 26929 4294967295 134512640 135237372 3218397328 3074941792 134562341 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=139812 CPUtime=6.65
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 3907 0 0 0 662 3 0 0 25 0 5 0 1133329692 143167488 26929 4294967295 134512640 135237372 3218397328 3066550400 134593217 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=139812 CPUtime=3.67
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 2088 0 0 0 365 2 0 0 25 0 5 0 1133329692 143167488 26929 4294967295 134512640 135237372 3218397328 3058341900 134636382 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.56
Current children cumulated vsize (KiB) 139812

[startup+25.5159 s]
/proc/loadavg: 6.10 6.43 6.17 7/122 14466
/proc/meminfo: memFree=2843648/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=169648 CPUtime=50.16
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 34592 0 0 0 4994 22 0 0 25 0 5 0 1133329417 173719552 34315 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 42412 34315 95 177 0 42234 0
[pid=14418/tid=14424] ppid=14416 vsize=169648 CPUtime=14.31
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 3572 0 0 0 1426 5 0 0 25 0 5 0 1133329691 173719552 34315 4294967295 134512640 135237372 3218397328 3083154928 134552745 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=169648 CPUtime=10.78
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 4343 0 0 0 1076 2 0 0 25 0 5 0 1133329691 173719552 34315 4294967295 134512640 135237372 3218397328 3074719792 134680239 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=169648 CPUtime=13.35
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 5483 0 0 0 1331 4 0 0 25 0 5 0 1133329692 173719552 34315 4294967295 134512640 135237372 3218397328 3066608560 134549899 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=169648 CPUtime=8.99
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 3468 0 0 0 897 2 0 0 25 0 5 0 1133329692 173719552 34315 4294967295 134512640 135237372 3218397328 3058078208 134550989 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.16
Current children cumulated vsize (KiB) 169648

[startup+51.1145 s]
/proc/loadavg: 6.15 6.41 6.17 7/122 14504
/proc/meminfo: memFree=2806808/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=209556 CPUtime=108.55
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 44152 0 0 0 10823 32 0 0 25 0 5 0 1133329417 214585344 43875 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 52389 43875 95 177 0 52211 0
[pid=14418/tid=14424] ppid=14416 vsize=209556 CPUtime=29.31
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 5559 0 0 0 2923 8 0 0 25 0 5 0 1133329691 214585344 43875 4294967295 134512640 135237372 3218397328 3083545744 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=209556 CPUtime=23.01
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 7007 0 0 0 2297 4 0 0 25 0 5 0 1133329691 214585344 43875 4294967295 134512640 135237372 3218397328 3075121312 134590275 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=209556 CPUtime=33.77
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 8143 0 0 0 3371 6 0 0 25 0 5 0 1133329692 214585344 43875 4294967295 134512640 135237372 3218397328 3066511356 134680506 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=209556 CPUtime=19.73
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 5717 0 0 0 1968 5 0 0 25 0 5 0 1133329692 214585344 43875 4294967295 134512640 135237372 3218397328 3058372448 134549920 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 108.55
Current children cumulated vsize (KiB) 209556

[startup+102.312 s]
/proc/loadavg: 6.31 6.43 6.19 7/122 14767
/proc/meminfo: memFree=2746508/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=271928 CPUtime=212.24
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 58918 0 0 0 21174 50 0 0 25 0 5 0 1133329417 278454272 58641 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 67982 58641 95 177 0 67804 0
[pid=14418/tid=14424] ppid=14416 vsize=271928 CPUtime=57.68
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 8979 0 0 0 5752 16 0 0 25 0 5 0 1133329691 278454272 58641 4294967295 134512640 135237372 3218397328 3083428752 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=271928 CPUtime=48.31
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 10647 0 0 0 4823 8 0 0 25 0 5 0 1133329691 278454272 58641 4294967295 134512640 135237372 3218397328 3074960208 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=271928 CPUtime=60.15
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 11352 0 0 0 6008 7 0 0 25 0 5 0 1133329692 278454272 58641 4294967295 134512640 135237372 3218397328 3066553824 134562357 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=271928 CPUtime=43.37
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 10214 0 0 0 4327 10 0 0 25 0 5 0 1133329692 278454272 58641 4294967295 134512640 135237372 3218397328 3058080720 134590541 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 212.24
Current children cumulated vsize (KiB) 271928

[startup+162.309 s]
/proc/loadavg: 6.45 6.46 6.21 7/124 15041
/proc/meminfo: memFree=2681816/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=340800 CPUtime=337.73
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 75229 0 0 0 33707 66 0 0 25 0 5 0 1133329417 348979200 74952 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 85200 74952 95 177 0 85022 0
[pid=14418/tid=14424] ppid=14416 vsize=340800 CPUtime=92.15
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 11864 0 0 0 9197 18 0 0 25 0 5 0 1133329691 348979200 74952 4294967295 134512640 135237372 3218397328 3083580048 134588131 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=340800 CPUtime=78.3
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 14359 0 0 0 7816 14 0 0 25 0 5 0 1133329691 348979200 74952 4294967295 134512640 135237372 3218397328 3075291196 134636382 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=340800 CPUtime=91.12
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 16325 0 0 0 9098 14 0 0 25 0 5 0 1133329692 348979200 74952 4294967295 134512640 135237372 3218397328 3066409904 134680503 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=340800 CPUtime=73.43
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 14955 0 0 0 7332 11 0 0 25 0 5 0 1133329692 348979200 74952 4294967295 134512640 135237372 3218397328 3058435536 134592131 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 337.73
Current children cumulated vsize (KiB) 340800

[startup+222.306 s]
/proc/loadavg: 6.47 6.46 6.23 7/122 15318
/proc/meminfo: memFree=2614988/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=409804 CPUtime=471.04
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 91646 0 0 0 47021 83 0 0 25 0 5 0 1133329417 419639296 91369 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 102451 91369 95 177 0 102273 0
[pid=14418/tid=14424] ppid=14416 vsize=409804 CPUtime=124.31
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 15750 0 0 0 12407 24 0 0 25 0 5 0 1133329691 419639296 91369 4294967295 134512640 135237372 3218397328 3083740032 134591059 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=409804 CPUtime=109.97
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 17323 0 0 0 10980 17 0 0 25 0 5 0 1133329691 419639296 91369 4294967295 134512640 135237372 3218397328 3075284112 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=409804 CPUtime=128.12
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 19792 0 0 0 12795 17 0 0 25 0 5 0 1133329692 419639296 91369 4294967295 134512640 135237372 3218397328 3066358096 134680296 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=409804 CPUtime=105.92
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 21055 0 0 0 10576 16 0 0 25 0 5 0 1133329692 419639296 91369 4294967295 134512640 135237372 3218397328 3058062540 134549872 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 471.04
Current children cumulated vsize (KiB) 409804

[startup+282.302 s]
/proc/loadavg: 6.48 6.47 6.24 7/124 15600
/proc/meminfo: memFree=2558240/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=469500 CPUtime=595.43
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 105876 0 0 0 59447 96 0 0 25 0 5 0 1133329417 480768000 105599 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 117375 105599 95 177 0 117197 0
[pid=14418/tid=14424] ppid=14416 vsize=469500 CPUtime=156.06
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 20484 0 0 0 15581 25 0 0 25 0 5 0 1133329691 480768000 105599 4294967295 134512640 135237372 3218397328 3083105808 134562338 0 0 0 0 0 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=14418/tid=14425] ppid=14416 vsize=768492 CPUtime=237.57
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 36778 0 0 0 23719 38 0 0 25 0 5 0 1133329691 786935808 176904 4294967295 134512640 135237372 3218397328 3075277984 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=768492 CPUtime=254.35
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 33034 0 0 0 25396 39 0 0 25 0 5 0 1133329692 786935808 176904 4294967295 134512640 135237372 3218397328 3066414464 134591079 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=768492 CPUtime=257.82
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 51229 0 0 0 25740 42 0 0 25 0 5 0 1133329692 786935808 176904 4294967295 134512640 135237372 3218397328 3058468768 134551002 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1004.78
Current children cumulated vsize (KiB) 768492

[startup+522.31 s]
/proc/loadavg: 6.53 6.50 6.30 8/122 16708
/proc/meminfo: memFree=2202832/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=843636 CPUtime=1124.67
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 195084 0 0 0 112289 178 0 0 25 0 5 0 1133329417 863883264 194807 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 210909 194807 95 177 0 210731 0
[pid=14418/tid=14424] ppid=14416 vsize=843636 CPUtime=283.23
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 44680 0 0 0 28289 34 0 0 25 0 5 0 1133329691 863883264 194807 4294967295 134512640 135237372 3218397328 3083191248 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=843636 CPUtime=266.61
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 39678 0 0 0 26619 42 0 0 25 0 5 0 1133329691 863883264 194807 4294967295 134512640 135237372 3218397328 3075299996 134680502 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=843636 CPUtime=284.15
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 35753 0 0 0 28372 43 0 0 25 0 5 0 1133329692 863883264 194807 4294967295 134512640 135237372 3218397328 3066751424 134590136 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=843636 CPUtime=287.95
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 57247 0 0 0 28745 50 0 0 25 0 5 0 1133329692 863883264 194807 4294967295 134512640 135237372 3218397328 3058375616 134549922 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1124.67
Current children cumulated vsize (KiB) 843636

[startup+582.307 s]
/proc/loadavg: 6.62 6.53 6.32 7/122 16988
/proc/meminfo: memFree=2121544/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=929000 CPUtime=1245.31
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 215038 0 0 0 124342 189 0 0 25 0 5 0 1133329417 951296000 214761 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 232250 214761 95 177 0 232072 0
[pid=14418/tid=14424] ppid=14416 vsize=929000 CPUtime=314.96
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 49094 0 0 0 31461 35 0 0 25 0 5 0 1133329691 951296000 214761 4294967295 134512640 135237372 3218397328 3083287872 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=929000 CPUtime=295.91
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 42823 0 0 0 29546 45 0 0 25 0 5 0 1133329691 951296000 214761 4294967295 134512640 135237372 3218397328 3075219088 134592435 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=929000 CPUtime=314.15
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 37898 0 0 0 31369 46 0 0 25 0 5 0 1133329692 951296000 214761 4294967295 134512640 135237372 3218397328 3066819472 134749351 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=929000 CPUtime=317.56
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 67497 0 0 0 31702 54 0 0 25 0 5 0 1133329692 951296000 214761 4294967295 134512640 135237372 3218397328 3058427424 134551756 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1245.31
Current children cumulated vsize (KiB) 929000

[startup+642.304 s]
/proc/loadavg: 6.66 6.53 6.32 7/122 17265
/proc/meminfo: memFree=2039760/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=1015416 CPUtime=1372.11
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 235245 0 0 0 137009 202 0 0 25 0 5 0 1133329417 1039785984 234968 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 253854 234968 95 177 0 253676 0
[pid=14418/tid=14424] ppid=14416 vsize=1015416 CPUtime=346.71
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 52968 0 0 0 34636 35 0 0 25 0 5 0 1133329691 1039785984 234968 4294967295 134512640 135237372 3218397328 3083151232 134680296 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=1015416 CPUtime=324.17
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 47282 0 0 0 32371 46 0 0 25 0 5 0 1133329691 1039785984 234968 4294967295 134512640 135237372 3218397328 3075221932 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=1015416 CPUtime=343.75
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 40322 0 0 0 34326 49 0 0 25 0 5 0 1133329692 1039785984 234968 4294967295 134512640 135237372 3218397328 3066429296 134590368 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=1015416 CPUtime=354.75
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 76947 0 0 0 35412 63 0 0 25 0 5 0 1133329692 1039785984 234968 4294967295 134512640 135237372 3218397328 3058510092 134636641 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1372.11
Current children cumulated vsize (KiB) 1015416

[startup+702.311 s]
/proc/loadavg: 6.65 6.54 6.34 7/122 17540
/proc/meminfo: memFree=1946952/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=1114584 CPUtime=1515.29
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 258556 0 0 0 151315 214 0 0 25 0 5 0 1133329417 1141334016 258279 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 278646 258279 95 177 0 278468 0
[pid=14418/tid=14424] ppid=14416 vsize=1114584 CPUtime=398.7
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 58627 0 0 0 39834 36 0 0 25 0 5 0 1133329691 1141334016 258279 4294967295 134512640 135237372 3218397328 3083163552 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=1114584 CPUtime=354.21
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 52412 0 0 0 35369 52 0 0 25 0 5 0 1133329691 1141334016 258279 4294967295 134512640 135237372 3218397328 3074994656 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=1114584 CPUtime=373.1
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 42866 0 0 0 37261 49 0 0 25 0 5 0 1133329692 1141334016 258279 4294967295 134512640 135237372 3218397328 3066687280 134562416 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=1114584 CPUtime=386.55
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 86925 0 0 0 38587 68 0 0 25 0 5 0 1133329692 1141334016 258279 4294967295 134512640 135237372 3218397328 3058505280 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1515.29
Current children cumulated vsize (KiB) 1114584

[startup+762.317 s]
/proc/loadavg: 6.64 6.53 6.35 8/123 17798
/proc/meminfo: memFree=1873400/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=1191884 CPUtime=1637.75
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 276773 0 0 0 163553 222 0 0 25 0 5 0 1133329417 1220489216 276496 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 297971 276496 95 177 0 297793 0
[pid=14418/tid=14424] ppid=14416 vsize=1191884 CPUtime=432.11
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 62070 0 0 0 43173 38 0 0 25 0 5 0 1133329691 1220489216 276496 4294967295 134512640 135237372 3218397328 3083509952 134562328 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=1191884 CPUtime=384.05
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 57241 0 0 0 38352 53 0 0 25 0 5 0 1133329691 1220489216 276496 4294967295 134512640 135237372 3218397328 3075222080 134552732 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=1191884 CPUtime=403.25
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 45091 0 0 0 40275 50 0 0 25 0 5 0 1133329692 1220489216 276496 4294967295 134512640 135237372 3218397328 3066748956 134549950 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=1191884 CPUtime=415.62
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 94645 0 0 0 41490 72 0 0 25 0 5 0 1133329692 1220489216 276496 4294967295 134512640 135237372 3218397328 3058424672 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1637.75
Current children cumulated vsize (KiB) 1191884

[startup+822.314 s]
/proc/loadavg: 6.45 6.49 6.35 7/122 18095
/proc/meminfo: memFree=1806076/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=1262124 CPUtime=1759.17
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 293572 0 0 0 175685 232 0 0 25 0 5 0 1133329417 1292414976 293295 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 315531 293295 95 177 0 315353 0
[pid=14418/tid=14424] ppid=14416 vsize=1262124 CPUtime=462.89
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 65319 0 0 0 46250 39 0 0 25 0 5 0 1133329691 1292414976 293295 4294967295 134512640 135237372 3218397328 3083699136 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=1262124 CPUtime=414.07
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 62475 0 0 0 41352 55 0 0 25 0 5 0 1133329691 1292414976 293295 4294967295 134512640 135237372 3218397328 3075302160 134680367 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=1262124 CPUtime=434.65
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 47356 0 0 0 43414 51 0 0 25 0 5 0 1133329692 1292414976 293295 4294967295 134512640 135237372 3218397328 3066364112 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=1262124 CPUtime=444.83
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 100696 0 0 0 44405 78 0 0 25 0 5 0 1133329692 1292414976 293295 4294967295 134512640 135237372 3218397328 3058491120 134591433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1759.17
Current children cumulated vsize (KiB) 1262124

[startup+882.311 s]
/proc/loadavg: 6.61 6.51 6.36 8/123 18286
/proc/meminfo: memFree=1741756/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=1330700 CPUtime=1896.96
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 309705 0 0 0 189453 243 0 0 25 0 5 0 1133329417 1362636800 309428 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 332675 309428 95 177 0 332497 0
[pid=14418/tid=14424] ppid=14416 vsize=1330700 CPUtime=495.29
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 69538 0 0 0 49488 41 0 0 25 0 5 0 1133329691 1362636800 309428 4294967295 134512640 135237372 3218397328 3083702784 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=1330700 CPUtime=443.71
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 67042 0 0 0 44310 61 0 0 25 0 5 0 1133329691 1362636800 309428 4294967295 134512640 135237372 3218397328 3075299424 134550399 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=1330700 CPUtime=482.8
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 50135 0 0 0 48229 51 0 0 25 0 5 0 1133329692 1362636800 309428 4294967295 134512640 135237372 3218397328 3066921504 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=1330700 CPUtime=472.43
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 105264 0 0 0 47162 81 0 0 25 0 5 0 1133329692 1362636800 309428 4294967295 134512640 135237372 3218397328 3058454592 134749337 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1896.96
Current children cumulated vsize (KiB) 1330700

[startup+942.308 s]
/proc/loadavg: 6.52 6.50 6.37 9/123 18537
/proc/meminfo: memFree=1686004/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=1389996 CPUtime=2018.66
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 323906 0 0 0 201612 254 0 0 25 0 5 0 1133329417 1423355904 323629 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 347499 323629 95 177 0 347321 0
[pid=14418/tid=14424] ppid=14416 vsize=1389996 CPUtime=526.51
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 72970 0 0 0 52606 45 0 0 25 0 5 0 1133329691 1423355904 323629 4294967295 134512640 135237372 3218397328 3083632464 134590245 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=1389996 CPUtime=475.06
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 70148 0 0 0 47443 63 0 0 25 0 5 0 1133329691 1423355904 323629 4294967295 134512640 135237372 3218397328 3075217984 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=1389996 CPUtime=512.43
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 52684 0 0 0 51188 55 0 0 25 0 5 0 1133329692 1423355904 323629 4294967295 134512640 135237372 3218397328 3066833496 134519962 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=1389996 CPUtime=501.93
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 110378 0 0 0 50111 82 0 0 25 0 5 0 1133329692 1423355904 323629 4294967295 134512640 135237372 3218397328 3058564560 134591160 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2018.66
Current children cumulated vsize (KiB) 1389996



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.02 s]
/proc/loadavg: 6.29 6.44 6.35 7/122 18736
/proc/meminfo: memFree=1605152/3368532 swapFree=1959840/1959888
[pid=14418] ppid=14416 vsize=1475320 CPUtime=2152.8
/proc/14418/stat : 14418 (ttsth-5-0) S 14416 14418 10612 0 -1 4202496 343837 0 0 0 215011 269 0 0 25 0 5 0 1133329417 1510727680 343560 4294967295 134512640 135237372 3218397328 3218396924 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14418/statm: 368830 343560 95 177 0 368652 0
[pid=14418/tid=14424] ppid=14416 vsize=1475320 CPUtime=559.91
/proc/14418/task/14424/stat : 14424 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 74658 0 0 0 55943 48 0 0 25 0 5 0 1133329691 1510727680 343560 4294967295 134512640 135237372 3218397328 3083601744 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14425] ppid=14416 vsize=1475320 CPUtime=511.62
/proc/14418/task/14425/stat : 14425 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 79545 0 0 0 51096 66 0 0 25 0 5 0 1133329691 1510727680 343560 4294967295 134512640 135237372 3218397328 3075196192 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14418/tid=14426] ppid=14416 vsize=1475320 CPUtime=539.35
/proc/14418/task/14426/stat : 14426 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 56118 0 0 0 53874 61 0 0 25 0 5 0 1133329692 1510727680 343560 4294967295 134512640 135237372 3218397328 3066848352 134680322 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14418/tid=14427] ppid=14416 vsize=1475320 CPUtime=539.19
/proc/14418/task/14427/stat : 14427 (ttsth-5-0) R 14416 14418 10612 0 -1 4202560 115790 0 0 0 53834 85 0 0 25 0 5 0 1133329692 1510727680 343560 4294967295 134512640 135237372 3218397328 3058534648 134519944 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2152.8
Current children cumulated vsize (KiB) 1475320

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.12
CPU time (s): 2152.9
CPU user time (s): 2150.14
CPU system time (s): 2.76
CPU usage (%): 215.264
Max. virtual memory (cumulated for all children) (KiB): 1475320

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2150.14
system time used= 2.76
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 343844
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1790
involuntary context switches= 73495

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 14:31:06
IDJOB=1781278
IDBENCH=71699
IDSOLVER=632
FILE ID=/1781278-1243686666
PBS_JOBID=
Free space on /tmp= 7980 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT_RACE06/goldb-heqc-i10mul.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781278-1243686666/watcher-1781278-1243686666 -o /tmp/evaluation-result-1781278-1243686666/solver-1781278-1243686666 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781278-1243686666.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 80e15f28c8e2d72627ec75fe75757317
RANDOM SEED= 1599458482

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2979740 kB
Buffers:        138220 kB
Cached:         122772 kB
SwapCached:          0 kB
Active:         175768 kB
Inactive:       107224 kB
HighTotal:     2489216 kB
HighFree:      2344184 kB
LowTotal:       879316 kB
LowFree:        635556 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:            2536 kB
Writeback:           0 kB
AnonPages:       22220 kB
Mapped:           8060 kB
Slab:            95552 kB
SReclaimable:    82608 kB
SUnreclaim:      12944 kB
PageTables:        768 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   123556 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 7980 MiB
End job on  at 2009-05-30 14:47:48