Trace number 1779943

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1580.73 850.95

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l37_lambda.cnf
MD5SUM6c0fa36b77ee8403468509d27984ddf2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark3.07
Satisfiable
(Un)Satisfiability was proved
Number of variables26241
Number of clauses128361
Sum of the clauses size368903
Maximum clause length9
Minimum clause length1
Number of clauses of size 13566
Number of clauses of size 233367
Number of clauses of size 373230
Number of clauses of size 412521
Number of clauses of size 55566
Number of clauses of size over 5111

Solver Data 

0.31/0.32	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779943-1243680222.cnf 
0.31/0.32	c Using SATTIMEOUT of 10000
0.31/0.32	c Using SATRAM of 2047
0.31/0.32	c Size of subset node = 16
0.31/0.32	c Variables = 26241
0.31/0.32	c Clauses = 128361
0.31/0.32	c Literals = 368903
0.31/0.32	c Reduced size:
0.31/0.32	c Variables = 26241
0.31/0.32	c Clauses = 114462
0.31/0.32	c Literals = 333968
0.31/0.32	c a2
0.51/0.61	c a1
7.43/14.14	c Independent sub-problems = 1
7.43/14.14	c Sub-problem with 21767 variables and 114462 clauses
7.43/14.14	c using permutation method 4
7.43/14.14	c count = 1
7.43/14.14	c Ordering finished 7.390 seconds
7.43/14.14	c mapped 7.440 seconds
7.43/14.14	c permuted 7.440 seconds
7.43/14.14	c about to sort
7.45/14.28	c sorted
9.02/17.41	c clauses now 114462
9.02/17.41	c init finished 7.630 seconds
9.02/17.41	c tree built 9.020 seconds
9.02/17.41	c 
9.02/17.41	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
9.02/17.41	c ---------------------------------|----------------------------------|------------------------------------------------------
9.02/17.41	c ................................ | ..........                       |                        9.0           0.0             
9.02/17.41	c ................................ | ..........                     1 |                        9.0           0.1             
9.02/17.41	c ****************................ | ..........                     2 |                        9.0           0.2            1
9.02/17.41	c ****************................ | ..........                     3 |                        9.0           0.3            1
9.02/17.41	c ****************................ | ..........                     4 |                        9.0           0.4            1
9.02/17.41	c ****************................ | ..........                     5 |                        9.0           0.6            1
9.02/17.41	c ****************................ | ..........                     6 |                        9.0           0.7            1
9.02/17.41	c ****************................ | ..........                  1000 | 2                      9.0         110.9          109
200.02/122.77	c ****************................ | ..........               1501000 | 120471               200.2        7499.4     17633798
400.04/230.84	c ****************................ | ..........               3089000 | 238158               400.1        7721.1     32168731
599.92/335.68	c ****************................ | ..........               4648000 | 355203               600.1        7745.6     47548806
800.18/443.05	c ****************................ | ..........               6210000 | 471457               800.2        7760.4     63256856
999.90/546.49	c ****************................ | *.........               7726000 | 587556              1000.1        7725.4     77352378
1200.22/651.32	c ****************................ | *.........               9265000 | 703880              1200.2        7719.4     92085720
1399.95/756.21	c ****************................ | *.........              10741000 | 815795              1400.1        7671.6    105469701

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1779943-1243680222/watcher-1779943-1243680222 -o /tmp/evaluation-result-1779943-1243680222/solver-1779943-1243680222 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779943-1243680222.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 8.72 8.72 8.25 7/113 8924
/proc/meminfo: memFree=2155416/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=1144 CPUtime=0
/proc/8924/stat : 8924 (ttsth-5-0) R 8922 8924 14986 0 -1 4202496 175 0 0 0 0 0 0 0 18 0 1 0 1122159540 1171456 131 4294967295 134512640 135237372 3214759200 3214757724 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/8924/statm: 286 131 75 177 0 108 0

[startup+0.030012 s]
/proc/loadavg: 8.72 8.72 8.25 7/113 8924
/proc/meminfo: memFree=2155416/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=2228 CPUtime=0.03
/proc/8924/stat : 8924 (ttsth-5-0) R 8922 8924 14986 0 -1 4202496 458 0 0 0 3 0 0 0 18 0 1 0 1122159540 2281472 414 4294967295 134512640 135237372 3214759200 3214757724 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/8924/statm: 557 415 75 177 0 379 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 2228

[startup+0.109985 s]
/proc/loadavg: 8.72 8.72 8.25 7/113 8924
/proc/meminfo: memFree=2155416/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=5760 CPUtime=0.11
/proc/8924/stat : 8924 (ttsth-5-0) R 8922 8924 14986 0 -1 4202496 1306 0 0 0 9 2 0 0 18 0 1 0 1122159540 5898240 1262 4294967295 134512640 135237372 3214759200 3214757724 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/8924/statm: 1440 1263 75 177 0 1262 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 5760

[startup+0.309975 s]
/proc/loadavg: 8.72 8.72 8.25 7/113 8924
/proc/meminfo: memFree=2155416/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=9892 CPUtime=0.31
/proc/8924/stat : 8924 (ttsth-5-0) R 8922 8924 14986 0 -1 4202496 2292 0 0 0 29 2 0 0 18 0 1 0 1122159540 10129408 2248 4294967295 134512640 135237372 3214759200 3214758892 134534259 0 0 0 0 0 0 0 17 2 0 0 0
/proc/8924/statm: 2473 2248 75 177 0 2295 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 9892

[startup+0.709939 s]
/proc/loadavg: 8.72 8.72 8.25 7/113 8924
/proc/meminfo: memFree=2155416/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=18312 CPUtime=0.71
/proc/8924/stat : 8924 (ttsth-5-0) R 8922 8924 14986 0 -1 4202496 4697 0 0 0 68 3 0 0 18 0 1 0 1122159540 18751488 4339 4294967295 134512640 135237372 3214759200 3214758528 134555272 0 0 0 0 0 0 0 17 2 0 0 0
/proc/8924/statm: 4578 4339 77 177 0 4400 0
Current children cumulated CPU time (s) 0.71
Current children cumulated vsize (KiB) 18312

[startup+1.50988 s]
/proc/loadavg: 8.42 8.66 8.24 6/114 8925
/proc/meminfo: memFree=2136668/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=22012 CPUtime=1.13
/proc/8924/stat : 8924 (ttsth-5-0) R 8922 8924 14986 0 -1 4202496 5664 0 0 0 109 4 0 0 19 0 1 0 1122159540 22540288 5306 4294967295 134512640 135237372 3214759200 3214758560 134600975 0 0 0 0 0 0 0 17 2 0 0 0
/proc/8924/statm: 5503 5306 77 177 0 5325 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 22012

[startup+3.10976 s]
/proc/loadavg: 8.42 8.66 8.24 6/114 8925
/proc/meminfo: memFree=2134336/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=22012 CPUtime=1.93
/proc/8924/stat : 8924 (ttsth-5-0) R 8922 8924 14986 0 -1 4202496 5664 0 0 0 189 4 0 0 21 0 1 0 1122159540 22540288 5306 4294967295 134512640 135237372 3214759200 3214758560 134600972 0 0 0 0 0 0 0 17 2 0 0 0
/proc/8924/statm: 5503 5306 77 177 0 5325 0
Current children cumulated CPU time (s) 1.93
Current children cumulated vsize (KiB) 22012
heavy processes:
  %CPU=86 pid=12341 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=85 pid=12739 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=85 pid=13124 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R
  %CPU=87 pid=13512 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R

[startup+6.30951 s]
/proc/loadavg: 8.42 8.66 8.24 6/114 8925
/proc/meminfo: memFree=2133972/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=22292 CPUtime=3.53
/proc/8924/stat : 8924 (ttsth-5-0) R 8922 8924 14986 0 -1 4202496 5717 0 0 0 349 4 0 0 25 0 1 0 1122159540 22827008 5359 4294967295 134512640 135237372 3214759200 3214758560 134600972 0 0 0 0 0 0 0 17 2 0 0 0
/proc/8924/statm: 5573 5359 77 177 0 5395 0
Current children cumulated CPU time (s) 3.53
Current children cumulated vsize (KiB) 22292
heavy processes:
  %CPU=86 pid=12341 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=85 pid=12739 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=85 pid=13124 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R
  %CPU=87 pid=13512 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R

[startup+12.709 s]
/proc/loadavg: 7.98 8.56 8.21 8/115 8990
/proc/meminfo: memFree=2133088/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=22292 CPUtime=6.73
/proc/8924/stat : 8924 (ttsth-5-0) R 8922 8924 14986 0 -1 4202496 5740 0 0 0 668 5 0 0 25 0 1 0 1122159540 22827008 5382 4294967295 134512640 135237372 3214759200 3214758560 134600728 0 0 0 0 0 0 0 17 2 0 0 0
/proc/8924/statm: 5573 5382 77 177 0 5395 0
Current children cumulated CPU time (s) 6.73
Current children cumulated vsize (KiB) 22292
heavy processes:
  %CPU=86 pid=12341 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=85 pid=12739 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=85 pid=13124 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R
  %CPU=87 pid=13512 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R

[startup+25.518 s]
/proc/loadavg: 7.91 8.52 8.20 9/118 9114
/proc/meminfo: memFree=2017660/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=171776 CPUtime=22.74
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 35156 0 0 0 2259 15 0 0 25 0 5 0 1122159540 175898624 34574 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 42944 34574 95 177 0 42766 0
[pid=8924/tid=9036] ppid=8922 vsize=171776 CPUtime=3.43
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 2657 0 0 0 340 3 0 0 25 0 5 0 1122161270 175898624 34574 4294967295 134512640 135237372 3214759200 3082849648 134593403 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=171776 CPUtime=3.11
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 2062 0 0 0 309 2 0 0 25 0 5 0 1122161270 175898624 34574 4294967295 134512640 135237372 3214759200 3074425280 134562420 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=171776 CPUtime=3.85
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 2414 0 0 0 384 1 0 0 25 0 5 0 1122161282 175898624 34574 4294967295 134512640 135237372 3214759200 3066034480 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=171776 CPUtime=3.33
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 2489 0 0 0 332 1 0 0 25 0 5 0 1122161282 175898624 34574 4294967295 134512640 135237372 3214759200 3057646176 134749337 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 22.74
Current children cumulated vsize (KiB) 171776

[startup+51.116 s]
/proc/loadavg: 8.20 8.54 8.21 9/118 9115
/proc/meminfo: memFree=1938652/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=255376 CPUtime=68.22
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 54955 0 0 0 6790 32 0 0 25 0 5 0 1122159540 261505024 54373 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 63844 54373 95 177 0 63666 0
[pid=8924/tid=9036] ppid=8922 vsize=255376 CPUtime=15.42
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 8916 0 0 0 1532 10 0 0 25 0 5 0 1122161270 261505024 54373 4294967295 134512640 135237372 3214759200 3082817316 134634454 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=255376 CPUtime=13.69
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 6083 0 0 0 1363 6 0 0 25 0 5 0 1122161270 261505024 54373 4294967295 134512640 135237372 3214759200 3074428708 134634688 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=255376 CPUtime=15.36
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 7106 0 0 0 1530 6 0 0 25 0 5 0 1122161282 261505024 54373 4294967295 134512640 135237372 3214759200 3066145440 134587921 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=255376 CPUtime=14.73
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 7316 0 0 0 1471 2 0 0 25 0 5 0 1122161282 261505024 54373 4294967295 134512640 135237372 3214759200 3057650176 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 68.22
Current children cumulated vsize (KiB) 255376

[startup+102.312 s]
/proc/loadavg: 8.63 8.60 8.25 9/118 9307
/proc/meminfo: memFree=1826068/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=370716 CPUtime=161.53
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 82523 0 0 0 16097 56 0 0 25 0 5 0 1122159540 379613184 81941 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 92679 81942 95 177 0 92501 0
[pid=8924/tid=9036] ppid=8922 vsize=370716 CPUtime=39.63
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 17928 0 0 0 3948 15 0 0 25 0 5 0 1122161270 379613184 81942 4294967295 134512640 135237372 3214759200 3082884204 134680502 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=370716 CPUtime=37.91
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 12421 0 0 0 3778 13 0 0 25 0 5 0 1122161270 379613184 81942 4294967295 134512640 135237372 3214759200 3074422080 134680265 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=370716 CPUtime=37.76
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 13452 0 0 0 3765 11 0 0 25 0 5 0 1122161282 379613184 81942 4294967295 134512640 135237372 3214759200 3066037152 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=370716 CPUtime=37.21
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 13189 0 0 0 3712 9 0 0 25 0 5 0 1122161282 379613184 81942 4294967295 134512640 135237372 3214759200 3057659488 134680737 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 161.53
Current children cumulated vsize (KiB) 370716

[startup+162.307 s]
/proc/loadavg: 8.96 8.69 8.30 9/118 9494
/proc/meminfo: memFree=1696416/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=507408 CPUtime=270.3
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 114962 0 0 0 26954 76 0 0 25 0 5 0 1122159540 519585792 114380 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 126852 114380 95 177 0 126674 0
[pid=8924/tid=9036] ppid=8922 vsize=507408 CPUtime=67.02
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 30820 0 0 0 6680 22 0 0 25 0 5 0 1122161270 519585792 114380 4294967295 134512640 135237372 3214759200 3082823072 134749345 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=507408 CPUtime=66.11
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 18745 0 0 0 6593 18 0 0 25 0 5 0 1122161270 519585792 114380 4294967295 134512640 135237372 3214759200 3074680480 134549896 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=507408 CPUtime=63.32
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 19834 0 0 0 6315 17 0 0 25 0 5 0 1122161282 519585792 114380 4294967295 134512640 135237372 3214759200 3066192784 134561524 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=507408 CPUtime=64.83
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 20029 0 0 0 6472 11 0 0 25 0 5 0 1122161282 519585792 114380 4294967295 134512640 135237372 3214759200 3057666320 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 270.3
Current children cumulated vsize (KiB) 507408

[startup+222.313 s]
/proc/loadavg: 8.86 8.70 8.32 9/118 9682
/proc/meminfo: memFree=1561688/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=647008 CPUtime=383.39
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 148096 0 0 0 38242 97 0 0 25 0 5 0 1122159540 662536192 147514 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 161752 147515 95 177 0 161574 0
[pid=8924/tid=9036] ppid=8922 vsize=647008 CPUtime=97.5
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 45749 0 0 0 9723 27 0 0 25 0 5 0 1122161270 662536192 147515 4294967295 134512640 135237372 3214759200 3082884448 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=647008 CPUtime=93.51
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 23702 0 0 0 9330 21 0 0 25 0 5 0 1122161270 662536192 147515 4294967295 134512640 135237372 3214759200 3074435392 134549905 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=647008 CPUtime=90.75
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 27034 0 0 0 9048 27 0 0 25 0 5 0 1122161282 662536192 147515 4294967295 134512640 135237372 3214759200 3066043488 134680727 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=647008 CPUtime=92.61
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 26078 0 0 0 9247 14 0 0 25 0 5 0 1122161282 662536192 147515 4294967295 134512640 135237372 3214759200 3057754688 134680343 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 383.39
Current children cumulated vsize (KiB) 647008

[startup+282.308 s]
/proc/loadavg: 8.78 8.71 8.35 10/118 9869
/proc/meminfo: memFree=1416460/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=801324 CPUtime=498.22
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 184368 0 0 0 49709 113 0 0 25 0 5 0 1122159540 820555776 183786 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 200331 183786 95 177 0 200153 0
[pid=8924/tid=9036] ppid=8922 vsize=801324 CPUtime=128.12
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 61165 0 0 0 12782 30 0 0 25 0 5 0 1122161270 820555776 183786 4294967295 134512640 135237372 3214759200 3082880144 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=801324 CPUtime=121.75

################
# More data... #
################

/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 45980 0 0 0 17674 25 0 0 25 0 5 0 1122161282 1109557248 250281 4294967295 134512640 135237372 3214759200 3057824080 134591065 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 722.29
Current children cumulated vsize (KiB) 1083552

[startup+462.314 s]
/proc/loadavg: 8.67 8.70 8.40 10/118 10439
/proc/meminfo: memFree=1006076/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=1230660 CPUtime=837.59
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 285815 0 0 0 83579 180 0 0 25 0 5 0 1122159540 1260195840 285233 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 307665 285233 95 177 0 307487 0
[pid=8924/tid=9036] ppid=8922 vsize=1230660 CPUtime=217.61
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 104340 0 0 0 21708 53 0 0 25 0 5 0 1122161270 1260195840 285233 4294967295 134512640 135237372 3214759200 3082871680 134592187 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=1230660 CPUtime=205.31
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 53322 0 0 0 20493 38 0 0 25 0 5 0 1122161270 1260195840 285233 4294967295 134512640 135237372 3214759200 3074426336 134592878 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=1230660 CPUtime=201.05
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 51240 0 0 0 20053 52 0 0 25 0 5 0 1122161282 1260195840 285233 4294967295 134512640 135237372 3214759200 3066342896 134680503 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=1230660 CPUtime=204.6
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 51379 0 0 0 20431 29 0 0 25 0 5 0 1122161282 1260195840 285233 4294967295 134512640 135237372 3214759200 3057670568 134551012 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 837.59
Current children cumulated vsize (KiB) 1230660

[startup+522.309 s]
/proc/loadavg: 8.79 8.72 8.43 10/118 10626
/proc/meminfo: memFree=877984/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=1367072 CPUtime=954.23
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 317950 0 0 0 95225 198 0 0 25 0 5 0 1122159540 1399881728 317368 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 341768 317368 95 177 0 341590 0
[pid=8924/tid=9036] ppid=8922 vsize=1367072 CPUtime=247.32
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 118312 0 0 0 24673 59 0 0 25 0 5 0 1122161270 1399881728 317368 4294967295 134512640 135237372 3214759200 3082868576 134680329 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=1367072 CPUtime=235.91
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 60531 0 0 0 23549 42 0 0 25 0 5 0 1122161270 1399881728 317368 4294967295 134512640 135237372 3214759200 3074489200 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=1367072 CPUtime=229.25
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 57058 0 0 0 22866 59 0 0 25 0 5 0 1122161282 1399881728 317368 4294967295 134512640 135237372 3214759200 3066072768 134749351 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=1367072 CPUtime=232.73
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 56515 0 0 0 23243 30 0 0 25 0 5 0 1122161282 1399881728 317368 4294967295 134512640 135237372 3214759200 3057898240 134591065 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 954.23
Current children cumulated vsize (KiB) 1367072

[startup+582.305 s]
/proc/loadavg: 8.80 8.75 8.46 9/118 10814
/proc/meminfo: memFree=745632/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=1505104 CPUtime=1069
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 350665 0 0 0 106685 215 0 0 25 0 5 0 1122159540 1541226496 350083 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 376276 350083 95 177 0 376098 0
[pid=8924/tid=9036] ppid=8922 vsize=1505104 CPUtime=278.82
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 133178 0 0 0 27820 62 0 0 25 0 5 0 1122161270 1541226496 350083 4294967295 134512640 135237372 3214759200 3082871488 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=1505104 CPUtime=263.46
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 66903 0 0 0 26299 47 0 0 25 0 5 0 1122161270 1541226496 350083 4294967295 134512640 135237372 3214759200 3074425152 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=1505104 CPUtime=257.25
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 62672 0 0 0 25661 64 0 0 25 0 5 0 1122161282 1541226496 350083 4294967295 134512640 135237372 3214759200 3066062816 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=1505104 CPUtime=260.45
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 62378 0 0 0 26011 34 0 0 25 0 5 0 1122161282 1541226496 350083 4294967295 134512640 135237372 3214759200 3057724080 134566000 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1069
Current children cumulated vsize (KiB) 1505104

[startup+642.31 s]
/proc/loadavg: 8.70 8.72 8.46 10/118 11002
/proc/meminfo: memFree=613180/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=1643952 CPUtime=1183.88
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 383235 0 0 0 118155 233 0 0 25 0 5 0 1122159540 1683406848 382653 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 410988 382653 95 177 0 410810 0
[pid=8924/tid=9036] ppid=8922 vsize=1643952 CPUtime=309.82
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 147338 0 0 0 30914 68 0 0 25 0 5 0 1122161270 1683406848 382653 4294967295 134512640 135237372 3214759200 3082892848 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=1643952 CPUtime=291.86
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 73676 0 0 0 29135 51 0 0 25 0 5 0 1122161270 1683406848 382653 4294967295 134512640 135237372 3214759200 3074703136 134749353 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=1643952 CPUtime=285.45
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 68516 0 0 0 28475 70 0 0 25 0 5 0 1122161282 1683406848 382653 4294967295 134512640 135237372 3214759200 3066053536 134749334 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=1643952 CPUtime=287.73
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 68171 0 0 0 28737 36 0 0 25 0 5 0 1122161282 1683406848 382653 4294967295 134512640 135237372 3214759200 3057642432 134565879 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1183.88
Current children cumulated vsize (KiB) 1643952

[startup+702.315 s]
/proc/loadavg: 8.59 8.68 8.46 10/118 11191
/proc/meminfo: memFree=493104/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=1771964 CPUtime=1297.16
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 413189 0 0 0 129461 255 0 0 25 0 5 0 1122159540 1814491136 412607 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 442991 412607 95 177 0 442813 0
[pid=8924/tid=9036] ppid=8922 vsize=1771964 CPUtime=339.22
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 160855 0 0 0 33848 74 0 0 25 0 5 0 1122161270 1814491136 412607 4294967295 134512640 135237372 3214759200 3082876556 134562272 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=1771964 CPUtime=319.91
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 79648 0 0 0 31935 56 0 0 25 0 5 0 1122161270 1814491136 412607 4294967295 134512640 135237372 3214759200 3074517840 134562444 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=1771964 CPUtime=313.95
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 73594 0 0 0 31318 77 0 0 25 0 5 0 1122161282 1814491136 412607 4294967295 134512640 135237372 3214759200 3066138240 134592450 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=1771964 CPUtime=315.06
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 73558 0 0 0 31466 40 0 0 25 0 5 0 1122161282 1814491136 412607 4294967295 134512640 135237372 3214759200 3057669024 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1297.16
Current children cumulated vsize (KiB) 1771964

[startup+762.32 s]
/proc/loadavg: 8.47 8.63 8.45 7/118 11378
/proc/meminfo: memFree=369476/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=1900672 CPUtime=1411.5
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 443554 0 0 0 140872 278 0 0 25 0 5 0 1122159540 1946288128 442972 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 475168 442972 95 177 0 474990 0
[pid=8924/tid=9036] ppid=8922 vsize=1900672 CPUtime=369.24
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 174508 0 0 0 36842 82 0 0 25 0 5 0 1122161270 1946288128 442972 4294967295 134512640 135237372 3214759200 3082869356 134680502 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=1900672 CPUtime=348.08
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 85641 0 0 0 34747 61 0 0 25 0 5 0 1122161270 1946288128 442972 4294967295 134512640 135237372 3214759200 3074427760 134562363 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=1900672 CPUtime=342.7
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 78606 0 0 0 34188 82 0 0 25 0 5 0 1122161282 1946288128 442972 4294967295 134512640 135237372 3214759200 3066040388 134634454 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=1900672 CPUtime=342.46
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 79265 0 0 0 34201 45 0 0 25 0 5 0 1122161282 1946288128 442972 4294967295 134512640 135237372 3214759200 3057667920 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1411.5
Current children cumulated vsize (KiB) 1900672

[startup+822.316 s]
/proc/loadavg: 8.54 8.60 8.46 9/118 11569
/proc/meminfo: memFree=245320/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=2031308 CPUtime=1527.49
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 474522 0 0 0 152444 305 0 0 25 0 5 0 1122159540 2080059392 473940 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 507827 473940 95 177 0 507649 0
[pid=8924/tid=9036] ppid=8922 vsize=2031308 CPUtime=400.22
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 188991 0 0 0 39932 90 0 0 25 0 5 0 1122161270 2080059392 473940 4294967295 134512640 135237372 3214759200 3082883536 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=2031308 CPUtime=376.57
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 91495 0 0 0 37592 65 0 0 25 0 5 0 1122161270 2080059392 473940 4294967295 134512640 135237372 3214759200 3074442892 134680502 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=2031308 CPUtime=370.95
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 84139 0 0 0 37005 90 0 0 25 0 5 0 1122161282 2080059392 473940 4294967295 134512640 135237372 3214759200 3066035232 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=2031308 CPUtime=370.73
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 84363 0 0 0 37021 52 0 0 25 0 5 0 1122161282 2080059392 473940 4294967295 134512640 135237372 3214759200 3057836752 134590129 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1527.49
Current children cumulated vsize (KiB) 2031308



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+850.614 s]
/proc/loadavg: 8.49 8.59 8.45 10/118 11756
/proc/meminfo: memFree=182184/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=2096280 CPUtime=1580.56
/proc/8924/stat : 8924 (ttsth-5-0) S 8922 8924 14986 0 -1 4202496 489818 0 0 0 157742 314 0 0 25 0 5 0 1122159540 2146590720 489236 4294967295 134512640 135237372 3214759200 3214758796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/8924/statm: 524070 489236 95 177 0 523892 0
[pid=8924/tid=9036] ppid=8922 vsize=2096280 CPUtime=413.45
/proc/8924/task/9036/stat : 9036 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 194980 0 0 0 41251 94 0 0 25 0 5 0 1122161270 2146590720 489237 4294967295 134512640 135237372 3214759200 3082884208 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=2096280 CPUtime=389.88
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 94477 0 0 0 38921 67 0 0 25 0 5 0 1122161270 2146590720 489237 4294967295 134512640 135237372 3214759200 3074426856 134636382 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9039] ppid=8922 vsize=2096280 CPUtime=383.96
/proc/8924/task/9039/stat : 9039 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 86554 0 0 0 38306 90 0 0 24 0 5 0 1122161282 2146590720 489237 4294967295 134512640 135237372 3214759200 3066278928 134592429 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8924/tid=9040] ppid=8922 vsize=2096280 CPUtime=384.25
/proc/8924/task/9040/stat : 9040 (ttsth-5-0) R 8922 8924 14986 0 -1 4202560 88274 0 0 0 38370 55 0 0 25 0 5 0 1122161282 2146590720 489237 4294967295 134512640 135237372 3214759200 3057684448 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1580.56
Current children cumulated vsize (KiB) 2096280

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+850.814 s]
/proc/loadavg: 8.49 8.59 8.45 10/118 11756
/proc/meminfo: memFree=182184/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=0 CPUtime=1580.65
/proc/8924/stat : 8924 (ttsth-5-0) Z 8922 8924 14986 0 -1 4203524 489827 0 0 0 157748 317 0 0 18 0 2 0 1122159540 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8924/statm: 0 0 0 0 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=0 CPUtime=389.91
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4203588 94477 0 0 0 38921 70 0 0 25 0 2 0 1122161270 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1580.65
Current children cumulated vsize (KiB) 0

[startup+850.914 s]
/proc/loadavg: 8.49 8.59 8.45 10/118 11756
/proc/meminfo: memFree=182184/3368532 swapFree=1953000/1959888
[pid=8924] ppid=8922 vsize=0 CPUtime=1580.7
/proc/8924/stat : 8924 (ttsth-5-0) Z 8922 8924 14986 0 -1 4203524 489827 0 0 0 157748 322 0 0 18 0 2 0 1122159540 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8924/statm: 0 0 0 0 0 0 0
[pid=8924/tid=9037] ppid=8922 vsize=0 CPUtime=389.96
/proc/8924/task/9037/stat : 9037 (ttsth-5-0) R 8922 8924 14986 0 -1 4203588 94477 0 0 0 38921 75 0 0 25 0 2 0 1122161270 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1580.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 850.95
CPU time (s): 1580.73
CPU user time (s): 1577.48
CPU system time (s): 3.25
CPU usage (%): 185.761
Max. virtual memory (cumulated for all children) (KiB): 2096280

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1577.48
system time used= 3.25
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 489827
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2207
involuntary context switches= 41566

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi45 at 2009-05-30 12:43:42
IDJOB=1779943
IDBENCH=70942
IDSOLVER=632
FILE ID=tipi45/1779943-1243680222
PBS_JOBID=
Free space on /tmp= 15500 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l37_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1779943-1243680222/watcher-1779943-1243680222 -o /tmp/evaluation-result-1779943-1243680222/solver-1779943-1243680222 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779943-1243680222.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 6c0fa36b77ee8403468509d27984ddf2
RANDOM SEED= 541628771

Linux tipi45 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2155416 kB
Buffers:         32064 kB
Cached:         633876 kB
SwapCached:       1892 kB
Active:         593220 kB
Inactive:       540116 kB
HighTotal:     2489216 kB
HighFree:      1404972 kB
LowTotal:       879316 kB
LowFree:        750444 kB
SwapTotal:     1959888 kB
SwapFree:      1953000 kB
Dirty:            5424 kB
Writeback:           0 kB
AnonPages:      466716 kB
Mapped:           6492 kB
Slab:            67532 kB
SReclaimable:    55760 kB
SUnreclaim:      11772 kB
PageTables:       1124 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   554772 kB
VmallocTotal:   114680 kB
VmallocUsed:     17900 kB
VmallocChunk:    96244 kB

Free space on /tmp at the end= 15500 MiB
End job on tipi45 at 2009-05-30 12:57:56