Trace number 1777426

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
gNovelty+-T 2009-03-22 (4 threads)? (TO) 3811.93 1000.04

General information on the benchmark

NameRANDOM/LARGE/3SAT/UNKNOWN/14000/
unif-k3-r4.2-v14000-c58800-S1339275181-076.cnf
MD5SUM0d3fcd560d811748824b45b279f18880
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables14000
Number of clauses58800
Sum of the clauses size176400
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 358800
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.42/0.47	c +------------------------------+
0.42/0.47	c | gNovelty+, version 1.0       |
0.42/0.47	c +------------------------------+
0.42/0.47	c gnovelty+ -h for help
0.42/0.47	c

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1777426-1243444505/watcher-1777426-1243444505 -o /tmp/evaluation-result-1777426-1243444505/solver-1777426-1243444505 -C 5000 -W 1000 -M 2047 HOME/gnovelty+ HOME/instance-1777426-1243444505.cnf 1009603685 4 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 3.46 3.77 4.06 3/115 3336
/proc/meminfo: memFree=3163704/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=509232 CPUtime=0.01
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 1191 0 0 0 1 0 0 0 18 0 1 0 1109130360 521453568 1149 4294967295 134512640 135680988 3216457408 3216456672 134537167 0 0 0 0 0 0 0 17 1 0 0 0
/proc/3336/statm: 127308 1157 99 286 0 127020 0

[startup+0.030634 s]
/proc/loadavg: 3.46 3.77 4.06 3/115 3336
/proc/meminfo: memFree=3163704/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=517048 CPUtime=0.04
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 9926 0 0 0 1 3 0 0 18 0 1 0 1109130360 529457152 9883 4294967295 134512640 135680988 3216457408 3216455516 134958286 0 0 0 0 0 0 0 17 1 0 0 0
/proc/3336/statm: 129262 9883 99 286 0 128974 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 517048

[startup+0.110649 s]
/proc/loadavg: 3.46 3.77 4.06 3/115 3336
/proc/meminfo: memFree=3163704/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=517048 CPUtime=0.12
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 10206 0 0 0 8 4 0 0 18 0 1 0 1109130360 529457152 10163 4294967295 134512640 135680988 3216457408 3216455516 134958286 0 0 0 0 0 0 0 17 1 0 0 0
/proc/3336/statm: 129262 10163 99 286 0 128974 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 517048

[startup+0.310622 s]
/proc/loadavg: 3.46 3.77 4.06 3/115 3336
/proc/meminfo: memFree=3163704/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=517044 CPUtime=0.32
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 20334 0 0 0 26 6 0 0 18 0 1 0 1109130360 529453056 20290 4294967295 134512640 135680988 3216457408 3216456672 134538748 0 0 0 0 0 0 0 17 1 0 0 0
/proc/3336/statm: 129261 20290 99 286 0 128973 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 517044

[startup+0.710613 s]
/proc/loadavg: 3.46 3.77 4.06 3/115 3336
/proc/meminfo: memFree=3163704/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=1.37
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 125 12 0 0 18 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 555376

[startup+1.51069 s]
/proc/loadavg: 3.46 3.77 4.06 5/119 3340
/proc/meminfo: memFree=3076092/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=4.54
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 401 53 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=1
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 92 8 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=1.02
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 85 17 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=1
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 91 9 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.54
Current children cumulated vsize (KiB) 555376

[startup+3.11055 s]
/proc/loadavg: 3.46 3.77 4.06 7/119 3340
/proc/meminfo: memFree=3075944/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=10.79
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 912 167 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=2.57
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 223 34 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=2.58
/proc/3336/task/3339/stat : 3339 (gnovelty+) S 3334 3336 24991 0 -1 4202560 465 0 0 0 210 48 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=2.59
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 228 31 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.79
Current children cumulated vsize (KiB) 555376

[startup+6.31041 s]
/proc/loadavg: 3.67 3.80 4.07 6/119 3340
/proc/meminfo: memFree=3075628/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=23.18
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 1915 403 0 0 16 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=5.6
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 457 103 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904364 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=5.74
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 463 111 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=5.71
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 487 84 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 23.18
Current children cumulated vsize (KiB) 555376

[startup+12.7102 s]
/proc/loadavg: 3.53 3.77 4.06 5/119 3340
/proc/meminfo: memFree=3075600/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=47.26
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 3812 914 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=11.65
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 934 231 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=12.03
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 958 245 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=11.57
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 956 201 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 47.26
Current children cumulated vsize (KiB) 555376

[startup+25.5097 s]
/proc/loadavg: 3.64 3.78 4.06 5/119 3342
/proc/meminfo: memFree=3075540/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=96.35
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 7637 1998 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957422 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=23.75
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 1888 487 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=24.35
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 1915 520 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=23.96
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 1924 472 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957422 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 96.35
Current children cumulated vsize (KiB) 555376

[startup+51.1085 s]
/proc/loadavg: 3.68 3.78 4.05 5/119 3345
/proc/meminfo: memFree=3075572/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=194.95
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 15069 4426 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=48.04
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 3714 1090 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=49.04
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 3797 1107 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=48.89
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 3798 1091 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 194.95
Current children cumulated vsize (KiB) 555376

[startup+102.316 s]
/proc/loadavg: 3.92 3.83 4.05 5/119 3553
/proc/meminfo: memFree=3074556/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=391.74
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 29934 9240 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=96.9
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 7400 2290 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=98.29
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 7482 2347 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=97.98
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 7567 2231 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 391.74
Current children cumulated vsize (KiB) 555376

[startup+162.314 s]
/proc/loadavg: 4.02 3.87 4.05 7/119 3753
/proc/meminfo: memFree=3074456/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=620.11
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 47326 14685 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=153.91
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 11733 3658 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=154.89
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 11822 3667 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=155.39
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 11959 3580 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 620.11
Current children cumulated vsize (KiB) 555376

[startup+222.311 s]
/proc/loadavg: 4.11 3.93 4.06 5/119 3944
/proc/meminfo: memFree=3074332/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=848.03
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 64149 20654 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456604 134957681 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=211.27
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 15972 5155 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=211.91
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 16063 5128 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=212.19
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 16129 5090 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 848.03
Current children cumulated vsize (KiB) 555376

[startup+282.309 s]
/proc/loadavg: 4.28 4.00 4.07 6/119 4133
/proc/meminfo: memFree=3074564/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=1075.47
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 80316 27231 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=267.48
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 19931 6817 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=269.36
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 20229 6707 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=3336] ppid=3334 vsize=555376 CPUtime=1534.09
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 113084 40325 0 0 16 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=381.79
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 28122 10057 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=384.18
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 28360 10058 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=382.81
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 28229 10052 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1534.09
Current children cumulated vsize (KiB) 555376

[startup+462.312 s]
/proc/loadavg: 3.86 3.97 4.05 6/119 4694
/proc/meminfo: memFree=3074828/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=1762.59
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 129239 47020 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=438.54
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 32052 11802 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=442.08
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 32449 11759 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=439.63
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 32332 11631 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957422 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1762.59
Current children cumulated vsize (KiB) 555376

[startup+522.309 s]
/proc/loadavg: 3.93 3.96 4.04 5/119 4887
/proc/meminfo: memFree=3074332/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=1990.8
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 145027 54053 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957422 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=495.85
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 35973 13612 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=499.09
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 36434 13475 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=496.95
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 36377 13318 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1990.8
Current children cumulated vsize (KiB) 555376

[startup+582.307 s]
/proc/loadavg: 4.12 4.01 4.05 5/119 5079
/proc/meminfo: memFree=3074440/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=2218.84
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 160987 60897 0 0 16 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=552.75
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 39915 15360 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=555.85
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 40419 15166 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=554.22
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 40417 15005 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2218.84
Current children cumulated vsize (KiB) 555376

[startup+642.305 s]
/proc/loadavg: 4.03 4.00 4.05 5/119 5266
/proc/meminfo: memFree=3074704/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=2446.98
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 176943 67755 0 0 16 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957422 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=609.89
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 43838 17151 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=613.02
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 44475 16827 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=610.64
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 44433 16631 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2446.98
Current children cumulated vsize (KiB) 555376

[startup+702.312 s]
/proc/loadavg: 3.93 3.97 4.03 5/119 5453
/proc/meminfo: memFree=3074820/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=2674.79
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 192608 74871 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=666.73
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 47749 18924 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=670.29
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 48473 18556 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=667.94
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 48397 18397 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2674.79
Current children cumulated vsize (KiB) 555376

[startup+762.32 s]
/proc/loadavg: 3.94 3.97 4.02 5/119 5640
/proc/meminfo: memFree=3074952/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=2903.74
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 208510 81864 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=723.74
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 51702 20672 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=727.48
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 52409 20339 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=725.46
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 52374 20172 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2903.74
Current children cumulated vsize (KiB) 555376

[startup+822.308 s]
/proc/loadavg: 4.01 3.99 4.02 5/119 5833
/proc/meminfo: memFree=3074952/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=3132.7
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 224812 88458 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456604 134957681 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=780.96
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 55724 22372 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=784.77
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 56496 21981 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374124 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=782.39
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 56399 21840 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3132.7
Current children cumulated vsize (KiB) 555376

[startup+882.315 s]
/proc/loadavg: 4.13 4.02 4.03 5/119 6022
/proc/meminfo: memFree=3074688/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=3361.75
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 241280 94895 0 0 16 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957681 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=837.89
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 59849 23940 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=841.9
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 60554 23636 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=839.84
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 60496 23488 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957422 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3361.75
Current children cumulated vsize (KiB) 555376

[startup+942.313 s]
/proc/loadavg: 4.14 4.04 4.03 6/119 6214
/proc/meminfo: memFree=3074456/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=3590.79
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 257598 101481 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456604 134957681 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=894.81
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 63855 25626 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=898.58
/proc/3336/task/3339/stat : 3339 (gnovelty+) R 3334 3336 24991 0 -1 4202560 465 0 0 0 64574 25284 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=897.84
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 64672 25112 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3590.79
Current children cumulated vsize (KiB) 555376



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 4.12 4.05 4.03 5/119 6400
/proc/meminfo: memFree=3074580/3368532 swapFree=1941392/1959888
[pid=3336] ppid=3334 vsize=555376 CPUtime=3811.86
/proc/3336/stat : 3336 (gnovelty+) R 3334 3336 24991 0 -1 4202496 22461 0 0 0 273493 107693 0 0 15 0 4 0 1109130360 568705024 22417 4294967295 134512640 135680988 3216457408 3216456652 134957422 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/3336/statm: 138844 22417 103 286 0 138556 0
[pid=3336/tid=3338] ppid=3334 vsize=555376 CPUtime=950.14
/proc/3336/task/3338/stat : 3338 (gnovelty+) R 3334 3336 24991 0 -1 4202560 452 0 0 0 67726 27288 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3074904412 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=3336/tid=3339] ppid=3334 vsize=555376 CPUtime=953.74
/proc/3336/task/3339/stat : 3339 (gnovelty+) S 3334 3336 24991 0 -1 4202560 465 0 0 0 68565 26809 0 0 15 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3063374172 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=3336/tid=3340] ppid=3334 vsize=555376 CPUtime=953.42
/proc/3336/task/3340/stat : 3340 (gnovelty+) R 3334 3336 24991 0 -1 4202560 466 0 0 0 68697 26645 0 0 16 0 4 0 1109130408 568705024 22417 4294967295 134512640 135680988 3216457408 3051843932 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3811.86
Current children cumulated vsize (KiB) 555376

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.04
CPU time (s): 3811.93
CPU user time (s): 2734.99
CPU system time (s): 1076.94
CPU usage (%): 381.179
Max. virtual memory (cumulated for all children) (KiB): 555376

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2734.99
system time used= 1076.94
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22461
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 50132909
involuntary context switches= 131080

runsolver used 0.02 second user time and 0.02 second system time

The end

Launcher Data 

Begin job on  at 2009-05-27 19:15:05
IDJOB=1777426
IDBENCH=70324
IDSOLVER=617
FILE ID=/1777426-1243444505
PBS_JOBID=
Free space on /tmp= 15729 MiB

SOLVER NAME= gNovelty+-T 2009-03-22 (4 threads)
BENCH NAME= SAT09/RANDOM/LARGE/3SAT/UNKNOWN/14000/unif-k3-r4.2-v14000-c58800-S1339275181-076.cnf
COMMAND LINE= HOME/gnovelty+ BENCHNAME RANDOMSEED MAXNBTHREAD
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1777426-1243444505/watcher-1777426-1243444505 -o /tmp/evaluation-result-1777426-1243444505/solver-1777426-1243444505 -C 5000 -W 1000 -M 2047  HOME/gnovelty+ HOME/instance-1777426-1243444505.cnf 1009603685 4

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 0d3fcd560d811748824b45b279f18880
RANDOM SEED= 1009603685

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3164148 kB
Buffers:         13032 kB
Cached:         119016 kB
SwapCached:       4320 kB
Active:         105952 kB
Inactive:        36484 kB
HighTotal:     2489216 kB
HighFree:      2357500 kB
LowTotal:       879316 kB
LowFree:        806648 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:            2596 kB
Writeback:           0 kB
AnonPages:        9444 kB
Mapped:           4352 kB
Slab:            51252 kB
SReclaimable:    42856 kB
SUnreclaim:       8396 kB
PageTables:        772 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127260 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15729 MiB
End job on  at 2009-05-27 19:31:48