Trace number 3369506

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CryptoMiniSat Strange-Night-1-mt (fixed)? (TO) 4800.51 1211.62

General information on the benchmark

Nameindustrial/vliw_sat_4.0/
9vliw_m_9stages_iq3_C1_bug5.cnf
MD5SUMc77a56af24208a6401c763e11a38de01
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark6.82496
Satisfiable
(Un)Satisfiability was proved
Number of variables520770
Number of clauses13380350
Sum of the clauses size39210884
Maximum clause length6689
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 28710587
Number of clauses of size 34215482
Number of clauses of size 425225
Number of clauses of size 515593
Number of clauses of size over 5413462

Solver Data 

0.00/0.00	c Outputting solution to console
0.00/0.01	c Using 4 threads
0.00/0.01	c This is CryptoMiniSat 2.9.0
0.00/0.01	c compiled with gcc version 4.4.5
0.00/0.01	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.01	c Reading file 'HOME/instance-3369506-1305389267.cnf'
0.00/0.01	c -- header says num vars:         520770
0.00/0.01	c -- header says num clauses:    13380350
20.93/5.72	c -- clauses added:            0 learnts,     13380350 normals,            0 xors
20.93/5.72	c -- vars added     520770
20.93/5.72	c Parsing time: 16.67 s
20.93/5.72	c  N st     0         0    520770   4669762   8710587         0  39210883         0   no data   no data  --
22.92/6.22	c asymm  cl-useful: 2/118/4669758 lits-rem:5 time: 1.87
65.14/16.84	c Flit:     5 Blit:  17865 bXBeca:    0 bXProp:   10 Bins:      0 BRemL:      0 BRemN:      0 P: 200.5M T: 39.73
66.74/17.24	c Cleaning up after failed var search:     1.58 s 
73.52/18.93	c Replacing       10 vars Replaced   213772 lits Time:     6.68 s 
90.46/23.23	c bin-w-bin subsume rem          592 bins  time:  6.72 s
96.05/24.67	c subs with bin:      685  lits-rem:     14886  v-fix:    0  time:  5.74 s
137.56/35.03	c Subs w/ non-existent bins:      0 l-rem:      0 v-fix:     0 done:   3310 time: 41.22 s
139.92/35.62	c Removed useless bin:     425  fixed:     0  props:  20.01M  time:  2.34 s
1534.46/389.63	c lits-rem:       387  cl-subs:    15865  v-elim:  14643  v-fix:    0  time: 1305.36 s
1535.62/389.96	c Finding binary XORs  T:     1.28 s  found:      64
1538.74/390.74	c Replacing       64 vars Replaced    33709 lits Time:     2.99 s 
1541.51/391.47	c Calc default polars -  time:   1.21 s pos:   28520 undec:   32824 neg:  459426
1541.51/391.48	c =========================================================================================
1541.51/391.48	c types(t): F = full restart, N = normal restart
1541.51/391.48	c types(t): S = simplification begin/end, E = solution found
1541.51/391.48	c restart types(rt): st = static, dy = dynamic
1541.51/391.48	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits
1541.51/391.48	c  B st     0         0    488177   4657934   8336003         0  38907363         0   no data   no data  --
1601.68/407.35	c  N dy    10      4025    488177   4657934   8336185      3778  38907350    211162     17.11     18.60  --
1680.07/427.26	c  N dy    32      8205    485473   4657934   8338683      7697  38907349    376547     16.59     17.55  --
1751.59/445.42	c  N dy    59     12768    485470   4657934   8339312     12037  38907346    681892     17.21     18.18  --
1813.86/461.14	c  N dy    75     16785    485470   4657934   8339461     15830  38907334    815840     16.54     17.63  --
1876.02/477.28	c  N dy    98     21044    485469   4657934   8340090     10450  38907333    250209     16.59     17.49  --
1953.26/496.81	c  F st   132     25000    485468   4657934   8340586     14267  38907329    460596     17.34   no data  --
1968.51/500.70	c  N st   133     25250    485468   4652839   8296579     14491  38760952    468583     17.34   no data  --
2035.94/517.97	c  N dy   138     30000    485468   4652839   8296678     19086  38760945    711456     17.34   no data  --
2035.94/517.97	c  S st   138     30000    485468   4652839   8296678     19086  38760945    711456     17.34   no data  --
2047.29/520.80	c  S st   138     30500    485450   4652839   8296769     19474  38760945    717375     17.34   no data  --
2049.28/521.34	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   2.14
4131.49/1043.43	c Flit:   116 Blit:  25975 bXBeca:    0 bXProp:   55 Bins:  18450 BRemL:      1 BRemN:     51 P: 200.0M T: 2077.72
4133.08/1043.82	c Cleaning up after failed var search:     1.46 s 
4137.11/1044.82	c Replacing       57 vars Replaced   212257 lits Time:     3.86 s 
4148.63/1047.71	c bin-w-bin subsume rem         1299 bins  time:  4.90 s
4153.42/1048.99	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  5.12 s
4164.98/1051.81	c Subs w/ non-existent bins:      3 l-rem:   8052 v-fix:     0 done:   6251 time: 11.25 s
4166.59/1052.29	c Removed useless bin:     495  fixed:     0  props:  20.02M  time:  1.91 s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3369506-1305389267/watcher-3369506-1305389267 -o /tmp/evaluation-result-3369506-1305389267/solver-3369506-1305389267 -C 4800 -W 1300 -M 15500 ./strangenight1-mt --threads=4 HOME/instance-3369506-1305389267.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.54 6.18 4.64 6/320 12980
/proc/meminfo: memFree=26234596/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=51236 CPUtime=0 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 412 0 0 0 0 0 0 0 24 0 4 0 650526417 52465664 352 33554432000 4194304 4650419 140735028902816 18446744073709551615 47134450579378 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12980/statm: 12809 352 303 112 0 7774 0
[pid=12980/tid=12981] ppid=12978 vsize=51236 CPUtime=0 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 650526417 52465664 352 33554432000 4194304 4650419 140735028902816 18446744073709551615 47134450579378 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=51236 CPUtime=0 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650526417 52465664 352 33554432000 4194304 4650419 140735028902816 18446744073709551615 47134450579378 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=51236 CPUtime=0 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650526417 52465664 352 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272745457 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.071537 s]
/proc/loadavg: 6.54 6.18 4.64 6/320 12980
/proc/meminfo: memFree=26234596/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=367260 CPUtime=0.21 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) D 12978 12980 12865 0 -1 4202496 10769 0 0 0 16 5 0 0 18 0 4 0 650526417 376074240 9212 33554432000 4194304 4650419 140735028902816 18446744073709551615 4361571 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12980/statm: 92071 9067 344 112 0 87036 0
[pid=12980/tid=12981] ppid=12978 vsize=367256 CPUtime=0.05 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 2834 0 0 0 4 1 0 0 18 0 4 0 650526417 376070144 9070 33554432000 4194304 4650419 140735028902816 18446744073709551615 4354216 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=366740 CPUtime=0.04 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 2826 0 0 0 3 1 0 0 18 0 4 0 650526417 375541760 9350 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794143 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=366740 CPUtime=0.04 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) S 12978 12980 12865 0 -1 4202560 2606 0 0 0 3 1 0 0 18 0 4 0 650526417 375541760 9439 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 18446604471122444480 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 367260

[startup+0.103785 s]
/proc/loadavg: 6.54 6.18 4.64 6/320 12980
/proc/meminfo: memFree=26234596/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=371328 CPUtime=0.34 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 15067 0 0 0 25 9 0 0 18 0 4 0 650526417 380239872 12976 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12980/statm: 92832 13072 344 112 0 87797 0
[pid=12980/tid=12981] ppid=12978 vsize=371328 CPUtime=0.08 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 3881 0 0 0 6 2 0 0 18 0 4 0 650526417 380239872 13158 33554432000 4194304 4650419 140735028902816 18446744073709551615 4316635 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=371328 CPUtime=0.07 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 3876 0 0 0 5 2 0 0 18 0 4 0 650526417 380239872 13261 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794143 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=371328 CPUtime=0.08 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) S 12978 12980 12865 0 -1 4202560 3495 0 0 0 6 2 0 0 18 0 4 0 650526417 380239872 13307 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 18446604471122444480 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 371328

[startup+0.30548 s]
/proc/loadavg: 6.54 6.18 4.64 6/320 12980
/proc/meminfo: memFree=26234596/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=401748 CPUtime=1.08 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) S 12978 12980 12865 0 -1 4202496 38513 0 0 0 82 26 0 0 18 0 4 0 650526417 411389952 34177 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12980/statm: 100437 34198 344 112 0 95402 0
[pid=12980/tid=12981] ppid=12978 vsize=401748 CPUtime=0.27 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) S 12978 12980 12865 0 -1 4202560 9972 0 0 0 20 7 0 0 18 0 4 0 650526417 411389952 34209 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 18446604471122444480 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=401748 CPUtime=0.26 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 10073 0 0 0 19 7 0 0 18 0 4 0 650526417 411389952 34222 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272386497 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=401748 CPUtime=0.26 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) S 12978 12980 12865 0 -1 4202560 9020 0 0 0 20 6 0 0 18 0 4 0 650526417 411389952 34234 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 18446604471122444480 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1.08
Current children cumulated vsize (KiB) 401748

[startup+0.703551 s]
/proc/loadavg: 6.54 6.18 4.64 6/320 12980
/proc/meminfo: memFree=26234596/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=534440 CPUtime=2.56 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 80857 0 0 0 198 58 0 0 18 0 4 0 650526417 547266560 72101 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794143 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12980/statm: 133643 72290 344 112 0 128608 0
[pid=12980/tid=12981] ppid=12978 vsize=567392 CPUtime=0.64 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) S 12978 12980 12865 0 -1 4202560 21228 0 0 0 49 15 0 0 18 0 4 0 650526417 581009408 72370 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=567392 CPUtime=0.63 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 20060 0 0 0 49 14 0 0 18 0 4 0 650526417 581009408 72446 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794143 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=567392 CPUtime=0.64 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) S 12978 12980 12865 0 -1 4202560 19530 0 0 0 50 14 0 0 18 0 4 0 650526417 581009408 72475 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.56
Current children cumulated vsize (KiB) 534440

[startup+1.71923 s]
/proc/loadavg: 6.54 6.18 4.64 6/320 12980
/proc/meminfo: memFree=26234596/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=946124 CPUtime=6.34 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 184634 0 0 0 487 147 0 0 18 0 4 0 650526417 968830976 166927 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794143 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12980/statm: 236531 166929 344 112 0 231496 0
[pid=12980/tid=12981] ppid=12978 vsize=946124 CPUtime=1.59 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 47534 0 0 0 124 35 0 0 18 0 4 0 650526417 968830976 166930 33554432000 4194304 4650419 140735028902816 18446744073709551615 4307313 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=946124 CPUtime=1.57 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 46261 0 0 0 119 38 0 0 18 0 4 0 650526417 968830976 166931 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 18446604471122444480 0 0 -1 3 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=946124 CPUtime=1.58 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 45721 0 0 0 122 36 0 0 18 0 4 0 650526417 968830976 166935 33554432000 4194304 4650419 140735028902816 18446744073709551615 4545819 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.34
Current children cumulated vsize (KiB) 946124

[startup+3.11198 s]
/proc/loadavg: 6.66 6.21 4.66 9/324 12984
/proc/meminfo: memFree=25028344/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=1486540 CPUtime=11.62 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 347705 0 0 0 939 223 0 0 18 0 4 0 650526417 1522216960 312363 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794143 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12980/statm: 371635 312367 344 112 0 366600 0
[pid=12980/tid=12981] ppid=12978 vsize=1486540 CPUtime=2.93 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 88546 0 0 0 237 56 0 0 18 0 4 0 650526417 1522216960 312367 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272385803 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=1486540 CPUtime=2.89 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 87723 0 0 0 232 57 0 0 18 0 4 0 650526417 1522216960 312367 33554432000 4194304 4650419 140735028902816 18446744073709551615 4372348 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=1486540 CPUtime=2.88 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 84868 0 0 0 233 55 0 0 18 0 4 0 650526417 1522216960 312369 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272794094 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.62
Current children cumulated vsize (KiB) 1486540

[startup+6.30042 s]
/proc/loadavg: 6.68 6.22 4.67 9/324 12985
/proc/meminfo: memFree=23564776/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=3654828 CPUtime=23.33 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 724817 0 0 0 1926 407 0 0 18 0 4 0 650526417 3742543872 667836 33554432000 4194304 4650419 140735028902816 18446744073709551615 4515976 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/12980/statm: 913707 667844 369 112 0 908672 0
[pid=12980/tid=12981] ppid=12978 vsize=3622196 CPUtime=5.86 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 190053 0 0 0 482 104 0 0 18 0 4 0 650526417 3709128704 662070 33554432000 4194304 4650419 140735028902816 18446744073709551615 4515973 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=3622196 CPUtime=5.81 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 196096 0 0 0 477 104 0 0 18 0 4 0 650526417 3709128704 662078 33554432000 4194304 4650419 140735028902816 18446744073709551615 4514425 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=3622196 CPUtime=5.85 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 161500 0 0 0 485 100 0 0 18 0 4 0 650526417 3709128704 662086 33554432000 4194304 4650419 140735028902816 18446744073709551615 4229511 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 23.33
Current children cumulated vsize (KiB) 3654828

[startup+12.7003 s]
/proc/loadavg: 6.79 6.25 4.69 9/324 12985
/proc/meminfo: memFree=23487160/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=3293940 CPUtime=48.78 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 933453 0 0 0 4431 447 0 0 25 0 4 0 650526417 3372994560 681495 33554432000 4194304 4650419 140735028902816 18446744073709551615 4369075 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/12980/statm: 823485 681495 373 112 0 818450 0
[pid=12980/tid=12981] ppid=12978 vsize=3293940 CPUtime=12.23 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 248257 0 0 0 1108 115 0 0 25 0 4 0 650526417 3372994560 681495 33554432000 4194304 4650419 140735028902816 18446744073709551615 4370252 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=3293940 CPUtime=12.19 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 261769 0 0 0 1102 117 0 0 25 0 4 0 650526417 3372994560 681495 33554432000 4194304 4650419 140735028902816 18446744073709551615 4369060 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=3293940 CPUtime=12.21 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 163037 0 0 0 1121 100 0 0 25 0 4 0 650526417 3372994560 681495 33554432000 4194304 4650419 140735028902816 18446744073709551615 4364503 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 48.78
Current children cumulated vsize (KiB) 3293940

[startup+25.501 s]
/proc/loadavg: 6.97 6.31 4.72 9/324 12985
/proc/meminfo: memFree=21765800/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=5011220 CPUtime=99.64 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 1358265 0 0 0 9418 546 0 0 25 0 4 0 650526417 5131489280 1106144 33554432000 4194304 4650419 140735028902816 18446744073709551615 4447099 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/12980/statm: 1252805 1106144 386 112 0 1247770 0
[pid=12980/tid=12981] ppid=12978 vsize=5011220 CPUtime=24.96 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 389560 0 0 0 2357 139 0 0 25 0 4 0 650526417 5131489280 1106144 33554432000 4194304 4650419 140735028902816 18446744073709551615 4446420 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=5011220 CPUtime=24.92 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 403828 0 0 0 2337 155 0 0 25 0 4 0 650526417 5131489280 1106144 33554432000 4194304 4650419 140735028902816 18446744073709551615 4340039 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=5011220 CPUtime=24.99 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 164005 0 0 0 2398 101 0 0 25 0 4 0 650526417 5131489280 1106144 33554432000 4194304 4650419 140735028902816 18446744073709551615 4365337 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 99.64
Current children cumulated vsize (KiB) 5011220

[startup+51.1004 s]
/proc/loadavg: 7.43 6.48 4.83 9/324 12986
/proc/meminfo: memFree=21324936/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=5683664 CPUtime=201.37 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 1726637 0 0 0 19526 611 0 0 25 0 4 0 650526417 5820071936 1211923 33554432000 4194304 4650419 140735028902816 18446744073709551615 4432392 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12980/statm: 1420916 1211923 389 112 0 1415881 0
[pid=12980/tid=12981] ppid=12978 vsize=5683664 CPUtime=50.54 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 443542 0 0 0 4906 148 0 0 25 0 4 0 650526417 5820071936 1211923 33554432000 4194304 4650419 140735028902816 18446744073709551615 4432376 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=5683664 CPUtime=50.5 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 501821 0 0 0 4879 171 0 0 25 0 4 0 650526417 5820071936 1211923 33554432000 4194304 4650419 140735028902816 18446744073709551615 4432392 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=5683664 CPUtime=50.12 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 171157 0 0 0 4910 102 0 0 25 0 4 0 650526417 5820071936 1211923 33554432000 4194304 4650419 140735028902816 18446744073709551615 4311000 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 201.37
Current children cumulated vsize (KiB) 5683664

[startup+102.3 s]
/proc/loadavg: 7.83 6.73 5.00 9/324 12987
/proc/meminfo: memFree=21095120/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=5792164 CPUtime=400.73 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 5034862 0 0 0 38829 1244 0 0 25 0 4 0 650526417 5931175936 1258682 33554432000 4194304 4650419 140735028902816 18446744073709551615 4441871 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12980/statm: 1448041 1258682 652 112 0 1443006 0
[pid=12980/tid=12981] ppid=12978 vsize=5792164 CPUtime=101.72 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 2246643 0 0 0 9678 494 0 0 25 0 4 0 650526417 5931175936 1258682 33554432000 4194304 4650419 140735028902816 18446744073709551615 4476309 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=5792164 CPUtime=101.67 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 1970584 0 0 0 9717 450 0 0 25 0 4 0 650526417 5931175936 1258682 33554432000 4194304 4650419 140735028902816 18446744073709551615 4441871 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=5792164 CPUtime=95.95 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 171932 0 0 0 9491 104 0 0 25 0 4 0 650526417 5931175936 1258682 33554432000 4194304 4650419 140735028902816 18446744073709551615 4363496 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 400.73
Current children cumulated vsize (KiB) 5792164

[startup+162.301 s]

################
# More data... #
################

[pid=12980/tid=12981] ppid=12978 vsize=7620520 CPUtime=696.02 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14867753 0 0 0 66769 2833 0 0 25 0 4 0 650526417 7803412480 1675458 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230553 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=7620520 CPUtime=692.84 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 18055766 0 0 0 65810 3474 0 0 25 0 4 0 650526417 7803412480 1675458 33554432000 4194304 4650419 140735028902816 18446744073709551615 4236872 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=7620520 CPUtime=685.76 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14250124 0 0 0 66621 1955 0 0 25 0 4 0 650526417 7803412480 1675459 33554432000 4194304 4650419 140735028902816 18446744073709551615 4367329 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2770.54
Current children cumulated vsize (KiB) 7620520

[startup+762.301 s]
/proc/loadavg: 8.14 7.96 6.57 9/324 13005
/proc/meminfo: memFree=18898072/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=7817128 CPUtime=3009.94 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 59830059 0 0 0 290319 10675 0 0 25 0 4 0 650526417 8004739072 1716955 33554432000 4194304 4650419 140735028902816 18446744073709551615 4236868 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12980/statm: 1954282 1716955 882 112 0 1949247 0
[pid=12980/tid=12981] ppid=12978 vsize=7817128 CPUtime=756.03 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14874709 0 0 0 72769 2834 0 0 25 0 4 0 650526417 8004739072 1716955 33554432000 4194304 4650419 140735028902816 18446744073709551615 4236872 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=7817128 CPUtime=752.24 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 18062325 0 0 0 71749 3475 0 0 25 0 4 0 650526417 8004739072 1716955 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230556 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=7817128 CPUtime=745.76 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14422179 0 0 0 72606 1970 0 0 25 0 4 0 650526417 8004739072 1716955 33554432000 4194304 4650419 140735028902816 18446744073709551615 4363335 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3009.94
Current children cumulated vsize (KiB) 7817128

[startup+822.301 s]
/proc/loadavg: 8.11 7.98 6.66 9/324 13006
/proc/meminfo: memFree=18740708/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=7948200 CPUtime=3249.36 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 59873163 0 0 0 314255 10681 0 0 25 0 4 0 650526417 8138956800 1754191 33554432000 4194304 4650419 140735028902816 18446744073709551615 4236891 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12980/statm: 1987050 1754191 882 112 0 1982015 0
[pid=12980/tid=12981] ppid=12978 vsize=7948200 CPUtime=816.02 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14877960 0 0 0 78768 2834 0 0 25 0 4 0 650526417 8138956800 1754191 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230671 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=7948200 CPUtime=811.65 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 18070719 0 0 0 77689 3476 0 0 25 0 4 0 650526417 8138956800 1754191 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230566 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=7948200 CPUtime=805.77 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14446695 0 0 0 78603 1974 0 0 25 0 4 0 650526417 8138956800 1754191 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230802 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3249.36
Current children cumulated vsize (KiB) 7948200

[startup+882.3 s]
/proc/loadavg: 8.21 8.03 6.75 9/324 13008
/proc/meminfo: memFree=18634532/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=8013736 CPUtime=3488.76 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 59894954 0 0 0 338192 10684 0 0 25 0 4 0 650526417 8206065664 1758037 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230784 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12980/statm: 2003434 1758037 882 112 0 1998399 0
[pid=12980/tid=12981] ppid=12978 vsize=8013736 CPUtime=876.03 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14884150 0 0 0 84768 2835 0 0 25 0 4 0 650526417 8206065664 1758037 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230600 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=8013736 CPUtime=871.05 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 18075430 0 0 0 83628 3477 0 0 25 0 4 0 650526417 8206065664 1758037 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230791 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=8013736 CPUtime=865.77 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14454318 0 0 0 84602 1975 0 0 25 0 4 0 650526417 8206065664 1758037 33554432000 4194304 4650419 140735028902816 18446744073709551615 4231034 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3488.76
Current children cumulated vsize (KiB) 8013736

[startup+942.301 s]
/proc/loadavg: 8.15 8.04 6.84 9/324 13009
/proc/meminfo: memFree=18626548/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=8013736 CPUtime=3728.18 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 59909407 0 0 0 362132 10686 0 0 25 0 4 0 650526417 8206065664 1760293 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230706 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12980/statm: 2003434 1760293 882 112 0 1998399 0
[pid=12980/tid=12981] ppid=12978 vsize=8013736 CPUtime=936.02 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14888248 0 0 0 90767 2835 0 0 25 0 4 0 650526417 8206065664 1760293 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230573 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=8013736 CPUtime=930.47 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 18079749 0 0 0 89569 3478 0 0 25 0 4 0 650526417 8206065664 1760293 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230557 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=8013736 CPUtime=925.77 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14455233 0 0 0 90602 1975 0 0 25 0 4 0 650526417 8206065664 1760293 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230804 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3728.18
Current children cumulated vsize (KiB) 8013736

[startup+1002.3 s]
/proc/loadavg: 8.17 8.06 6.92 9/324 13011
/proc/meminfo: memFree=18562536/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=8013736 CPUtime=3967.59 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 59926792 0 0 0 386070 10689 0 0 25 0 4 0 650526417 8206065664 1764782 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230791 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12980/statm: 2003434 1764782 882 112 0 1998399 0
[pid=12980/tid=12981] ppid=12978 vsize=8013736 CPUtime=996.03 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14900150 0 0 0 96766 2837 0 0 25 0 4 0 650526417 8206065664 1764782 33554432000 4194304 4650419 140735028902816 18446744073709551615 4432392 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=8013736 CPUtime=989.87 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 18081012 0 0 0 95509 3478 0 0 25 0 4 0 650526417 8206065664 1764782 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230804 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=8013736 CPUtime=985.78 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14457495 0 0 0 96602 1976 0 0 25 0 4 0 650526417 8206065664 1764782 33554432000 4194304 4650419 140735028902816 18446744073709551615 4236868 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3967.59
Current children cumulated vsize (KiB) 8013736

[startup+1062.3 s]
/proc/loadavg: 8.22 8.09 7.00 9/324 13013
/proc/meminfo: memFree=18426648/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=8079272 CPUtime=4206.9 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 60234849 0 0 0 409961 10729 0 0 25 0 4 0 650526417 8273174528 1791146 33554432000 4194304 4650419 140735028902816 18446744073709551615 4432376 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/12980/statm: 2019818 1791146 883 112 0 2014783 0
[pid=12980/tid=12981] ppid=12978 vsize=8079272 CPUtime=1056.04 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14992027 0 0 0 102755 2849 0 0 25 0 4 0 650526417 8273174528 1791146 33554432000 4194304 4650419 140735028902816 18446744073709551615 4476519 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=8079272 CPUtime=1049.49 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 18083435 0 0 0 101471 3478 0 0 25 0 4 0 650526417 8273174528 1791146 33554432000 4194304 4650419 140735028902816 18446744073709551615 4370522 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=8079272 CPUtime=1045.77 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14459700 0 0 0 102601 1976 0 0 25 0 4 0 650526417 8273174528 1791146 33554432000 4194304 4650419 140735028902816 18446744073709551615 4236872 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4206.9
Current children cumulated vsize (KiB) 8079272

[startup+1122.3 s]
/proc/loadavg: 8.14 8.09 7.06 9/324 13045
/proc/meminfo: memFree=20379520/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=8134640 CPUtime=4445.86 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 63606055 0 0 0 433350 11236 0 0 25 0 4 0 650526417 8329871360 1803615 33554432000 4194304 4650419 140735028902816 18446744073709551615 4476519 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12980/statm: 2033660 1803632 1137 112 0 2028625 0
[pid=12980/tid=12981] ppid=12978 vsize=8134640 CPUtime=1116.03 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14998279 0 0 0 108750 2853 0 0 25 0 4 0 650526417 8329871360 1803640 33554432000 4194304 4650419 140735028902816 18446744073709551615 4476309 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=8134640 CPUtime=1109.39 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 20462900 0 0 0 107082 3857 0 0 25 0 4 0 650526417 8329871360 1803649 33554432000 4194304 4650419 140735028902816 18446744073709551615 4441897 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=8134640 CPUtime=1105.16 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14459742 0 0 0 108540 1976 0 0 25 0 4 0 650526417 8329871360 1803660 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230555 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4445.86
Current children cumulated vsize (KiB) 8134640

[startup+1182.31 s]
/proc/loadavg: 8.11 8.09 7.12 9/324 13047
/proc/meminfo: memFree=19817976/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=8200176 CPUtime=4684.67 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 74895572 0 0 0 455537 12930 0 0 25 0 4 0 650526417 8396980224 1816179 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272386375 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/12980/statm: 2050044 1816179 926 112 0 2045009 0
[pid=12980/tid=12981] ppid=12978 vsize=8200176 CPUtime=1176.04 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14998604 0 0 0 114751 2853 0 0 25 0 4 0 650526417 8396980224 1816179 33554432000 4194304 4650419 140735028902816 18446744073709551615 4440593 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=8200176 CPUtime=1168.88 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 31750359 0 0 0 111342 5546 0 0 25 0 4 0 650526417 8396980224 1816179 33554432000 4194304 4650419 140735028902816 18446744073709551615 4476175 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=8200176 CPUtime=1165.14 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14459742 0 0 0 114538 1976 0 0 25 0 4 0 650526417 8396980224 1816179 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230684 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4684.67
Current children cumulated vsize (KiB) 8200176



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1211.3 s]
/proc/loadavg: 8.06 8.08 7.15 9/324 13048
/proc/meminfo: memFree=19814124/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=8200176 CPUtime=4800.16 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4202496 79104849 0 0 0 466364 13652 0 0 25 0 4 0 650526417 8396980224 1812894 33554432000 4194304 4650419 140735028902816 18446744073709551615 4442096 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/12980/statm: 2050044 1812905 921 112 0 2045009 0
[pid=12980/tid=12981] ppid=12978 vsize=8200176 CPUtime=1205.04 cores=1,3,5,7
/proc/12980/task/12981/stat : 12981 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14998651 0 0 0 117651 2853 0 0 25 0 4 0 650526417 8396980224 1815612 33554432000 4194304 4650419 140735028902816 18446744073709551615 4440593 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12980/tid=12982] ppid=12978 vsize=8200176 CPUtime=1197.84 cores=1,3,5,7
/proc/12980/task/12982/stat : 12982 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 35962046 0 0 0 113516 6268 0 0 25 0 4 0 650526417 8396980224 1815627 33554432000 4194304 4650419 140735028902816 18446744073709551615 268272386497 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12980/tid=12983] ppid=12978 vsize=8200176 CPUtime=1193.93 cores=1,3,5,7
/proc/12980/task/12983/stat : 12983 (strangenight1-m) R 12978 12980 12865 0 -1 4202560 14459742 0 0 0 117417 1976 0 0 25 0 4 0 650526417 8396980224 1815640 33554432000 4194304 4650419 140735028902816 18446744073709551615 4230600 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 8200176

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1211.5 s]
/proc/loadavg: 8.06 8.08 7.15 9/324 13048
/proc/meminfo: memFree=19814124/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=0 CPUtime=4800.38 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4203524 79109208 0 0 0 466367 13671 0 0 25 0 1 0 650526417 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12980/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4800.38
Current children cumulated vsize (KiB) 0

[startup+1211.6 s]
/proc/loadavg: 8.06 8.08 7.15 9/324 13048
/proc/meminfo: memFree=19814124/32950928 swapFree=60199044/67111528
[pid=12980] ppid=12978 vsize=0 CPUtime=4800.48 cores=1,3,5,7
/proc/12980/stat : 12980 (strangenight1-m) R 12978 12980 12865 0 -1 4203524 79109208 0 0 0 466367 13681 0 0 25 0 1 0 650526417 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12980/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4800.48
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1211.62
CPU time (s): 4800.51
CPU user time (s): 4663.68
CPU system time (s): 136.829
CPU usage (%): 396.207
Max. virtual memory (cumulated for all children) (KiB): 8265712

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4663.68
system time used= 136.829
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 79109208
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 437995
involuntary context switches= 34789

runsolver used 3.57546 second user time and 9.07362 second system time

The end

Launcher Data 

Begin job on node122 at 2011-05-14 18:07:56
IDJOB=3369506
IDBENCH=20582
IDSOLVER=1846
FILE ID=node122/3369506-1305389267
RUNJOBID= node122-1305388863-12884
PBS_JOBID= 13324424
Free space on /tmp= 73116 MiB

SOLVER NAME= CryptoMiniSat Strange-Night-1-mt (fixed)
BENCH NAME= SAT07/industrial/vliw_sat_4.0/9vliw_m_9stages_iq3_C1_bug5.cnf
COMMAND LINE= ./strangenight1-mt --threads=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3369506-1305389267/watcher-3369506-1305389267 -o /tmp/evaluation-result-3369506-1305389267/solver-3369506-1305389267 -C 4800 -W 1300 -M 15500  ./strangenight1-mt --threads=4 HOME/instance-3369506-1305389267.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c77a56af24208a6401c763e11a38de01
RANDOM SEED=1882009949

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      26234876 kB
Buffers:        262868 kB
Cached:        3641848 kB
SwapCached:      50104 kB
Active:        2653224 kB
Inactive:      3839928 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      26234876 kB
SwapTotal:    67111528 kB
SwapFree:     60199044 kB
Dirty:          322064 kB
Writeback:           0 kB
AnonPages:     2549440 kB
Mapped:          14408 kB
Slab:           123216 kB
PageTables:      35140 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 54230140 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73124 MiB
End job on node122 at 2011-05-14 18:28:10