Trace number 3369488

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CryptoMiniSat Strange-Night-1-mt (fixed)? (TO) 4800.37 1217.18

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/11pipe_k.cnf
MD5SUM932387240a0c17f4c88af52c4ca151c6
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark325.87
Satisfiable
(Un)Satisfiability was proved
Number of variables89315
Number of clauses5584003
Sum of the clauses size16593705
Maximum clause length295
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 25473787
Number of clauses of size 337063
Number of clauses of size 4514
Number of clauses of size 5453
Number of clauses of size over 572185

Solver Data 

0.00/0.03	c Outputting solution to console
0.00/0.03	c Using 4 threads
0.00/0.03	c This is CryptoMiniSat 2.9.0
0.00/0.03	c compiled with gcc version 4.4.5
0.00/0.03	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.03	c Reading file 'HOME/instance-3369488-1305433623.cnf'
0.00/0.03	c -- header says num vars:          89315
0.00/0.03	c -- header says num clauses:     5584003
2.24/1.69	c -- clauses added:            0 learnts,      5584003 normals,            0 xors
2.24/1.69	c -- vars added      89315
2.24/1.69	c Parsing time:  4.60 s
2.24/1.69	c  N st     0         0     89315    110215   5473787         0  16593704         0   no data   no data  --
2.24/34.48	c asymm  cl-useful: 13/13/110213 lits-rem:157 time: 4.35
2.24/34.48	c Flit:  1550 Blit:      0 bXBeca:    0 bXProp:   10 Bins:      0 BRemL:      0 BRemN:      0 P: 200.0M T: 22.38
2.24/34.48	c Cleaning up after failed var search:     0.22 s 
2.24/34.48	c Replacing       12 vars Replaced     1726 lits Time:     0.40 s 
2.24/34.48	c bin-w-bin subsume rem          695 bins  time:  1.36 s
2.24/34.48	c subs with bin:        0  lits-rem:        24  v-fix:    0  time:  4.47 s
2.24/34.48	c Subs w/ non-existent bins:      0 l-rem:     88 v-fix:     0 done:  85537 time:  3.80 s
2.24/34.48	c Removed useless bin:       0  fixed:     0  props:  20.00M  time:  0.85 s
526.32/146.12	c lits-rem:         0  cl-subs:    14342  v-elim:   7223  v-fix:    0  time: 480.84 s
526.72/146.22	c Finding binary XORs  T:     0.40 s  found:      32
527.52/146.45	c Replacing       32 vars Replaced      320 lits Time:     0.91 s 
529.12/146.88	c Finding non-binary XORs:     0.79 s (found:       0, avg size: nan)
529.12/146.88	c Calc default polars -  time:   0.41 s pos:    5345 undec:    8953 neg:   75017
529.12/146.88	c =========================================================================================
529.12/146.88	c types(t): F = full restart, N = normal restart
529.12/146.88	c types(t): S = simplification begin/end, E = solution found
529.12/146.88	c restart types(rt): st = static, dy = dynamic
529.12/146.88	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits
529.12/146.88	c  B st     0         0     80485     84758   5266837         0  14426441         0   no data   no data  --
540.68/149.75	c  N dy    12      4244     80485     84758   5266946      4110  14426441    577248     83.12     90.41  --
549.44/151.93	c  N dy    19      8878     80453     84758   5269226      8514  14426435   1520985     66.04     70.70  --
558.23/154.13	c  N dy    29     12900     80452     84758   5269408     12329  14426435   2000442     59.94     65.20  --
565.41/155.91	c  N dy    41     17159     80452     84758   5269627     16329  14426435   2527773     57.46     61.06  --
574.58/158.29	c  N dy    56     21386     80450     84758   5269954     10813  14426431    745504     55.10     60.00  --
581.37/159.92	c  F st    65     25001     80449     84758   5270070     14274  14426424   1416133     53.48     46.48  --
586.58/161.23	c  N st    67     25628     80447     84758   5265407     14870  14417015   1546691     53.48   no data  --
593.73/163.02	c  N dy    71     30004     80442     84758   5265715     19020  14417015   2336965     53.48   no data  --
593.73/163.02	c  S st    71     30004     80442     84758   5265715     19020  14417015   2336965     53.48   no data  --
598.92/164.39	c  S st    71     30505     80425     84758   5265886     19329  14417015   2349551     53.48   no data  --
599.74/164.57	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.69
2943.60/751.84	c Flit:  3692 Blit:     17 bXBeca:    0 bXProp:    5 Bins:  39704 BRemL:      1 BRemN:      0 P: 200.0M T: 2343.10
2944.01/751.93	c Cleaning up after failed var search:     0.33 s 
2944.42/752.10	c Replacing        6 vars Replaced     2843 lits Time:     0.64 s 
2948.81/753.14	c bin-w-bin subsume rem          265 bins  time:  2.71 s
2958.35/755.51	c subs with bin:        0  lits-rem:      1657  v-fix:    0  time:  9.46 s
2963.54/756.81	c Subs w/ non-existent bins:      1 l-rem:    591 v-fix:     0 done:  47819 time:  5.19 s
2965.96/757.46	c Removed useless bin:    7882  fixed:     0  props:  20.00M  time:  2.58 s
3014.25/769.58	c lits-rem:       287  cl-subs:     7041  v-elim:   2770  v-fix:    0  time: 48.23 s
3015.81/769.98	c asymm  cl-useful: 554/557/141866 lits-rem:28810 time: 1.58
3016.22/770.08	c  N dy    71     30505     73799    141862   4776618     12381  14398648   1161425     53.48   no data  --
3024.61/772.11	c Finding binary XORs  T:     0.21 s  found:      57
3025.00/772.26	c  N dy   103     34630     69584    137146   4204908     16315  12980247   1586074     56.52     59.99  --
3029.79/773.43	c  N dy   115     38761     69583    137146   4204982     20338  12980247   1978730     55.53     60.70  --
3034.98/774.79	c  N dy   132     43006     69583    137146   4205195     24469  12980243   2337776     54.82     57.97  --
3039.37/775.82	c  S st   142     45758     69583    137146   4205253     27120  12980242   2566948     54.32     42.13  --
3042.16/776.56	c  S st   142     46259     69581    137146   4205421     27440  12980242   2578646     54.32   no data  --
3042.56/776.66	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.40
3963.27/1007.39	c Flit:  1976 Blit:      8 bXBeca:    0 bXProp:    7 Bins:  14151 BRemL:     13 BRemN:      0 P: 200.0M T: 920.28
3963.67/1007.48	c Cleaning up after failed var search:     0.35 s 
3964.47/1007.65	c Replacing       64 vars Replaced    21549 lits Time:     0.64 s 
3968.06/1008.51	c bin-w-bin subsume rem         3906 bins  time:  2.10 s
3974.05/1010.08	c subs with bin:      138  lits-rem:      9229  v-fix:    0  time:  6.27 s
3977.24/1010.86	c Subs w/ non-existent bins:   1971 l-rem:  12819 v-fix:     0 done:  16163 time:  3.08 s
3980.05/1011.54	c Removed useless bin:    4361  fixed:     0  props:  20.00M  time:  1.75 s
4043.49/1027.41	c lits-rem:      2523  cl-subs:     2118  v-elim:    416  v-fix:    0  time: 63.23 s
4046.68/1028.25	c vivif2 --  cl tried    66383 cl shrink     7672 lits rem      58659 time: 3.36
4048.27/1028.65	c vivif2 --  cl tried    26386 cl shrink     7494 lits rem      50490 time: 1.56
4049.48/1028.99	c asymm  cl-useful: 388/391/158545 lits-rem:3678 time: 1.36
4050.71/1029.28	c calculated reachability. Time: 0.82
4050.71/1029.29	c  N dy   142     46259     67104    158545   3870011     26377  12162656   2411954     54.32   no data  --
4059.07/1031.35	c  N dy   151     50401     67104    158545   3870266     15826  12162650    980693     52.87     56.57  --
4064.64/1032.78	c  N dy   159     54534     65108    158545   3908113     19799  12162648   1432406     51.57     55.40  --
4071.02/1034.30	c  N dy   171     58537     65107    155653   3557181     23127  11340778   1769262     50.70     53.42  --
4078.60/1036.26	c  N dy   185     63736     65107    155653   3557299     28060  11340772   2179170     49.35     52.83  --
4084.99/1037.83	c  N dy   195     67886     65107    155653   3557916     32024  11340769   2509418     48.42     51.88  --
4087.38/1038.47	c  S st   199     69388     65107    155653   3557958     33441  11340769   2617191     48.06   no data  --
4093.77/1040.08	c Finding binary XORs  T:     2.33 s  found:      79
4093.77/1040.10	c  S st   199     69888     65097    155616   3555076     33754  11331982   2624836     48.06   no data  --
4094.18/1040.20	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.39
4094.18/1040.20	c Cache  BProp: 3 Set: 0 BXProp: 0 T: 0.02
4606.19/1168.47	c Flit:  2089 Blit:      2 bXBeca:    0 bXProp:   28 Bins:   5511 BRemL:     28 BRemN:      0 P: 200.0M T: 511.42
4606.60/1168.54	c Cleaning up after failed var search:     0.30 s 
4607.40/1168.73	c Replacing      107 vars Replaced    43681 lits Time:     0.71 s 
4610.19/1169.43	c bin-w-bin subsume rem         7743 bins  time:  1.64 s
4615.78/1170.87	c subs with bin:     1270  lits-rem:     37366  v-fix:    0  time:  5.71 s
4619.76/1171.84	c Subs w/ non-existent bins:    754 l-rem:   2534 v-fix:     0 done:  31346 time:  3.84 s
4620.98/1172.20	c Removed useless bin:    3723  fixed:     0  props:  20.00M  time:  1.31 s
4703.17/1192.70	c lits-rem:       173  cl-subs:     3086  v-elim:   1693  v-fix:    0  time: 81.60 s
4705.96/1193.43	c vivif2 --  cl tried    68377 cl shrink     1879 lits rem       4094 time: 2.89
4709.19/1194.24	c vivif2 --  cl tried    31799 cl shrink    10897 lits rem      42777 time: 3.21
4710.75/1194.66	c asymm  cl-useful: 588/588/155869 lits-rem:11953 time: 1.69
4712.35/1195.06	c calculated reachability. Time: 1.31
4712.35/1195.06	c  N dy   199     69888     61164    155869   3173394     31792  10236729   2380369     48.06   no data  --
4721.52/1197.41	c  N dy   207     74614     59348    141168   2923324     15268   9590420    981260     46.94     49.49  --
4729.51/1199.37	c  N dy   229     79431     59348    141168   2923554     19915   9590412   1398971     46.52     53.98  --
4737.09/1201.22	c  N dy   231     85118     59337    141168   2923869     25282   9590410   1678777     44.46     47.64  --
4739.92/1201.95	c  F st   233     87500     59337    141168   2923926     27553   9590406   1825513     43.97     40.67  --
4746.66/1203.60	c  N st   238     90796     59337    141138   2922749     30713   9587548   2143379     43.97   no data  --
4768.61/1209.10	c  N dy   245    104836     59337    141138   2923037     26248   9587547   1454095     41.92     18.27  --
4768.61/1209.10	c  S st   245    104836     59337    141138   2923037     26248   9587547   1454095     41.92     18.27  --
4772.20/1210.03	c  S st   245    105336     58929    141138   2925585     26607   9587544   1466037     41.92   no data  --
4772.60/1210.12	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.35
4772.60/1210.13	c Cache  BProp: 2 Set: 0 BXProp: 2 T: 0.05

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3369488-1305433623/watcher-3369488-1305433623 -o /tmp/evaluation-result-3369488-1305433623/solver-3369488-1305433623 -C 4800 -W 1300 -M 15500 ./strangenight1-mt --threads=4 HOME/instance-3369488-1305433623.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.45 4.04 5.03 1/278 14213
/proc/meminfo: memFree=18651440/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=11796 CPUtime=0 cores=1,3,5,7
/proc/14213/stat : 14213 (runsolver) S 14211 14213 14183 0 -1 4202560 41 0 0 0 0 0 0 0 21 0 1 0 654961993 12079104 49 33554432000 4194304 5432360 140736258107456 18446744073709551615 4881623 0 2147483391 4096 24578 18446744071699870519 0 0 17 5 0 0 0
/proc/14213/statm: 2949 49 30 303 0 2643 0

[startup+0.089296 s]
/proc/loadavg: 3.45 4.04 5.03 1/278 14213
/proc/meminfo: memFree=18651440/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=287364 CPUtime=0.17 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 7184 0 0 0 13 4 0 0 18 0 4 0 654961993 294260736 6946 33554432000 4194304 4650419 140733317408464 18446744073709551615 4373787 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14213/statm: 71841 6957 343 112 0 66806 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 287364

[startup+0.105071 s]
/proc/loadavg: 3.45 4.04 5.03 1/278 14213
/proc/meminfo: memFree=18651440/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=290564 CPUtime=0.23 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 8899 0 0 0 18 5 0 0 18 0 4 0 654961993 297537536 8398 33554432000 4194304 4650419 140733317408464 18446744073709551615 4305933 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14213/statm: 72641 8422 343 112 0 67606 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 290564

[startup+0.300801 s]
/proc/loadavg: 3.45 4.04 5.03 1/278 14213
/proc/meminfo: memFree=18651440/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=309368 CPUtime=0.87 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 27302 0 0 0 66 21 0 0 18 0 4 0 654961993 316792832 26248 33554432000 4194304 4650419 140733317408464 18446744073709551615 274664851639 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14213/statm: 77342 26289 344 112 0 72307 0
Current children cumulated CPU time (s) 0.87
Current children cumulated vsize (KiB) 309368

[startup+0.700732 s]
/proc/loadavg: 3.45 4.04 5.03 1/278 14213
/proc/meminfo: memFree=18651440/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=483872 CPUtime=2.24 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 66541 0 0 0 175 49 0 0 18 0 4 0 654961993 495484928 64380 33554432000 4194304 4650419 140733317408464 18446744073709551615 274664913439 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14213/statm: 120968 64380 344 112 0 115933 0
Current children cumulated CPU time (s) 2.24
Current children cumulated vsize (KiB) 483872

[startup+34.5879 s]
/proc/loadavg: 3.45 4.04 5.03 1/278 14213
/proc/meminfo: memFree=18651440/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1387136 CPUtime=108.79 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 295707 0 0 0 10731 148 0 0 25 0 4 0 654961993 1420427264 269437 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 346784 269437 390 112 0 341749 0
Current children cumulated CPU time (s) 108.79
Current children cumulated vsize (KiB) 1387136

[startup+34.6009 s]
/proc/loadavg: 3.45 4.04 5.03 1/278 14213
/proc/meminfo: memFree=18651440/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1387136 CPUtime=108.83 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 295710 0 0 0 10735 148 0 0 25 0 4 0 654961993 1420427264 269440 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 346784 269440 390 112 0 341749 0
Current children cumulated CPU time (s) 108.83
Current children cumulated vsize (KiB) 1387136

[startup+34.7009 s]
/proc/loadavg: 8.74 5.28 5.41 12/289 14227
/proc/meminfo: memFree=16245132/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1387136 CPUtime=109.15 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 295720 0 0 0 10767 148 0 0 25 0 4 0 654961993 1420427264 269450 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 346784 269450 390 112 0 341749 0
[pid=14213/tid=14215] ppid=14211 vsize=1387136 CPUtime=32.44 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 82131 0 0 0 3207 37 0 0 25 0 4 0 654961997 1420427264 269450 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433081 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=1387136 CPUtime=20.56 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 81230 0 0 0 2025 31 0 0 25 0 4 0 654961997 1420427264 269450 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=1387136 CPUtime=21.79 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 50491 0 0 0 2145 34 0 0 25 0 4 0 654961997 1420427264 269450 33554432000 4194304 4650419 140733317408464 18446744073709551615 4363420 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 109.15
Current children cumulated vsize (KiB) 1387136

[startup+34.8118 s]
/proc/loadavg: 8.74 5.28 5.41 12/289 14227
/proc/meminfo: memFree=16245132/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1387136 CPUtime=109.46 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 295732 0 0 0 10798 148 0 0 25 0 4 0 654961993 1420427264 269462 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433084 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 346784 269462 390 112 0 341749 0
[pid=14213/tid=14215] ppid=14211 vsize=1387136 CPUtime=32.54 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 82131 0 0 0 3217 37 0 0 25 0 4 0 654961997 1420427264 269462 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433081 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=1387136 CPUtime=20.59 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 81230 0 0 0 2028 31 0 0 25 0 4 0 654961997 1420427264 269462 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433081 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=1387136 CPUtime=21.86 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 50503 0 0 0 2152 34 0 0 25 0 4 0 654961997 1420427264 269462 33554432000 4194304 4650419 140733317408464 18446744073709551615 4304205 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 109.46
Current children cumulated vsize (KiB) 1387136

[startup+34.9008 s]
/proc/loadavg: 8.74 5.28 5.41 12/289 14227
/proc/meminfo: memFree=16245132/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1387136 CPUtime=109.72 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 295737 0 0 0 10824 148 0 0 25 0 4 0 654961993 1420427264 269467 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433084 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 346784 269467 390 112 0 341749 0
[pid=14213/tid=14215] ppid=14211 vsize=1387136 CPUtime=32.63 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 82131 0 0 0 3226 37 0 0 25 0 4 0 654961997 1420427264 269467 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433074 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=1387136 CPUtime=20.65 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 81230 0 0 0 2034 31 0 0 25 0 4 0 654961997 1420427264 269467 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=1387136 CPUtime=21.89 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 50508 0 0 0 2155 34 0 0 25 0 4 0 654961997 1420427264 269467 33554432000 4194304 4650419 140733317408464 18446744073709551615 4365062 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 109.72
Current children cumulated vsize (KiB) 1387136

[startup+51.101 s]
/proc/loadavg: 9.83 5.69 5.54 12/289 14228
/proc/meminfo: memFree=16185604/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1461428 CPUtime=158.16 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 304978 0 0 0 15664 152 0 0 25 0 4 0 654961993 1496502272 278472 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 365357 278472 391 112 0 360322 0
[pid=14213/tid=14215] ppid=14211 vsize=1461428 CPUtime=48.68 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 85520 0 0 0 4829 39 0 0 25 0 4 0 654961997 1496502272 278472 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=1461428 CPUtime=28.79 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 81230 0 0 0 2848 31 0 0 25 0 4 0 654961997 1496502272 278472 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=1461428 CPUtime=29.95 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 53581 0 0 0 2959 36 0 0 25 0 4 0 654961997 1496502272 278472 33554432000 4194304 4650419 140733317408464 18446744073709551615 4363762 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 158.16
Current children cumulated vsize (KiB) 1461428

[startup+102.301 s]
/proc/loadavg: 9.32 6.22 5.73 9/289 14229
/proc/meminfo: memFree=15032324/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1907184 CPUtime=351.58 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 432360 0 0 0 34966 192 0 0 25 0 4 0 654961993 1952956416 393794 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 476796 393794 392 112 0 471761 0
[pid=14213/tid=14215] ppid=14211 vsize=1907184 CPUtime=99.37 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 85554 0 0 0 9898 39 0 0 25 0 4 0 654961997 1952956416 393794 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=1907184 CPUtime=74.48 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 84267 0 0 0 7414 34 0 0 25 0 4 0 654961997 1952956416 393794 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=1907184 CPUtime=75.84 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 177752 0 0 0 7512 72 0 0 25 0 4 0 654961997 1952956416 393794 33554432000 4194304 4650419 140733317408464 18446744073709551615 4303382 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 351.58
Current children cumulated vsize (KiB) 1907184

[startup+162.301 s]
/proc/loadavg: 8.48 6.54 5.87 9/289 14231
/proc/meminfo: memFree=14831592/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1903092 CPUtime=590.96 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 492098 0 0 0 58889 207 0 0 25 0 4 0 654961993 1948766208 401824 33554432000 4194304 4650419 140733317408464 18446744073709551615 4520364 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 475773 401824 395 112 0 470738 0
[pid=14213/tid=14215] ppid=14211 vsize=1903092 CPUtime=158.78 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 109332 0 0 0 15833 45 0 0 25 0 4 0 654961997 1948766208 401828 33554432000 4194304 4650419 140733317408464 18446744073709551615 4368084 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=1903092 CPUtime=134.48 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 87113 0 0 0 13413 35 0 0 25 0 4 0 654961997 1948766208 401828 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432392 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=1903092 CPUtime=135.85 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 181160 0 0 0 13512 73 0 0 25 0 4 0 654961997 1948766208 401828 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433081 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 590.96
Current children cumulated vsize (KiB) 1903092

[startup+222.3 s]
/proc/loadavg: 8.24 6.82 6.00 9/289 14232
/proc/meminfo: memFree=14779992/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1901760 CPUtime=830.37 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 664647 0 0 0 82801 236 0 0 25 0 4 0 654961993 1947402240 404750 33554432000 4194304 4650419 140733317408464 18446744073709551615 4231007 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 475440 404750 395 112 0 470405 0
[pid=14213/tid=14215] ppid=14211 vsize=1901760 CPUtime=218.22 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 125676 0 0 0 21773 49 0 0 25 0 4 0 654961997 1947402240 404750 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230798 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=1901760 CPUtime=194.46 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 189549 0 0 0 19393 53 0 0 25 0 4 0 654961997 1947402240 404750 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230546 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=1901760 CPUtime=195.83 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 226409 0 0 0 19505 78 0 0 25 0 4 0 654961997 1947402240 404750 33554432000 4194304 4650419 140733317408464 18446744073709551615 4370340 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 830.37
Current children cumulated vsize (KiB) 1901760

[startup+282.311 s]
/proc/loadavg: 8.09 7.03 6.13 9/289 14234
/proc/meminfo: memFree=14743032/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1904540 CPUtime=1069.87 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 703434 0 0 0 106745 242 0 0 25 0 4 0 654961993 1950248960 408443 33554432000 4194304 4650419 140733317408464 18446744073709551615 4236872 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 476135 408443 395 112 0 471100 0
[pid=14213/tid=14215] ppid=14211 vsize=1904540 CPUtime=277.68 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 130780 0 0 0 27718 50 0 0 25 0 4 0 654961997 1950248960 408443 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230706 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=1904540 CPUtime=254.47 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 195504 0 0 0 25393 54 0 0 25 0 4 0 654961997 1950248960 408443 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230556 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=1904540 CPUtime=255.85 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 249803 0 0 0 25503 82 0 0 25 0 4 0 654961997 1950248960 408443 33554432000 4194304 4650419 140733317408464 18446744073709551615 4231031 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1069.87

################
# More data... #
################


[startup+702.3 s]
/proc/loadavg: 8.06 7.84 6.84 9/289 14245
/proc/meminfo: memFree=13506560/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=1911228 CPUtime=2746.03 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 844248 0 0 0 274342 261 0 0 25 0 4 0 654961993 1957097472 420440 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230798 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 477807 420440 395 112 0 472772 0
[pid=14213/tid=14215] ppid=14211 vsize=1911228 CPUtime=693.87 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 156026 0 0 0 69334 53 0 0 25 0 4 0 654961997 1957097472 420440 33554432000 4194304 4650419 140733317408464 18446744073709551615 4236891 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=1911228 CPUtime=674.47 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 226385 0 0 0 67390 57 0 0 25 0 4 0 654961997 1957097472 420440 33554432000 4194304 4650419 140733317408464 18446744073709551615 4231007 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=1911228 CPUtime=675.85 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 298518 0 0 0 67495 90 0 0 25 0 4 0 654961997 1957097472 420440 33554432000 4194304 4650419 140733317408464 18446744073709551615 4231019 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2746.03
Current children cumulated vsize (KiB) 1911228

[startup+762.301 s]
/proc/loadavg: 8.09 7.89 6.92 9/289 14247
/proc/meminfo: memFree=13189724/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=2232216 CPUtime=2985.5 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 940378 0 0 0 298266 284 0 0 25 0 4 0 654961993 2285789184 472717 33554432000 4194304 4650419 140733317408464 18446744073709551615 4432396 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 558054 472717 395 112 0 553019 0
[pid=14213/tid=14215] ppid=14211 vsize=2232216 CPUtime=753.33 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 182235 0 0 0 75273 60 0 0 25 0 4 0 654961997 2285789184 472717 33554432000 4194304 4650419 140733317408464 18446744073709551615 4364883 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=2232216 CPUtime=734.47 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 264893 0 0 0 73379 68 0 0 25 0 4 0 654961997 2285789184 472717 33554432000 4194304 4650419 140733317408464 18446744073709551615 4363750 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=2232216 CPUtime=735.85 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 307360 0 0 0 73494 91 0 0 25 0 4 0 654961997 2285789184 472717 33554432000 4194304 4650419 140733317408464 18446744073709551615 4231034 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2985.5
Current children cumulated vsize (KiB) 2232216

[startup+822.3 s]
/proc/loadavg: 8.07 7.92 6.99 9/289 14248
/proc/meminfo: memFree=12801352/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=2573772 CPUtime=3224.97 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 1142473 0 0 0 322180 317 0 0 25 0 4 0 654961993 2635542528 552043 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230555 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 643443 552043 395 112 0 638408 0
[pid=14213/tid=14215] ppid=14211 vsize=2573772 CPUtime=812.79 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 194592 0 0 0 81216 63 0 0 25 0 4 0 654961997 2635542528 552043 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230566 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=2573772 CPUtime=794.48 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 272177 0 0 0 79378 70 0 0 25 0 4 0 654961997 2635542528 552043 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230556 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=2573772 CPUtime=795.86 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 466476 0 0 0 79471 115 0 0 25 0 4 0 654961997 2635542528 552043 33554432000 4194304 4650419 140733317408464 18446744073709551615 4328474 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3224.97
Current children cumulated vsize (KiB) 2573772

[startup+882.301 s]
/proc/loadavg: 8.13 7.96 7.06 9/289 14250
/proc/meminfo: memFree=12729056/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=2579312 CPUtime=3464.4 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 1191467 0 0 0 346115 325 0 0 25 0 4 0 654961993 2641215488 561137 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230580 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 644828 561137 395 112 0 639793 0
[pid=14213/tid=14215] ppid=14211 vsize=2579312 CPUtime=872.23 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 201979 0 0 0 87160 63 0 0 25 0 4 0 654961997 2641215488 561137 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230795 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=2579312 CPUtime=854.47 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 281139 0 0 0 85375 72 0 0 25 0 4 0 654961997 2641215488 561137 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230555 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=2579312 CPUtime=855.85 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 487904 0 0 0 85466 119 0 0 25 0 4 0 654961997 2641215488 561137 33554432000 4194304 4650419 140733317408464 18446744073709551615 4236872 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3464.4
Current children cumulated vsize (KiB) 2579312

[startup+942.311 s]
/proc/loadavg: 8.19 8.00 7.13 9/289 14251
/proc/meminfo: memFree=12637904/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=2658372 CPUtime=3703.9 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 1236752 0 0 0 370060 330 0 0 25 0 4 0 654961993 2722172928 571237 33554432000 4194304 4650419 140733317408464 18446744073709551615 4231034 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 664593 571237 395 112 0 659558 0
[pid=14213/tid=14215] ppid=14211 vsize=2658372 CPUtime=931.7 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 215658 0 0 0 93105 65 0 0 25 0 4 0 654961997 2722172928 571237 33554432000 4194304 4650419 140733317408464 18446744073709551615 4231031 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=2658372 CPUtime=914.49 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 293471 0 0 0 91375 74 0 0 25 0 4 0 654961997 2722172928 571237 33554432000 4194304 4650419 140733317408464 18446744073709551615 4231019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=2658372 CPUtime=915.86 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 495942 0 0 0 91466 120 0 0 25 0 4 0 654961997 2722172928 571237 33554432000 4194304 4650419 140733317408464 18446744073709551615 4236872 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3703.9
Current children cumulated vsize (KiB) 2658372

[startup+1002.3 s]
/proc/loadavg: 8.21 8.03 7.19 9/289 14253
/proc/meminfo: memFree=12359144/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=3130348 CPUtime=3943.32 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 1353912 0 0 0 393983 349 0 0 25 0 4 0 654961993 3205476352 650447 33554432000 4194304 4650419 140733317408464 18446744073709551615 4371011 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 782587 650447 395 112 0 777552 0
[pid=14213/tid=14215] ppid=14211 vsize=3130348 CPUtime=991.15 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 230644 0 0 0 99048 67 0 0 25 0 4 0 654961997 3205476352 650447 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230589 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=3130348 CPUtime=974.48 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 309699 0 0 0 97372 76 0 0 25 0 4 0 654961997 3205476352 650447 33554432000 4194304 4650419 140733317408464 18446744073709551615 4231031 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=3130348 CPUtime=975.85 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 538562 0 0 0 97458 127 0 0 25 0 4 0 654961997 3205476352 650447 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433087 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3943.32
Current children cumulated vsize (KiB) 3130348

[startup+1062.3 s]
/proc/loadavg: 8.21 8.06 7.25 9/289 14255
/proc/meminfo: memFree=11428256/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=3608360 CPUtime=4182.75 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 1617867 0 0 0 417873 402 0 0 25 0 4 0 654961993 3694960640 775523 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230566 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 902090 775523 395 112 0 897055 0
[pid=14213/tid=14215] ppid=14211 vsize=3608360 CPUtime=1050.6 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 342030 0 0 0 104969 91 0 0 25 0 4 0 654961997 3694960640 775523 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230555 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=3608360 CPUtime=1034.47 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 375923 0 0 0 103363 84 0 0 25 0 4 0 654961997 3694960640 775523 33554432000 4194304 4650419 140733317408464 18446744073709551615 4364883 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=3608360 CPUtime=1035.86 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 573407 0 0 0 103450 136 0 0 25 0 4 0 654961997 3694960640 775523 33554432000 4194304 4650419 140733317408464 18446744073709551615 4363350 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4182.75
Current children cumulated vsize (KiB) 3608360

[startup+1122.3 s]
/proc/loadavg: 8.19 8.08 7.30 9/289 14256
/proc/meminfo: memFree=11379272/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=3611388 CPUtime=4422.22 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 1669866 0 0 0 441809 413 0 0 25 0 4 0 654961993 3698061312 780133 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230684 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 902847 780133 395 112 0 897812 0
[pid=14213/tid=14215] ppid=14211 vsize=3611388 CPUtime=1110.06 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 350246 0 0 0 110914 92 0 0 25 0 4 0 654961997 3698061312 780133 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230586 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=3611388 CPUtime=1094.48 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 396220 0 0 0 109359 89 0 0 25 0 4 0 654961997 3698061312 780133 33554432000 4194304 4650419 140733317408464 18446744073709551615 4236879 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=3611388 CPUtime=1095.86 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 593346 0 0 0 109446 140 0 0 25 0 4 0 654961997 3698061312 780133 33554432000 4194304 4650419 140733317408464 18446744073709551615 4328424 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4422.22
Current children cumulated vsize (KiB) 3611388

[startup+1182.3 s]
/proc/loadavg: 8.18 8.09 7.35 9/289 14258
/proc/meminfo: memFree=10670476/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=4524372 CPUtime=4661.66 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 1877207 0 0 0 465709 457 0 0 25 0 4 0 654961993 4632956928 950906 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433048 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 1131093 950906 395 112 0 1126058 0
[pid=14213/tid=14215] ppid=14211 vsize=4524372 CPUtime=1169.51 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 409793 0 0 0 116848 103 0 0 25 0 4 0 654961997 4632956928 950906 33554432000 4194304 4650419 140733317408464 18446744073709551615 4420830 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=4524372 CPUtime=1154.47 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 453302 0 0 0 115344 103 0 0 25 0 4 0 654961997 4632956928 950906 33554432000 4194304 4650419 140733317408464 18446744073709551615 4436464 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=4524372 CPUtime=1155.86 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 612821 0 0 0 115441 145 0 0 25 0 4 0 654961997 4632956928 950906 33554432000 4194304 4650419 140733317408464 18446744073709551615 4364984 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4661.66
Current children cumulated vsize (KiB) 4524372



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1217 s]
/proc/loadavg: 7.49 7.95 7.33 5/280 14277
/proc/meminfo: memFree=14630332/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=4892404 CPUtime=4800.16 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) R 14211 14213 14183 0 -1 4202496 2035359 0 0 0 479522 494 0 0 25 0 4 0 654961993 5009821696 1015125 33554432000 4194304 4650419 140733317408464 18446744073709551615 4230798 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 1223101 1015125 395 112 0 1218066 0
[pid=14213/tid=14215] ppid=14211 vsize=4892404 CPUtime=1203.9 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 428408 0 0 0 120281 109 0 0 25 0 4 0 654961997 5009821696 1015125 33554432000 4194304 4650419 140733317408464 18446744073709551615 4365330 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14213/tid=14216] ppid=14211 vsize=4892404 CPUtime=1189.18 cores=1,3,5,7
/proc/14213/task/14216/stat : 14216 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 470496 0 0 0 118810 108 0 0 25 0 4 0 654961997 5009821696 1015125 33554432000 4194304 4650419 140733317408464 18446744073709551615 4363709 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14213/tid=14217] ppid=14211 vsize=4892404 CPUtime=1190.57 cores=1,3,5,7
/proc/14213/task/14217/stat : 14217 (strangenight1-m) R 14211 14213 14183 0 -1 4202560 657367 0 0 0 118898 159 0 0 25 0 4 0 654961997 5009821696 1015125 33554432000 4194304 4650419 140733317408464 18446744073709551615 4433093 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 4892404

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1217.12 s]
/proc/loadavg: 7.49 7.95 7.33 5/280 14277
/proc/meminfo: memFree=14630332/32951132 swapFree=67093824/67111528
[pid=14213] ppid=14211 vsize=0 CPUtime=4800.29 cores=1,3,5,7
/proc/14213/stat : 14213 (strangenight1-m) Z 14211 14213 14183 0 -1 4203548 2035361 0 0 0 479525 504 0 0 25 0 2 0 654961993 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/14213/statm: 0 0 0 0 0 0 0
[pid=14213/tid=14215] ppid=14211 vsize=0 CPUtime=1204.01 cores=1,3,5,7
/proc/14213/task/14215/stat : 14215 (strangenight1-m) R 14211 14213 14183 0 -1 4203588 428410 0 0 0 120282 119 0 0 25 0 2 0 654961997 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1217.18
CPU time (s): 4800.37
CPU user time (s): 4795.26
CPU system time (s): 5.11122
CPU usage (%): 394.385
Max. virtual memory (cumulated for all children) (KiB): 4892404

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.26
system time used= 5.11122
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2035361
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 77841
involuntary context switches= 21826

runsolver used 2.92755 second user time and 7.95979 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-15 06:27:03
IDJOB=3369488
IDBENCH=88167
IDSOLVER=1846
FILE ID=node131/3369488-1305433623
RUNJOBID= node131-1305433623-14202
PBS_JOBID= 13324635
Free space on /tmp= 73556 MiB

SOLVER NAME= CryptoMiniSat Strange-Night-1-mt (fixed)
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/11pipe_k.cnf
COMMAND LINE= ./strangenight1-mt --threads=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3369488-1305433623/watcher-3369488-1305433623 -o /tmp/evaluation-result-3369488-1305433623/solver-3369488-1305433623 -C 4800 -W 1300 -M 15500  ./strangenight1-mt --threads=4 HOME/instance-3369488-1305433623.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 932387240a0c17f4c88af52c4ca151c6
RANDOM SEED=546044410

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      18654400 kB
Buffers:        281436 kB
Cached:        4034056 kB
SwapCached:       1504 kB
Active:       10818024 kB
Inactive:      3214596 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      18654400 kB
SwapTotal:    67111528 kB
SwapFree:     67093824 kB
Dirty:          174668 kB
Writeback:           0 kB
AnonPages:     9715788 kB
Mapped:          26148 kB
Slab:           169044 kB
PageTables:      31080 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 27988820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73604 MiB
End job on node131 at 2011-05-15 06:47:23