Trace number 3281374

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CryptoMiniSat TechDemo-Alpha-mt? (TO) 4800.54 1216.25

General information on the benchmark

Nameindustrial/vliw_sat_4.0/
9vliw_m_9stages_iq3_C1_bug5.cnf
MD5SUMc77a56af24208a6401c763e11a38de01
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark6.82496
Satisfiable
(Un)Satisfiability was proved
Number of variables520770
Number of clauses13380350
Sum of the clauses size39210884
Maximum clause length6689
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 28710587
Number of clauses of size 34215482
Number of clauses of size 425225
Number of clauses of size 515593
Number of clauses of size over 5413462

Solver Data 

0.00/0.00	c Outputting solution to console
0.00/0.00	c This is CryptoMiniSat 2.9.0
0.00/0.00	c compiled with gcc version 4.4.5
0.00/0.00	c Using 4 thread(s)
0.00/0.00	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.00	c Reading file 'HOME/instance-3281374-1304032627.cnf'
0.00/0.00	c -- header says num vars:         520770
0.00/0.00	c -- header says num clauses:    13380350
18.69/18.75	c -- clauses added:            0 learnts,     13380350 normals,            0 xors
18.69/18.75	c -- vars added     520770
18.69/18.75	c Parsing time: 17.80 s
18.69/18.76	c  N st     0         0    520770   4669762   8710587         0  39210883         0   no data   no data  --
20.10/19.18	c asymm  cl-useful: 0/29/4669758 lits-rem:0 time: 1.08
44.01/25.18	c Flit:     0 Blit:  16982 bXBeca:    0 bXProp:    4 Bin:      0 BRemL:      0 BRemN:      0 CBin:       0 P: 60.0M T: 20.85
45.99/25.64	c Cleaning up after failed var search:     1.82 s 
58.37/28.78	c Calc non-exist non-lernt bins v-fix:     8 done:   1092 time: 12.20 s
58.37/28.79	c Cache  BProp: 0 Set: 0 BXProp: 0 T: 0.03
59.17/28.95	c Subs w/ non-existent bins:      0 time:  0.61 s
67.96/31.13	c Replacing        4 vars Replaced   211091 lits Time:     8.69 s 
82.24/34.81	c bin-w-bin subsume rem          592 bins  time:  6.86 s
87.83/36.23	c subs with bin:      101  lits-rem:       101  v-fix:    0  time:  5.64 s
89.82/36.70	c Removed useless bin:     459  fixed:     0  bprops:  10.00M  time:  1.86 s
490.78/137.12	c lits-rem:         0  cl-subs:    14772  v-elim:   9002  v-fix:    0  time: 400.81 s
490.78/137.12	c learnt bin added due to v-elim: 0
491.60/137.34	c Finding binary XORs  T:     0.87 s  found:     124
494.38/138.08	c Replacing      124 vars Replaced    55679 lits Time:     2.98 s 
497.17/138.75	c Calc default polars -  time:   1.17 s pos:   28902 undec:   26347 neg:  465521
497.17/138.75	c =========================================================================================
497.17/138.75	c types(t): F = full restart, N = normal restart
497.17/138.75	c types(t): S = simplification begin/end, E = solution found
497.17/138.75	c restart types(rt): st = static, dy = dynamic
497.17/138.75	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits   MTavgCS    LTAvgG
497.17/138.75	c  B st     0         0    494660   4648010   8374261         0  38743091         0   no data   no data  --
537.91/148.92	c Decided on dynamic restart strategy
569.88/156.95	c  N dy    20      4084    494660   4648010   8374323      3929  38743084    217364     41.20     21.02  --
659.74/179.50	c  N dy    50      8248    494660   4648010   8374371      7959  38743082    434471     53.44     21.84  --
717.27/193.85	c  N dy    79     12281    494660   4648010   8374430     11820  38743077    595535     51.51     19.59  --
768.42/206.65	c  N dy   108     16348    494657   4648010   8375100     17389  38743201    759652     33.19     19.51  --
819.53/219.45	c  N dy   137     20462    494655   4648010   8375153     10904  38743188    182355     52.04     19.36  --
876.66/233.73	c  N dy   166     24575    494655   4648010   8375178     14934  38743181    487233     60.28     21.10  --
943.78/250.57	c  N dy   195     28610    494655   4648010   8375209     18860  38743148    669609     47.17     20.64  --
964.94/255.88	c  S st   206     30002    494653   4648010   8375231     20185  38743147    733413     45.56     20.45  --
978.12/259.19	c  S st   206     30502    494637   4648010   8375294     20601  38743147    739972     45.56     20.45  --
980.11/259.65	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   1.84
2755.74/704.18	c Flit:     8 Blit:  12269 bXBeca:    0 bXProp:   13 Bin:  11818 BRemL:     23 BRemN:    400 CBin:       0 P: 60.6M T: 1775.25
2757.74/704.60	c Cleaning up after failed var search:     1.60 s 
2766.52/706.85	c Calc non-exist non-lernt bins v-fix:     0 done:   7332 time:  8.83 s
2766.52/706.86	c Cache  BProp: 0 Set: 0 BXProp: 0 T: 0.03
2767.34/707.06	c Subs w/ non-existent bins:      0 time:  0.83 s
2769.72/707.67	c Replacing       13 vars Replaced    29914 lits Time:     2.35 s 
2781.30/710.57	c bin-w-bin subsume rem          644 bins  time:  6.56 s
2790.89/712.93	c subs with bin:        1  lits-rem:       337  v-fix:    0  time:  9.41 s
2792.89/713.40	c Removed useless bin:      79  fixed:     0  bprops:  10.08M  time:  1.89 s
3203.92/816.33	c lits-rem:         1  cl-subs:    13613  v-elim:   8666  v-fix:    0  time: 411.07 s
3203.92/816.33	c learnt bin added due to v-elim: 0
3215.53/819.28	c asymm  cl-useful: 0/347417/4656338 lits-rem:0 time: 11.78
3217.11/819.66	c  N dy   206     30502    473692   4656338   8121334     15479  38365574    548950     45.56     20.45  --
3217.11/819.66	c  F st   206     30502    473692   4656338   8121334     15479  38365574    548950     45.56     20.45  --
3250.68/828.09	c Decided on dynamic restart strategy
3279.43/835.30	c  N dy   226     34578    473692   4656338   8121366     19420  38365570    765794     83.55     20.44  --
3340.54/850.52	c  N dy   254     38622    468335   4656338   8149833     46250  38366414   1118614     70.40     20.49  --
3387.30/862.28	c  N dy   283     42680    467026   4656338   8149864     50152  38366400   1323809     49.23     20.60  --
3427.22/872.29	c  S st   305     45755    466475   4650948   8024916     53108  38038282   1515594     54.16     20.81  --
3440.80/875.63	c  S st   305     46256    466467   4650948   8024955     26831  38038282    159864     54.16     20.81  --
3442.40/876.05	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   1.66
3883.42/986.42	c Flit:     0 Blit:   6233 bXBeca:    0 bXProp:   65 Bin:   5499 BRemL:    757 BRemN:    181 CBin:       0 P: 60.3M T: 440.81
3884.99/986.80	c Cleaning up after failed var search:     1.46 s 
3897.01/989.88	c Calc non-exist non-lernt bins v-fix:     0 done:   2232 time: 12.17 s
3897.01/989.89	c Cache  BProp: 2 Set: 2 BXProp: 10 T: 0.03
3898.18/990.12	c Subs w/ non-existent bins:     21 time:  0.91 s
3902.18/991.11	c Replacing       75 vars Replaced    40737 lits Time:     3.89 s 
3912.96/993.88	c bin-w-bin subsume rem         2509 bins  time:  6.45 s
3918.57/995.21	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  5.29 s
3920.15/995.63	c Removed useless bin:       0  fixed:     0  bprops:  10.04M  time:  1.69 s
4332.01/1098.74	c lits-rem:         0  cl-subs:    29966  v-elim:   6399  v-fix:    0  time: 411.55 s
4332.01/1098.74	c learnt bin added due to v-elim: 0
4343.97/1101.75	c asymm  cl-useful: 0/344569/4665989 lits-rem:0 time: 12.03
4345.57/1102.13	c  N dy   305     46256    454121   4665989   7885394      8573  37854217    105479     54.16     20.81  --
4396.71/1114.91	c  N dy   333     50283    452989   4665989   7891172     32181  37854611    334686     49.78     20.45  --
4443.03/1126.56	c  N dy   362     54350    451623   4665989   7891195     36098  37854609    542400     72.83     20.57  --
4498.99/1140.60	c  N dy   391     58391    451623   4665989   7891241     40031  37854602    779334     52.69     20.65  --
4559.68/1155.71	c  N dy   419     62451    451623   4665989   7891264     43978  37854601    993790     55.70     20.48  --
4625.19/1172.14	c  N dy   448     66573    451623   4665989   7891296     47964  37854597   1187012     39.09     20.41  --
4669.94/1183.34	c  S st   468     69388    451622   4665989   7891310     50700  37854596   1309722     51.32     20.47  --
4685.91/1187.39	c  S st   468     69888    451605   4665989   7891333     51153  37854596   1317663     51.32     20.47  --
4687.93/1187.82	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   1.70

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3281374-1304032627/watcher-3281374-1304032627 -o /tmp/evaluation-result-3281374-1304032627/solver-3281374-1304032627 -C 4800 -W 1300 -M 15500 ./techdemo --threads=4 HOME/instance-3281374-1304032627.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.37 5.44 6.82 2/177 17195
/proc/meminfo: memFree=17436872/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=51036 CPUtime=0 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 1031 0 0 0 0 0 0 0 22 0 1 0 514861623 52260864 967 33554432000 4194304 4797429 140735344067728 18446744073709551615 4417161 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/17195/statm: 12759 967 348 148 0 7688 0

[startup+0.03322 s]
/proc/loadavg: 3.37 5.44 6.82 2/177 17195
/proc/meminfo: memFree=17436872/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=57660 CPUtime=0.02 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2737 0 0 0 2 0 0 0 22 0 1 0 514861623 59043840 2664 33554432000 4194304 4797429 140735344067728 18446744073709551615 228122372773 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/17195/statm: 14415 2664 348 148 0 9344 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 57660

[startup+0.1012 s]
/proc/loadavg: 3.37 5.44 6.82 2/177 17195
/proc/meminfo: memFree=17436872/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=75476 CPUtime=0.09 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 7789 0 0 0 8 1 0 0 22 0 1 0 514861623 77287424 6354 33554432000 4194304 4797429 140735344067728 18446744073709551615 228122374853 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/17195/statm: 18869 6359 349 148 0 13798 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 75476

[startup+0.30114 s]
/proc/loadavg: 3.37 5.44 6.82 2/177 17195
/proc/meminfo: memFree=17436872/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=112496 CPUtime=0.29 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 19721 0 0 0 27 2 0 0 23 0 1 0 514861623 115195904 16377 33554432000 4194304 4797429 140735344067728 18446744073709551615 4688061 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/17195/statm: 28124 16382 349 148 0 23053 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 112496

[startup+1.32995 s]
/proc/loadavg: 3.37 5.44 6.82 2/177 17195
/proc/meminfo: memFree=17436872/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=284896 CPUtime=1.32 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 69608 0 0 0 124 8 0 0 25 0 1 0 514861623 291733504 55180 33554432000 4194304 4797429 140735344067728 18446744073709551615 4367912 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/17195/statm: 71224 55180 349 148 0 66153 0
Current children cumulated CPU time (s) 1.32
Current children cumulated vsize (KiB) 284896

[startup+1.50092 s]
/proc/loadavg: 3.37 5.44 6.82 2/177 17195
/proc/meminfo: memFree=17436872/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=298376 CPUtime=1.49 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 74933 0 0 0 140 9 0 0 25 0 1 0 514861623 305537024 60446 33554432000 4194304 4797429 140735344067728 18446744073709551615 228122374853 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/17195/statm: 74594 60446 349 148 0 69523 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 298376

[startup+3.10665 s]
/proc/loadavg: 3.50 5.43 6.81 6/181 17199
/proc/meminfo: memFree=16659776/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=648240 CPUtime=3.1 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 144289 0 0 0 292 18 0 0 25 0 1 0 514861623 663797760 115108 33554432000 4194304 4797429 140735344067728 18446744073709551615 228122374853 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/17195/statm: 162060 115112 349 148 0 156989 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 648240

[startup+6.30103 s]
/proc/loadavg: 3.50 5.43 6.81 6/181 17199
/proc/meminfo: memFree=16221192/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=1118276 CPUtime=6.29 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 277025 0 0 0 594 35 0 0 25 0 1 0 514861623 1145114624 218360 33554432000 4194304 4797429 140735344067728 18446744073709551615 4431150 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/17195/statm: 279569 218360 349 148 0 274498 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1118276

[startup+12.7009 s]
/proc/loadavg: 3.62 5.42 6.80 6/181 17199
/proc/meminfo: memFree=14866004/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=1981916 CPUtime=12.69 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 489176 0 0 0 1205 64 0 0 25 0 1 0 514861623 2029481984 427384 33554432000 4194304 4797429 140735344067728 18446744073709551615 4431950 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/17195/statm: 495479 427384 350 148 0 490408 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1981916

[startup+25.5005 s]
/proc/loadavg: 4.16 5.45 6.79 9/184 17203
/proc/meminfo: memFree=13379904/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=3856816 CPUtime=45.59 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 1069222 0 0 0 4396 163 0 0 25 0 4 0 514861623 3949379584 740917 33554432000 4194304 4797429 140735344067728 18446744073709551615 4345040 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/17195/statm: 964204 740917 385 148 0 959133 0
[pid=17195/tid=17201] ppid=17193 vsize=3856816 CPUtime=6.72 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 85781 0 0 0 655 17 0 0 25 0 4 0 514863499 3949379584 740917 33554432000 4194304 4797429 140735344067728 18446744073709551615 4223288 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=3856816 CPUtime=6.7 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 92629 0 0 0 651 19 0 0 25 0 4 0 514863499 3949379584 740917 33554432000 4194304 4797429 140735344067728 18446744073709551615 4345045 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=3856816 CPUtime=6.68 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 66037 0 0 0 654 14 0 0 25 0 4 0 514863499 3949379584 740917 33554432000 4194304 4797429 140735344067728 18446744073709551615 4225099 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 45.59
Current children cumulated vsize (KiB) 3856816

[startup+51.1009 s]
/proc/loadavg: 5.47 5.65 6.82 9/184 17203
/proc/meminfo: memFree=11264984/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=6311244 CPUtime=147.25 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 1583400 0 0 0 14439 286 0 0 25 0 4 0 514861623 6462713856 1244277 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568103 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 1577811 1244277 673 148 0 1572740 0
[pid=17195/tid=17201] ppid=17193 vsize=6311244 CPUtime=32.11 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 223962 0 0 0 3160 51 0 0 25 0 4 0 514863499 6462713856 1244277 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568103 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=6311244 CPUtime=32.3 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 186795 0 0 0 3196 34 0 0 25 0 4 0 514863499 6462713856 1244277 33554432000 4194304 4797429 140735344067728 18446744073709551615 4525944 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=6311244 CPUtime=31.91 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 198452 0 0 0 3139 52 0 0 25 0 4 0 514863499 6462713856 1244277 33554432000 4194304 4797429 140735344067728 18446744073709551615 4525944 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 147.25
Current children cumulated vsize (KiB) 6311244

[startup+102.301 s]
/proc/loadavg: 6.90 6.01 6.88 9/184 17205
/proc/meminfo: memFree=10920704/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=6311244 CPUtime=351.77 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 1588276 0 0 0 34889 288 0 0 25 0 4 0 514861623 6462713856 1246823 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568103 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 1577811 1246823 626 148 0 1572740 0
[pid=17195/tid=17201] ppid=17193 vsize=6311244 CPUtime=83.32 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 227257 0 0 0 8280 52 0 0 25 0 4 0 514863499 6462713856 1246823 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568088 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=6311244 CPUtime=83.5 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 186922 0 0 0 8316 34 0 0 25 0 4 0 514863499 6462713856 1246823 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568088 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=6311244 CPUtime=82.83 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 198777 0 0 0 8231 52 0 0 25 0 4 0 514863499 6462713856 1246823 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568103 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 351.77
Current children cumulated vsize (KiB) 6311244

[startup+162.301 s]
/proc/loadavg: 7.59 6.37 6.95 9/184 17206
/proc/meminfo: memFree=10642812/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=6373920 CPUtime=591.45 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 1608996 0 0 0 58852 293 0 0 25 0 4 0 514861623 6526894080 1263862 33554432000 4194304 4797429 140735344067728 18446744073709551615 4424642 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 1593480 1263862 411 148 0 1588409 0
[pid=17195/tid=17201] ppid=17193 vsize=6373920 CPUtime=143.32 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 229585 0 0 0 14279 53 0 0 25 0 4 0 514863499 6526894080 1263862 33554432000 4194304 4797429 140735344067728 18446744073709551615 4423635 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=6373920 CPUtime=143.49 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 192848 0 0 0 14314 35 0 0 25 0 4 0 514863499 6526894080 1263862 33554432000 4194304 4797429 140735344067728 18446744073709551615 4258754 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=6373920 CPUtime=142.49 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 204698 0 0 0 14197 52 0 0 25 0 4 0 514863499 6526894080 1263862 33554432000 4194304 4797429 140735344067728 18446744073709551615 4425609 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 591.45
Current children cumulated vsize (KiB) 6373920

[startup+222.301 s]
/proc/loadavg: 7.97 6.70 7.02 9/184 17208
/proc/meminfo: memFree=10207432/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=6546176 CPUtime=831.11 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 1648919 0 0 0 82811 300 0 0 25 0 4 0 514861623 6703284224 1300807 33554432000 4194304 4797429 140735344067728 18446744073709551615 4424399 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 1636544 1300807 415 148 0 1631473 0
[pid=17195/tid=17201] ppid=17193 vsize=6546176 CPUtime=203.32 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 236576 0 0 0 20277 55 0 0 25 0 4 0 514863499 6703284224 1300807 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259112 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=6546176 CPUtime=203.5 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 203807 0 0 0 20313 37 0 0 25 0 4 0 514863499 6703284224 1300807 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259135 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=6546176 CPUtime=202.16 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 212725 0 0 0 20162 54 0 0 25 0 4 0 514863499 6703284224 1300807 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259686 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 831.11
Current children cumulated vsize (KiB) 6546176

[startup+282.301 s]
/proc/loadavg: 8.09 6.96 7.09 9/184 17210
/proc/meminfo: memFree=9790540/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=6964676 CPUtime=1070.8 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 1728130 0 0 0 106769 311 0 0 25 0 4 0 514861623 7131828224 1378481 33554432000 4194304 4797429 140735344067728 18446744073709551615 4236524 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 1741169 1378481 415 148 0 1736098 0
[pid=17195/tid=17201] ppid=17193 vsize=6964676 CPUtime=263.32 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 246887 0 0 0 26276 56 0 0 25 0 4 0 514863499 7131828224 1378481 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259072 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=6964676 CPUtime=263.5 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 207155 0 0 0 26313 37 0 0 25 0 4 0 514863499 7131828224 1378481 33554432000 4194304 4797429 140735344067728 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=6964676 CPUtime=261.84 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 271934 0 0 0 26122 62 0 0 25 0 4 0 514863499 7131828224 1378481 33554432000 4194304 4797429 140735344067728 18446744073709551615 4567988 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1070.8
Current children cumulated vsize (KiB) 6964676

[startup+342.301 s]
/proc/loadavg: 8.13 7.18 7.15 9/184 17211
/proc/meminfo: memFree=9557516/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=7244524 CPUtime=1310.47 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 1783763 0 0 0 130729 318 0 0 25 0 4 0 514861623 7418392576 1432658 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259288 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 1811131 1432658 415 148 0 1806060 0
[pid=17195/tid=17201] ppid=17193 vsize=7244524 CPUtime=323.33 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 300668 0 0 0 32270 63 0 0 25 0 4 0 514863499 7418392576 1432658 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568103 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=7244524 CPUtime=323.5 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 207973 0 0 0 32313 37 0 0 25 0 4 0 514863499 7418392576 1432658 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259135 0 0 4096 2 0 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=17195/tid=17203] ppid=17193 vsize=8405736 CPUtime=679.55 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 349525 0 0 0 67884 71 0 0 25 0 4 0 514863499 8607473664 1628923 33554432000 4194304 4797429 140735344067728 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2748.55
Current children cumulated vsize (KiB) 8405736

[startup+762.3 s]
/proc/loadavg: 8.13 7.86 7.48 9/184 17222
/proc/meminfo: memFree=7141240/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=8814092 CPUtime=2988.22 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2186028 0 0 0 298454 368 0 0 25 0 4 0 514861623 9025630208 1718303 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568062 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 2203523 1718303 416 148 0 2198452 0
[pid=17195/tid=17201] ppid=17193 vsize=8814092 CPUtime=743.34 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 460825 0 0 0 74252 82 0 0 25 0 4 0 514863499 9025630208 1718303 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259072 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=8814092 CPUtime=743.51 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 315529 0 0 0 74301 50 0 0 25 0 4 0 514863499 9025630208 1718303 33554432000 4194304 4797429 140735344067728 18446744073709551615 4612551 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=8814092 CPUtime=739.22 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 350811 0 0 0 73850 72 0 0 25 0 4 0 514863499 9025630208 1718303 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259664 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2988.22
Current children cumulated vsize (KiB) 8814092

[startup+822.3 s]
/proc/loadavg: 8.14 7.91 7.52 9/184 17224
/proc/meminfo: memFree=6810644/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=8832332 CPUtime=3227.9 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2193950 0 0 0 322421 369 0 0 25 0 4 0 514861623 9044307968 1719123 33554432000 4194304 4797429 140735344067728 18446744073709551615 4386163 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 2208083 1719123 416 148 0 2203012 0
[pid=17195/tid=17201] ppid=17193 vsize=8832332 CPUtime=803.34 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 461178 0 0 0 80252 82 0 0 25 0 4 0 514863499 9044307968 1719123 33554432000 4194304 4797429 140735344067728 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=8832332 CPUtime=803.51 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 317515 0 0 0 80301 50 0 0 25 0 4 0 514863499 9044307968 1719123 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568144 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=8832332 CPUtime=798.9 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 350811 0 0 0 79818 72 0 0 25 0 4 0 514863499 9044307968 1719123 33554432000 4194304 4797429 140735344067728 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3227.9
Current children cumulated vsize (KiB) 8832332

[startup+882.301 s]
/proc/loadavg: 8.22 7.97 7.56 9/184 17226
/proc/meminfo: memFree=6440728/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=9150844 CPUtime=3467.57 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2239162 0 0 0 346383 374 0 0 25 0 4 0 514861623 9370464256 1764138 33554432000 4194304 4797429 140735344067728 18446744073709551615 4236524 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 2287711 1764138 416 148 0 2282640 0
[pid=17195/tid=17201] ppid=17193 vsize=9150844 CPUtime=863.34 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 499117 0 0 0 86248 86 0 0 25 0 4 0 514863499 9370464256 1764138 33554432000 4194304 4797429 140735344067728 18446744073709551615 4360158 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=9150844 CPUtime=863.51 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 320078 0 0 0 86301 50 0 0 25 0 4 0 514863499 9370464256 1764138 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259072 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=9150844 CPUtime=858.56 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 351743 0 0 0 85784 72 0 0 25 0 4 0 514863499 9370464256 1764138 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259149 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3467.57
Current children cumulated vsize (KiB) 9150844

[startup+942.301 s]
/proc/loadavg: 8.13 7.99 7.59 9/184 17227
/proc/meminfo: memFree=5693480/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=9224968 CPUtime=3707.24 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2255960 0 0 0 370348 376 0 0 25 0 4 0 514861623 9446367232 1780362 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259135 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 2306242 1780362 416 148 0 2301171 0
[pid=17195/tid=17201] ppid=17193 vsize=9224968 CPUtime=923.35 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 511187 0 0 0 92247 88 0 0 25 0 4 0 514863499 9446367232 1780362 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568122 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=9224968 CPUtime=923.51 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 322932 0 0 0 92301 50 0 0 25 0 4 0 514863499 9446367232 1780362 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259265 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=9224968 CPUtime=918.23 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 352929 0 0 0 91751 72 0 0 25 0 4 0 514863499 9446367232 1780362 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259149 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3707.24
Current children cumulated vsize (KiB) 9224968

[startup+1002.3 s]
/proc/loadavg: 8.10 8.00 7.62 9/184 17229
/proc/meminfo: memFree=5350268/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=9550652 CPUtime=3946.92 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2370838 0 0 0 394301 391 0 0 25 0 4 0 514861623 9779867648 1836907 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 2387663 1836907 418 148 0 2382592 0
[pid=17195/tid=17201] ppid=17193 vsize=9550652 CPUtime=983.35 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 568767 0 0 0 98240 95 0 0 25 0 4 0 514863499 9779867648 1836907 33554432000 4194304 4797429 140735344067728 18446744073709551615 4423712 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=9550652 CPUtime=983.52 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 324593 0 0 0 98301 51 0 0 25 0 4 0 514863499 9779867648 1836907 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259081 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=9550652 CPUtime=977.9 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 353733 0 0 0 97718 72 0 0 25 0 4 0 514863499 9779867648 1836907 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259081 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3946.92
Current children cumulated vsize (KiB) 9550652

[startup+1062.3 s]
/proc/loadavg: 8.08 8.02 7.65 9/184 17230
/proc/meminfo: memFree=5149856/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=9867188 CPUtime=4186.61 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2429840 0 0 0 418262 399 0 0 25 0 4 0 514861623 10104000512 1895889 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568088 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 2466797 1895889 418 148 0 2461726 0
[pid=17195/tid=17201] ppid=17193 vsize=9867188 CPUtime=1043.35 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 570434 0 0 0 104240 95 0 0 25 0 4 0 514863499 10104000512 1895889 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259680 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=9867188 CPUtime=1043.52 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 326352 0 0 0 104301 51 0 0 25 0 4 0 514863499 10104000512 1895889 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259680 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=9867188 CPUtime=1037.57 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 409309 0 0 0 103677 80 0 0 25 0 4 0 514863499 10104000512 1895889 33554432000 4194304 4797429 140735344067728 18446744073709551615 4525944 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4186.61
Current children cumulated vsize (KiB) 9867188

[startup+1122.3 s]
/proc/loadavg: 8.03 8.01 7.66 9/184 17232
/proc/meminfo: memFree=4466948/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=10513332 CPUtime=4426.25 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2528376 0 0 0 442211 414 0 0 25 0 4 0 514861623 10765651968 1990658 33554432000 4194304 4797429 140735344067728 18446744073709551615 4425045 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 2628333 1990658 418 148 0 2623262 0
[pid=17195/tid=17201] ppid=17193 vsize=10513332 CPUtime=1103.35 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 622255 0 0 0 110231 104 0 0 25 0 4 0 514863499 10765651968 1990658 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568088 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=10513332 CPUtime=1103.52 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 368720 0 0 0 110295 57 0 0 25 0 4 0 514863499 10765651968 1990658 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568088 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=10513332 CPUtime=1097.23 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 411685 0 0 0 109643 80 0 0 25 0 4 0 514863499 10765651968 1990658 33554432000 4194304 4797429 140735344067728 18446744073709551615 228122370005 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4426.25
Current children cumulated vsize (KiB) 10513332

[startup+1182.31 s]
/proc/loadavg: 8.01 8.00 7.68 9/184 17234
/proc/meminfo: memFree=4156728/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=10782892 CPUtime=4665.95 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2585821 0 0 0 466174 421 0 0 25 0 4 0 514861623 11041681408 2048059 33554432000 4194304 4797429 140735344067728 18446744073709551615 4425034 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 2695723 2048059 418 148 0 2690652 0
[pid=17195/tid=17201] ppid=17193 vsize=10782892 CPUtime=1163.36 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 622256 0 0 0 116232 104 0 0 25 0 4 0 514863499 11041681408 2048059 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568103 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=10782892 CPUtime=1163.53 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 368789 0 0 0 116296 57 0 0 25 0 4 0 514863499 11041681408 2048059 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568098 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=10782892 CPUtime=1156.91 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 468139 0 0 0 115604 87 0 0 25 0 4 0 514863499 11041681408 2048059 33554432000 4194304 4797429 140735344067728 18446744073709551615 4568103 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4665.95
Current children cumulated vsize (KiB) 10782892



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1215.9 s]
/proc/loadavg: 7.58 7.90 7.66 9/184 17266
/proc/meminfo: memFree=9440248/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=10808212 CPUtime=4800.17 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) R 17193 17195 16792 0 -1 4202496 2628913 0 0 0 479589 428 0 0 25 0 4 0 514861623 11067609088 2059766 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259149 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 2702053 2059766 418 148 0 2696982 0
[pid=17195/tid=17201] ppid=17193 vsize=10808212 CPUtime=1196.96 cores=0,2,4,6
/proc/17195/task/17201/stat : 17201 (techdemo) R 17193 17195 16792 0 -1 4202560 623919 0 0 0 119591 105 0 0 25 0 4 0 514863499 11067609088 2059766 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259274 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=17195/tid=17202] ppid=17193 vsize=10808212 CPUtime=1197.13 cores=0,2,4,6
/proc/17195/task/17202/stat : 17202 (techdemo) R 17193 17195 16792 0 -1 4202560 407941 0 0 0 119652 61 0 0 25 0 4 0 514863499 11067609088 2059766 33554432000 4194304 4797429 140735344067728 18446744073709551615 4259288 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=10808212 CPUtime=1190.32 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4202560 468139 0 0 0 118945 87 0 0 25 0 4 0 514863499 11067609088 2059766 33554432000 4194304 4797429 140735344067728 18446744073709551615 4526821 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 10808212

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1216.1 s]
/proc/loadavg: 7.58 7.90 7.66 9/184 17266
/proc/meminfo: memFree=9440248/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=0 CPUtime=4800.38 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) Z 17193 17195 16792 0 -1 4203548 2628913 0 0 0 479591 447 0 0 25 0 2 0 514861623 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 0 0 0 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=0 CPUtime=1190.52 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4203588 468139 0 0 0 118946 106 0 0 25 0 2 0 514863499 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.38
Current children cumulated vsize (KiB) 0

[startup+1216.2 s]
/proc/loadavg: 7.58 7.90 7.66 9/184 17266
/proc/meminfo: memFree=9440248/32951124 swapFree=67111528/67111528
[pid=17195] ppid=17193 vsize=0 CPUtime=4800.48 cores=0,2,4,6
/proc/17195/stat : 17195 (techdemo) Z 17193 17195 16792 0 -1 4203548 2628913 0 0 0 479591 457 0 0 25 0 2 0 514861623 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17195/statm: 0 0 0 0 0 0 0
[pid=17195/tid=17203] ppid=17193 vsize=0 CPUtime=1190.62 cores=0,2,4,6
/proc/17195/task/17203/stat : 17203 (techdemo) R 17193 17195 16792 0 -1 4203588 468139 0 0 0 118946 116 0 0 25 0 2 0 514863499 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.48
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1216.25
CPU time (s): 4800.54
CPU user time (s): 4795.92
CPU system time (s): 4.6183
CPU usage (%): 394.7
Max. virtual memory (cumulated for all children) (KiB): 10808212

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.92
system time used= 4.6183
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2628913
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 85727
involuntary context switches= 23806

runsolver used 1.92371 second user time and 4.67629 second system time

The end

Launcher Data 

Begin job on node138 at 2011-04-29 01:17:16
IDJOB=3281374
IDBENCH=20582
IDSOLVER=1584
FILE ID=node138/3281374-1304032627
RUNJOBID= node138-1304032627-17175
PBS_JOBID= 13170314
Free space on /tmp= 71380 MiB

SOLVER NAME= CryptoMiniSat TechDemo-Alpha-mt
BENCH NAME= SAT07/industrial/vliw_sat_4.0/9vliw_m_9stages_iq3_C1_bug5.cnf
COMMAND LINE= ./techdemo --threads=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3281374-1304032627/watcher-3281374-1304032627 -o /tmp/evaluation-result-3281374-1304032627/solver-3281374-1304032627 -C 4800 -W 1300 -M 15500  ./techdemo --threads=4 HOME/instance-3281374-1304032627.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c77a56af24208a6401c763e11a38de01
RANDOM SEED=1532173305

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17437400 kB
Buffers:       2040824 kB
Cached:       12093692 kB
SwapCached:          0 kB
Active:        4472568 kB
Inactive:     10470020 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17437400 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          454628 kB
Writeback:           0 kB
AnonPages:      807588 kB
Mapped:          15424 kB
Slab:           505508 kB
PageTables:       6284 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1078096 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71476 MiB
End job on node138 at 2011-04-29 01:37:34