Trace number 3284090

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CryptoMiniSat Strange-Night-2-mt? (TO) 3268.13 1300.36

General information on the benchmark

Namevelev-npe-1.0-9dlx-b71.cnf
MD5SUM75d91f0ba4398ccb5b452707c0e7fa27
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark20.3769
Satisfiable
(Un)Satisfiability was proved
Number of variables889302
Number of clauses14582074
Sum of the clauses size42006170
Maximum clause length5391
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 212803954
Number of clauses of size 3913633
Number of clauses of size 418493
Number of clauses of size 536153
Number of clauses of size over 5809840

Solver Data 

0.00/0.00	c Outputting solution to console
0.00/0.00	c Using 4 threads
0.00/0.00	c This is CryptoMiniSat 3.0.0
0.00/0.00	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.00	c Reading file 'HOME/instance-3284090-1304029150.cnf'
0.00/0.00	c -- header says num vars:         889302
0.00/0.00	c -- header says num clauses:    14582074
18.14/4.63	c -- clauses added:            0 learnts,     14582074 normals,            0 xors
18.14/4.63	c -- vars added     889302
18.14/4.63	c Parsing time:  4.19 s
18.14/4.63	c  N st     0         0    889302   1778118  12803934         0  42006124         0   no data   no data
19.75/5.01	c asymm  cl-useful: 0/1799/1778118 lits-rem:0 time: 0.31
57.69/14.58	c Flit:    41 Blit:    818 bXBeca:    0 bXProp:    0 Bins:      0 BRemL:      0 BRemN:      0 P: 200.0M T:  9.56
57.69/14.59	c Cleaning up after failed var search:     0.00 s 
64.46/16.26	c blocked clauses removed:        0 vars:      0 tried:           0 T: 0.01 s
70.44/17.79	c bin-w-bin subsume rem            0 bins  time:  1.54 s
94.81/23.80	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  6.01 s
123.17/30.97	c Subs w/ non-existent bins:      0 l-rem:      0 v-fix:     0 done:   2074 time:  7.17 s
125.17/31.46	c Removed useless bin:    1161  fixed:     0  props:  20.55M  time:  0.49 s
247.39/62.01	c lits-rem:         0  cl-subs:     7754  v-elim:   7887  v-fix:    0  time: 30.50 s
248.58/62.34	c Finding binary XORs  T:     0.33 s  found:       0
249.80/62.69	c calculated reachability. Time: 0.02
251.38/63.05	c Calc default polars -  time:   0.36 s pos:    9969 undec:    8783 neg:  870550
251.38/63.05	c =========================================================================================
251.38/63.05	c types(t): F = full restart, N = normal restart
251.38/63.05	c types(t): S = simplification begin/end, E = solution found
251.38/63.05	c restart types(rt): st = static, dy = dynamic
251.38/63.05	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits
251.38/63.05	c  B st     0         0    880552   1793246  12749864         0  43081937         0   no data   no data
310.10/77.77	c  N dy    14      4073    880551   1793246  12750233      3642  43081937   1120966     11.70     12.54
379.20/95.02	c  N dy    30      8091    880537   1793246  12751493      7324  43081937   2258735     10.37     11.40
451.93/113.21	c  N dy    53     12237    880537   1793246  12751862     11061  43081937   3317641     11.07     11.69
535.82/134.29	c  N dy    68     16395    880524   1793246  12753373     14817  43081933   4513926     12.62     13.32
604.49/151.50	c  N dy    83     20884    880500   1793246  12754655      9975  43081933    335867     12.27     13.21
677.59/169.71	c  N dy    94     24922    880498   1793246  12754902     13746  43081933   1472799     11.95     12.60
679.19/170.10	c  F st    95     25000    880490   1793246  12755778     13819  43081933   1482504     11.93   no data
764.67/191.58	c  N dy   101     30000    880489   1793246  12754759     18561  43079240   3153978     11.93   no data
764.67/191.59	c  S st   101     30000    880489   1793246  12754759     18561  43079240   3153978     11.93   no data
784.64/196.52	c  S st   101     30504    880485   1793246  12754845     18971  43079240   3173558     11.93   no data
786.63/197.09	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.57
839.76/210.35	c Flit:     0 Blit:   4815 bXBeca:    0 bXProp:    2 Bins:1279163 BRemL:     75 BRemN:      0 P: 200.2M T: 13.25
839.76/210.39	c Cleaning up after failed var search:     0.00 s 
846.96/212.17	c Replacing        3 vars Replaced   212074 lits Time:     1.72 s 
854.54/214.09	c blocked clauses removed:        0 vars:      0 tried:      875666 T: 0.71 s
860.56/215.59	c bin-w-bin subsume rem            9 bins  time:  1.50 s
884.51/221.59	c subs with bin:        0  lits-rem:       624  v-fix:    0  time:  6.00 s
909.29/227.73	c Subs w/ non-existent bins:      0 l-rem:      0 v-fix:     0 done:   7293 time:  6.14 s
911.26/228.28	c Removed useless bin:     293  fixed:     0  props:  20.21M  time:  0.55 s
950.41/238.01	c lits-rem:         0  cl-subs:      973  v-elim:    203  v-fix:    0  time:  9.70 s
965.20/241.70	c subs with bin:        7  lits-rem:        41  v-fix:    0  time:  3.18 s
1033.50/258.89	c lits-rem:        10  cl-subs:      912  v-elim:      0  v-fix:    0  time: 16.44 s
1035.10/259.29	c asymm  cl-useful: 0/102240/1794165 lits-rem:0 time: 0.40
1037.09/259.70	c calculated reachability. Time: 0.05
1037.09/259.75	c  N dy   101     30504    875463   1794165  13915647     18092  42810803   5472812     11.93   no data
1038.69/260.16	c Finding binary XORs  T:     0.41 s  found:       1
1168.70/302.57	c  N dy   114     34698    875422   1794165  13918857     22108  42810803   6139126     11.77     12.54
1203.78/314.22	c  N dy   120     39029    875422   1794165  13918961     26286  42810803   6977442     11.51     12.14
1362.56/373.19	c  N dy   144     43114    874879   1794165  14008285     15814  42810802   3544173     11.51     13.30
1431.84/396.66	c Finding binary XORs  T:     0.39 s  found:       6
1447.04/400.48	c  S st   157     45756    874596   1794163  14065766     18304  42779288   4457268     11.43   no data
1468.19/405.71	c  S st   157     46257    874592   1794163  14065843     18718  42779287   4485454     11.43   no data
1470.59/406.34	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.62
1516.63/418.88	c Flit:    17 Blit:    450 bXBeca:    0 bXProp:    1 Bins:1515011 BRemL:    167 BRemN:      0 P: 200.4M T: 12.53
1516.83/418.90	c Cleaning up after failed var search:     0.00 s 
1521.40/420.19	c Replacing        8 vars Replaced     8724 lits Time:     1.25 s 
1528.18/421.83	c blocked clauses removed:        0 vars:      0 tried:           0 T: 0.04 s
1534.99/423.57	c bin-w-bin subsume rem           62 bins  time:  1.74 s
1559.33/429.63	c subs with bin:       27  lits-rem:      5480  v-fix:    0  time:  6.05 s
1580.11/434.82	c Subs w/ non-existent bins:      3 l-rem:    163 v-fix:     0 done:  12848 time:  5.20 s
1582.11/435.39	c Removed useless bin:     140  fixed:     0  props:  20.00M  time:  0.57 s
1621.65/445.20	c lits-rem:         0  cl-subs:      641  v-elim:     74  v-fix:    0  time:  9.79 s
1628.84/447.02	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  1.48 s
1683.98/460.83	c lits-rem:      1958  cl-subs:      731  v-elim:      0  v-fix:    0  time: 13.08 s
1685.56/461.28	c asymm  cl-useful: 0/69987/1793014 lits-rem:0 time: 0.45
1687.56/461.74	c calculated reachability. Time: 0.05
1687.56/461.79	c  N dy   157     46257    874043   1793014  15573034     18490  42765439   7483192     11.43   no data
1689.15/462.19	c Finding binary XORs  T:     0.40 s  found:       0
1761.85/480.36	c  N dy   177     50320    874041   1793014  15573241     22289  42765439   8396850     11.35     12.01
1918.08/536.67	c  N dy   194     54550    873881   1793014  15618675     26221  42765439   9412812     11.22     11.83
2050.69/610.20	c  N dy   210     58704    873869   1793014  15619539     30138  42765436  10315275     11.26     12.03
2097.81/625.95	c  N dy   229     62841    873865   1793014  15619704     34078  42765436  11428010     11.27     12.26
2161.25/660.32	c Finding binary XORs  T:     0.40 s  found:      17
2220.77/675.30	c  N dy   257     66992    873312   1793014  15670781     20428  42733313   7783824     11.40     12.06
2261.90/685.59	c  S st   270     69386    873311   1793014  15670934     22643  42733313   8452979     11.40   no data
2283.47/690.91	c  S st   270     69886    873288   1793014  15671876     23042  42733312   8501265     11.40   no data
2285.87/691.56	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.65
2340.99/705.30	c Flit:    50 Blit:   1561 bXBeca:    0 bXProp:    0 Bins:3162317 BRemL:    150 BRemN:     24 P: 200.0M T: 13.70
2340.99/705.35	c Cleaning up after failed var search:     0.00 s 
2346.59/706.75	c Replacing       17 vars Replaced      985 lits Time:     1.34 s 
2351.38/707.95	c blocked clauses removed:        0 vars:      0 tried:           0 T: 0.05 s
2360.56/710.21	c bin-w-bin subsume rem         4650 bins  time:  2.25 s
2383.34/715.99	c subs with bin:       30  lits-rem:      5358  v-fix:    0  time:  5.79 s
2400.52/720.20	c Subs w/ non-existent bins:      0 l-rem:      0 v-fix:     0 done:  32752 time:  4.20 s
2402.91/720.87	c Removed useless bin:      21  fixed:     0  props:  20.02M  time:  0.67 s
2448.85/732.38	c lits-rem:      8171  cl-subs:     1365  v-elim:     69  v-fix:    0  time: 11.50 s
2456.84/734.31	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  1.52 s
2541.12/755.44	c lits-rem:       539  cl-subs:      466  v-elim:      0  v-fix:    0  time: 20.36 s
2542.72/755.88	c asymm  cl-useful: 0/86227/1791492 lits-rem:0 time: 0.45
2545.12/756.42	c calculated reachability. Time: 0.05
2545.12/756.47	c  N dy   270     69886    871584   1791492  18789452     22718  42689188  14759778     11.40   no data
2547.11/756.90	c Finding binary XORs  T:     0.43 s  found:       3
2623.01/775.95	c  N dy   294     75007    871581   1791492  18789630     27610  42689188  16050310     11.44     12.40
2905.53/973.17	c  N dy   311     79929    871541   1791492  18791985     32262  42689188  17251877     11.37     12.09

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3284090-1304029150/watcher-3284090-1304029150 -o /tmp/evaluation-result-3284090-1304029150/solver-3284090-1304029150 -C 4800 -W 1300 -M 15500 ./strangenight2-mt --threads=4 HOME/instance-3284090-1304029150.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.67 6.13 3.00 5/180 20197
/proc/meminfo: memFree=16703668/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=51212 CPUtime=0 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 409 0 0 0 0 0 0 0 24 0 4 0 593146821 52441088 349 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827858352 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 12803 349 299 106 0 7774 0
[pid=20197/tid=20198] ppid=20195 vsize=51212 CPUtime=0 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 593146821 52441088 349 33554432000 4194304 4627427 140733607064144 18446744073709551615 215988648945 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=51212 CPUtime=0 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 593146821 52441088 349 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827858344 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=51212 CPUtime=0 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 593146821 52441088 349 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827858354 0 0 4096 2 0 0 0 -1 2 0 0 0

[startup+0.00752292 s]
/proc/loadavg: 7.67 6.13 3.00 5/180 20197
/proc/meminfo: memFree=16703668/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=249356 CPUtime=0 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) D 20195 20197 20083 0 -1 4202496 1831 0 0 0 0 0 0 0 25 0 4 0 593146821 255340544 1744 33554432000 4194304 4627427 140733607064144 18446744073709551615 4358019 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 62339 1744 336 106 0 57310 0
[pid=20197/tid=20198] ppid=20195 vsize=249356 CPUtime=0 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 363 0 0 0 0 0 0 0 25 0 4 0 593146821 255340544 1744 33554432000 4194304 4627427 140733607064144 18446744073709551615 215988635831 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=249356 CPUtime=0 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) D 20195 20197 20083 0 -1 4202560 308 0 0 0 0 0 0 0 25 0 4 0 593146821 255340544 1744 33554432000 4194304 4627427 140733607064144 18446744073709551615 4353792 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=249356 CPUtime=0 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) D 20195 20197 20083 0 -1 4202560 377 0 0 0 0 0 0 0 25 0 4 0 593146821 255340544 1744 33554432000 4194304 4627427 140733607064144 18446744073709551615 4316503 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 249356

[startup+0.10539 s]
/proc/loadavg: 7.67 6.13 3.00 5/180 20197
/proc/meminfo: memFree=16703668/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=404672 CPUtime=0.36 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) D 20195 20197 20083 0 -1 4202496 67106 0 0 0 23 13 0 0 25 0 4 0 593146821 414384128 50082 33554432000 4194304 4627427 140733607064144 18446744073709551615 4314206 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 101168 50082 337 106 0 96139 0
[pid=20197/tid=20198] ppid=20195 vsize=404672 CPUtime=0.08 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) D 20195 20197 20083 0 -1 4202560 16555 0 0 0 5 3 0 0 18 0 4 0 593146821 414384128 50082 33554432000 4194304 4627427 140733607064144 18446744073709551615 4314206 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=404672 CPUtime=0.07 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 16078 0 0 0 4 3 0 0 25 0 4 0 593146821 414384128 50082 33554432000 4194304 4627427 140733607064144 18446744073709551615 215988650410 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=404672 CPUtime=0.09 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) D 20195 20197 20083 0 -1 4202560 16916 0 0 0 6 3 0 0 25 0 4 0 593146821 414384128 50082 33554432000 4194304 4627427 140733607064144 18446744073709551615 4314206 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 404672

[startup+0.313466 s]
/proc/loadavg: 7.67 6.13 3.00 5/180 20197
/proc/meminfo: memFree=16703668/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=960408 CPUtime=1.14 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 218524 0 0 0 73 41 0 0 25 0 4 0 593146821 983457792 167483 33554432000 4194304 4627427 140733607064144 18446744073709551615 4354520 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 240102 167530 337 106 0 235073 0
[pid=20197/tid=20198] ppid=20195 vsize=960408 CPUtime=0.28 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 53490 0 0 0 17 11 0 0 18 0 4 0 593146821 983457792 167557 33554432000 4194304 4627427 140733607064144 18446744073709551615 4358019 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=960408 CPUtime=0.26 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 51263 0 0 0 17 9 0 0 25 0 4 0 593146821 983457792 167584 33554432000 4194304 4627427 140733607064144 18446744073709551615 4358062 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=960408 CPUtime=0.28 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 56152 0 0 0 19 9 0 0 25 0 4 0 593146821 983457792 167608 33554432000 4194304 4627427 140733607064144 18446744073709551615 4354520 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.14
Current children cumulated vsize (KiB) 960408

[startup+0.700393 s]
/proc/loadavg: 7.67 6.13 3.00 5/180 20197
/proc/meminfo: memFree=16703668/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=1358044 CPUtime=2.61 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 323560 0 0 0 198 63 0 0 25 0 4 0 593146821 1390637056 253633 33554432000 4194304 4627427 140733607064144 18446744073709551615 4350979 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 339511 253638 341 106 0 334482 0
[pid=20197/tid=20198] ppid=20195 vsize=1358044 CPUtime=0.64 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 79124 0 0 0 49 15 0 0 18 0 4 0 593146821 1390637056 253638 33554432000 4194304 4627427 140733607064144 18446744073709551615 4531649 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=1358044 CPUtime=0.6 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 77641 0 0 0 46 14 0 0 25 0 4 0 593146821 1390637056 253638 33554432000 4194304 4627427 140733607064144 18446744073709551615 4530607 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=1358044 CPUtime=0.66 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 81410 0 0 0 51 15 0 0 25 0 4 0 593146821 1390637056 253638 33554432000 4194304 4627427 140733607064144 18446744073709551615 215988289291 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.61
Current children cumulated vsize (KiB) 1358044

[startup+1.50025 s]
/proc/loadavg: 7.67 6.13 3.00 9/184 20201
/proc/meminfo: memFree=15598300/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=1744176 CPUtime=5.79 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 388361 0 0 0 497 82 0 0 25 0 4 0 593146821 1786036224 318434 33554432000 4194304 4627427 140733607064144 18446744073709551615 4531675 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 436044 318434 341 106 0 431015 0
[pid=20197/tid=20198] ppid=20195 vsize=1744176 CPUtime=1.44 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 93313 0 0 0 126 18 0 0 19 0 4 0 593146821 1786036224 318438 33554432000 4194304 4627427 140733607064144 18446744073709551615 215988253729 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=1744176 CPUtime=1.4 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 94762 0 0 0 119 21 0 0 25 0 4 0 593146821 1786036224 318439 33554432000 4194304 4627427 140733607064144 18446744073709551615 4257956 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=1744176 CPUtime=1.46 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 97682 0 0 0 125 21 0 0 25 0 4 0 593146821 1786036224 318443 33554432000 4194304 4627427 140733607064144 18446744073709551615 4530593 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.79
Current children cumulated vsize (KiB) 1744176

[startup+3.10097 s]
/proc/loadavg: 7.67 6.13 3.00 9/184 20201
/proc/meminfo: memFree=15207284/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=2714768 CPUtime=12.17 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 527494 0 0 0 1097 120 0 0 25 0 4 0 593146821 2779922432 457567 33554432000 4194304 4627427 140733607064144 18446744073709551615 4301208 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 678692 457567 341 106 0 673663 0
[pid=20197/tid=20198] ppid=20195 vsize=2714768 CPUtime=3.04 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 128202 0 0 0 277 27 0 0 19 0 4 0 593146821 2779922432 457569 33554432000 4194304 4627427 140733607064144 18446744073709551615 4507260 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=2714768 CPUtime=3 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 129571 0 0 0 270 30 0 0 25 0 4 0 593146821 2779922432 457571 33554432000 4194304 4627427 140733607064144 18446744073709551615 4530486 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=2714768 CPUtime=3.04 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 132280 0 0 0 273 31 0 0 19 0 4 0 593146821 2779922432 457571 33554432000 4194304 4627427 140733607064144 18446744073709551615 4301234 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.17
Current children cumulated vsize (KiB) 2714768

[startup+6.30042 s]
/proc/loadavg: 7.70 6.16 3.03 9/184 20201
/proc/meminfo: memFree=14067912/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=3395588 CPUtime=24.93 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 727816 0 0 0 2329 164 0 0 20 0 4 0 593146821 3477082112 657878 33554432000 4194304 4627427 140733607064144 18446744073709551615 4308987 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 848897 657878 366 106 0 843868 0
[pid=20197/tid=20198] ppid=20195 vsize=3395588 CPUtime=6.24 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 178204 0 0 0 584 40 0 0 20 0 4 0 593146821 3477082112 657878 33554432000 4194304 4627427 140733607064144 18446744073709551615 4308139 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=3395588 CPUtime=6.17 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 180359 0 0 0 577 40 0 0 20 0 4 0 593146821 3477082112 657878 33554432000 4194304 4627427 140733607064144 18446744073709551615 4308139 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=3395588 CPUtime=6.23 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 181773 0 0 0 581 42 0 0 20 0 4 0 593146821 3477082112 657878 33554432000 4194304 4627427 140733607064144 18446744073709551615 4305890 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.93
Current children cumulated vsize (KiB) 3395588

[startup+12.7003 s]
/proc/loadavg: 7.72 6.19 3.05 9/184 20201
/proc/meminfo: memFree=14037908/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=3396368 CPUtime=50.5 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 742217 0 0 0 4883 167 0 0 25 0 4 0 593146821 3477880832 667162 33554432000 4194304 4627427 140733607064144 18446744073709551615 4238972 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 849092 667162 366 106 0 844063 0
[pid=20197/tid=20198] ppid=20195 vsize=3396368 CPUtime=12.63 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 178425 0 0 0 1223 40 0 0 25 0 4 0 593146821 3477880832 667162 33554432000 4194304 4627427 140733607064144 18446744073709551615 4308416 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=3396368 CPUtime=12.54 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 180574 0 0 0 1213 41 0 0 25 0 4 0 593146821 3477880832 667162 33554432000 4194304 4627427 140733607064144 18446744073709551615 4238464 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=3396368 CPUtime=12.64 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 195505 0 0 0 1219 45 0 0 25 0 4 0 593146821 3477880832 667162 33554432000 4194304 4627427 140733607064144 18446744073709551615 4324663 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.5
Current children cumulated vsize (KiB) 3396368

[startup+25.501 s]
/proc/loadavg: 7.86 6.30 3.14 9/184 20202
/proc/meminfo: memFree=12847588/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=4714068 CPUtime=101.6 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 1042237 0 0 0 9940 220 0 0 25 0 4 0 593146821 4827205632 964576 33554432000 4194304 4627427 140733607064144 18446744073709551615 4338991 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 1178517 964576 378 106 0 1173488 0
[pid=20197/tid=20198] ppid=20195 vsize=4714068 CPUtime=25.42 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 270627 0 0 0 2484 58 0 0 25 0 4 0 593146821 4827205632 964576 33554432000 4194304 4627427 140733607064144 18446744073709551615 4338717 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=4714068 CPUtime=25.26 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 272775 0 0 0 2470 56 0 0 25 0 4 0 593146821 4827205632 964576 33554432000 4194304 4627427 140733607064144 18446744073709551615 4436225 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=4714068 CPUtime=25.44 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 218779 0 0 0 2496 48 0 0 25 0 4 0 593146821 4827205632 964576 33554432000 4194304 4627427 140733607064144 18446744073709551615 4299630 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.6
Current children cumulated vsize (KiB) 4714068

[startup+51.1006 s]
/proc/loadavg: 7.98 6.45 3.27 9/184 20202
/proc/meminfo: memFree=12575836/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=5086428 CPUtime=203.84 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 1141897 0 0 0 20143 241 0 0 25 0 4 0 593146821 5208502272 1031299 33554432000 4194304 4627427 140733607064144 18446744073709551615 4440942 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 1271607 1031299 382 106 0 1266578 0
[pid=20197/tid=20198] ppid=20195 vsize=5086428 CPUtime=51.02 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 292881 0 0 0 5038 64 0 0 25 0 4 0 593146821 5208502272 1031299 33554432000 4194304 4627427 140733607064144 18446744073709551615 4412744 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=5086428 CPUtime=50.72 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 288810 0 0 0 5014 58 0 0 25 0 4 0 593146821 5208502272 1031299 33554432000 4194304 4627427 140733607064144 18446744073709551615 215988261231 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=5086428 CPUtime=51.03 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 265391 0 0 0 5045 58 0 0 25 0 4 0 593146821 5208502272 1031299 33554432000 4194304 4627427 140733607064144 18446744073709551615 4308139 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.84
Current children cumulated vsize (KiB) 5086428

[startup+102.307 s]
/proc/loadavg: 7.99 6.69 3.52 9/184 20204
/proc/meminfo: memFree=12128352/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=5596940 CPUtime=408.38 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 1289121 0 0 0 40569 269 0 0 25 0 4 0 593146821 5731266560 1138542 33554432000 4194304 4627427 140733607064144 18446744073709551615 4324663 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 1399235 1138542 383 106 0 1394206 0
[pid=20197/tid=20198] ppid=20195 vsize=5596940 CPUtime=102.23 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 324284 0 0 0 10152 71 0 0 25 0 4 0 593146821 5731266560 1138542 33554432000 4194304 4627427 140733607064144 18446744073709551615 4324972 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=5596940 CPUtime=101.65 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 327462 0 0 0 10098 67 0 0 25 0 4 0 593146821 5731266560 1138542 33554432000 4194304 4627427 140733607064144 18446744073709551615 4328849 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=5596940 CPUtime=102.24 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 325892 0 0 0 10156 68 0 0 25 0 4 0 593146821 5731266560 1138542 33554432000 4194304 4627427 140733607064144 18446744073709551615 4308139 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 408.38
Current children cumulated vsize (KiB) 5596940

[startup+162.301 s]

################
# More data... #
################

[pid=20197/tid=20200] ppid=20195 vsize=10337320 CPUtime=644.58 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 1140986 0 0 0 64252 206 0 0 25 0 4 0 593146821 10585415680 2000518 33554432000 4194304 4627427 140733607064144 18446744073709551615 4308940 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2568.71
Current children cumulated vsize (KiB) 10337320

[startup+822.3 s]
/proc/loadavg: 6.81 7.10 5.51 6/184 20254
/proc/meminfo: memFree=8157376/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=10139808 CPUtime=2742.81 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 2742405 0 0 0 273749 532 0 0 25 0 4 0 593146821 10383163392 2013763 33554432000 4194304 4627427 140733607064144 18446744073709551615 4538330 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 2534952 2013763 388 106 0 2529923 0
[pid=20197/tid=20198] ppid=20195 vsize=10139808 CPUtime=699.98 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 548839 0 0 0 69884 114 0 0 25 0 4 0 593146821 10383163392 2013763 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=10139808 CPUtime=678.57 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 543278 0 0 0 67750 107 0 0 25 0 4 0 593146821 10383163392 2013763 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=10139808 CPUtime=672.77 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 1178667 0 0 0 67063 214 0 0 25 0 4 0 593146821 10383163392 2013763 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2742.81
Current children cumulated vsize (KiB) 10139808

[startup+882.301 s]
/proc/loadavg: 5.66 6.72 5.48 6/184 20256
/proc/meminfo: memFree=7666804/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=10139808 CPUtime=2802.82 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 2742414 0 0 0 279750 532 0 0 25 0 4 0 593146821 10383163392 2013772 33554432000 4194304 4627427 140733607064144 18446744073709551615 4538330 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 2534952 2013772 388 106 0 2529923 0
[pid=20197/tid=20198] ppid=20195 vsize=10139808 CPUtime=699.98 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 548839 0 0 0 69884 114 0 0 25 0 4 0 593146821 10383163392 2013772 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=10139808 CPUtime=678.57 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 543278 0 0 0 67750 107 0 0 25 0 4 0 593146821 10383163392 2013772 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=10139808 CPUtime=672.77 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 1178667 0 0 0 67063 214 0 0 25 0 4 0 593146821 10383163392 2013772 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2802.82
Current children cumulated vsize (KiB) 10139808

[startup+942.3 s]
/proc/loadavg: 5.24 6.40 5.44 6/184 20257
/proc/meminfo: memFree=7629008/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=10139808 CPUtime=2862.81 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) R 20195 20197 20083 0 -1 4202496 2742414 0 0 0 285749 532 0 0 25 0 4 0 593146821 10383163392 2013772 33554432000 4194304 4627427 140733607064144 18446744073709551615 4538320 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 2534952 2013772 388 106 0 2529923 0
[pid=20197/tid=20198] ppid=20195 vsize=10139808 CPUtime=699.98 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 548839 0 0 0 69884 114 0 0 25 0 4 0 593146821 10383163392 2013772 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=10139808 CPUtime=678.57 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 543278 0 0 0 67750 107 0 0 25 0 4 0 593146821 10383163392 2013772 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=10139808 CPUtime=672.77 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 1178667 0 0 0 67063 214 0 0 25 0 4 0 593146821 10383163392 2013772 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2862.81
Current children cumulated vsize (KiB) 10139808

[startup+1002.3 s]
/proc/loadavg: 5.33 6.22 5.44 7/184 20259
/proc/meminfo: memFree=7417824/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=10238116 CPUtime=2941.92 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) S 20195 20197 20083 0 -1 4202496 2763674 0 0 0 293656 536 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 2559529 2034038 388 106 0 2554500 0
[pid=20197/tid=20198] ppid=20195 vsize=10238116 CPUtime=699.98 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 548839 0 0 0 69884 114 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=10238116 CPUtime=678.57 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 543278 0 0 0 67750 107 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=10238116 CPUtime=713.89 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 1198366 0 0 0 71172 217 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 4538320 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2941.92
Current children cumulated vsize (KiB) 10238116

[startup+1062.3 s]
/proc/loadavg: 5.15 6.01 5.42 6/184 20260
/proc/meminfo: memFree=7398660/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=10238116 CPUtime=3001.92 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) S 20195 20197 20083 0 -1 4202496 2763674 0 0 0 299656 536 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 2559529 2034038 388 106 0 2554500 0
[pid=20197/tid=20198] ppid=20195 vsize=10238116 CPUtime=699.98 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 548839 0 0 0 69884 114 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=10238116 CPUtime=678.57 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 543278 0 0 0 67750 107 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=10238116 CPUtime=773.89 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 1198366 0 0 0 77172 217 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 4538330 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3001.92
Current children cumulated vsize (KiB) 10238116

[startup+1122.3 s]
/proc/loadavg: 5.05 5.82 5.39 6/184 20262
/proc/meminfo: memFree=7384360/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=10238116 CPUtime=3061.92 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) S 20195 20197 20083 0 -1 4202496 2763674 0 0 0 305656 536 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 2559529 2034038 388 106 0 2554500 0
[pid=20197/tid=20198] ppid=20195 vsize=10238116 CPUtime=699.98 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 548839 0 0 0 69884 114 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=10238116 CPUtime=678.57 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 543278 0 0 0 67750 107 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=10238116 CPUtime=833.89 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 1198366 0 0 0 83172 217 0 0 25 0 4 0 593146821 10483830784 2034038 33554432000 4194304 4627427 140733607064144 18446744073709551615 4538330 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3061.92
Current children cumulated vsize (KiB) 10238116

[startup+1182.3 s]
/proc/loadavg: 5.38 5.76 5.39 6/184 20267
/proc/meminfo: memFree=7233496/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=10336424 CPUtime=3150.06 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) S 20195 20197 20083 0 -1 4202496 2798590 0 0 0 314463 543 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 2584106 2068928 388 106 0 2579077 0
[pid=20197/tid=20198] ppid=20195 vsize=10336424 CPUtime=739.88 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 563209 0 0 0 73871 117 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 4538330 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=10336424 CPUtime=678.57 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 543278 0 0 0 67750 107 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=10336424 CPUtime=882.13 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 1218912 0 0 0 87992 221 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3150.06
Current children cumulated vsize (KiB) 10336424

[startup+1242.3 s]
/proc/loadavg: 5.25 5.65 5.37 6/184 20268
/proc/meminfo: memFree=7231940/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=10336424 CPUtime=3210.06 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) S 20195 20197 20083 0 -1 4202496 2798590 0 0 0 320463 543 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 2584106 2068928 388 106 0 2579077 0
[pid=20197/tid=20198] ppid=20195 vsize=10336424 CPUtime=799.88 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 563209 0 0 0 79871 117 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 4538320 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=10336424 CPUtime=678.57 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 543278 0 0 0 67750 107 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=10336424 CPUtime=882.13 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 1218912 0 0 0 87992 221 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3210.06
Current children cumulated vsize (KiB) 10336424



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.76 5.45 5.32 6/184 20300
/proc/meminfo: memFree=8846684/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=10336424 CPUtime=3267.77 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) S 20195 20197 20083 0 -1 4202496 2798590 0 0 0 326234 543 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 2584106 2068928 388 106 0 2579077 0
[pid=20197/tid=20198] ppid=20195 vsize=10336424 CPUtime=857.59 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4202560 563209 0 0 0 85642 117 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 4538320 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20197/tid=20199] ppid=20195 vsize=10336424 CPUtime=678.57 cores=0,2,4,6
/proc/20197/task/20199/stat : 20199 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 543278 0 0 0 67750 107 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 4 0 0 0
[pid=20197/tid=20200] ppid=20195 vsize=10336424 CPUtime=882.13 cores=0,2,4,6
/proc/20197/task/20200/stat : 20200 (strangenight2-m) S 20195 20197 20083 0 -1 4202560 1218912 0 0 0 87992 221 0 0 25 0 4 0 593146821 10584498176 2068928 33554432000 4194304 4627427 140733607064144 18446744073709551615 47849827856926 0 0 4096 2 18446604453906396416 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3267.77
Current children cumulated vsize (KiB) 10336424

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.21 s]
/proc/loadavg: 4.76 5.45 5.32 6/183 20301
/proc/meminfo: memFree=11190944/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=0 CPUtime=3267.96 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) Z 20195 20197 20083 0 -1 4203548 2798590 0 0 0 326234 562 0 0 18 0 2 0 593146821 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 0 0 0 0 0 0 0
[pid=20197/tid=20198] ppid=20195 vsize=0 CPUtime=857.79 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4203588 563209 0 0 0 85642 137 0 0 25 0 2 0 593146821 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3267.96
Current children cumulated vsize (KiB) 0

[startup+1300.3 s]
/proc/loadavg: 4.76 5.45 5.32 6/183 20301
/proc/meminfo: memFree=11190944/32950940 swapFree=67111528/67111528
[pid=20197] ppid=20195 vsize=0 CPUtime=3268.06 cores=0,2,4,6
/proc/20197/stat : 20197 (strangenight2-m) Z 20195 20197 20083 0 -1 4203548 2798590 0 0 0 326234 572 0 0 18 0 2 0 593146821 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20197/statm: 0 0 0 0 0 0 0
[pid=20197/tid=20198] ppid=20195 vsize=0 CPUtime=857.88 cores=0,2,4,6
/proc/20197/task/20198/stat : 20198 (strangenight2-m) R 20195 20197 20083 0 -1 4203588 563209 0 0 0 85642 146 0 0 25 0 2 0 593146821 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3268.06
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.36
CPU time (s): 3268.13
CPU user time (s): 3262.35
CPU system time (s): 5.77912
CPU usage (%): 251.325
Max. virtual memory (cumulated for all children) (KiB): 10556316

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3262.35
system time used= 5.77912
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2798590
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23498
involuntary context switches= 11378

runsolver used 1.9367 second user time and 4.71328 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-29 00:19:20
IDJOB=3284090
IDBENCH=71686
IDSOLVER=1586
FILE ID=node117/3284090-1304029150
RUNJOBID= node117-1304028687-20101
PBS_JOBID= 13170335
Free space on /tmp= 71364 MiB

SOLVER NAME= CryptoMiniSat Strange-Night-2-mt
BENCH NAME= SAT_RACE06/velev-npe-1.0-9dlx-b71.cnf
COMMAND LINE= ./strangenight2-mt --threads=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3284090-1304029150/watcher-3284090-1304029150 -o /tmp/evaluation-result-3284090-1304029150/solver-3284090-1304029150 -C 4800 -W 1300 -M 15500  ./strangenight2-mt --threads=4 HOME/instance-3284090-1304029150.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 75d91f0ba4398ccb5b452707c0e7fa27
RANDOM SEED=1848238275

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      16703576 kB
Buffers:       2374808 kB
Cached:       12702020 kB
SwapCached:          0 kB
Active:        8903560 kB
Inactive:      6758688 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      16703576 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          322228 kB
Writeback:           0 kB
AnonPages:      584804 kB
Mapped:          15512 kB
Slab:           520676 kB
PageTables:       5720 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   907328 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71360 MiB
End job on node117 at 2011-04-29 00:41:03