Trace number 3385445

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 13331.4 1672.16

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v500-c2130-S1762880211-075.UNKNOWN.cnf
MD5SUM57a2cff28dc53061839e3102dd9b3447
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1657.58
Satisfiable
(Un)Satisfiability was proved
Number of variables500
Number of clauses2130
Sum of the clauses size6390
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32130
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.47	c INFO: solving HOME/instance-3385445-1305566681.cnf
0.31/0.47	c INFO: computing task features
0.31/0.47	c INFO: computed variable-clause graph statistics
0.31/0.47	c INFO: computed clause balance statistics
0.40/0.51	c INFO: computed variable balance statistics
0.40/0.55	c INFO: computed small-clause counts
0.40/0.55	c INFO: computed Horn-clause counts
0.40/0.55	c INFO: computed variable graph statistics
0.40/0.55	c INFO: collected features for HOME/instance-3385445-1305566681.cnf in 0.08 s
0.40/0.58	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.57)
0.50/0.61	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.34)
0.50/0.64	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.30)
0.50/0.67	c INFO: running march_hi@0 for 97 with 4999 remaining (b = 0.09)
0.60/0.70	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.07)
0.60/0.74	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.25)
0.60/0.77	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.23)
0.69/0.81	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.20)
784.82/98.97	c INFO: running march_hi@0 for 485 with 4901 remaining (b = 0.18)
801.45/101.07	c INFO: running kcnfs-2006@0 for 582 with 4899 remaining (b = 0.18)
818.19/103.13	c INFO: running march_hi@0 for 97 with 4897 remaining (b = 0.04)
1568.78/197.28	c INFO: running march_hi@93 for 97 with 4803 remaining (b = 0.04)
2348.81/295.06	c INFO: running march_hi@190 for 97 with 4705 remaining (b = 0.04)
3113.74/390.94	c INFO: running march_hi@0 for 97 with 4609 remaining (b = 0.03)
3139.27/394.15	c INFO: running march_hi@580 for 194 with 4606 remaining (b = 0.08)
3206.29/402.57	c INFO: running march_hi@0 for 291 with 4597 remaining (b = 0.11)
3878.59/486.82	c INFO: running march_hi@98 for 97 with 4513 remaining (b = 0.04)
3908.99/490.61	c INFO: running march_hi@0 for 291 with 4509 remaining (b = 0.11)
3910.47/490.85	c INFO: running march_hi@0 for 97 with 4509 remaining (b = 0.04)
3921.64/492.26	c INFO: running march_hi@98 for 97 with 4508 remaining (b = 0.05)
4664.18/585.39	c INFO: running march_hi@586 for 97 with 4415 remaining (b = 0.07)
4696.91/589.51	c INFO: running march_hi@488 for 97 with 4410 remaining (b = 0.05)
4700.06/589.88	c INFO: running march_hi@99 for 291 with 4410 remaining (b = 0.11)
4704.06/590.37	c INFO: running march_hi@196 for 194 with 4410 remaining (b = 0.09)
4706.51/590.70	c INFO: running march_hi@972 for 1164 with 4409 remaining (b = 0.46)
5459.42/685.09	c INFO: running march_hi@0 for 388 with 4315 remaining (b = 0.14)
5464.17/685.60	c INFO: running march_hi@977 for 1164 with 4314 remaining (b = 0.41)
5490.47/688.98	c INFO: running kcnfs-2006@102 for 485 with 4311 remaining (b = 0.19)
5521.59/692.87	c INFO: running march_hi@95 for 97 with 4307 remaining (b = 0.04)
6220.29/780.44	c INFO: running march_hi@488 for 194 with 4220 remaining (b = 0.09)
6253.79/784.62	c INFO: running march_hi@389 for 97 with 4215 remaining (b = 0.04)
6335.95/794.90	c INFO: running march_hi@384 for 97 with 4205 remaining (b = 0.06)
7025.91/881.55	c INFO: running kcnfs-2006@0 for 582 with 4118 remaining (b = 0.20)
7025.91/881.59	c INFO: running march_hi@197 for 97 with 4118 remaining (b = 0.04)
7110.53/892.16	c INFO: running march_hi@481 for 97 with 4108 remaining (b = 0.03)
7788.38/977.18	c INFO: running kcnfs-2006@0 for 582 with 4023 remaining (b = 0.18)
7799.52/978.57	c INFO: running march_hi@293 for 97 with 4021 remaining (b = 0.05)
7888.03/989.69	c INFO: running adaptg2wsat2009++@0 for 97 with 4010 remaining (b = 0.03)
8588.29/1077.41	c INFO: running kcnfs-2006@0 for 582 with 3923 remaining (b = 0.16)
8668.89/1087.55	c INFO: running march_hi@684 for 1455 with 3912 remaining (b = 0.39)
8688.76/1090.07	c INFO: running march_hi@93 for 194 with 3910 remaining (b = 0.06)
9370.58/1175.56	c INFO: running kcnfs-2006@390 for 194 with 3824 remaining (b = 0.10)
10290.95/1290.96	c INFO: running march_hi@0 for 388 with 3709 remaining (b = 0.11)
10947.27/1373.22	c INFO: running kcnfs-2006@585 for 194 with 3627 remaining (b = 0.05)
11707.39/1468.53	c INFO: running kcnfs-2006@290 for 388 with 3531 remaining (b = 0.12)
12468.90/1564.10	c INFO: running kcnfs-2006@96 for 485 with 3436 remaining (b = 0.13)
12475.29/1564.86	c INFO: running kcnfs-2006@1169 for 194 with 3435 remaining (b = 0.06)
13276.83/1665.34	c INFO: running kcnfs-2006@391 for 194 with 3335 remaining (b = 0.10)
13331.10/1672.13	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385445-1305566681/watcher-3385445-1305566681 -o /tmp/evaluation-result-3385445-1305566681/solver-3385445-1305566681 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385445-1305566681.cnf -seed 1374732334 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.98 8.40 7.09 1/445 32740
/proc/meminfo: memFree=12238936/32951124 swapFree=65586204/67111528
[pid=32740] ppid=32738 vsize=16240 CPUtime=0 cores=0-7
/proc/32740/stat : 32740 (python) R 32738 32740 32378 0 -1 4202496 1050 0 0 0 0 0 0 0 25 0 1 0 746898738 16629760 922 33554432000 4194304 5683644 140733953857344 18446744073709551615 216734872527 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/32740/statm: 4060 922 381 364 0 547 0

[startup+0.0439159 s]
/proc/loadavg: 7.98 8.40 7.09 1/445 32740
/proc/meminfo: memFree=12238936/32951124 swapFree=65586204/67111528
[pid=32740] ppid=32738 vsize=27348 CPUtime=0.02 cores=0-7
/proc/32740/stat : 32740 (python) R 32738 32740 32378 0 -1 4202496 1351 0 0 0 2 0 0 0 25 0 1 0 746898738 28004352 1197 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735174501 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/32740/statm: 6837 1197 440 364 0 724 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 27348

[startup+0.100913 s]
/proc/loadavg: 7.98 8.40 7.09 1/445 32740
/proc/meminfo: memFree=12238936/32951124 swapFree=65586204/67111528
[pid=32740] ppid=32738 vsize=104228 CPUtime=0.06 cores=0-7
/proc/32740/stat : 32740 (python) S 32738 32740 32378 0 -1 4202496 3066 0 0 0 5 1 0 0 17 0 1 0 746898738 106729472 2748 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735176704 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/32740/statm: 26057 2748 847 364 0 1805 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104228

[startup+0.300872 s]
/proc/loadavg: 7.98 8.40 7.09 1/445 32740
/proc/meminfo: memFree=12238936/32951124 swapFree=65586204/67111528
[pid=32740] ppid=32738 vsize=170752 CPUtime=0.23 cores=0-7
/proc/32740/stat : 32740 (python) S 32738 32740 32378 0 -1 4202496 6738 933 1 0 18 5 0 0 18 0 1 0 746898738 174850048 4807 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735176704 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/32740/statm: 42688 4807 1336 364 0 3453 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 170752

[startup+0.700757 s]
/proc/loadavg: 7.98 8.40 7.09 1/445 32740
/proc/meminfo: memFree=12238936/32951124 swapFree=65586204/67111528
[pid=32740] ppid=32738 vsize=320264 CPUtime=0.6 cores=0-7
/proc/32740/stat : 32740 (python) R 32738 32740 32378 0 -1 4202496 12830 933 1 0 51 9 0 0 18 0 5 0 746898738 327950336 7279 33554432000 4194304 5683644 140733953857344 18446744073709551615 216738660625 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/32740/statm: 80066 7279 1880 364 0 15975 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 320264

[startup+1.50162 s]
/proc/loadavg: 7.98 8.40 7.09 9/470 301
/proc/meminfo: memFree=12178200/32951124 swapFree=65586204/67111528
[pid=32740] ppid=32738 vsize=426824 CPUtime=0.71 cores=0-7
/proc/32740/stat : 32740 (python) S 32738 32740 32378 0 -1 4202496 15749 933 1 0 61 10 0 0 24 0 9 0 746898738 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/32740/statm: 106706 7477 1889 364 0 42603 0
[pid=32746] ppid=32740 vsize=278680 CPUtime=0 cores=0-7
/proc/32746/stat : 32746 (python) S 32740 32740 32378 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 746898796 285368320 5577 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198735 0 0 16781312 514 2447521958695272447 0 0 17 7 0 0 0
/proc/32746/statm: 69670 5577 354 364 0 5588 0
[pid=32748] ppid=32746 vsize=1017800 CPUtime=0.91 cores=0-7
/proc/32748/stat : 32748 (gnovelty+2) R 32746 32748 32748 0 -1 4202496 439 0 0 0 91 0 0 0 21 0 1 0 746898796 1042227200 177 33554432000 134512640 135663704 4291716208 18446744073709551615 134545622 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32748/statm: 254450 177 113 282 0 254166 0
[pid=32749] ppid=32740 vsize=289340 CPUtime=0 cores=0-7
/proc/32749/stat : 32749 (python) S 32740 32740 32378 0 -1 4202560 758 0 0 0 0 0 0 0 15 0 1 0 746898799 296284160 5693 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 6372703428186964225 0 0 17 6 0 0 0
/proc/32749/statm: 72335 5693 348 364 0 8250 0
[pid=32751] ppid=32749 vsize=2352 CPUtime=0.88 cores=0-7
/proc/32751/stat : 32751 (march_hi) R 32749 32751 32751 0 -1 4202496 658 0 0 0 88 0 0 0 23 0 1 0 746898799 2408448 395 33554432000 4194304 4955518 140735471295360 18446744073709551615 4261424 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32751/statm: 588 395 104 186 0 401 0
[pid=32752] ppid=32740 vsize=299252 CPUtime=0 cores=0-7
/proc/32752/stat : 32752 (python) S 32740 32740 32378 0 -1 4202560 755 0 0 0 0 0 0 0 15 0 1 0 746898802 306434048 5612 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 16049615215406317825 0 0 17 0 0 0 0
/proc/32752/statm: 74813 5612 348 364 0 10725 0
[pid=32754] ppid=32752 vsize=2352 CPUtime=0.83 cores=0-7
/proc/32754/stat : 32754 (march_hi) R 32752 32754 32754 0 -1 4202496 660 0 0 0 83 0 0 0 23 0 1 0 746898803 2408448 393 33554432000 4194304 4955518 140736736285168 18446744073709551615 4209669 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32754/statm: 588 393 104 186 0 401 0
[pid=32755] ppid=32740 vsize=310020 CPUtime=0 cores=0-7
/proc/32755/stat : 32755 (python) S 32740 32740 32378 0 -1 4202560 768 0 0 0 0 0 0 0 17 0 1 0 746898805 317460480 5726 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 11493529300972306689 0 0 17 0 0 0 0
/proc/32755/statm: 77505 5726 348 364 0 13414 0
[pid=32757] ppid=32755 vsize=2352 CPUtime=0.81 cores=0-7
/proc/32757/stat : 32757 (march_hi) R 32755 32757 32757 0 -1 4202496 660 0 0 0 81 0 0 0 25 0 1 0 746898806 2408448 393 33554432000 4194304 4955518 140733381161280 18446744073709551615 4209653 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32757/statm: 588 393 104 186 0 401 0
[pid=32758] ppid=32740 vsize=320276 CPUtime=0 cores=0-7
/proc/32758/stat : 32758 (python) S 32740 32740 32378 0 -1 4202560 752 0 0 0 0 0 0 0 19 0 1 0 746898809 327962624 5747 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 13790897549437042687 0 0 17 0 0 0 0
/proc/32758/statm: 80069 5747 348 364 0 15975 0
[pid=32760] ppid=32758 vsize=1017800 CPUtime=0.78 cores=0-7
/proc/32760/stat : 32760 (gnovelty+2) R 32758 32760 32760 0 -1 4202496 443 0 0 0 78 0 0 0 22 0 1 0 746898809 1042227200 177 33554432000 134512640 135663704 4288719280 18446744073709551615 134545607 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32760/statm: 254450 177 113 282 0 254166 0
[pid=32761] ppid=32740 vsize=330532 CPUtime=0 cores=0-7
/proc/32761/stat : 32761 (python) S 32740 32740 32378 0 -1 4202560 771 0 0 0 0 0 0 0 16 0 1 0 746898812 338464768 5751 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 14862846344850014465 0 0 17 2 0 0 0
/proc/32761/statm: 82633 5751 348 364 0 18536 0
[pid=32763] ppid=32761 vsize=2352 CPUtime=0.75 cores=0-7
/proc/32763/stat : 32763 (march_hi) R 32761 32763 32763 0 -1 4202496 657 0 0 0 75 0 0 0 22 0 1 0 746898812 2408448 391 33554432000 4194304 4955518 140733435322352 18446744073709551615 4209699 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32763/statm: 588 391 104 186 0 401 0
[pid=32764] ppid=32740 vsize=340788 CPUtime=0 cores=0-7
/proc/32764/stat : 32764 (python) S 32740 32740 32378 0 -1 4202560 776 0 0 0 0 0 0 0 18 0 1 0 746898815 348966912 5755 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 173850384832364803 0 0 17 0 0 0 0
/proc/32764/statm: 85197 5755 348 364 0 21097 0
[pid=32766] ppid=32764 vsize=2352 CPUtime=0.72 cores=0-7
/proc/32766/stat : 32766 (march_hi) R 32764 32766 32766 0 -1 4202496 658 0 0 0 72 0 0 0 25 0 1 0 746898816 2408448 390 33554432000 4194304 4955518 140735879674016 18446744073709551615 4224747 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32766/statm: 588 390 104 186 0 401 0
[pid=32767] ppid=32740 vsize=416580 CPUtime=0 cores=0-7
/proc/32767/stat : 32767 (python) S 32740 32740 32378 0 -1 4202560 780 0 0 0 0 0 0 0 20 0 1 0 746898819 426577920 5938 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 11402925144797053185 0 0 17 0 0 0 0
/proc/32767/statm: 104145 5938 354 364 0 40042 0
[pid=301] ppid=32767 vsize=2352 CPUtime=0.66 cores=0-7
/proc/301/stat : 301 (march_hi) R 32767 301 301 0 -1 4202496 648 0 0 0 66 0 0 0 25 0 1 0 746898819 2408448 388 33554432000 4194304 4955518 140734403481200 18446744073709551615 4224687 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/301/statm: 588 388 104 186 0 401 0
[pid=32740/tid=32747] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32747/stat : 32747 (python) S 32738 32740 32378 0 -1 4202560 27 933 0 0 0 0 0 0 19 0 9 0 746898796 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32750] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32750/stat : 32750 (python) S 32738 32740 32378 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 9 0 746898799 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 6 0 0 0
[pid=32740/tid=32753] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32753/stat : 32753 (python) S 32738 32740 32378 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 9 0 746898802 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32756] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32756/stat : 32756 (python) S 32738 32740 32378 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 9 0 746898806 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32759] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32759/stat : 32759 (python) S 32738 32740 32378 0 -1 4202560 27 933 0 0 0 0 0 0 20 0 9 0 746898809 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32762] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32762/stat : 32762 (python) S 32738 32740 32378 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 9 0 746898812 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 2 0 0 0
[pid=32740/tid=32765] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32765/stat : 32765 (python) S 32738 32740 32378 0 -1 4202560 26 933 0 0 0 0 0 0 22 0 9 0 746898815 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
[pid=32740/tid=300] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/300/stat : 300 (python) S 32738 32740 32378 0 -1 4202560 68 933 0 0 0 0 0 0 25 0 9 0 746898819 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7.05
Current children cumulated vsize (KiB) 5062004

[startup+3.10134 s]
/proc/loadavg: 7.98 8.40 7.09 9/470 301
/proc/meminfo: memFree=12174604/32951124 swapFree=65586204/67111528
[pid=32740] ppid=32738 vsize=426824 CPUtime=0.71 cores=0-7
/proc/32740/stat : 32740 (python) S 32738 32740 32378 0 -1 4202496 15749 933 1 0 61 10 0 0 24 0 9 0 746898738 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/32740/statm: 106706 7477 1889 364 0 42603 0
[pid=32746] ppid=32740 vsize=278680 CPUtime=0 cores=0-7
/proc/32746/stat : 32746 (python) S 32740 32740 32378 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 746898796 285368320 5577 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198735 0 0 16781312 514 2447521958695239938 0 0 17 7 0 0 0
/proc/32746/statm: 69670 5577 354 364 0 5588 0
[pid=32748] ppid=32746 vsize=1017800 CPUtime=2.51 cores=0-7
/proc/32748/stat : 32748 (gnovelty+2) R 32746 32748 32748 0 -1 4202496 439 0 0 0 251 0 0 0 25 0 1 0 746898796 1042227200 177 33554432000 134512640 135663704 4291716208 18446744073709551615 134564723 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32748/statm: 254450 177 113 282 0 254166 0
[pid=32749] ppid=32740 vsize=289340 CPUtime=0 cores=0-7
/proc/32749/stat : 32749 (python) S 32740 32740 32378 0 -1 4202560 761 0 0 0 0 0 0 0 15 0 1 0 746898799 296284160 5693 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 6372703428186964225 0 0 17 6 0 0 0
/proc/32749/statm: 72335 5693 348 364 0 8250 0
[pid=32751] ppid=32749 vsize=2984 CPUtime=2.48 cores=0-7
/proc/32751/stat : 32751 (march_hi) R 32749 32751 32751 0 -1 4202496 784 0 0 0 248 0 0 0 25 0 1 0 746898799 3055616 521 33554432000 4194304 4955518 140735471295360 18446744073709551615 4227800 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32751/statm: 746 521 104 186 0 559 0
[pid=32752] ppid=32740 vsize=299252 CPUtime=0 cores=0-7
/proc/32752/stat : 32752 (python) S 32740 32740 32378 0 -1 4202560 758 0 0 0 0 0 0 0 15 0 1 0 746898802 306434048 5612 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 16049615215406317825 0 0 17 0 0 0 0
/proc/32752/statm: 74813 5612 348 364 0 10725 0
[pid=32754] ppid=32752 vsize=2984 CPUtime=2.41 cores=0-7
/proc/32754/stat : 32754 (march_hi) R 32752 32754 32754 0 -1 4202496 786 0 0 0 241 0 0 0 25 0 1 0 746898803 3055616 519 33554432000 4194304 4955518 140736736285168 18446744073709551615 4227664 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32754/statm: 746 519 104 186 0 559 0
[pid=32755] ppid=32740 vsize=310020 CPUtime=0 cores=0-7
/proc/32755/stat : 32755 (python) S 32740 32740 32378 0 -1 4202560 771 0 0 0 0 0 0 0 15 0 1 0 746898805 317460480 5726 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 11493529300972306689 0 0 17 0 0 0 0
/proc/32755/statm: 77505 5726 348 364 0 13414 0
[pid=32757] ppid=32755 vsize=2984 CPUtime=2.4 cores=0-7
/proc/32757/stat : 32757 (march_hi) R 32755 32757 32757 0 -1 4202496 786 0 0 0 240 0 0 0 25 0 1 0 746898806 3055616 519 33554432000 4194304 4955518 140733381161280 18446744073709551615 4224682 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32757/statm: 746 519 104 186 0 559 0
[pid=32758] ppid=32740 vsize=320276 CPUtime=0 cores=0-7
/proc/32758/stat : 32758 (python) S 32740 32740 32378 0 -1 4202560 752 0 0 0 0 0 0 0 18 0 1 0 746898809 327962624 5747 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 13790897549437010178 0 0 17 0 0 0 0
/proc/32758/statm: 80069 5747 348 364 0 15975 0
[pid=32760] ppid=32758 vsize=1017800 CPUtime=2.38 cores=0-7
/proc/32760/stat : 32760 (gnovelty+2) R 32758 32760 32760 0 -1 4202496 443 0 0 0 238 0 0 0 25 0 1 0 746898809 1042227200 177 33554432000 134512640 135663704 4288719280 18446744073709551615 134544167 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32760/statm: 254450 177 113 282 0 254166 0
[pid=32761] ppid=32740 vsize=330532 CPUtime=0 cores=0-7
/proc/32761/stat : 32761 (python) S 32740 32740 32378 0 -1 4202560 774 0 0 0 0 0 0 0 15 0 1 0 746898812 338464768 5751 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 14862846344850014465 0 0 17 2 0 0 0
/proc/32761/statm: 82633 5751 348 364 0 18536 0
[pid=32763] ppid=32761 vsize=2984 CPUtime=2.35 cores=0-7
/proc/32763/stat : 32763 (march_hi) R 32761 32763 32763 0 -1 4202496 781 0 0 0 235 0 0 0 25 0 1 0 746898812 3055616 515 33554432000 4194304 4955518 140733435322352 18446744073709551615 4244549 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32763/statm: 746 515 104 186 0 559 0
[pid=32764] ppid=32740 vsize=340788 CPUtime=0 cores=0-7
/proc/32764/stat : 32764 (python) S 32740 32740 32378 0 -1 4202560 779 0 0 0 0 0 0 0 15 0 1 0 746898815 348966912 5755 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 2447514262113845507 0 0 17 0 0 0 0
/proc/32764/statm: 85197 5755 348 364 0 21097 0
[pid=32766] ppid=32764 vsize=2984 CPUtime=2.32 cores=0-7
/proc/32766/stat : 32766 (march_hi) R 32764 32766 32766 0 -1 4202496 782 0 0 0 232 0 0 0 25 0 1 0 746898816 3055616 514 33554432000 4194304 4955518 140735879674016 18446744073709551615 4238735 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32766/statm: 746 514 104 186 0 559 0
[pid=32767] ppid=32740 vsize=416580 CPUtime=0 cores=0-7
/proc/32767/stat : 32767 (python) S 32740 32740 32378 0 -1 4202560 782 0 0 0 0 0 0 0 15 0 1 0 746898819 426577920 5938 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 11402925144797053185 0 0 17 0 0 0 0
/proc/32767/statm: 104145 5938 354 364 0 40042 0
[pid=301] ppid=32767 vsize=2984 CPUtime=2.26 cores=0-7
/proc/301/stat : 301 (march_hi) R 32767 301 301 0 -1 4202496 772 0 0 0 226 0 0 0 25 0 1 0 746898819 3055616 512 33554432000 4194304 4955518 140734403481200 18446744073709551615 4210833 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/301/statm: 746 512 104 186 0 559 0
[pid=32740/tid=32747] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32747/stat : 32747 (python) S 32738 32740 32378 0 -1 4202560 27 933 0 0 0 0 0 0 19 0 9 0 746898796 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32750] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32750/stat : 32750 (python) S 32738 32740 32378 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 9 0 746898799 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 6 0 0 0
[pid=32740/tid=32753] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32753/stat : 32753 (python) S 32738 32740 32378 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 9 0 746898802 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32756] ppid=32738 vsize=426824 CPUtime=0 cores=0-7
/proc/32740/task/32756/stat : 32756 (python) S 32738 32740 32378 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 9 0 746898806 437067776 7477 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32759] ppid=32738 vsize=426824 CPUtime=0 cores=0-7

################
# More data... #
################

/proc/32758/task/309/stat : 309 (python) S 32740 32740 32378 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 746908842 395071488 5801 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604447533702208 0 0 -1 6 0 0 0
[pid=32761] ppid=32740 vsize=396068 CPUtime=6.08 cores=0-7
/proc/32761/stat : 32761 (python) S 32740 32740 32378 0 -1 4202560 1192 0 0 0 327 281 0 0 15 0 2 0 746898812 405573632 5813 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/32761/statm: 99017 5813 400 364 0 34920 0
[pid=32763] ppid=32761 vsize=261208 CPUtime=1663.02 cores=0-7
/proc/32763/stat : 32763 (march_hi) R 32761 32763 32763 0 -1 4202496 47079 0 0 0 166290 12 0 0 25 0 1 0 746898812 267476992 46813 33554432000 4194304 4955518 140733435322352 18446744073709551615 4238735 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32763/statm: 65302 46813 104 186 0 65115 0
[pid=32761/tid=336] ppid=32740 vsize=396068 CPUtime=0 cores=0-7
/proc/32761/task/336/stat : 336 (python) S 32740 32740 32378 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 746947820 405573632 5813 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604452667688832 0 0 -1 1 0 0 0
[pid=32764] ppid=32740 vsize=406324 CPUtime=3.47 cores=0-7
/proc/32764/stat : 32764 (python) S 32740 32740 32378 0 -1 4202560 1247 0 0 0 179 168 0 0 15 0 2 0 746898815 416075776 5822 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/32764/statm: 101581 5822 406 364 0 37481 0
[pid=32766] ppid=32764 vsize=120792 CPUtime=972.78 cores=0-7
/proc/32766/stat : 32766 (march_hi) T 32764 32766 32766 0 -1 4202496 29812 0 0 0 97273 5 0 0 25 0 1 0 746898816 123691008 29544 33554432000 4194304 4955518 140735879674016 18446744073709551615 4209653 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32766/statm: 30198 29544 104 186 0 30011 0
[pid=32764/tid=335] ppid=32740 vsize=406324 CPUtime=0 cores=0-7
/proc/32764/task/335/stat : 335 (python) S 32740 32740 32378 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 746947796 416075776 5822 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604449187582272 0 0 -1 2 0 0 0
[pid=32767] ppid=32740 vsize=416580 CPUtime=3.15 cores=0-7
/proc/32767/stat : 32767 (python) S 32740 32740 32378 0 -1 4202560 1095 0 0 0 167 148 0 0 16 0 2 0 746898819 426577920 5991 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/32767/statm: 104145 5991 406 364 0 40042 0
[pid=301] ppid=32767 vsize=120792 CPUtime=876.65 cores=0-7
/proc/301/stat : 301 (march_hi) T 32767 301 301 0 -1 4202496 27329 0 0 0 87655 10 0 0 25 0 1 0 746898819 123691008 27069 33554432000 4194304 4955518 140734403481200 18446744073709551615 4244416 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/301/statm: 30198 27069 104 186 0 30011 0
[pid=32767/tid=337] ppid=32740 vsize=416580 CPUtime=0 cores=0-7
/proc/32767/task/337/stat : 337 (python) S 32740 32740 32378 0 -1 4202560 115 0 0 0 0 0 0 0 16 0 2 0 746947961 426577920 5991 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604450522857664 0 0 -1 0 0 0 0
[pid=32740/tid=32747] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/32747/stat : 32747 (python) S 32738 32740 32378 0 -1 4202560 27 933 0 0 0 0 0 0 19 0 17 0 746898796 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32750] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/32750/stat : 32750 (python) S 32738 32740 32378 0 -1 4202560 35 933 0 0 0 0 0 0 18 0 17 0 746898799 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 6 0 0 0
[pid=32740/tid=32753] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/32753/stat : 32753 (python) S 32738 32740 32378 0 -1 4202560 41 933 0 0 0 0 0 0 18 0 17 0 746898802 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32756] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/32756/stat : 32756 (python) S 32738 32740 32378 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 17 0 746898806 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32759] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/32759/stat : 32759 (python) S 32738 32740 32378 0 -1 4202560 27 933 0 0 0 0 0 0 20 0 17 0 746898809 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32762] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/32762/stat : 32762 (python) S 32738 32740 32378 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 17 0 746898812 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 2 0 0 0
[pid=32740/tid=32765] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/32765/stat : 32765 (python) S 32738 32740 32378 0 -1 4202560 42 933 0 0 0 0 0 0 18 0 17 0 746898815 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
[pid=32740/tid=300] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/300/stat : 300 (python) S 32738 32740 32378 0 -1 4202560 83 933 0 0 0 0 0 0 18 0 17 0 746898819 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=307] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/307/stat : 307 (python) S 32738 32740 32378 0 -1 4202560 57 933 0 0 0 0 0 0 15 0 17 0 746908635 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
[pid=32740/tid=320] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/320/stat : 320 (python) S 32738 32740 32378 0 -1 4202560 50 933 0 0 0 0 0 0 18 0 17 0 746908845 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=346] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/346/stat : 346 (python) S 32738 32740 32378 0 -1 4202560 52 933 0 0 0 0 0 0 18 0 17 0 746967247 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=358] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/358/stat : 358 (python) S 32738 32740 32378 0 -1 4202560 47 933 0 0 0 0 0 0 18 0 17 0 746986894 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 3 0 0 0
[pid=32740/tid=363] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/363/stat : 363 (python) S 32738 32740 32378 0 -1 4202560 43 933 0 0 0 0 0 0 18 0 17 0 746996456 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
[pid=32740/tid=367] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/367/stat : 367 (python) S 32738 32740 32378 0 -1 4202560 37 933 0 0 0 0 0 0 20 0 17 0 746997707 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=372] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/372/stat : 372 (python) S 32738 32740 32378 0 -1 4202560 39 933 0 0 0 0 0 0 18 0 17 0 747006479 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
[pid=32740/tid=383] ppid=32738 vsize=508872 CPUtime=0 cores=0-7
/proc/32740/task/383/stat : 383 (python) S 32738 32740 32378 0 -1 4202560 41 933 0 0 0 0 0 0 20 0 17 0 747027835 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 13329.4
Current children cumulated vsize (KiB) 11686848

[startup+1672.1 s]
/proc/loadavg: 8.08 8.10 7.92 9/509 397
/proc/meminfo: memFree=11028652/32951124 swapFree=65586204/67111528
[pid=32740] ppid=32738 vsize=508872 CPUtime=4013.63 cores=0-7
/proc/32740/stat : 32740 (python) S 32738 32740 32378 0 -1 4202496 27705 125722 1 0 192 12 400428 731 17 0 17 0 746898738 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747008831 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/32740/statm: 127218 7629 1906 364 0 63091 0
[pid=310] ppid=32740 vsize=437092 CPUtime=5.22 cores=0-7
/proc/310/stat : 310 (python) S 32740 32740 32378 0 -1 4202560 1032 0 0 0 285 237 0 0 18 0 2 0 746908845 447582208 6021 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/310/statm: 109273 6021 400 364 0 45164 0
[pid=321] ppid=310 vsize=182448 CPUtime=1563.96 cores=0-7
/proc/321/stat : 321 (kcnfs-2006) R 310 321 321 0 -1 4202496 589 0 0 0 156389 7 0 0 25 0 1 0 746908845 186826752 328 33554432000 134512640 135163436 4292515056 18446744073709551615 134667459 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/321/statm: 45612 328 77 159 0 45452 0
[pid=310/tid=348] ppid=32740 vsize=437092 CPUtime=0 cores=0-7
/proc/310/task/348/stat : 348 (python) S 32740 32740 32378 0 -1 4202560 79 0 0 0 0 0 0 0 18 0 2 0 746967633 447582208 6021 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604446009020800 0 0 -1 1 0 0 0
[pid=345] ppid=32740 vsize=447348 CPUtime=2.18 cores=0-7
/proc/345/stat : 345 (python) S 32740 32740 32378 0 -1 4202560 1061 0 0 0 113 105 0 0 15 0 2 0 746967247 458084352 5998 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/345/statm: 111837 5998 400 364 0 47725 0
[pid=347] ppid=345 vsize=91324 CPUtime=586.51 cores=0-7
/proc/347/stat : 347 (march_hi) T 345 347 347 0 -1 4202496 19082 0 0 0 58647 4 0 0 25 0 1 0 746967248 93515776 18817 33554432000 4194304 4955518 140735554111936 18446744073709551615 4224665 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/347/statm: 22831 18817 104 186 0 22644 0
[pid=345/tid=374] ppid=32740 vsize=447348 CPUtime=0 cores=0-7
/proc/345/task/374/stat : 374 (python) S 32740 32740 32378 0 -1 4202560 88 0 0 0 0 0 0 0 15 0 2 0 747007489 458084352 5998 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604449878004672 0 0 -1 0 0 0 0
[pid=357] ppid=32740 vsize=457604 CPUtime=2.62 cores=0-7
/proc/357/stat : 357 (python) S 32740 32740 32378 0 -1 4202560 1056 0 0 0 144 118 0 0 18 0 2 0 746986893 468586496 6045 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/357/statm: 114401 6045 400 364 0 50286 0
[pid=359] ppid=357 vsize=182452 CPUtime=786.96 cores=0-7
/proc/359/stat : 359 (kcnfs-2006) R 357 359 359 0 -1 4202496 590 0 0 0 78694 2 0 0 25 0 1 0 746986895 186830848 328 33554432000 134512640 135163436 4287853936 18446744073709551615 134588785 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/359/statm: 45613 328 77 159 0 45453 0
[pid=357/tid=389] ppid=32740 vsize=457604 CPUtime=0 cores=0-7
/proc/357/task/389/stat : 389 (python) S 32740 32740 32378 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 747045588 468586496 6045 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604447630636352 0 0 -1 6 0 0 0
[pid=362] ppid=32740 vsize=467860 CPUtime=2.32 cores=0-7
/proc/362/stat : 362 (python) S 32740 32740 32378 0 -1 4202560 1065 0 0 0 129 103 0 0 18 0 2 0 746996456 479088640 6051 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/362/statm: 116965 6051 400 364 0 52847 0
[pid=364] ppid=362 vsize=182448 CPUtime=692.33 cores=0-7
/proc/364/stat : 364 (kcnfs-2006) R 362 364 364 0 -1 4202496 593 0 0 0 69233 0 0 0 25 0 1 0 746996457 186826752 328 33554432000 134512640 135163436 4293952528 18446744073709551615 134621371 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/364/statm: 45612 328 77 159 0 45452 0
[pid=362/tid=393] ppid=32740 vsize=467860 CPUtime=0 cores=0-7
/proc/362/task/393/stat : 393 (python) S 32740 32740 32378 0 -1 4202560 82 0 0 0 0 0 0 0 19 0 2 0 747055145 479088640 6051 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604447630635456 0 0 -1 0 0 0 0
[pid=366] ppid=32740 vsize=0 CPUtime=99.77 cores=0-7
/proc/366/stat : 366 (python) Z 32740 32740 32378 0 -1 4202588 1168 467 0 0 20 14 9943 0 18 0 2 0 746997707 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 0 0 0 0
/proc/366/statm: 0 0 0 0 0 0 0
[pid=366/tid=375] ppid=32740 vsize=0 CPUtime=99.43 cores=0-7
/proc/366/task/375/stat : 375 (python) R 32740 32740 32378 0 -1 4203588 92 467 0 0 0 0 9943 0 18 0 2 0 747007742 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 -1 6 0 0 0
[pid=371] ppid=32740 vsize=488372 CPUtime=2.01 cores=0-7
/proc/371/stat : 371 (python) S 32740 32740 32378 0 -1 4202560 1212 0 0 0 109 92 0 0 18 0 2 0 747006479 500092928 6121 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/371/statm: 122093 6121 407 364 0 57969 0
[pid=373] ppid=371 vsize=182452 CPUtime=593.77 cores=0-7
/proc/373/stat : 373 (kcnfs-2006) R 371 373 373 0 -1 4202496 601 0 0 0 59376 1 0 0 25 0 1 0 747006479 186830848 329 33554432000 134512640 135163436 4289234640 18446744073709551615 134675088 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/373/statm: 45613 329 77 159 0 45453 0
[pid=371/tid=397] ppid=32740 vsize=488372 CPUtime=0 cores=0-7
/proc/371/task/397/stat : 397 (python) S 32740 32740 32378 0 -1 4202560 78 0 0 0 0 0 0 0 19 0 2 0 747065269 500092928 6121 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604453902106688 0 0 -1 7 0 0 0
[pid=382] ppid=32740 vsize=498628 CPUtime=1.4 cores=0-7
/proc/382/stat : 382 (python) S 32740 32740 32378 0 -1 4202560 1001 0 0 0 75 65 0 0 15 0 1 0 747027835 510595072 6095 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 11566009107475300610 0 0 17 7 0 0 0
/proc/382/statm: 124657 6095 380 364 0 60530 0
[pid=384] ppid=382 vsize=56652 CPUtime=372.04 cores=0-7
/proc/384/stat : 384 (march_hi) R 382 384 384 0 -1 4202496 12808 0 0 0 37201 3 0 0 25 0 1 0 747027835 58011648 12537 33554432000 4194304 4955518 140736405647984 18446744073709551615 4227593 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/384/statm: 14163 12537 104 186 0 13976 0
[pid=32749] ppid=32740 vsize=289340 CPUtime=4.56 cores=0-7
/proc/32749/stat : 32749 (python) S 32740 32740 32378 0 -1 4202560 1151 0 0 0 243 213 0 0 15 0 2 0 746898799 296284160 5746 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32749/statm: 72335 5746 400 364 0 8250 0
[pid=32751] ppid=32749 vsize=194776 CPUtime=1265.79 cores=0-7
/proc/32751/stat : 32751 (march_hi) R 32749 32751 32751 0 -1 4202496 37611 0 0 0 126571 8 0 0 25 0 1 0 746898799 199450624 37348 33554432000 4194304 4955518 140735471295360 18446744073709551615 4224704 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32751/statm: 48694 37348 104 186 0 48507 0
[pid=32749/tid=331] ppid=32740 vsize=289340 CPUtime=0 cores=0-7
/proc/32749/task/331/stat : 331 (python) S 32740 32740 32378 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 746937829 296284160 5746 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604444314932224 0 0 -1 5 0 0 0
[pid=32755] ppid=32740 vsize=310020 CPUtime=6.06 cores=0-7
/proc/32755/stat : 32755 (python) S 32740 32740 32378 0 -1 4202560 1190 0 0 0 312 294 0 0 15 0 2 0 746898805 317460480 5779 33554432000 4194304 5683644 140733953857344 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/32755/statm: 77505 5779 400 364 0 13414 0
[pid=32757] ppid=32755 vsize=261208 CPUtime=1660.72 cores=0-7
/proc/32757/stat : 32757 (march_hi) R 32755 32757 32757 0 -1 4202496 47060 0 0 0 166055 17 0 0 25 0 1 0 746898806 267476992 46793 33554432000 4194304 4955518 140733381161280 18446744073709551615 4209733 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32757/statm: 65302 46793 104 186 0 65115 0
[pid=32755/tid=322] ppid=32740 vsize=310020 CPUtime=0 cores=0-7
/proc/32755/task/322/stat : 322 (python) S 32740 32740 32378 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 746909048 317460480 5779 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 514 18446604443553798848 0 0 -1 0 0 0 0
[pid=32761] ppid=32740 vsize=0 CPUtime=1669.25 cores=0-7
/proc/32761/stat : 32761 (python) Z 32740 32740 32378 0 -1 4202588 1271 47082 0 0 327 281 166304 13 16 0 1 0 746898812 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 2 0 0 0
/proc/32761/statm: 0 0 0 0 0 0 0
[pid=32740/tid=32747] ppid=32738 vsize=508872 CPUtime=4011.59 cores=0-7
/proc/32740/task/32747/stat : 32747 (python) S 32738 32740 32378 0 -1 4202560 27 125722 0 0 0 0 400428 731 19 0 17 0 746898796 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32750] ppid=32738 vsize=508872 CPUtime=4011.59 cores=0-7
/proc/32740/task/32750/stat : 32750 (python) S 32738 32740 32378 0 -1 4202560 35 125722 0 0 0 0 400428 731 18 0 17 0 746898799 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 6 0 0 0
[pid=32740/tid=32753] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/32753/stat : 32753 (python) S 32738 32740 32378 0 -1 4202560 41 127357 0 0 0 0 410391 746 18 0 17 0 746898802 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32756] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/32756/stat : 32756 (python) S 32738 32740 32378 0 -1 4202560 31 127357 0 0 0 0 410391 746 18 0 17 0 746898806 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32759] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/32759/stat : 32759 (python) S 32738 32740 32378 0 -1 4202560 27 127357 0 0 0 0 410391 746 20 0 17 0 746898809 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=32762] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/32762/stat : 32762 (python) S 32738 32740 32378 0 -1 4202560 40 127357 0 0 0 0 410391 746 18 0 17 0 746898812 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 2 0 0 0
[pid=32740/tid=32765] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/32765/stat : 32765 (python) S 32738 32740 32378 0 -1 4202560 42 127357 0 0 0 0 410391 746 18 0 17 0 746898815 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
[pid=32740/tid=300] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/300/stat : 300 (python) S 32738 32740 32378 0 -1 4202560 83 127357 0 0 0 0 410391 746 18 0 17 0 746898819 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=307] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/307/stat : 307 (python) S 32738 32740 32378 0 -1 4202560 57 127357 0 0 0 0 410391 746 15 0 17 0 746908635 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
[pid=32740/tid=320] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/320/stat : 320 (python) S 32738 32740 32378 0 -1 4202560 50 127357 0 0 0 0 410391 746 18 0 17 0 746908845 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=346] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/346/stat : 346 (python) S 32738 32740 32378 0 -1 4202560 52 127357 0 0 0 0 410391 746 18 0 17 0 746967247 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=358] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/358/stat : 358 (python) S 32738 32740 32378 0 -1 4202560 47 127357 0 0 0 0 410391 746 18 0 17 0 746986894 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 3 0 0 0
[pid=32740/tid=363] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/363/stat : 363 (python) S 32738 32740 32378 0 -1 4202560 43 127357 0 0 0 0 410391 746 18 0 17 0 746996456 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
[pid=32740/tid=367] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/367/stat : 367 (python) S 32738 32740 32378 0 -1 4202560 37 127357 0 0 0 0 410391 746 20 0 17 0 746997707 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 0 0 0 0
[pid=32740/tid=372] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/372/stat : 372 (python) S 32738 32740 32378 0 -1 4202560 39 127357 0 0 0 0 410391 746 18 0 17 0 747006479 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
[pid=32740/tid=383] ppid=32738 vsize=508872 CPUtime=4111.37 cores=0-7
/proc/32740/task/383/stat : 383 (python) S 32738 32740 32378 0 -1 4202560 41 127357 0 0 0 0 410391 746 20 0 17 0 747027835 521084928 7629 33554432000 4194304 5683644 140733953857344 18446744073709551615 216747002289 0 0 16781312 2 18446604447788989184 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 13331.1
Current children cumulated vsize (KiB) 5238896

Child status: 0
Real time (s): 1672.16
CPU time (s): 13331.4
CPU user time (s): 13308.1
CPU system time (s): 23.3504
CPU usage (%): 797.259
Max. virtual memory (cumulated for all children) (KiB): 11686852

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 13308.1
system time used= 23.3504
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 335537
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 20434
involuntary context switches= 78183

runsolver used 12.3821 second user time and 27.0869 second system time

The end

Launcher Data 

Begin job on node119 at 2011-05-16 19:24:41
IDJOB=3385445
IDBENCH=82710
IDSOLVER=1870
FILE ID=node119/3385445-1305566681
RUNJOBID= node119-1305564964-32392
PBS_JOBID= 13350131
Free space on /tmp= 73068 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v500-c2130-S1762880211-075.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385445-1305566681/watcher-3385445-1305566681 -o /tmp/evaluation-result-3385445-1305566681/solver-3385445-1305566681 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385445-1305566681.cnf -seed 1374732334 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 57a2cff28dc53061839e3102dd9b3447
RANDOM SEED=1374732334

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12239216 kB
Buffers:        317188 kB
Cached:        5554252 kB
SwapCached:       4756 kB
Active:       16573372 kB
Inactive:      3781572 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12239216 kB
SwapTotal:    67111528 kB
SwapFree:     65586204 kB
Dirty:           31984 kB
Writeback:           0 kB
AnonPages:    14482608 kB
Mapped:          34112 kB
Slab:           216908 kB
PageTables:      69408 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 130398664 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73036 MiB
End job on node119 at 2011-05-16 19:52:33