Trace number 3385318

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 11790.6 1491.73

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v50000-c210000-S874492400-019-UNKNOWN.cnf
MD5SUMec4818cc72441ba3110ddbe772c6ebb9
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark441.68
Satisfiable
(Un)Satisfiability was proved
Number of variables50000
Number of clauses210000
Sum of the clauses size630000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3210000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.30/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.30/0.47	c INFO: solving HOME/instance-3385318-1305565081.cnf
0.30/0.47	c INFO: computing task features
1.09/1.22	c INFO: computed variable-clause graph statistics
1.09/1.25	c INFO: computed clause balance statistics
4.79/4.90	c INFO: computed variable balance statistics
7.69/7.89	c INFO: computed small-clause counts
7.79/7.91	c INFO: computed Horn-clause counts
10.80/10.98	c INFO: computed variable graph statistics
10.80/10.98	c INFO: collected features for HOME/instance-3385318-1305565081.cnf in 10.49 s
10.90/11.01	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.35)
10.90/11.04	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.21)
10.90/11.08	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.14)
10.99/11.11	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.09)
10.99/11.14	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.07)
10.99/11.17	c INFO: running hybridGM3@0 for 194 with 4989 remaining (b = 0.10)
11.08/11.20	c INFO: running hybridGM3@0 for 194 with 4989 remaining (b = 0.07)
11.08/11.24	c INFO: running hybridGM3@0 for 194 with 4989 remaining (b = 0.06)
796.03/109.50	c INFO: running hybridGM3@0 for 97 with 4890 remaining (b = 0.03)
811.97/111.52	c INFO: running hybridGM3@0 for 97 with 4888 remaining (b = 0.03)
811.97/111.55	c INFO: running hybridGM3@0 for 97 with 4888 remaining (b = 0.03)
811.97/111.59	c INFO: running hybridGM3@0 for 97 with 4888 remaining (b = 0.03)
812.72/111.64	c INFO: running hybridGM3@0 for 97 with 4888 remaining (b = 0.03)
1572.11/206.85	c INFO: running hybridGM3@100 for 97 with 4793 remaining (b = 0.03)
1572.11/206.89	c INFO: running hybridGM3@100 for 97 with 4793 remaining (b = 0.03)
1572.75/206.92	c INFO: running TNM@0 for 97 with 4793 remaining (b = 0.03)
1572.75/206.98	c INFO: running hybridGM3@100 for 97 with 4793 remaining (b = 0.02)
1581.50/208.02	c INFO: running hybridGM3@94 for 97 with 4792 remaining (b = 0.02)
1581.50/208.07	c INFO: running hybridGM3@0 for 97 with 4792 remaining (b = 0.02)
1595.86/209.88	c INFO: running hybridGM3@98 for 97 with 4790 remaining (b = 0.02)
1629.34/214.02	c INFO: running hybridGM3@100 for 97 with 4786 remaining (b = 0.02)
2342.35/303.41	c INFO: running hybridGM3@0 for 97 with 4697 remaining (b = 0.02)
2373.40/307.31	c INFO: running hybridGM3@100 for 97 with 4693 remaining (b = 0.02)
2380.57/308.21	c INFO: running hybridGM3@0 for 194 with 4692 remaining (b = 0.04)
2380.57/308.25	c INFO: running hybridGM3@0 for 194 with 4692 remaining (b = 0.03)
2381.23/308.35	c INFO: running TNM@0 for 97 with 4692 remaining (b = 0.02)
2381.23/308.39	c INFO: running hybridGM3@297 for 97 with 4692 remaining (b = 0.02)
2396.57/310.25	c INFO: running hybridGM3@296 for 97 with 4690 remaining (b = 0.02)
2397.20/310.39	c INFO: running TNM@0 for 97 with 4690 remaining (b = 0.01)
3117.27/400.78	c INFO: running hybridGM3@99 for 97 with 4599 remaining (b = 0.01)
3141.23/403.75	c INFO: running hybridGM3@396 for 97 with 4596 remaining (b = 0.01)
3156.27/405.61	c INFO: running TNM@0 for 97 with 4594 remaining (b = 0.01)
3156.27/405.69	c INFO: running hybridGM3@392 for 97 with 4594 remaining (b = 0.01)
3180.95/408.74	c INFO: running TNM@0 for 97 with 4591 remaining (b = 0.01)
3229.51/414.87	c INFO: running TNM@0 for 97 with 4585 remaining (b = 0.01)
3877.21/496.15	c INFO: running TNM@0 for 97 with 4504 remaining (b = 0.01)
3940.76/504.15	c INFO: running hybridGM3@100 for 97 with 4496 remaining (b = 0.01)
3947.92/505.09	c INFO: running hybridGM3@98 for 97 with 4495 remaining (b = 0.01)
3948.69/505.14	c INFO: running TNM@0 for 97 with 4495 remaining (b = 0.01)
3955.97/506.08	c INFO: running TNM@0 for 97 with 4494 remaining (b = 0.01)
3963.84/507.08	c INFO: running TNM@0 for 2037 with 4493 remaining (b = 0.19)
3972.54/508.17	c INFO: running hybridGM3@0 for 194 with 4492 remaining (b = 0.02)
4021.03/514.29	c INFO: running hybridGM3@0 for 194 with 4486 remaining (b = 0.02)
4676.39/596.59	c INFO: running hybridGM3@0 for 194 with 4403 remaining (b = 0.01)
4707.35/600.47	c INFO: running adaptg2wsat2009++@0 for 97 with 4400 remaining (b = 0.01)
4732.07/603.57	c INFO: running hybridGM3@297 for 97 with 4396 remaining (b = 0.01)
4764.58/607.67	c INFO: running adaptg2wsat2009++@0 for 194 with 4392 remaining (b = 0.01)
4787.77/610.58	c INFO: running TNM@0 for 97 with 4389 remaining (b = 0.01)
5523.43/703.01	c INFO: running hybridGM3@398 for 97 with 4297 remaining (b = 0.01)
5540.22/705.19	c INFO: running hybridGM3@99 for 97 with 4295 remaining (b = 0.01)
5554.41/706.92	c INFO: running TNM@194 for 1843 with 4293 remaining (b = 0.11)
5572.71/709.28	c INFO: running hybridGM3@100 for 97 with 4291 remaining (b = 0.01)
5587.01/711.03	c INFO: running hybridGM3@0 for 194 with 4289 remaining (b = 0.01)
6243.21/793.56	c INFO: running hybridGM3@95 for 97 with 4206 remaining (b = 0.01)
6298.87/800.53	c INFO: running adaptg2wsat2009++@99 for 97 with 4200 remaining (b = 0.01)
6329.89/804.44	c INFO: running hybridGM3@0 for 194 with 4196 remaining (b = 0.01)
6347.35/806.61	c INFO: running adaptg2wsat2009++@100 for 97 with 4193 remaining (b = 0.01)
6372.02/809.72	c INFO: running adaptg2wsat2009++@0 for 194 with 4190 remaining (b = 0.01)
7001.91/888.96	c INFO: running hybridGM3@192 for 97 with 4111 remaining (b = 0.01)
7073.48/897.96	c INFO: running adaptg2wsat2009++@294 for 291 with 4102 remaining (b = 0.02)
7121.97/904.05	c INFO: running hybridGM3@195 for 291 with 4096 remaining (b = 0.01)
7178.40/911.13	c INFO: running FH@0 for 97 with 4089 remaining (b = 0.00)
7541.73/956.91	c INFO: running hybridGM3@194 for 291 with 4043 remaining (b = 0.01)
7808.12/990.38	c INFO: running hybridGM3@289 for 291 with 4010 remaining (b = 0.01)
7895.60/1001.40	c INFO: running hybridGM3@96 for 97 with 3999 remaining (b = 0.01)
7929.79/1005.61	c INFO: running hybridGM3@195 for 291 with 3994 remaining (b = 0.01)
7976.69/1011.56	c INFO: running hybridGM3@201 for 291 with 3988 remaining (b = 0.01)
8653.97/1096.80	c INFO: running NCVWr@0 for 485 with 3903 remaining (b = 0.02)
9546.86/1209.14	c INFO: running adaptg2wsat2009++@391 for 194 with 3791 remaining (b = 0.01)
9895.67/1253.01	c INFO: running hybridGM3@294 for 194 with 3747 remaining (b = 0.01)
10113.48/1280.47	c INFO: running TNM@0 for 97 with 3720 remaining (b = 0.00)
10211.05/1292.73	c INFO: running hybridGM3@294 for 194 with 3707 remaining (b = 0.01)
10329.46/1307.67	c INFO: running hybridGM3@296 for 194 with 3692 remaining (b = 0.01)
10911.84/1380.92	c INFO: running TNM@0 for 97 with 3619 remaining (b = 0.00)
11069.94/1400.87	c INFO: running adaptg2wsat2009++@685 for 97 with 3599 remaining (b = 0.00)
11418.69/1444.75	c INFO: running hybridGM3@194 for 291 with 3555 remaining (b = 0.01)
11709.41/1481.36	c INFO: running TNM@0 for 97 with 3519 remaining (b = 0.00)
11781.76/1490.49	c INFO: running FH@0 for 97 with 3510 remaining (b = 0.00)
11790.62/1491.63	c INFO: running TNM@0 for 97 with 3508 remaining (b = 0.00)
11790.62/1491.70	c INFO: running TNM@0 for 97 with 3508 remaining (b = 0.00)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385318-1305565081/watcher-3385318-1305565081 -o /tmp/evaluation-result-3385318-1305565081/solver-3385318-1305565081 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385318-1305565081.cnf -seed 116777666 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.08 2.18 0.78 1/429 6740
/proc/meminfo: memFree=25185116/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=15380 CPUtime=0 cores=0-7
/proc/6740/stat : 6740 (python) S 6738 6740 6487 0 -1 4202496 791 0 0 0 0 0 0 0 18 0 1 0 668106164 15749120 679 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244346880 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/6740/statm: 3846 679 322 364 0 333 0

[startup+0.030022 s]
/proc/loadavg: 6.08 2.18 0.78 1/429 6740
/proc/meminfo: memFree=25185116/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=18884 CPUtime=0.01 cores=0-7
/proc/6740/stat : 6740 (python) R 6738 6740 6487 0 -1 4202496 1268 0 0 0 1 0 0 0 17 0 1 0 668106164 19337216 1121 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244009669 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6740/statm: 4721 1121 421 364 0 690 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18884

[startup+0.101019 s]
/proc/loadavg: 6.08 2.18 0.78 1/429 6740
/proc/meminfo: memFree=25185116/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=104220 CPUtime=0.06 cores=0-7
/proc/6740/stat : 6740 (python) S 6738 6740 6487 0 -1 4202496 3047 0 0 0 5 1 0 0 17 0 1 0 668106164 106721280 2732 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244346880 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/6740/statm: 26055 2732 847 364 0 1803 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104220

[startup+0.300968 s]
/proc/loadavg: 6.08 2.18 0.78 1/429 6740
/proc/meminfo: memFree=25185116/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=168672 CPUtime=0.22 cores=0-7
/proc/6740/stat : 6740 (python) R 6738 6740 6487 0 -1 4202496 6717 933 1 0 17 5 0 0 17 0 1 0 668106164 172720128 4794 33554432000 4194304 5683644 140736418623760 18446744073709551615 4867472 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6740/statm: 42168 4794 1331 364 0 3453 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 168672

[startup+0.700908 s]
/proc/loadavg: 6.08 2.18 0.78 1/429 6740
/proc/meminfo: memFree=25185116/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=296428 CPUtime=0.59 cores=0-7
/proc/6740/stat : 6740 (python) R 6738 6740 6487 0 -1 4202496 13671 933 1 0 52 7 0 0 17 0 1 0 668106164 303542272 11351 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244009669 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6740/statm: 74107 11351 1761 364 0 10031 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 296428

[startup+1.50075 s]
/proc/loadavg: 6.08 2.18 0.78 2/430 6745
/proc/meminfo: memFree=25128440/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=328000 CPUtime=1.39 cores=0-7
/proc/6740/stat : 6740 (python) R 6738 6740 6487 0 -1 4202496 27456 933 1 0 130 9 0 0 19 0 1 0 668106164 335872000 19385 33554432000 4194304 5683644 140736418623760 18446744073709551615 47320178509765 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6740/statm: 82000 19385 1826 364 0 17924 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 328000

[startup+3.10047 s]
/proc/loadavg: 6.08 2.18 0.78 2/430 6745
/proc/meminfo: memFree=25113932/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=328000 CPUtime=2.99 cores=0-7
/proc/6740/stat : 6740 (python) R 6738 6740 6487 0 -1 4202496 27456 933 1 0 290 9 0 0 22 0 1 0 668106164 335872000 19385 33554432000 4194304 5683644 140736418623760 18446744073709551615 4570204 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6740/statm: 82000 19385 1826 364 0 17924 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 328000

[startup+6.30091 s]
/proc/loadavg: 5.67 2.16 0.78 2/430 6745
/proc/meminfo: memFree=25114304/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=328000 CPUtime=6.19 cores=0-7
/proc/6740/stat : 6740 (python) R 6738 6740 6487 0 -1 4202496 27457 933 1 0 610 9 0 0 25 0 1 0 668106164 335872000 19386 33554432000 4194304 5683644 140736418623760 18446744073709551615 47320176028327 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6740/statm: 82000 19386 1827 364 0 17924 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 328000

[startup+12.7017 s]
/proc/loadavg: 5.30 2.14 0.78 9/454 6769
/proc/meminfo: memFree=24957160/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=471692 CPUtime=11.13 cores=0-7
/proc/6740/stat : 6740 (python) S 6738 6740 6487 0 -1 4202496 33520 933 1 0 1101 12 0 0 19 0 9 0 668106164 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6740/statm: 117923 18658 1889 364 0 53820 0
[pid=6746] ppid=6740 vsize=324120 CPUtime=0 cores=0-7
/proc/6746/stat : 6746 (python) S 6740 6740 6487 0 -1 4202560 729 0 0 0 0 0 0 0 18 0 1 0 668107266 331898880 16936 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368911 0 0 16781312 514 2820594775214784511 0 0 17 7 0 0 0
/proc/6746/statm: 81030 16936 353 364 0 16948 0
[pid=6748] ppid=6746 vsize=276240 CPUtime=1.66 cores=0-7
/proc/6748/stat : 6748 (hybridGM3) R 6746 6748 6748 0 -1 4202496 5012 0 0 0 166 0 0 0 25 0 1 0 668107266 282869760 4746 33554432000 134512640 135204385 4292220288 18446744073709551615 134543975 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6748/statm: 69060 4746 57 169 0 68890 0
[pid=6749] ppid=6740 vsize=334376 CPUtime=0 cores=0-7
/proc/6749/stat : 6749 (python) S 6740 6740 6487 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 668107269 342401024 16934 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 17889886518512713727 0 0 17 6 0 0 0
/proc/6749/statm: 83594 16934 347 364 0 19509 0
[pid=6751] ppid=6749 vsize=276232 CPUtime=1.64 cores=0-7
/proc/6751/stat : 6751 (hybridGM3) R 6749 6751 6751 0 -1 4202496 4986 0 0 0 163 1 0 0 25 0 1 0 668107270 282861568 4722 33554432000 134512640 135204385 4288659712 18446744073709551615 134543968 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/6751/statm: 69058 4722 57 169 0 68888 0
[pid=6752] ppid=6740 vsize=344632 CPUtime=0 cores=0-7
/proc/6752/stat : 6752 (python) S 6740 6740 6487 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 668107272 352903168 16938 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 2820602471796178943 0 0 17 1 0 0 0
/proc/6752/statm: 86158 16938 347 364 0 22070 0
[pid=6754] ppid=6752 vsize=276240 CPUtime=1.6 cores=0-7
/proc/6754/stat : 6754 (hybridGM3) R 6752 6754 6754 0 -1 4202496 4963 0 0 0 160 0 0 0 25 0 1 0 668107273 282869760 4700 33554432000 134512640 135204385 4291229904 18446744073709551615 134543975 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6754/statm: 69060 4700 57 169 0 68890 0
[pid=6755] ppid=6740 vsize=354888 CPUtime=0 cores=0-7
/proc/6755/stat : 6755 (python) S 6740 6740 6487 0 -1 4202560 745 0 0 0 0 0 0 0 18 0 1 0 668107276 363405312 16942 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 5247516004879171583 0 0 17 1 0 0 0
/proc/6755/statm: 88722 16942 347 364 0 24631 0
[pid=6757] ppid=6755 vsize=276240 CPUtime=1.57 cores=0-7
/proc/6757/stat : 6757 (hybridGM3) R 6755 6757 6757 0 -1 4202496 4939 0 0 0 156 1 0 0 25 0 1 0 668107276 282869760 4679 33554432000 134512640 135204385 4293732720 18446744073709551615 134543975 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6757/statm: 69060 4679 57 169 0 68890 0
[pid=6758] ppid=6740 vsize=430680 CPUtime=0 cores=0-7
/proc/6758/stat : 6758 (python) S 6740 6740 6487 0 -1 4202560 717 0 0 0 0 0 0 0 18 0 1 0 668107279 441016320 17120 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 3906709403562147839 0 0 17 1 0 0 0
/proc/6758/statm: 107670 17120 348 364 0 43576 0
[pid=6760] ppid=6758 vsize=276232 CPUtime=1.53 cores=0-7
/proc/6760/stat : 6760 (hybridGM3) R 6758 6760 6760 0 -1 4202496 4892 0 0 0 152 1 0 0 24 0 1 0 668107279 282861568 4637 33554432000 134512640 135204385 4288830512 18446744073709551615 134543968 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6760/statm: 69058 4637 57 169 0 68888 0
[pid=6761] ppid=6740 vsize=440936 CPUtime=0 cores=0-7
/proc/6761/stat : 6761 (python) S 6740 6740 6487 0 -1 4202560 724 0 0 0 0 0 0 0 18 0 1 0 668107282 451518464 17088 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 7272376618591453183 0 0 17 1 0 0 0
/proc/6761/statm: 110234 17088 348 364 0 46137 0
[pid=6763] ppid=6761 vsize=276236 CPUtime=1.49 cores=0-7
/proc/6763/stat : 6763 (hybridGM3) R 6761 6763 6763 0 -1 4202496 4873 0 0 0 149 0 0 0 25 0 1 0 668107282 282865664 4617 33554432000 134512640 135204385 4291408720 18446744073709551615 134543968 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6763/statm: 69059 4617 57 169 0 68889 0
[pid=6764] ppid=6740 vsize=451192 CPUtime=0 cores=0-7
/proc/6764/stat : 6764 (python) S 6740 6740 6487 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 668107285 462020608 17092 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 11427276578573254655 0 0 17 1 0 0 0
/proc/6764/statm: 112798 17092 348 364 0 48698 0
[pid=6766] ppid=6764 vsize=276236 CPUtime=1.44 cores=0-7
/proc/6766/stat : 6766 (hybridGM3) R 6764 6766 6766 0 -1 4202496 4847 0 0 0 144 0 0 0 25 0 1 0 668107287 282865664 4588 33554432000 134512640 135204385 4292351376 18446744073709551615 134543975 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/6766/statm: 69059 4588 57 169 0 68889 0
[pid=6767] ppid=6740 vsize=461448 CPUtime=0 cores=0-7
/proc/6767/stat : 6767 (python) S 6740 6740 6487 0 -1 4202560 771 0 0 0 0 0 0 0 18 0 1 0 668107289 472522752 17119 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 10593108442660995071 0 0 17 1 0 0 0
/proc/6767/statm: 115362 17119 354 364 0 51259 0
[pid=6769] ppid=6767 vsize=276232 CPUtime=1.4 cores=0-7
/proc/6769/stat : 6769 (hybridGM3) R 6767 6769 6769 0 -1 4202496 4818 0 0 0 140 0 0 0 25 0 1 0 668107291 282861568 4554 33554432000 134512640 135204385 4292812400 18446744073709551615 134543968 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6769/statm: 69058 4554 57 169 0 68888 0
[pid=6740/tid=6747] ppid=6738 vsize=471692 CPUtime=0 cores=0-7
/proc/6740/task/6747/stat : 6747 (python) S 6738 6740 6487 0 -1 4202560 25 933 0 0 0 0 0 0 25 0 9 0 668107266 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 2 0 0 0
[pid=6740/tid=6750] ppid=6738 vsize=471692 CPUtime=0 cores=0-7
/proc/6740/task/6750/stat : 6750 (python) S 6738 6740 6487 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 9 0 668107269 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6753] ppid=6738 vsize=471692 CPUtime=0 cores=0-7
/proc/6740/task/6753/stat : 6753 (python) S 6738 6740 6487 0 -1 4202560 25 933 0 0 0 0 0 0 21 0 9 0 668107273 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6756] ppid=6738 vsize=471692 CPUtime=0 cores=0-7
/proc/6740/task/6756/stat : 6756 (python) S 6738 6740 6487 0 -1 4202560 22 933 0 0 0 0 0 0 18 0 9 0 668107276 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 5 0 0 0
[pid=6740/tid=6759] ppid=6738 vsize=471692 CPUtime=0 cores=0-7
/proc/6740/task/6759/stat : 6759 (python) S 6738 6740 6487 0 -1 4202560 88 933 0 0 0 0 0 0 19 0 9 0 668107279 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6762] ppid=6738 vsize=471692 CPUtime=0 cores=0-7
/proc/6740/task/6762/stat : 6762 (python) S 6738 6740 6487 0 -1 4202560 32 933 0 0 0 0 0 0 20 0 9 0 668107282 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 7 0 0 0
[pid=6740/tid=6765] ppid=6738 vsize=471692 CPUtime=0 cores=0-7
/proc/6740/task/6765/stat : 6765 (python) S 6738 6740 6487 0 -1 4202560 35 933 0 0 0 0 0 0 19 0 9 0 668107286 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6768] ppid=6738 vsize=471692 CPUtime=0 cores=0-7
/proc/6740/task/6768/stat : 6768 (python) S 6738 6740 6487 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 9 0 668107289 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 23.46
Current children cumulated vsize (KiB) 5823852

[startup+25.5015 s]
/proc/loadavg: 5.98 2.45 0.90 9/454 6770
/proc/meminfo: memFree=24793020/32951124 swapFree=64205392/67111528
[pid=6740] ppid=6738 vsize=471692 CPUtime=11.13 cores=0-7
/proc/6740/stat : 6740 (python) S 6738 6740 6487 0 -1 4202496 33520 933 1 0 1101 12 0 0 19 0 9 0 668106164 483012608 18658 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6740/statm: 117923 18658 1889 364 0 53820 0
[pid=6746] ppid=6740 vsize=324120 CPUtime=0.03 cores=0-7
/proc/6746/stat : 6746 (python) S 6740 6740 6487 0 -1 4202560 893 0 0 0 2 1 0 0 15 0 1 0 668107266 331898880 16959 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368911 0 0 16781312 514 10608915017526903044 0 0 17 7 0 0 0
/proc/6746/statm: 81030 16959 376 364 0 16948 0
[pid=6748] ppid=6746 vsize=276244 CPUtime=14.47 cores=0-7
/proc/6748/stat : 6748 (hybridGM3) R 6746 6748 6748 0 -1 4202496 9520 0 0 0 1446 1 0 0 25 0 1 0 668107266 282873856 9254 33554432000 134512640 135204385 4292220288 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6748/statm: 69061 9254 64 169 0 68891 0
[pid=6749] ppid=6740 vsize=334376 CPUtime=0.03 cores=0-7
/proc/6749/stat : 6749 (python) S 6740 6740 6487 0 -1 4202560 911 0 0 0 1 2 0 0 15 0 1 0 668107269 342401024 16957 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 10608915017526903041 0 0 17 6 0 0 0
/proc/6749/statm: 83594 16957 370 364 0 19509 0
[pid=6751] ppid=6749 vsize=276236 CPUtime=14.44 cores=0-7
/proc/6751/stat : 6751 (hybridGM3) R 6749 6751 6751 0 -1 4202496 9515 0 0 0 1443 1 0 0 25 0 1 0 668107270 282865664 9251 33554432000 134512640 135204385 4288659712 18446744073709551615 134537167 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/6751/statm: 69059 9251 64 169 0 68889 0
[pid=6752] ppid=6740 vsize=344632 CPUtime=0.04 cores=0-7
/proc/6752/stat : 6752 (python) S 6740 6740 6487 0 -1 4202560 933 0 0 0 2 2 0 0 15 0 1 0 668107272 352903168 16961 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 10608915017526903043 0 0 17 1 0 0 0
/proc/6752/statm: 86158 16961 370 364 0 22070 0
[pid=6754] ppid=6752 vsize=276244 CPUtime=14.36 cores=0-7
/proc/6754/stat : 6754 (hybridGM3) R 6752 6754 6754 0 -1 4202496 9519 0 0 0 1435 1 0 0 25 0 1 0 668107273 282873856 9256 33554432000 134512640 135204385 4291229904 18446744073709551615 134545968 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6754/statm: 69061 9256 64 169 0 68891 0
[pid=6755] ppid=6740 vsize=354888 CPUtime=0.03 cores=0-7
/proc/6755/stat : 6755 (python) S 6740 6740 6487 0 -1 4202560 935 0 0 0 1 2 0 0 15 0 1 0 668107276 363405312 16965 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 10608915017526903043 0 0 17 1 0 0 0
/proc/6755/statm: 88722 16965 370 364 0 24631 0
[pid=6757] ppid=6755 vsize=276244 CPUtime=14.37 cores=0-7
/proc/6757/stat : 6757 (hybridGM3) R 6755 6757 6757 0 -1 4202496 9511 0 0 0 1435 2 0 0 25 0 1 0 668107276 282873856 9251 33554432000 134512640 135204385 4293732720 18446744073709551615 134536698 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6757/statm: 69061 9251 64 169 0 68891 0
[pid=6758] ppid=6740 vsize=430680 CPUtime=0.03 cores=0-7
/proc/6758/stat : 6758 (python) S 6740 6740 6487 0 -1 4202560 800 0 0 0 1 2 0 0 15 0 1 0 668107279 441016320 17143 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 10608915017526903043 0 0 17 1 0 0 0
/proc/6758/statm: 107670 17143 371 364 0 43576 0
[pid=6760] ppid=6758 vsize=276236 CPUtime=14.32 cores=0-7
/proc/6760/stat : 6760 (hybridGM3) R 6758 6760 6760 0 -1 4202496 9505 0 0 0 1431 1 0 0 25 0 1 0 668107279 282865664 9250 33554432000 134512640 135204385 4288830512 18446744073709551615 134547471 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6760/statm: 69059 9250 64 169 0 68889 0

################
# More data... #
################

[pid=6861/tid=6876] ppid=6740 vsize=625544 CPUtime=0 cores=0-7
/proc/6861/task/6876/stat : 6876 (python) S 6740 6740 6487 0 -1 4202560 89 0 0 0 0 0 0 0 18 0 2 0 668176851 640557056 17513 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 514 18446604467864254656 0 0 -1 7 0 0 0
[pid=6865] ppid=6740 vsize=635800 CPUtime=1.09 cores=0-7
/proc/6865/stat : 6865 (python) S 6740 6740 6487 0 -1 4202560 1215 0 0 0 57 52 0 0 18 0 2 0 668166932 651059200 17518 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6865/statm: 158950 17518 406 364 0 94796 0
[pid=6867] ppid=6865 vsize=438600 CPUtime=292.54 cores=0-7
/proc/6867/stat : 6867 (adaptg2wsat2009) T 6865 6867 6867 0 -1 4202496 8785 0 0 0 29248 6 0 0 25 0 1 0 668166932 449126400 8499 33554432000 134512640 135107411 4293142064 18446744073709551615 134531627 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/6867/statm: 109650 8499 59 146 0 108526 0
[pid=6865/tid=6885] ppid=6740 vsize=635800 CPUtime=0 cores=0-7
/proc/6865/task/6885/stat : 6885 (python) S 6740 6740 6487 0 -1 4202560 92 0 0 0 0 0 0 0 18 0 2 0 668186603 651059200 17518 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 514 18446604458127521088 0 0 -1 0 0 0 0
[pid=6869] ppid=6740 vsize=646056 CPUtime=0.37 cores=0-7
/proc/6869/stat : 6869 (python) S 6740 6740 6487 0 -1 4202560 1183 0 0 0 17 20 0 0 19 0 2 0 668167223 661561344 17486 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6869/statm: 161514 17486 400 364 0 97357 0
[pid=6871] ppid=6869 vsize=471116 CPUtime=98.62 cores=0-7
/proc/6871/stat : 6871 (TNM) T 6869 6871 6871 0 -1 4202496 8455 0 0 0 9860 2 0 0 25 0 1 0 668167224 482422784 8172 33554432000 134512640 135008748 4287901856 18446744073709551615 134529002 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/6871/statm: 117779 8172 46 122 0 116679 0
[pid=6869/tid=6878] ppid=6740 vsize=646056 CPUtime=0 cores=0-7
/proc/6869/task/6878/stat : 6878 (python) S 6740 6740 6487 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 668177261 661561344 17486 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 514 18446604458852391104 0 0 -1 6 0 0 0
[pid=6879] ppid=6740 vsize=656312 CPUtime=0.75 cores=0-7
/proc/6879/stat : 6879 (python) S 6740 6740 6487 0 -1 4202560 1202 0 0 0 40 35 0 0 16 0 2 0 668177268 672063488 17492 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/6879/statm: 164078 17492 400 364 0 99918 0
[pid=6881] ppid=6879 vsize=276240 CPUtime=198.25 cores=0-7
/proc/6881/stat : 6881 (hybridGM3) T 6879 6881 6881 0 -1 4202496 9533 0 0 0 19823 2 0 0 25 0 1 0 668177269 282869760 9250 33554432000 134512640 135204385 4292699856 18446744073709551615 134537363 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/6881/statm: 69060 9250 64 169 0 68890 0
[pid=6879/tid=6895] ppid=6740 vsize=656312 CPUtime=0 cores=0-7
/proc/6879/task/6895/stat : 6895 (python) S 6740 6740 6487 0 -1 4202560 93 0 0 0 0 0 0 0 16 0 2 0 668197271 672063488 17492 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 514 18446604469704847680 0 0 -1 1 0 0 0
[pid=6886] ppid=6740 vsize=666568 CPUtime=1.08 cores=0-7
/proc/6886/stat : 6886 (python) S 6740 6740 6487 0 -1 4202560 1215 0 0 0 57 51 0 0 16 0 2 0 668186609 682565632 17498 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/6886/statm: 166642 17498 400 364 0 102479 0
[pid=6888] ppid=6886 vsize=276240 CPUtime=291.14 cores=0-7
/proc/6888/stat : 6888 (hybridGM3) T 6886 6888 6888 0 -1 4202496 9538 0 0 0 29112 2 0 0 25 0 1 0 668186610 282869760 9255 33554432000 134512640 135204385 4293198912 18446744073709551615 134537608 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6888/statm: 69060 9255 64 169 0 68890 0
[pid=6886/tid=6902] ppid=6740 vsize=666568 CPUtime=0 cores=0-7
/proc/6886/task/6902/stat : 6902 (python) S 6740 6740 6487 0 -1 4202560 90 0 0 0 0 0 0 0 15 0 2 0 668206298 682565632 17498 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 514 18446604461039284352 0 0 -1 1 0 0 0
[pid=6890] ppid=6740 vsize=676824 CPUtime=0.73 cores=0-7
/proc/6890/stat : 6890 (python) S 6740 6740 6487 0 -1 4202560 1276 0 0 0 35 38 0 0 19 0 2 0 668187137 693067776 17546 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6890/statm: 169206 17546 407 364 0 105040 0
[pid=6892] ppid=6890 vsize=438600 CPUtime=194.58 cores=0-7
/proc/6892/stat : 6892 (adaptg2wsat2009) T 6890 6892 6892 0 -1 4202496 8788 0 0 0 19456 2 0 0 25 0 1 0 668187138 449126400 8500 33554432000 134512640 135107411 4292674048 18446744073709551615 134531709 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6892/statm: 109650 8500 59 146 0 108526 0
[pid=6890/tid=6903] ppid=6740 vsize=676824 CPUtime=0 cores=0-7
/proc/6890/task/6903/stat : 6903 (python) S 6740 6740 6487 0 -1 4202560 89 0 0 0 0 0 0 0 19 0 2 0 668206720 693067776 17546 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 514 18446604470783338560 0 0 -1 1 0 0 0
[pid=6896] ppid=6740 vsize=687080 CPUtime=0.37 cores=0-7
/proc/6896/stat : 6896 (python) S 6740 6740 6487 0 -1 4202560 1245 0 0 0 17 20 0 0 18 0 2 0 668197277 703569920 17610 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6896/statm: 171770 17610 407 364 0 107601 0
[pid=6898] ppid=6896 vsize=266468 CPUtime=99.25 cores=0-7
/proc/6898/stat : 6898 (FH) T 6896 6898 6898 0 -1 4202496 8672 0 0 0 9921 4 0 0 25 0 1 0 668197278 272863232 8380 33554432000 134512640 134936988 4293337056 18446744073709551615 134552102 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/6898/statm: 66617 8380 41 104 0 66121 0
[pid=6896/tid=6904] ppid=6740 vsize=687080 CPUtime=0 cores=0-7
/proc/6896/task/6904/stat : 6904 (python) S 6740 6740 6487 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 668207315 703569920 17610 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 514 18446604470783339456 0 0 -1 0 0 0 0
[pid=6907] ppid=6740 vsize=697336 CPUtime=1.45 cores=0-7
/proc/6907/stat : 6907 (python) S 6740 6740 6487 0 -1 4202560 1059 0 0 0 75 70 0 0 18 0 1 0 668215844 714072064 17584 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 10608915017526903045 0 0 17 1 0 0 0
/proc/6907/statm: 174334 17584 378 364 0 110162 0
[pid=6909] ppid=6907 vsize=440652 CPUtime=377.97 cores=0-7
/proc/6909/stat : 6909 (NCVWr) R 6907 6909 6909 0 -1 4202496 9018 0 0 0 37795 2 0 0 25 0 1 0 668215845 451227648 8731 33554432000 134512640 135113558 4293793392 18446744073709551615 134531493 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6909/statm: 110163 8731 58 147 0 109038 0
[pid=6915] ppid=6740 vsize=707592 CPUtime=0.38 cores=0-7
/proc/6915/stat : 6915 (python) S 6740 6740 6487 0 -1 4202560 1274 0 0 0 20 18 0 0 19 0 2 0 668234211 724574208 17589 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6915/statm: 176898 17589 406 364 0 112723 0
[pid=6917] ppid=6915 vsize=471116 CPUtime=99.25 cores=0-7
/proc/6917/stat : 6917 (TNM) T 6915 6917 6917 0 -1 4202496 8463 0 0 0 9921 4 0 0 25 0 1 0 668234214 482422784 8173 33554432000 134512640 135008748 4287456112 18446744073709551615 134528967 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/6917/statm: 117779 8173 46 122 0 116679 0
[pid=6915/tid=6921] ppid=6740 vsize=707592 CPUtime=0 cores=0-7
/proc/6915/task/6921/stat : 6921 (python) S 6740 6740 6487 0 -1 4202560 99 0 0 0 0 0 0 0 19 0 2 0 668244251 724574208 17589 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 514 18446604467446042816 0 0 -1 0 0 0 0
[pid=6922] ppid=6740 vsize=717848 CPUtime=0.37 cores=0-7
/proc/6922/stat : 6922 (python) S 6740 6740 6487 0 -1 4202560 1276 0 0 0 18 19 0 0 19 0 2 0 668244257 735076352 17631 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6922/statm: 179462 17631 407 364 0 115284 0
[pid=6924] ppid=6922 vsize=471116 CPUtime=99.39 cores=0-7
/proc/6924/stat : 6924 (TNM) T 6922 6924 6924 0 -1 4202496 8461 0 0 0 9937 2 0 0 25 0 1 0 668244257 482422784 8171 33554432000 134512640 135008748 4290012208 18446744073709551615 134529475 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/6924/statm: 117779 8171 46 122 0 116679 0
[pid=6922/tid=6927] ppid=6740 vsize=717848 CPUtime=0 cores=0-7
/proc/6922/task/6927/stat : 6927 (python) S 6740 6740 6487 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 668254295 735076352 17631 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 514 18446604467446045504 0 0 -1 0 0 0 0
[pid=6928] ppid=6740 vsize=728104 CPUtime=0.04 cores=0-7
/proc/6928/stat : 6928 (python) S 6740 6740 6487 0 -1 4202560 1051 0 0 0 3 1 0 0 18 0 1 0 668254301 745578496 17573 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 10608915017526903044 0 0 17 1 0 0 0
/proc/6928/statm: 182026 17573 373 364 0 117845 0
[pid=6930] ppid=6928 vsize=471116 CPUtime=10.01 cores=0-7
/proc/6930/stat : 6930 (TNM) R 6928 6930 6930 0 -1 4202496 8463 0 0 0 999 2 0 0 25 0 1 0 668254302 482422784 8172 33554432000 134512640 135008748 4289712288 18446744073709551615 134524720 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/6930/statm: 117779 8172 46 122 0 116679 0
[pid=6932] ppid=6740 vsize=738360 CPUtime=0 cores=0-7
/proc/6932/stat : 6932 (python) S 6740 6740 6487 0 -1 4202560 946 0 0 0 0 0 0 0 18 0 1 0 668255214 756080640 17616 33554432000 4194304 5683644 140736418623760 18446744073709551615 228244368966 0 0 16781312 514 4934177181195567103 0 0 17 1 0 0 0
/proc/6932/statm: 184590 17616 349 364 0 120406 0
[pid=6934] ppid=6932 vsize=264984 CPUtime=0.97 cores=0-7
/proc/6934/stat : 6934 (FH) R 6932 6934 6934 0 -1 4202496 7303 0 0 0 96 1 0 0 23 0 1 0 668255214 271343616 7011 33554432000 134512640 134936988 4287098544 18446744073709551615 134544239 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6934/statm: 66246 7011 40 104 0 65750 0
[pid=6740/tid=6747] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6747/stat : 6747 (python) S 6738 6740 6487 0 -1 4202560 45 11718 0 0 0 0 34962 68 18 0 36 0 668107266 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 2 0 0 0
[pid=6740/tid=6750] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6750/stat : 6750 (python) S 6738 6740 6487 0 -1 4202560 33 11718 0 0 0 0 34962 68 18 0 36 0 668107269 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6753] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6753/stat : 6753 (python) S 6738 6740 6487 0 -1 4202560 44 11718 0 0 0 0 34962 68 15 0 36 0 668107273 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6756] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6756/stat : 6756 (python) S 6738 6740 6487 0 -1 4202560 45 11718 0 0 0 0 34962 68 18 0 36 0 668107276 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 5 0 0 0
[pid=6740/tid=6759] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6759/stat : 6759 (python) S 6738 6740 6487 0 -1 4202560 104 11718 0 0 0 0 34962 68 18 0 36 0 668107279 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6762] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6762/stat : 6762 (python) S 6738 6740 6487 0 -1 4202560 51 11718 0 0 0 0 34962 68 18 0 36 0 668107282 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 7 0 0 0
[pid=6740/tid=6765] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6765/stat : 6765 (python) S 6738 6740 6487 0 -1 4202560 55 11718 0 0 0 0 34962 68 18 0 36 0 668107286 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6768] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6768/stat : 6768 (python) S 6738 6740 6487 0 -1 4202560 56 11718 0 0 0 0 34962 68 18 0 36 0 668107289 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6790] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6790/stat : 6790 (python) S 6738 6740 6487 0 -1 4202560 39 11718 0 0 0 0 34962 68 20 0 36 0 668126857 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 2 0 0 0
[pid=6740/tid=6800] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6800/stat : 6800 (python) S 6738 6740 6487 0 -1 4202560 48 11718 0 0 0 0 34962 68 18 0 36 0 668136986 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 5 0 0 0
[pid=6740/tid=6803] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6803/stat : 6803 (python) S 6738 6740 6487 0 -1 4202560 52 11718 0 0 0 0 34962 68 18 0 36 0 668136990 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 7 0 0 0
[pid=6740/tid=6806] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6806/stat : 6806 (python) S 6738 6740 6487 0 -1 4202560 32 11718 0 0 0 0 34962 68 22 0 36 0 668137000 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 6 0 0 0
[pid=6740/tid=6809] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6809/stat : 6809 (python) S 6738 6740 6487 0 -1 4202560 36 11718 0 0 0 0 34962 68 20 0 36 0 668137204 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 7 0 0 0
[pid=6740/tid=6819] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6819/stat : 6819 (python) S 6738 6740 6487 0 -1 4202560 40 11718 0 0 0 0 34962 68 20 0 36 0 668146726 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6823] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6823/stat : 6823 (python) S 6738 6740 6487 0 -1 4202560 37 11718 0 0 0 0 34962 68 20 0 36 0 668147039 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6827] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6827/stat : 6827 (python) S 6738 6740 6487 0 -1 4202560 33 11718 0 0 0 0 34962 68 20 0 36 0 668147652 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6832] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6832/stat : 6832 (python) S 6738 6740 6487 0 -1 4202560 38 11718 0 0 0 0 34962 68 18 0 36 0 668155780 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6837] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6837/stat : 6837 (python) S 6738 6740 6487 0 -1 4202560 34 11718 0 0 0 0 34962 68 20 0 36 0 668156679 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6841] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6841/stat : 6841 (python) S 6738 6740 6487 0 -1 4202560 32 11718 0 0 0 0 34962 68 20 0 36 0 668156773 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6844] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6844/stat : 6844 (python) S 6738 6740 6487 0 -1 4202560 32 11718 0 0 0 0 34962 68 20 0 36 0 668156874 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6849] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6849/stat : 6849 (python) S 6738 6740 6487 0 -1 4202560 40 11718 0 0 0 0 34962 68 18 0 36 0 668156982 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6853] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6853/stat : 6853 (python) S 6738 6740 6487 0 -1 4202560 41 11718 0 0 0 0 34962 68 18 0 36 0 668157595 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6859] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6859/stat : 6859 (python) S 6738 6740 6487 0 -1 4202560 45 11718 0 0 0 0 34962 68 18 0 36 0 668165824 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6862] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6862/stat : 6862 (python) S 6738 6740 6487 0 -1 4202560 52 11718 0 0 0 0 34962 68 18 0 36 0 668166212 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6866] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6866/stat : 6866 (python) S 6738 6740 6487 0 -1 4202560 36 11718 0 0 0 0 34962 68 18 0 36 0 668166932 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6870] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6870/stat : 6870 (python) S 6738 6740 6487 0 -1 4202560 37 11718 0 0 0 0 34962 68 20 0 36 0 668167224 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6880] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6880/stat : 6880 (python) S 6738 6740 6487 0 -1 4202560 35 11718 0 0 0 0 34962 68 20 0 36 0 668177268 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6887] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6887/stat : 6887 (python) S 6738 6740 6487 0 -1 4202560 40 11718 0 0 0 0 34962 68 18 0 36 0 668186609 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6891] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6891/stat : 6891 (python) S 6738 6740 6487 0 -1 4202560 34 11718 0 0 0 0 34962 68 20 0 36 0 668187138 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6897] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6897/stat : 6897 (python) S 6738 6740 6487 0 -1 4202560 36 11718 0 0 0 0 34962 68 19 0 36 0 668197278 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6908] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6908/stat : 6908 (python) S 6738 6740 6487 0 -1 4202560 37 11718 0 0 0 0 34962 68 20 0 36 0 668215845 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6916] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6916/stat : 6916 (python) S 6738 6740 6487 0 -1 4202560 37 11718 0 0 0 0 34962 68 19 0 36 0 668234212 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6923] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6923/stat : 6923 (python) S 6738 6740 6487 0 -1 4202560 37 11718 0 0 0 0 34962 68 20 0 36 0 668244257 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
[pid=6740/tid=6929] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6929/stat : 6929 (python) S 6738 6740 6487 0 -1 4202560 33 11718 0 0 0 0 34962 68 20 0 36 0 668254302 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 0 0 0 0
[pid=6740/tid=6933] ppid=6738 vsize=748604 CPUtime=350.3 cores=0-7
/proc/6740/task/6933/stat : 6933 (python) S 6738 6740 6487 0 -1 4202560 32 11718 0 0 0 0 34962 68 20 0 36 0 668255214 766570496 19215 33554432000 4194304 5683644 140736418623760 18446744073709551615 228256172465 0 0 16781312 2 18446604442213792448 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11790.6
Current children cumulated vsize (KiB) 32653500

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6740 and gives
#  childrusage.ru_utime.tv_sec=4702
#  childrusage.ru_utime.tv_usec=438120
#  childrusage.ru_stime.tv_sec=21
#  childrusage.ru_stime.tv_usec=991656
# CPU time returned by wait4() is 4724.43
# while last known CPU time is 11790.6
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1491.73
CPU time (s): 11790.6
CPU user time (s): 11768
CPU system time (s): 22.6
CPU usage (%): 790.4
Max. virtual memory (cumulated for all children) (KiB): 32653500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4702.44
system time used= 21.9917
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 183178
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16199
involuntary context switches= 40104

runsolver used 17.6933 second user time and 43.7503 second system time

The end

Launcher Data 

Begin job on node136 at 2011-05-16 18:58:02
IDJOB=3385318
IDBENCH=82583
IDSOLVER=1870
FILE ID=node136/3385318-1305565081
RUNJOBID= node136-1305564962-6501
PBS_JOBID= 13350114
Free space on /tmp= 72968 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v50000-c210000-S874492400-019-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385318-1305565081/watcher-3385318-1305565081 -o /tmp/evaluation-result-3385318-1305565081/solver-3385318-1305565081 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385318-1305565081.cnf -seed 116777666 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ec4818cc72441ba3110ddbe772c6ebb9
RANDOM SEED=116777666

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25185520 kB
Buffers:         33980 kB
Cached:         691768 kB
SwapCached:      24924 kB
Active:        1039800 kB
Inactive:      6516360 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25185520 kB
SwapTotal:    67111528 kB
SwapFree:     64205392 kB
Dirty:           36548 kB
Writeback:           0 kB
AnonPages:     6811608 kB
Mapped:          32308 kB
Slab:            87380 kB
PageTables:      51952 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 122405504 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72900 MiB
End job on node136 at 2011-05-16 19:22:56