Trace number 3321830

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 7734.48 978.006

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v40000-c168000-S1184456903-078-UNKNOWN.cnf
MD5SUM33dd7efc1f63d9d3511c7a69c68ea88b
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark108.505
Satisfiable
(Un)Satisfiability was proved
Number of variables40000
Number of clauses168000
Sum of the clauses size504000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3168000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.47	c INFO: solving HOME/instance-3321830-1304368010.cnf
0.31/0.47	c INFO: computing task features
0.90/1.05	c INFO: computed variable-clause graph statistics
0.90/1.07	c INFO: computed clause balance statistics
3.90/4.07	c INFO: computed variable balance statistics
6.31/6.47	c INFO: computed small-clause counts
6.31/6.48	c INFO: computed Horn-clause counts
8.30/8.49	c INFO: computed variable graph statistics
8.30/8.49	c INFO: collected features for HOME/instance-3321830-1304368010.cnf in 8.01 s
8.40/8.53	c INFO: running hybridGM3@0 for 97 with 39991 remaining (b = 0.35)
8.40/8.57	c INFO: running hybridGM3@0 for 97 with 39991 remaining (b = 0.21)
8.50/8.61	c INFO: running hybridGM3@0 for 97 with 39991 remaining (b = 0.14)
8.50/8.65	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.18)
8.50/8.69	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.13)
9.00/8.73	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.10)
9.00/8.77	c INFO: running TNM@0 for 97 with 39991 remaining (b = 0.04)
9.60/8.81	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.07)
802.80/108.18	c INFO: running hybridGM3@0 for 97 with 39892 remaining (b = 0.03)
809.98/109.02	c INFO: running hybridGM3@0 for 194 with 39891 remaining (b = 0.05)
811.42/109.23	c INFO: running hybridGM3@0 for 97 with 39891 remaining (b = 0.02)
811.42/109.27	c INFO: running hybridGM3@0 for 97 with 39891 remaining (b = 0.02)
1564.19/203.55	c INFO: running hybridGM3@0 for 97 with 39796 remaining (b = 0.02)
1571.30/204.46	c INFO: running hybridGM3@100 for 97 with 39796 remaining (b = 0.02)
1571.30/204.50	c INFO: running hybridGM3@0 for 194 with 39796 remaining (b = 0.04)
1579.08/205.55	c INFO: running hybridGM3@0 for 97 with 39794 remaining (b = 0.02)
1580.89/205.64	c INFO: running hybridGM3@99 for 97 with 39794 remaining (b = 0.02)
1595.17/207.44	c INFO: running hybridGM3@99 for 97 with 39793 remaining (b = 0.02)
1628.66/211.60	c INFO: running hybridGM3@0 for 97 with 39788 remaining (b = 0.02)
2339.71/300.79	c INFO: running hybridGM3@0 for 194 with 39699 remaining (b = 0.03)
2340.51/300.89	c INFO: running hybridGM3@0 for 194 with 39699 remaining (b = 0.03)
2354.84/302.69	c INFO: running TNM@0 for 97 with 39697 remaining (b = 0.01)
2356.34/302.81	c INFO: running hybridGM3@94 for 97 with 39697 remaining (b = 0.01)
2379.64/305.72	c INFO: running hybridGM3@298 for 97 with 39694 remaining (b = 0.01)
2381.16/305.99	c INFO: running hybridGM3@100 for 97 with 39694 remaining (b = 0.01)
2388.39/306.85	c INFO: running hybridGM3@94 for 97 with 39693 remaining (b = 0.01)
2799.30/358.34	c INFO: running TNM@0 for 1940 with 39642 remaining (b = 0.20)
2800.10/358.43	c INFO: running hybridGM3@0 for 194 with 39642 remaining (b = 0.02)
3143.28/401.44	c INFO: running TNM@0 for 97 with 39599 remaining (b = 0.01)
3155.20/402.98	c INFO: running adaptg2wsat2009++@0 for 194 with 39597 remaining (b = 0.02)
3189.48/407.25	c INFO: running hybridGM3@193 for 97 with 39593 remaining (b = 0.01)
3196.68/408.11	c INFO: running hybridGM3@144 for 97 with 39592 remaining (b = 0.01)
3292.40/420.17	c INFO: running TNM@0 for 97 with 39580 remaining (b = 0.01)
3911.58/497.73	c INFO: running hybridGM3@95 for 97 with 39502 remaining (b = 0.01)
3912.38/497.80	c INFO: running hybridGM3@94 for 97 with 39502 remaining (b = 0.01)
3943.48/501.72	c INFO: running hybridGM3@0 for 194 with 39498 remaining (b = 0.02)
3949.10/502.51	c INFO: running hybridGM3@294 for 97 with 39498 remaining (b = 0.01)
4092.48/520.45	c INFO: running hybridGM3@0 for 194 with 39480 remaining (b = 0.02)
4362.73/554.39	c INFO: running TNM@0 for 97 with 39446 remaining (b = 0.01)
4671.15/593.01	c INFO: running hybridGM3@291 for 194 with 39407 remaining (b = 0.02)
4671.15/593.08	c INFO: running TNM@0 for 97 with 39407 remaining (b = 0.01)
4708.55/597.77	c INFO: running hybridGM3@393 for 97 with 39402 remaining (b = 0.01)
4769.89/605.47	c INFO: running TNM@0 for 97 with 39395 remaining (b = 0.01)
5162.01/654.70	c INFO: running TNM@0 for 97 with 39345 remaining (b = 0.01)
5257.71/666.69	c INFO: running TNM@0 for 97 with 39333 remaining (b = 0.01)
5371.65/680.92	c INFO: running TNM@0 for 97 with 39319 remaining (b = 0.01)
5470.39/693.39	c INFO: running adaptg2wsat2009++@99 for 97 with 39307 remaining (b = 0.01)
5513.47/698.71	c INFO: running hybridGM3@94 for 97 with 39301 remaining (b = 0.01)
5562.05/704.82	c INFO: running hybridGM3@0 for 194 with 39295 remaining (b = 0.01)
5662.42/717.47	c INFO: running TNM@0 for 97 with 39283 remaining (b = 0.01)
5953.78/754.04	c INFO: running TNM@0 for 97 with 39246 remaining (b = 0.01)
6049.27/766.06	c INFO: running TNM@0 for 97 with 39234 remaining (b = 0.01)
6170.22/781.24	c INFO: running adaptg2wsat2009++@0 for 194 with 39219 remaining (b = 0.01)
6245.84/790.71	c INFO: running adaptg2wsat2009++@296 for 291 with 39209 remaining (b = 0.02)
6319.85/800.03	c INFO: running hybridGM3@193 for 97 with 39200 remaining (b = 0.01)
6453.58/816.87	c INFO: running TNM@0 for 97 with 39183 remaining (b = 0.01)
6752.05/854.37	c INFO: running TNM@0 for 97 with 39146 remaining (b = 0.01)
6840.43/865.41	c INFO: running TNM@0 for 97 with 39135 remaining (b = 0.01)
7078.43/895.34	c INFO: running hybridGM3@291 for 194 with 39105 remaining (b = 0.01)
7130.12/901.88	c INFO: running TNM@0 for 97 with 39098 remaining (b = 0.01)
7252.57/917.22	c INFO: running TNM@0 for 97 with 39083 remaining (b = 0.01)
7550.76/954.72	c INFO: running TNM@0 for 97 with 39045 remaining (b = 0.01)
7638.18/965.77	c INFO: running hybridGM3@194 for 291 with 39034 remaining (b = 0.02)
7726.47/976.82	c INFO: running TNM@0 for 97 with 39023 remaining (b = 0.00)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321830-1304368010/watcher-3321830-1304368010 -o /tmp/evaluation-result-3321830-1304368010/solver-3321830-1304368010 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321830-1304368010.cnf -seed 1851351691 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.71 8.01 6.66 1/271 6982
/proc/meminfo: memFree=21201556/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=15520 CPUtime=0 cores=0-7
/proc/6982/stat : 6982 (python) R 6980 6982 6594 0 -1 4202496 827 0 0 0 0 0 0 0 20 0 1 0 529217208 15892480 711 33554432000 4194304 5683644 140733913516464 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6982/statm: 3945 715 334 364 0 432 0

[startup+0.0550139 s]
/proc/loadavg: 7.71 8.01 6.66 1/271 6982
/proc/meminfo: memFree=21201556/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=34424 CPUtime=0.03 cores=0-7
/proc/6982/stat : 6982 (python) S 6980 6982 6594 0 -1 4202496 1552 0 0 0 3 0 0 0 20 0 1 0 529217208 35250176 1388 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106766848 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/6982/statm: 8606 1388 448 364 0 944 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 34424

[startup+0.101006 s]
/proc/loadavg: 7.71 8.01 6.66 1/271 6982
/proc/meminfo: memFree=21201556/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=104228 CPUtime=0.07 cores=0-7
/proc/6982/stat : 6982 (python) R 6980 6982 6594 0 -1 4202496 3087 0 0 0 5 2 0 0 20 0 1 0 529217208 106729472 2767 33554432000 4194304 5683644 140733913516464 18446744073709551615 5114052 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6982/statm: 26057 2767 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104228

[startup+0.300973 s]
/proc/loadavg: 7.71 8.01 6.66 1/271 6982
/proc/meminfo: memFree=21201556/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=170752 CPUtime=0.23 cores=0-7
/proc/6982/stat : 6982 (python) S 6980 6982 6594 0 -1 4202496 6734 938 1 0 16 7 0 0 21 0 1 0 529217208 174850048 4806 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106766848 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/6982/statm: 42688 4806 1336 364 0 3453 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 170752

[startup+0.70091 s]
/proc/loadavg: 7.71 8.01 6.66 1/271 6982
/proc/meminfo: memFree=21201556/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=296024 CPUtime=0.6 cores=0-7
/proc/6982/stat : 6982 (python) R 6980 6982 6594 0 -1 4202496 13617 938 1 0 51 9 0 0 21 0 1 0 529217208 303128576 11297 33554432000 4194304 5683644 140733913516464 18446744073709551615 4300627 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6982/statm: 74006 11297 1761 364 0 9930 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 296024

[startup+1.50078 s]
/proc/loadavg: 7.71 8.01 6.66 2/272 6987
/proc/meminfo: memFree=21155048/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=317984 CPUtime=1.4 cores=0-7
/proc/6982/stat : 6982 (python) R 6980 6982 6594 0 -1 4202496 23799 938 1 0 129 11 0 0 23 0 1 0 529217208 325615616 16881 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106428835 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6982/statm: 79496 16881 1826 364 0 15420 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 317984

[startup+3.10048 s]
/proc/loadavg: 7.71 8.01 6.66 2/272 6987
/proc/meminfo: memFree=21140808/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=317984 CPUtime=3 cores=0-7
/proc/6982/stat : 6982 (python) R 6980 6982 6594 0 -1 4202496 23799 938 1 0 289 11 0 0 25 0 1 0 529217208 325615616 16881 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106424089 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6982/statm: 79496 16881 1826 364 0 15420 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 317984

[startup+6.30092 s]
/proc/loadavg: 7.25 7.91 6.64 2/272 6987
/proc/meminfo: memFree=21140932/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=317984 CPUtime=6.21 cores=0-7
/proc/6982/stat : 6982 (python) R 6980 6982 6594 0 -1 4202496 23800 938 1 0 610 11 0 0 25 0 1 0 529217208 325615616 16882 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106426609 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6982/statm: 79496 16882 1827 364 0 15420 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 317984

[startup+12.7018 s]
/proc/loadavg: 7.39 7.93 6.65 9/296 7012
/proc/meminfo: memFree=20851716/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=396916 CPUtime=8.71 cores=0-7
/proc/6982/stat : 6982 (python) S 6980 6982 6594 0 -1 4202496 30527 938 1 0 858 13 0 0 24 0 9 0 529217208 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6982/statm: 99229 16194 1889 364 0 35126 0
[pid=6989] ppid=6982 vsize=314880 CPUtime=0 cores=0-7
/proc/6989/stat : 6989 (python) S 6982 6982 6594 0 -1 4202560 735 0 0 0 0 0 0 0 15 0 1 0 529218062 322437120 14626 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788879 0 0 16781312 514 657894985797959939 0 0 17 7 0 0 0
/proc/6989/statm: 78720 14626 353 364 0 14638 0
[pid=6991] ppid=6989 vsize=276240 CPUtime=4.15 cores=0-7
/proc/6991/stat : 6991 (hybridGM3) R 6989 6991 6991 0 -1 4202496 8563 0 0 0 414 1 0 0 25 0 1 0 529218062 282869760 8298 33554432000 134512640 135204385 4290501728 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6991/statm: 69060 8298 64 169 0 68890 0
[pid=6992] ppid=6982 vsize=325136 CPUtime=0 cores=0-7
/proc/6992/stat : 6992 (python) S 6982 6982 6594 0 -1 4202560 740 0 0 0 0 0 0 0 15 0 1 0 529218066 332939264 14624 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 4554779698915148034 0 0 17 2 0 0 0
/proc/6992/statm: 81284 14624 347 364 0 17199 0
[pid=6994] ppid=6992 vsize=276240 CPUtime=4.12 cores=0-7
/proc/6994/stat : 6994 (hybridGM3) R 6992 6994 6994 0 -1 4202496 8565 0 0 0 411 1 0 0 25 0 1 0 529218066 282869760 8301 33554432000 134512640 135204385 4288465136 18446744073709551615 134546102 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6994/statm: 69060 8301 64 169 0 68890 0
[pid=6995] ppid=6982 vsize=335392 CPUtime=0 cores=0-7
/proc/6995/stat : 6995 (python) S 6982 6982 6594 0 -1 4202560 748 0 0 0 0 0 0 0 15 0 1 0 529218070 343441408 14628 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 976964464085532930 0 0 17 2 0 0 0
/proc/6995/statm: 83848 14628 347 364 0 19760 0
[pid=6997] ppid=6995 vsize=276236 CPUtime=4.08 cores=0-7
/proc/6997/stat : 6997 (hybridGM3) R 6995 6997 6997 0 -1 4202496 8566 0 0 0 407 1 0 0 25 0 1 0 529218070 282865664 8302 33554432000 134512640 135204385 4292165584 18446744073709551615 134537483 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6997/statm: 69059 8302 64 169 0 68889 0
[pid=6998] ppid=6982 vsize=345648 CPUtime=0 cores=0-7
/proc/6998/stat : 6998 (python) S 6982 6982 6594 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 529218074 353943552 14632 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 16140738341069881603 0 0 17 0 0 0 0
/proc/6998/statm: 86412 14632 347 364 0 22321 0
[pid=7000] ppid=6998 vsize=276244 CPUtime=4.03 cores=0-7
/proc/7000/stat : 7000 (hybridGM3) R 6998 7000 7000 0 -1 4202496 8565 0 0 0 402 1 0 0 25 0 1 0 529218074 282873856 8302 33554432000 134512640 135204385 4293772752 18446744073709551615 134537401 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7000/statm: 69061 8302 64 169 0 68891 0
[pid=7001] ppid=6982 vsize=355904 CPUtime=0 cores=0-7
/proc/7001/stat : 7001 (python) S 6982 6982 6594 0 -1 4202560 762 0 0 0 0 0 0 0 15 0 1 0 529218078 364445696 14636 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 18318796108903448833 0 0 17 0 0 0 0
/proc/7001/statm: 88976 14636 347 364 0 24882 0
[pid=7003] ppid=7001 vsize=276236 CPUtime=3.99 cores=0-7
/proc/7003/stat : 7003 (hybridGM3) R 7001 7003 7003 0 -1 4202496 8562 0 0 0 398 1 0 0 25 0 1 0 529218078 282865664 8296 33554432000 134512640 135204385 4293071504 18446744073709551615 134546082 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/7003/statm: 69059 8296 64 169 0 68889 0
[pid=7004] ppid=6982 vsize=366160 CPUtime=0 cores=0-7
/proc/7004/stat : 7004 (python) S 6982 6982 6594 0 -1 4202560 759 0 0 0 0 0 0 0 15 0 1 0 529218082 374947840 14640 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 13597251286675194113 0 0 17 2 0 0 0
/proc/7004/statm: 91540 14640 347 364 0 27443 0
[pid=7006] ppid=7004 vsize=276236 CPUtime=3.91 cores=0-7
/proc/7006/stat : 7006 (hybridGM3) R 7004 7006 7006 0 -1 4202496 8560 0 0 0 391 0 0 0 25 0 1 0 529218082 282865664 8296 33554432000 134512640 135204385 4287271440 18446744073709551615 134537565 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/7006/statm: 69059 8296 64 169 0 68889 0
[pid=7007] ppid=6982 vsize=376416 CPUtime=0 cores=0-7
/proc/7007/stat : 7007 (python) S 6982 6982 6594 0 -1 4202560 768 0 0 0 0 0 0 0 18 0 1 0 529218086 385449984 14644 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 17954962763470045444 0 0 17 0 0 0 0
/proc/7007/statm: 94104 14644 347 364 0 30004 0
[pid=7009] ppid=7007 vsize=467024 CPUtime=3.9 cores=0-7
/proc/7009/stat : 7009 (TNM) R 7007 7009 7009 0 -1 4202496 6823 0 0 0 389 1 0 0 25 0 1 0 529218087 478232576 6557 33554432000 134512640 135008748 4287752224 18446744073709551615 134528974 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/7009/statm: 116756 6557 46 122 0 115656 0
[pid=7010] ppid=6982 vsize=386672 CPUtime=0 cores=0-7
/proc/7010/stat : 7010 (python) S 6982 6982 6594 0 -1 4202560 797 0 0 0 0 0 0 0 15 0 1 0 529218090 395952128 14654 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 12794871681189380354 0 0 17 2 0 0 0
/proc/7010/statm: 96668 14654 353 364 0 32565 0
[pid=7012] ppid=7010 vsize=276240 CPUtime=3.87 cores=0-7
/proc/7012/stat : 7012 (hybridGM3) R 7010 7012 7012 0 -1 4202496 8571 0 0 0 386 1 0 0 25 0 1 0 529218091 282869760 8301 33554432000 134512640 135204385 4291260080 18446744073709551615 134536744 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7012/statm: 69060 8301 64 169 0 68890 0
[pid=6982/tid=6990] ppid=6980 vsize=396916 CPUtime=0 cores=0-7
/proc/6982/task/6990/stat : 6990 (python) S 6980 6982 6594 0 -1 4202560 25 938 0 0 0 0 0 0 25 0 9 0 529218062 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 0 0 0 0
[pid=6982/tid=6993] ppid=6980 vsize=396916 CPUtime=0 cores=0-7
/proc/6982/task/6993/stat : 6993 (python) S 6980 6982 6594 0 -1 4202560 23 938 0 0 0 0 0 0 25 0 9 0 529218066 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 2 0 0 0
[pid=6982/tid=6996] ppid=6980 vsize=396916 CPUtime=0 cores=0-7
/proc/6982/task/6996/stat : 6996 (python) S 6980 6982 6594 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 9 0 529218070 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 2 0 0 0
[pid=6982/tid=6999] ppid=6980 vsize=396916 CPUtime=0 cores=0-7
/proc/6982/task/6999/stat : 6999 (python) S 6980 6982 6594 0 -1 4202560 26 938 0 0 0 0 0 0 20 0 9 0 529218074 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7002] ppid=6980 vsize=396916 CPUtime=0 cores=0-7
/proc/6982/task/7002/stat : 7002 (python) S 6980 6982 6594 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 9 0 529218078 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 0 0 0 0
[pid=6982/tid=7005] ppid=6980 vsize=396916 CPUtime=0 cores=0-7
/proc/6982/task/7005/stat : 7005 (python) S 6980 6982 6594 0 -1 4202560 23 938 0 0 0 0 0 0 20 0 9 0 529218082 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 0 0 0 0
[pid=6982/tid=7008] ppid=6980 vsize=396916 CPUtime=0 cores=0-7
/proc/6982/task/7008/stat : 7008 (python) S 6980 6982 6594 0 -1 4202560 26 938 0 0 0 0 0 0 22 0 9 0 529218086 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 0 0 0 0
[pid=6982/tid=7011] ppid=6980 vsize=396916 CPUtime=0 cores=0-7
/proc/6982/task/7011/stat : 7011 (python) S 6980 6982 6594 0 -1 4202560 30 938 0 0 0 0 0 0 24 0 9 0 529218091 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40.76
Current children cumulated vsize (KiB) 5603820

[startup+25.5015 s]
/proc/loadavg: 7.60 7.95 6.67 9/296 7012
/proc/meminfo: memFree=20851096/32951124 swapFree=67111448/67111528
[pid=6982] ppid=6980 vsize=396916 CPUtime=8.71 cores=0-7
/proc/6982/stat : 6982 (python) S 6980 6982 6594 0 -1 4202496 30527 938 1 0 858 13 0 0 24 0 9 0 529217208 406441984 16194 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6982/statm: 99229 16194 1889 364 0 35126 0
[pid=6989] ppid=6982 vsize=314880 CPUtime=0.03 cores=0-7
/proc/6989/stat : 6989 (python) S 6982 6982 6594 0 -1 4202560 907 0 0 0 2 1 0 0 15 0 1 0 529218062 322437120 14649 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788879 0 0 16781312 514 14175554816171802883 0 0 17 7 0 0 0
/proc/6989/statm: 78720 14649 376 364 0 14638 0
[pid=6991] ppid=6989 vsize=276240 CPUtime=16.95 cores=0-7
/proc/6991/stat : 6991 (hybridGM3) R 6989 6991 6991 0 -1 4202496 8563 0 0 0 1694 1 0 0 25 0 1 0 529218062 282869760 8298 33554432000 134512640 135204385 4290501728 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6991/statm: 69060 8298 64 169 0 68890 0
[pid=6992] ppid=6982 vsize=325136 CPUtime=0.04 cores=0-7
/proc/6992/stat : 6992 (python) S 6982 6982 6594 0 -1 4202560 925 0 0 0 2 2 0 0 16 0 1 0 529218066 332939264 14647 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 14175554816171802882 0 0 17 2 0 0 0
/proc/6992/statm: 81284 14647 370 364 0 17199 0
[pid=6994] ppid=6992 vsize=276240 CPUtime=16.92 cores=0-7
/proc/6994/stat : 6994 (hybridGM3) R 6992 6994 6994 0 -1 4202496 8565 0 0 0 1691 1 0 0 25 0 1 0 529218066 282869760 8301 33554432000 134512640 135204385 4288465136 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6994/statm: 69060 8301 64 169 0 68890 0
[pid=6995] ppid=6982 vsize=335392 CPUtime=0.03 cores=0-7
/proc/6995/stat : 6995 (python) S 6982 6982 6594 0 -1 4202560 928 0 0 0 2 1 0 0 15 0 1 0 529218070 343441408 14651 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 14175554816171802882 0 0 17 2 0 0 0
/proc/6995/statm: 83848 14651 370 364 0 19760 0
[pid=6997] ppid=6995 vsize=276236 CPUtime=16.88 cores=0-7
/proc/6997/stat : 6997 (hybridGM3) R 6995 6997 6997 0 -1 4202496 8566 0 0 0 1687 1 0 0 25 0 1 0 529218070 282865664 8302 33554432000 134512640 135204385 4292165584 18446744073709551615 134536929 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6997/statm: 69059 8302 64 169 0 68889 0
[pid=6998] ppid=6982 vsize=345648 CPUtime=0.03 cores=0-7
/proc/6998/stat : 6998 (python) S 6982 6982 6594 0 -1 4202560 933 0 0 0 1 2 0 0 16 0 1 0 529218074 353943552 14655 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 14175554816171802883 0 0 17 7 0 0 0
/proc/6998/statm: 86412 14655 370 364 0 22321 0
[pid=7000] ppid=6998 vsize=276244 CPUtime=16.83 cores=0-7
/proc/7000/stat : 7000 (hybridGM3) R 6998 7000 7000 0 -1 4202496 8565 0 0 0 1682 1 0 0 25 0 1 0 529218074 282873856 8302 33554432000 134512640 135204385 4293772752 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7000/statm: 69061 8302 64 169 0 68891 0
[pid=7001] ppid=6982 vsize=355904 CPUtime=0.03 cores=0-7
/proc/7001/stat : 7001 (python) S 6982 6982 6594 0 -1 4202560 952 0 0 0 1 2 0 0 16 0 1 0 529218078 364445696 14659 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 14175554816171802881 0 0 17 0 0 0 0
/proc/7001/statm: 88976 14659 370 364 0 24882 0
[pid=7003] ppid=7001 vsize=276236 CPUtime=16.79 cores=0-7
/proc/7003/stat : 7003 (hybridGM3) R 7001 7003 7003 0 -1 4202496 8563 0 0 0 1678 1 0 0 25 0 1 0 529218078 282865664 8297 33554432000 134512640 135204385 4293071504 18446744073709551615 134536705 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/7003/statm: 69059 8297 64 169 0 68889 0

################
# More data... #
################

/proc/7109/statm: 116756 6558 46 122 0 115656 0
[pid=7107/tid=7125] ppid=6982 vsize=647072 CPUtime=0 cores=0-7
/proc/7107/task/7125/stat : 7125 (python) S 6982 6982 6594 0 -1 4202560 203 0 0 0 0 0 0 0 19 0 2 0 529298886 662601728 15095 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 514 18446604453947205760 0 0 -1 4 0 0 0
[pid=7112] ppid=6982 vsize=657328 CPUtime=0.24 cores=0-7
/proc/7112/stat : 7112 (python) S 6982 6982 6594 0 -1 4202560 1187 0 0 0 11 13 0 0 19 0 2 0 529292613 673103872 15157 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/7112/statm: 164332 15157 400 364 0 100169 0
[pid=7114] ppid=7112 vsize=467024 CPUtime=99.71 cores=0-7
/proc/7114/stat : 7114 (TNM) T 7112 7114 7114 0 -1 4202496 6839 0 0 0 9970 1 0 0 25 0 1 0 529292613 478232576 6558 33554432000 134512640 135008748 4293711936 18446744073709551615 134529292 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7114/statm: 116756 6558 46 122 0 115656 0
[pid=7112/tid=7130] ppid=6982 vsize=657328 CPUtime=0 cores=0-7
/proc/7112/task/7130/stat : 7130 (python) S 6982 6982 6594 0 -1 4202560 101 0 0 0 0 0 0 0 19 0 2 0 529302636 673103872 15157 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 514 18446604453979961536 0 0 -1 6 0 0 0
[pid=7117] ppid=6982 vsize=667584 CPUtime=0.23 cores=0-7
/proc/7117/stat : 7117 (python) S 6982 6982 6594 0 -1 4202560 1237 0 0 0 11 12 0 0 19 0 2 0 529293814 683606016 15155 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/7117/statm: 166896 15155 407 364 0 102730 0
[pid=7119] ppid=7117 vsize=467024 CPUtime=98.65 cores=0-7
/proc/7119/stat : 7119 (TNM) T 7117 7119 7119 0 -1 4202496 6846 0 0 0 9864 1 0 0 25 0 1 0 529293815 478232576 6557 33554432000 134512640 135008748 4288152528 18446744073709551615 134527773 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7119/statm: 116756 6557 46 122 0 115656 0
[pid=7117/tid=7134] ppid=6982 vsize=667584 CPUtime=0 cores=0-7
/proc/7117/task/7134/stat : 7134 (python) S 6982 6982 6594 0 -1 4202560 101 0 0 0 0 0 0 0 19 0 2 0 529303739 683606016 15155 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 514 18446604453950964160 0 0 -1 4 0 0 0
[pid=7121] ppid=6982 vsize=677840 CPUtime=0.47 cores=0-7
/proc/7121/stat : 7121 (python) S 6982 6982 6594 0 -1 4202560 1340 0 0 0 24 23 0 0 18 0 2 0 529295333 694108160 15159 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/7121/statm: 169460 15159 407 364 0 105291 0
[pid=7123] ppid=7121 vsize=434080 CPUtime=195.32 cores=0-7
/proc/7123/stat : 7123 (adaptg2wsat2009) T 7121 7123 7123 0 -1 4202496 7111 0 0 0 19531 1 0 0 25 0 1 0 529295334 444497920 6819 33554432000 134512640 135107411 4289259088 18446744073709551615 134531296 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/7123/statm: 108520 6819 59 146 0 107396 0
[pid=7121/tid=7154] ppid=6982 vsize=677840 CPUtime=0 cores=0-7
/proc/7121/task/7154/stat : 7154 (python) S 6982 6982 6594 0 -1 4202560 80 0 0 0 0 0 0 0 19 0 2 0 529314880 694108160 15159 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 514 18446604451860361536 0 0 -1 0 0 0 0
[pid=7126] ppid=6982 vsize=688096 CPUtime=0.24 cores=0-7
/proc/7126/stat : 7126 (python) S 6982 6982 6594 0 -1 4202560 1366 0 0 0 12 12 0 0 19 0 2 0 529298896 704610304 15181 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/7126/statm: 172024 15181 407 364 0 107852 0
[pid=7128] ppid=7126 vsize=467024 CPUtime=99.73 cores=0-7
/proc/7128/stat : 7128 (TNM) T 7126 7128 7128 0 -1 4202496 6849 0 0 0 9972 1 0 0 25 0 1 0 529298896 478232576 6558 33554432000 134512640 135008748 4292199712 18446744073709551615 134527693 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/7128/statm: 116756 6558 46 122 0 115656 0
[pid=7126/tid=7144] ppid=6982 vsize=688096 CPUtime=0 cores=0-7
/proc/7126/task/7144/stat : 7144 (python) S 6982 6982 6594 0 -1 4202560 220 0 0 0 0 0 0 0 19 0 2 0 529308920 704610304 15181 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 514 18446604453920135296 0 0 -1 5 0 0 0
[pid=7131] ppid=6982 vsize=698352 CPUtime=0.24 cores=0-7
/proc/7131/stat : 7131 (python) S 6982 6982 6594 0 -1 4202560 1267 0 0 0 12 12 0 0 19 0 2 0 529302646 715112448 15269 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/7131/statm: 174588 15269 406 364 0 110413 0
[pid=7133] ppid=7131 vsize=467024 CPUtime=99.65 cores=0-7
/proc/7133/stat : 7133 (TNM) T 7131 7133 7133 0 -1 4202496 6853 0 0 0 9964 1 0 0 25 0 1 0 529302647 478232576 6559 33554432000 134512640 135008748 4289068752 18446744073709551615 134527524 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7133/statm: 116756 6559 46 122 0 115656 0
[pid=7131/tid=7149] ppid=6982 vsize=698352 CPUtime=0 cores=0-7
/proc/7131/task/7149/stat : 7149 (python) S 6982 6982 6594 0 -1 4202560 110 0 0 0 0 0 0 0 19 0 2 0 529312670 715112448 15269 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 514 18446604453931593792 0 0 -1 4 0 0 0
[pid=7135] ppid=6982 vsize=708608 CPUtime=0.25 cores=0-7
/proc/7135/stat : 7135 (python) S 6982 6982 6594 0 -1 4202560 1243 0 0 0 12 13 0 0 19 0 2 0 529303749 725614592 15345 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/7135/statm: 177152 15345 401 364 0 112974 0
[pid=7137] ppid=7135 vsize=467024 CPUtime=99.85 cores=0-7
/proc/7137/stat : 7137 (TNM) T 7135 7137 7137 0 -1 4202496 6852 0 0 0 9984 1 0 0 25 0 1 0 529303750 478232576 6559 33554432000 134512640 135008748 4287550928 18446744073709551615 134529448 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/7137/statm: 116756 6559 46 122 0 115656 0
[pid=7135/tid=7153] ppid=6982 vsize=708608 CPUtime=0 cores=0-7
/proc/7135/task/7153/stat : 7153 (python) S 6982 6982 6594 0 -1 4202560 110 0 0 0 0 0 0 0 19 0 2 0 529313775 725614592 15345 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 514 18446604451012116544 0 0 -1 4 0 0 0
[pid=7140] ppid=6982 vsize=718864 CPUtime=0.18 cores=0-7
/proc/7140/stat : 7140 (python) S 6982 6982 6594 0 -1 4202560 1027 0 0 0 9 9 0 0 18 0 1 0 529307397 736116736 15355 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 14175554816171802881 0 0 17 4 0 0 0
/proc/7140/statm: 179716 15355 373 364 0 115535 0
[pid=7142] ppid=7140 vsize=467024 CPUtime=75.79 cores=0-7
/proc/7142/stat : 7142 (TNM) R 7140 7142 7142 0 -1 4202496 6845 0 0 0 7578 1 0 0 25 0 1 0 529307397 478232576 6559 33554432000 134512640 135008748 4288386224 18446744073709551615 134527339 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/7142/statm: 116756 6559 46 122 0 115656 0
[pid=7145] ppid=6982 vsize=729120 CPUtime=0.14 cores=0-7
/proc/7145/stat : 7145 (python) S 6982 6982 6594 0 -1 4202560 1047 0 0 0 9 5 0 0 18 0 1 0 529308931 746618880 15316 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 14175554816171802884 0 0 17 4 0 0 0
/proc/7145/statm: 182280 15316 372 364 0 118096 0
[pid=7147] ppid=7145 vsize=467024 CPUtime=60.07 cores=0-7
/proc/7147/stat : 7147 (TNM) R 7145 7147 7147 0 -1 4202496 6849 0 0 0 6006 1 0 0 25 0 1 0 529308932 478232576 6558 33554432000 134512640 135008748 4287162672 18446744073709551615 134527542 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/7147/statm: 116756 6558 46 122 0 115656 0
[pid=7150] ppid=6982 vsize=739376 CPUtime=0.06 cores=0-7
/proc/7150/stat : 7150 (python) S 6982 6982 6594 0 -1 4202560 1068 0 0 0 3 3 0 0 18 0 1 0 529312681 757121024 15389 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 14175554816171802881 0 0 17 1 0 0 0
/proc/7150/statm: 184844 15389 379 364 0 120657 0
[pid=7152] ppid=7150 vsize=467024 CPUtime=23.04 cores=0-7
/proc/7152/stat : 7152 (TNM) R 7150 7152 7152 0 -1 4202496 6854 0 0 0 2302 2 0 0 25 0 1 0 529312682 478232576 6557 33554432000 134512640 135008748 4288021296 18446744073709551615 134527066 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/7152/statm: 116756 6557 46 122 0 115656 0
[pid=7155] ppid=6982 vsize=749632 CPUtime=0 cores=0-7
/proc/7155/stat : 7155 (python) S 6982 6982 6594 0 -1 4202560 962 0 0 0 0 0 0 0 19 0 1 0 529314891 767623168 15376 33554432000 4194304 5683644 140733913516464 18446744073709551615 255106788934 0 0 16781312 514 5582881070124105727 0 0 17 4 0 0 0
/proc/7155/statm: 187408 15376 351 364 0 123218 0
[pid=7157] ppid=7155 vsize=467024 CPUtime=0.98 cores=0-7
/proc/7157/stat : 7157 (TNM) R 7155 7157 7157 0 -1 4202496 6855 0 0 0 98 0 0 0 23 0 1 0 529314892 478232576 6559 33554432000 134512640 135008748 4291440288 18446744073709551615 134528940 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7157/statm: 116756 6559 46 122 0 115656 0
[pid=6982/tid=6990] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/6990/stat : 6990 (python) S 6980 6982 6594 0 -1 4202560 37 50241 0 0 0 0 203351 251 18 0 38 0 529218062 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 0 0 0 0
[pid=6982/tid=6993] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/6993/stat : 6993 (python) S 6980 6982 6594 0 -1 4202560 28 50241 0 0 0 0 203351 251 15 0 38 0 529218066 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 2 0 0 0
[pid=6982/tid=6996] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/6996/stat : 6996 (python) S 6980 6982 6594 0 -1 4202560 30 50241 0 0 0 0 203351 251 18 0 38 0 529218070 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 2 0 0 0
[pid=6982/tid=6999] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/6999/stat : 6999 (python) S 6980 6982 6594 0 -1 4202560 34 50241 0 0 0 0 203351 251 18 0 38 0 529218074 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7002] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7002/stat : 7002 (python) S 6980 6982 6594 0 -1 4202560 28 50241 0 0 0 0 203351 251 18 0 38 0 529218078 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 0 0 0 0
[pid=6982/tid=7005] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7005/stat : 7005 (python) S 6980 6982 6594 0 -1 4202560 36 50241 0 0 0 0 203351 251 18 0 38 0 529218082 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 0 0 0 0
[pid=6982/tid=7008] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7008/stat : 7008 (python) S 6980 6982 6594 0 -1 4202560 29 50241 0 0 0 0 203351 251 18 0 38 0 529218086 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 0 0 0 0
[pid=6982/tid=7011] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7011/stat : 7011 (python) S 6980 6982 6594 0 -1 4202560 33 50241 0 0 0 0 203351 251 18 0 38 0 529218091 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 2 0 0 0
[pid=6982/tid=7018] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7018/stat : 7018 (python) S 6980 6982 6594 0 -1 4202560 48 50241 0 0 0 0 203351 251 18 0 38 0 529228111 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7027] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7027/stat : 7027 (python) S 6980 6982 6594 0 -1 4202560 26 50241 0 0 0 0 203351 251 20 0 38 0 529237660 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7035] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7035/stat : 7035 (python) S 6980 6982 6594 0 -1 4202560 42 50241 0 0 0 0 203351 251 18 0 38 0 529247288 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7038] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7038/stat : 7038 (python) S 6980 6982 6594 0 -1 4202560 35 50241 0 0 0 0 203351 251 18 0 38 0 529247298 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7041] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7041/stat : 7041 (python) S 6980 6982 6594 0 -1 4202560 27 50241 0 0 0 0 203351 251 20 0 38 0 529247478 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7047] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7047/stat : 7047 (python) S 6980 6982 6594 0 -1 4202560 32 50241 0 0 0 0 203351 251 20 0 38 0 529253053 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7052] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7052/stat : 7052 (python) S 6980 6982 6594 0 -1 4202560 32 50241 0 0 0 0 203351 251 20 0 38 0 529257353 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 1 0 0 0
[pid=6982/tid=7056] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7056/stat : 7056 (python) S 6980 6982 6594 0 -1 4202560 186 50241 0 0 0 0 203351 251 18 0 38 0 529257508 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7059] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7059/stat : 7059 (python) S 6980 6982 6594 0 -1 4202560 40 50241 0 0 0 0 203351 251 20 0 38 0 529259226 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7067] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7067/stat : 7067 (python) S 6980 6982 6594 0 -1 4202560 59 50241 0 0 0 0 203351 251 18 0 38 0 529267381 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7072] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7072/stat : 7072 (python) S 6980 6982 6594 0 -1 4202560 35 50241 0 0 0 0 203351 251 20 0 38 0 529269254 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7077] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7077/stat : 7077 (python) S 6980 6982 6594 0 -1 4202560 29 50241 0 0 0 0 203351 251 20 0 38 0 529272649 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 6 0 0 0
[pid=6982/tid=7081] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7081/stat : 7081 (python) S 6980 6982 6594 0 -1 4202560 41 50241 0 0 0 0 203351 251 20 0 38 0 529276517 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 1 0 0 0
[pid=6982/tid=7085] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7085/stat : 7085 (python) S 6980 6982 6594 0 -1 4202560 28 50241 0 0 0 0 203351 251 20 0 38 0 529277757 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7091] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7091/stat : 7091 (python) S 6980 6982 6594 0 -1 4202560 28 50241 0 0 0 0 203351 251 20 0 38 0 529282679 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 1 0 0 0
[pid=6982/tid=7094] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7094/stat : 7094 (python) S 6980 6982 6594 0 -1 4202560 155 50241 0 0 0 0 203351 251 20 0 38 0 529283879 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7097] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7097/stat : 7097 (python) S 6980 6982 6594 0 -1 4202560 26 50241 0 0 0 0 203351 251 20 0 38 0 529285301 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7104] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7104/stat : 7104 (python) S 6980 6982 6594 0 -1 4202560 26 50241 0 0 0 0 203351 251 19 0 38 0 529287691 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 3 0 0 0
[pid=6982/tid=7108] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7108/stat : 7108 (python) S 6980 6982 6594 0 -1 4202560 152 50241 0 0 0 0 203351 251 20 0 38 0 529288956 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 1 0 0 0
[pid=6982/tid=7113] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7113/stat : 7113 (python) S 6980 6982 6594 0 -1 4202560 36 50241 0 0 0 0 203351 251 19 0 38 0 529292613 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7118] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7118/stat : 7118 (python) S 6980 6982 6594 0 -1 4202560 34 50241 0 0 0 0 203351 251 19 0 38 0 529293815 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7122] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7122/stat : 7122 (python) S 6980 6982 6594 0 -1 4202560 27 50241 0 0 0 0 203351 251 20 0 38 0 529295333 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 1 0 0 0
[pid=6982/tid=7127] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7127/stat : 7127 (python) S 6980 6982 6594 0 -1 4202560 167 50241 0 0 0 0 203351 251 19 0 38 0 529298896 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7132] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7132/stat : 7132 (python) S 6980 6982 6594 0 -1 4202560 36 50241 0 0 0 0 203351 251 20 0 38 0 529302647 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 1 0 0 0
[pid=6982/tid=7136] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7136/stat : 7136 (python) S 6980 6982 6594 0 -1 4202560 39 50241 0 0 0 0 203351 251 19 0 38 0 529303750 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7141] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7141/stat : 7141 (python) S 6980 6982 6594 0 -1 4202560 35 50241 0 0 0 0 203351 251 20 0 38 0 529307397 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7146] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7146/stat : 7146 (python) S 6980 6982 6594 0 -1 4202560 33 50241 0 0 0 0 203351 251 20 0 38 0 529308932 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 1 0 0 0
[pid=6982/tid=7151] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7151/stat : 7151 (python) S 6980 6982 6594 0 -1 4202560 35 50241 0 0 0 0 203351 251 19 0 38 0 529312681 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
[pid=6982/tid=7156] ppid=6980 vsize=759876 CPUtime=2036.02 cores=0-7
/proc/6982/task/7156/stat : 7156 (python) S 6980 6982 6594 0 -1 4202560 36 50241 0 0 0 0 203351 251 20 0 38 0 529314892 778113024 16976 33554432000 4194304 5683644 140733913516464 18446744073709551615 255118592433 0 0 16781312 2 18446604448503223296 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7734.48
Current children cumulated vsize (KiB) 31812704

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6982 and gives
#  childrusage.ru_utime.tv_sec=2046
#  childrusage.ru_utime.tv_usec=36955
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=825570
# CPU time returned by wait4() is 2048.86
# while last known CPU time is 7734.48
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 978.006
CPU time (s): 7734.48
CPU user time (s): 7725.02
CPU system time (s): 9.46
CPU usage (%): 790.842
Max. virtual memory (cumulated for all children) (KiB): 31812704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2046.04
system time used= 2.82557
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 121716
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3657
involuntary context switches= 12163

runsolver used 7.02693 second user time and 19.1021 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-02 22:26:51
IDJOB=3321830
IDBENCH=82608
IDSOLVER=1712
FILE ID=node144/3321830-1304368010
RUNJOBID= node144-1304366464-6608
PBS_JOBID= 13181730
Free space on /tmp= 73532 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v40000-c168000-S1184456903-078-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321830-1304368010/watcher-3321830-1304368010 -o /tmp/evaluation-result-3321830-1304368010/solver-3321830-1304368010 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321830-1304368010.cnf -seed 1851351691 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 33dd7efc1f63d9d3511c7a69c68ea88b
RANDOM SEED=1851351691

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21201960 kB
Buffers:       2152116 kB
Cached:        5391300 kB
SwapCached:         80 kB
Active:        4331988 kB
Inactive:      6841964 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21201960 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:           35560 kB
Writeback:           0 kB
AnonPages:     3630076 kB
Mapped:          22676 kB
Slab:           488044 kB
PageTables:      21892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 49177608 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73340 MiB
End job on node144 at 2011-05-02 22:43:11