Trace number 3385378

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 10150.2 1432.31

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S817927155-033-UNKNOWN.cnf
MD5SUMbdd02c131ae0dd9fa14ba01f07a63379
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.67	c INFO: solving HOME/instance-3385378-1305566068.cnf
0.35/0.67	c INFO: computing task features
0.63/0.90	c INFO: computed variable-clause graph statistics
0.63/0.91	c INFO: computed clause balance statistics
1.73/2.11	c INFO: computed variable balance statistics
2.23/2.57	c INFO: computed small-clause counts
2.23/2.58	c INFO: computed Horn-clause counts
2.33/2.62	c INFO: computed variable graph statistics
2.33/2.62	c INFO: collected features for HOME/instance-3385378-1305566068.cnf in 1.94 s
2.33/2.65	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.38)
2.33/2.68	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
2.42/2.71	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.08)
2.42/2.74	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.07)
2.42/2.77	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.05)
2.52/2.80	c INFO: running gnovelty+2@0 for 97 with 4997 remaining (b = 0.04)
2.52/2.83	c INFO: running FH@0 for 97 with 4997 remaining (b = 0.03)
2.52/2.87	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.03)
725.60/103.09	c INFO: running adaptg2wsat2009++@0 for 97 with 4897 remaining (b = 0.02)
726.27/103.14	c INFO: running FH@0 for 97 with 4897 remaining (b = 0.02)
726.27/103.19	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.04)
726.77/103.23	c INFO: running gnovelty+2@0 for 97 with 4897 remaining (b = 0.02)
726.77/103.27	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
727.58/103.32	c INFO: running adaptg2wsat2009++@0 for 97 with 4897 remaining (b = 0.01)
928.37/132.14	c INFO: running hybridGM3@0 for 194 with 4868 remaining (b = 0.03)
1062.34/151.35	c INFO: running hybridGM3@0 for 194 with 4849 remaining (b = 0.02)
1425.72/203.42	c INFO: running TNM@0 for 1552 with 4797 remaining (b = 0.18)
1425.72/203.47	c INFO: running FH@0 for 97 with 4797 remaining (b = 0.01)
1426.77/203.64	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1678.72/239.81	c INFO: running adaptg2wsat2009++@0 for 97 with 4760 remaining (b = 0.01)
2115.77/300.98	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.01)
2235.03/318.05	c INFO: running hybridGM3@99 for 97 with 4682 remaining (b = 0.01)
2368.21/337.14	c INFO: running adaptg2wsat2009++@100 for 97 with 4663 remaining (b = 0.01)
2471.39/351.98	c INFO: running hybridGM3@0 for 194 with 4648 remaining (b = 0.02)
2485.94/354.04	c INFO: running hybridGM3@99 for 97 with 4646 remaining (b = 0.01)
2570.27/366.14	c INFO: running hybridGM3@100 for 97 with 4634 remaining (b = 0.01)
2639.28/376.11	c INFO: running hybridGM3@97 for 97 with 4624 remaining (b = 0.01)
2878.45/410.35	c INFO: running hybridGM3@0 for 194 with 4590 remaining (b = 0.02)
2991.12/425.41	c INFO: running TNM@0 for 1455 with 4575 remaining (b = 0.14)
3138.27/446.52	c INFO: running adaptg2wsat2009++@100 for 97 with 4554 remaining (b = 0.01)
3242.00/461.40	c INFO: running hybridGM3@297 for 97 with 4539 remaining (b = 0.01)
3325.71/473.50	c INFO: running hybridGM3@297 for 97 with 4527 remaining (b = 0.01)
3488.31/495.50	c INFO: running iPAWS@0 for 97 with 4505 remaining (b = 0.01)
3866.62/549.88	c INFO: running hybridGM3@188 for 97 with 4450 remaining (b = 0.01)
3963.31/562.75	c INFO: running hybridGM3@390 for 97 with 4437 remaining (b = 0.01)
3991.32/566.75	c INFO: running FH@0 for 291 with 4433 remaining (b = 0.03)
4048.04/574.84	c INFO: running gnovelty+2@0 for 97 with 4425 remaining (b = 0.01)
4326.29/613.91	c INFO: running hybridGM3@394 for 97 with 4386 remaining (b = 0.01)
4600.29/653.24	c INFO: running adaptg2wsat2009++@102 for 97 with 4347 remaining (b = 0.01)
4649.09/660.23	c INFO: running hybridGM3@99 for 97 with 4340 remaining (b = 0.01)
4755.52/675.16	c INFO: running FH@100 for 291 with 4325 remaining (b = 0.02)
4885.04/693.36	c INFO: running hybridGM3@0 for 194 with 4307 remaining (b = 0.01)
5241.94/741.34	c INFO: running TNM@0 for 1552 with 4259 remaining (b = 0.11)
5385.00/761.57	c INFO: running hybridGM3@192 for 97 with 4239 remaining (b = 0.01)
5482.95/774.66	c INFO: running adaptg2wsat2009++@297 for 291 with 4226 remaining (b = 0.02)
6147.97/868.68	c INFO: running iPAWS@0 for 97 with 4132 remaining (b = 0.01)
6422.75/908.17	c INFO: running hybridGM3@95 for 97 with 4092 remaining (b = 0.01)
6435.95/910.10	c INFO: running hybridGM3@0 for 194 with 4090 remaining (b = 0.01)
6876.21/971.06	c INFO: running FH@200 for 194 with 4029 remaining (b = 0.01)
7037.99/993.10	c INFO: running FH@99 for 291 with 4007 remaining (b = 0.02)
7294.95/1027.60	c INFO: running gnovelty+2@0 for 97 with 3973 remaining (b = 0.01)
7543.17/1062.57	c INFO: running hybridGM3@0 for 194 with 3938 remaining (b = 0.01)
7928.01/1117.89	c INFO: running hybridGM3@292 for 194 with 3882 remaining (b = 0.01)
8089.64/1140.08	c INFO: running NCVWr@0 for 485 with 3860 remaining (b = 0.03)
8623.87/1216.84	c INFO: running FH@298 for 97 with 3783 remaining (b = 0.01)
9234.08/1301.52	c INFO: running iPAWS@0 for 97 with 3699 remaining (b = 0.01)
9391.88/1324.22	c INFO: running adaptg2wsat2009++@100 for 97 with 3676 remaining (b = 0.01)
9412.73/1327.29	c INFO: running FH@0 for 97 with 3673 remaining (b = 0.01)
9459.61/1333.59	c INFO: running hybridGM3@389 for 97 with 3667 remaining (b = 0.01)
10076.27/1421.58	c INFO: running adaptg2wsat2009++@390 for 194 with 3579 remaining (b = 0.01)
10149.29/1432.05	c INFO: running hybridGM3@0 for 194 with 3568 remaining (b = 0.01)
10150.15/1432.28	c INFO: running hybridGM3@0 for 194 with 3568 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385378-1305566068/watcher-3385378-1305566068 -o /tmp/evaluation-result-3385378-1305566068/solver-3385378-1305566068 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385378-1305566068.cnf -seed 216506747 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.48 8.36 5.88 2/362 5738
/proc/meminfo: memFree=13659600/32951124 swapFree=63308188/67111528
[pid=5738] ppid=5736 vsize=15772 CPUtime=0 cores=0-7
/proc/5738/stat : 5738 (python) R 5736 5738 5504 0 -1 4202496 858 0 0 0 0 0 0 0 23 0 1 0 668204730 16150528 740 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377301136 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/5738/statm: 3943 740 335 364 0 430 0

[startup+0.075461 s]
/proc/loadavg: 8.48 8.36 5.88 2/362 5738
/proc/meminfo: memFree=13659600/32951124 swapFree=63308188/67111528
[pid=5738] ppid=5736 vsize=40972 CPUtime=0.03 cores=0-7
/proc/5738/stat : 5738 (python) R 5736 5738 5504 0 -1 4202496 1677 0 0 0 3 0 0 0 24 0 1 0 668204730 41955328 1502 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377299456 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/5738/statm: 10243 1502 463 364 0 1026 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 40972

[startup+0.100455 s]
/proc/loadavg: 8.48 8.36 5.88 2/362 5738
/proc/meminfo: memFree=13659600/32951124 swapFree=63308188/67111528
[pid=5738] ppid=5736 vsize=87704 CPUtime=0.05 cores=0-7
/proc/5738/stat : 5738 (python) R 5736 5738 5504 0 -1 4202496 2638 0 0 0 4 1 0 0 24 0 1 0 668204730 89808896 2354 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377299456 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/5738/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 87704

[startup+0.300466 s]
/proc/loadavg: 8.48 8.36 5.88 2/362 5738
/proc/meminfo: memFree=13659600/32951124 swapFree=63308188/67111528
[pid=5738] ppid=5736 vsize=135748 CPUtime=0.18 cores=0-7
/proc/5738/stat : 5738 (python) S 5736 5738 5504 0 -1 4202496 5967 938 1 0 14 4 0 0 18 0 1 0 668204730 139005952 4151 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377297413 0 2147483391 16781312 2 18446744071699453118 0 0 17 2 0 0 0
/proc/5738/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700363 s]
/proc/loadavg: 8.48 8.36 5.88 2/362 5738
/proc/meminfo: memFree=13659600/32951124 swapFree=63308188/67111528
[pid=5738] ppid=5736 vsize=279980 CPUtime=0.42 cores=0-7
/proc/5738/stat : 5738 (python) R 5736 5738 5504 0 -1 4202496 9651 938 1 0 32 10 0 0 17 0 1 0 668204730 286699520 7330 33554432000 4194304 5683644 140733563443696 18446744073709551615 4272664 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/5738/statm: 69995 7330 1761 364 0 5919 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 279980

[startup+1.50021 s]
/proc/loadavg: 7.96 8.25 5.86 3/363 5743
/proc/meminfo: memFree=13626112/32951124 swapFree=63308188/67111528
[pid=5738] ppid=5736 vsize=289496 CPUtime=1.23 cores=0-7
/proc/5738/stat : 5738 (python) R 5736 5738 5504 0 -1 4202496 13885 938 1 0 112 11 0 0 18 0 1 0 668204730 296443904 9759 33554432000 4194304 5683644 140733563443696 18446744073709551615 4509432 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/5738/statm: 72374 9759 1826 364 0 8298 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 289496

[startup+3.10086 s]
/proc/loadavg: 7.96 8.25 5.86 3/363 5743
/proc/meminfo: memFree=13626112/32951124 swapFree=63308188/67111528
[pid=5738] ppid=5736 vsize=364416 CPUtime=2.59 cores=0-7
/proc/5738/stat : 5738 (python) S 5736 5738 5504 0 -1 4202496 20175 938 1 0 246 13 0 0 23 0 9 0 668204730 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5738/statm: 91104 8071 1891 364 0 27001 0
Current children cumulated CPU time (s) 2.59
Current children cumulated vsize (KiB) 364416

[startup+6.30127 s]
/proc/loadavg: 7.96 8.25 5.86 10/387 5767
/proc/meminfo: memFree=13562664/32951124 swapFree=63308188/67111528
[pid=5738] ppid=5736 vsize=364416 CPUtime=2.59 cores=0-7
/proc/5738/stat : 5738 (python) S 5736 5738 5504 0 -1 4202496 20175 938 1 0 246 13 0 0 23 0 9 0 668204730 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5738/statm: 91104 8071 1891 364 0 27001 0
[pid=5744] ppid=5738 vsize=282236 CPUtime=0 cores=0-7
/proc/5744/stat : 5744 (python) S 5738 5738 5504 0 -1 4202560 729 0 0 0 0 0 0 0 18 0 1 0 668204995 289009664 6331 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321487 0 0 16781312 514 16846901058398552324 0 0 17 2 0 0 0
/proc/5744/statm: 70559 6331 355 364 0 6477 0
[pid=5746] ppid=5744 vsize=1020188 CPUtime=3.64 cores=0-7
/proc/5746/stat : 5746 (gnovelty+2) R 5744 5746 5746 0 -1 4202496 1139 0 0 0 364 0 0 0 25 0 1 0 668204996 1044672512 876 33554432000 134512640 135663704 4292362160 18446744073709551615 134525258 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5746/statm: 255047 876 113 282 0 254763 0
[pid=5747] ppid=5738 vsize=293120 CPUtime=0 cores=0-7
/proc/5747/stat : 5747 (python) S 5738 5738 5504 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 668204998 300154880 6367 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 15910853549446103297 0 0 17 4 0 0 0
/proc/5747/statm: 73280 6367 349 364 0 9195 0
[pid=5749] ppid=5747 vsize=1020188 CPUtime=3.61 cores=0-7
/proc/5749/stat : 5749 (gnovelty+2) R 5747 5749 5749 0 -1 4202496 1139 0 0 0 361 0 0 0 25 0 1 0 668204999 1044672512 876 33554432000 134512640 135663704 4292778784 18446744073709551615 134525224 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/5749/statm: 255047 876 113 282 0 254763 0
[pid=5750] ppid=5738 vsize=302892 CPUtime=0 cores=0-7
/proc/5750/stat : 5750 (python) S 5738 5738 5504 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 668205001 310161408 6504 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 2298094205311877376 0 0 17 2 0 0 0
/proc/5750/statm: 75723 6504 347 364 0 11635 0
[pid=5752] ppid=5750 vsize=421140 CPUtime=3.53 cores=0-7
/proc/5752/stat : 5752 (adaptg2wsat2009) R 5750 5752 5752 0 -1 4202496 1805 0 0 0 353 0 0 0 25 0 1 0 668205002 431247360 1538 33554432000 134512640 135107411 4289740528 18446744073709551615 134523448 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/5752/statm: 105285 1538 49 146 0 104161 0
[pid=5753] ppid=5738 vsize=313148 CPUtime=0 cores=0-7
/proc/5753/stat : 5753 (python) S 5738 5738 5504 0 -1 4202560 750 0 0 0 0 0 0 0 18 0 1 0 668205004 320663552 6507 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 2298098053602574593 0 0 17 4 0 0 0
/proc/5753/statm: 78287 6507 347 364 0 14196 0
[pid=5755] ppid=5753 vsize=421140 CPUtime=3.55 cores=0-7
/proc/5755/stat : 5755 (adaptg2wsat2009) R 5753 5755 5755 0 -1 4202496 1803 0 0 0 355 0 0 0 25 0 1 0 668205005 431247360 1538 33554432000 134512640 135107411 4292585728 18446744073709551615 134523314 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/5755/statm: 105285 1538 49 146 0 104161 0
[pid=5756] ppid=5738 vsize=323404 CPUtime=0 cores=0-7
/proc/5756/stat : 5756 (python) S 5738 5738 5504 0 -1 4202560 753 0 0 0 0 0 0 0 18 0 1 0 668205007 331165696 6512 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 12790350764253872384 0 0 17 2 0 0 0
/proc/5756/statm: 80851 6512 347 364 0 16757 0
[pid=5758] ppid=5756 vsize=421140 CPUtime=3.52 cores=0-7
/proc/5758/stat : 5758 (adaptg2wsat2009) R 5756 5758 5758 0 -1 4202496 1805 0 0 0 352 0 0 0 25 0 1 0 668205008 431247360 1538 33554432000 134512640 135107411 4289043088 18446744073709551615 134523290 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/5758/statm: 105285 1538 49 146 0 104161 0
[pid=5759] ppid=5738 vsize=333660 CPUtime=0 cores=0-7
/proc/5759/stat : 5759 (python) S 5738 5738 5504 0 -1 4202560 758 0 0 0 0 0 0 0 18 0 1 0 668205011 341667840 6516 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 2298090357021180162 0 0 17 4 0 0 0
/proc/5759/statm: 83415 6516 347 364 0 19318 0
[pid=5761] ppid=5759 vsize=1020188 CPUtime=3.48 cores=0-7
/proc/5761/stat : 5761 (gnovelty+2) R 5759 5761 5761 0 -1 4202496 1142 0 0 0 348 0 0 0 25 0 1 0 668205011 1044672512 877 33554432000 134512640 135663704 4292716512 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/5761/statm: 255047 877 113 282 0 254763 0
[pid=5762] ppid=5738 vsize=344556 CPUtime=0 cores=0-7
/proc/5762/stat : 5762 (python) S 5738 5738 5504 0 -1 4202560 766 0 0 0 0 0 0 0 18 0 1 0 668205014 352825344 6522 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 12790358460835266820 0 0 17 2 0 0 0
/proc/5762/statm: 86139 6522 349 364 0 22039 0
[pid=5764] ppid=5762 vsize=249144 CPUtime=3.42 cores=0-7
/proc/5764/stat : 5764 (FH) R 5762 5764 5764 0 -1 4202496 1560 0 0 0 342 0 0 0 25 0 1 0 668205016 255123456 1296 33554432000 134512640 134936988 4292781664 18446744073709551615 134523482 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/5764/statm: 62286 1296 37 104 0 61790 0
[pid=5765] ppid=5738 vsize=354744 CPUtime=0 cores=0-7
/proc/5765/stat : 5765 (python) S 5738 5738 5504 0 -1 4202560 804 0 0 0 0 0 0 0 18 0 1 0 668205017 363257856 6532 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 1679134030060028161 0 0 17 1 0 0 0
/proc/5765/statm: 88686 6532 355 364 0 24583 0
[pid=5767] ppid=5765 vsize=421140 CPUtime=1.71 cores=0-7
/proc/5767/stat : 5767 (adaptg2wsat2009) R 5765 5767 5767 0 -1 4202496 1810 0 0 0 171 0 0 0 25 0 1 0 668205018 431247360 1538 33554432000 134512640 135107411 4292005648 18446744073709551615 134523432 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/5767/statm: 105285 1538 49 146 0 104161 0
[pid=5738/tid=5745] ppid=5736 vsize=364416 CPUtime=0 cores=0-7
/proc/5738/task/5745/stat : 5745 (python) S 5736 5738 5504 0 -1 4202560 26 938 0 0 0 0 0 0 22 0 9 0 668204995 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 0 0 0 0
[pid=5738/tid=5748] ppid=5736 vsize=364416 CPUtime=0 cores=0-7
/proc/5738/task/5748/stat : 5748 (python) S 5736 5738 5504 0 -1 4202560 23 938 0 0 0 0 0 0 24 0 9 0 668204998 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 4 0 0 0
[pid=5738/tid=5751] ppid=5736 vsize=364416 CPUtime=0 cores=0-7
/proc/5738/task/5751/stat : 5751 (python) S 5736 5738 5504 0 -1 4202560 24 938 0 0 0 0 0 0 25 0 9 0 668205001 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 0 0 0 0
[pid=5738/tid=5754] ppid=5736 vsize=364416 CPUtime=0 cores=0-7
/proc/5738/task/5754/stat : 5754 (python) S 5736 5738 5504 0 -1 4202560 20 938 0 0 0 0 0 0 20 0 9 0 668205005 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 0 0 0 0
[pid=5738/tid=5757] ppid=5736 vsize=364416 CPUtime=0 cores=0-7
/proc/5738/task/5757/stat : 5757 (python) S 5736 5738 5504 0 -1 4202560 26 938 0 0 0 0 0 0 20 0 9 0 668205008 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 0 0 0 0
[pid=5738/tid=5760] ppid=5736 vsize=364416 CPUtime=0 cores=0-7
/proc/5738/task/5760/stat : 5760 (python) S 5736 5738 5504 0 -1 4202560 28 938 0 0 0 0 0 0 20 0 9 0 668205011 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 4 0 0 0
[pid=5738/tid=5763] ppid=5736 vsize=364416 CPUtime=0 cores=0-7
/proc/5738/task/5763/stat : 5763 (python) S 5736 5738 5504 0 -1 4202560 24 938 0 0 0 0 0 0 22 0 9 0 668205014 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 2 0 0 0
[pid=5738/tid=5766] ppid=5736 vsize=364416 CPUtime=0 cores=0-7
/proc/5738/task/5766/stat : 5766 (python) S 5736 5738 5504 0 -1 4202560 30 938 0 0 0 0 0 0 23 0 9 0 668205017 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 29.05
Current children cumulated vsize (KiB) 7906444

[startup+12.7011 s]
/proc/loadavg: 8.12 8.28 5.89 11/387 5767
/proc/meminfo: memFree=13555008/32951124 swapFree=63308188/67111528
[pid=5738] ppid=5736 vsize=364416 CPUtime=2.59 cores=0-7
/proc/5738/stat : 5738 (python) S 5736 5738 5504 0 -1 4202496 20175 938 1 0 246 13 0 0 23 0 9 0 668204730 373161984 8071 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5738/statm: 91104 8071 1891 364 0 27001 0
[pid=5744] ppid=5738 vsize=282236 CPUtime=0.01 cores=0-7
/proc/5744/stat : 5744 (python) S 5738 5738 5504 0 -1 4202560 896 0 0 0 0 1 0 0 18 0 1 0 668204995 289009664 6354 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321487 0 0 16781312 514 16846901058398552324 0 0 17 2 0 0 0
/proc/5744/statm: 70559 6354 378 364 0 6477 0
[pid=5746] ppid=5744 vsize=1020188 CPUtime=10.04 cores=0-7
/proc/5746/stat : 5746 (gnovelty+2) R 5744 5746 5746 0 -1 4202496 1139 0 0 0 1004 0 0 0 25 0 1 0 668204996 1044672512 876 33554432000 134512640 135663704 4292362160 18446744073709551615 134525265 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5746/statm: 255047 876 113 282 0 254763 0
[pid=5747] ppid=5738 vsize=293120 CPUtime=0 cores=0-7
/proc/5747/stat : 5747 (python) S 5738 5738 5504 0 -1 4202560 903 0 0 0 0 0 0 0 18 0 1 0 668204998 300154880 6390 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 15910853549446103297 0 0 17 4 0 0 0
/proc/5747/statm: 73280 6390 372 364 0 9195 0
[pid=5749] ppid=5747 vsize=1020188 CPUtime=10.01 cores=0-7
/proc/5749/stat : 5749 (gnovelty+2) R 5747 5749 5749 0 -1 4202496 1139 0 0 0 1001 0 0 0 25 0 1 0 668204999 1044672512 876 33554432000 134512640 135663704 4292778784 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/5749/statm: 255047 876 113 282 0 254763 0
[pid=5750] ppid=5738 vsize=302892 CPUtime=0.01 cores=0-7
/proc/5750/stat : 5750 (python) S 5738 5738 5504 0 -1 4202560 899 0 0 0 0 1 0 0 18 0 1 0 668205001 310161408 6527 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 2298094205311877376 0 0 17 2 0 0 0
/proc/5750/statm: 75723 6527 370 364 0 11635 0
[pid=5752] ppid=5750 vsize=421804 CPUtime=9.84 cores=0-7
/proc/5752/stat : 5752 (adaptg2wsat2009) R 5750 5752 5752 0 -1 4202496 2138 0 0 0 984 0 0 0 25 0 1 0 668205002 431927296 1871 33554432000 134512640 135107411 4289740528 18446744073709551615 134537748 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/5752/statm: 105451 1871 59 146 0 104327 0
[pid=5753] ppid=5738 vsize=313148 CPUtime=0.01 cores=0-7
/proc/5753/stat : 5753 (python) S 5738 5738 5504 0 -1 4202560 941 0 0 0 1 0 0 0 18 0 1 0 668205004 320663552 6530 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 2298098053602574593 0 0 17 4 0 0 0
/proc/5753/statm: 78287 6530 370 364 0 14196 0
[pid=5755] ppid=5753 vsize=421804 CPUtime=9.94 cores=0-7
/proc/5755/stat : 5755 (adaptg2wsat2009) R 5753 5755 5755 0 -1 4202496 2136 0 0 0 994 0 0 0 25 0 1 0 668205005 431927296 1871 33554432000 134512640 135107411 4292585728 18446744073709551615 134531781 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/5755/statm: 105451 1871 59 146 0 104327 0
[pid=5756] ppid=5738 vsize=323404 CPUtime=0 cores=0-7
/proc/5756/stat : 5756 (python) S 5738 5738 5504 0 -1 4202560 937 0 0 0 0 0 0 0 18 0 1 0 668205007 331165696 6535 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 12790350764253872384 0 0 17 2 0 0 0
/proc/5756/statm: 80851 6535 370 364 0 16757 0
[pid=5758] ppid=5756 vsize=421804 CPUtime=9.92 cores=0-7
/proc/5758/stat : 5758 (adaptg2wsat2009) R 5756 5758 5758 0 -1 4202496 2138 0 0 0 992 0 0 0 25 0 1 0 668205008 431927296 1871 33554432000 134512640 135107411 4289043088 18446744073709551615 134531246 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/5758/statm: 105451 1871 59 146 0 104327 0
[pid=5759] ppid=5738 vsize=333660 CPUtime=0.01 cores=0-7
/proc/5759/stat : 5759 (python) S 5738 5738 5504 0 -1 4202560 945 0 0 0 0 1 0 0 18 0 1 0 668205011 341667840 6539 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 2298090357021180162 0 0 17 4 0 0 0
/proc/5759/statm: 83415 6539 370 364 0 19318 0
[pid=5761] ppid=5759 vsize=1020188 CPUtime=9.83 cores=0-7
/proc/5761/stat : 5761 (gnovelty+2) R 5759 5761 5761 0 -1 4202496 1142 0 0 0 983 0 0 0 25 0 1 0 668205011 1044672512 877 33554432000 134512640 135663704 4292716512 18446744073709551615 134525181 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/5761/statm: 255047 877 113 282 0 254763 0
[pid=5762] ppid=5738 vsize=344556 CPUtime=0.01 cores=0-7
/proc/5762/stat : 5762 (python) S 5738 5738 5504 0 -1 4202560 954 0 0 0 1 0 0 0 18 0 1 0 668205014 352825344 6545 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 12790358460835266820 0 0 17 2 0 0 0
/proc/5762/statm: 86139 6545 372 364 0 22039 0

################
# More data... #
################

[pid=5837] ppid=5738 vsize=564628 CPUtime=0.36 cores=0-7
/proc/5837/stat : 5837 (python) S 5738 5738 5504 0 -1 4202560 1240 0 0 0 17 19 0 0 19 0 2 0 668254281 578179072 7007 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5837/statm: 141157 7007 407 364 0 77012 0
[pid=5839] ppid=5837 vsize=335996 CPUtime=98.18 cores=0-7
/proc/5839/stat : 5839 (iPAWS) T 5837 5839 5839 0 -1 4202496 2033 0 0 0 9818 0 0 0 25 0 1 0 668254281 344059904 1749 33554432000 134512640 135114423 4294518224 18446744073709551615 134516669 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/5839/statm: 83999 1749 59 147 0 83851 0
[pid=5837/tid=5847] ppid=5738 vsize=564628 CPUtime=0 cores=0-7
/proc/5837/task/5847/stat : 5847 (python) S 5738 5738 5504 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 668266116 578179072 7007 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 514 18446604444960014656 0 0 -1 1 0 0 0
[pid=5843] ppid=5738 vsize=574720 CPUtime=0.36 cores=0-7
/proc/5843/stat : 5843 (python) S 5738 5738 5504 0 -1 4202560 1251 0 0 0 18 18 0 0 17 0 2 0 668262215 588513280 7020 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5843/statm: 143680 7020 407 364 0 79532 0
[pid=5845] ppid=5843 vsize=1020188 CPUtime=100.66 cores=0-7
/proc/5845/stat : 5845 (gnovelty+2) T 5843 5845 5845 0 -1 4202496 1165 0 0 0 10066 0 0 0 25 0 1 0 668262215 1044672512 877 33554432000 134512640 135663704 4287525344 18446744073709551615 134524507 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/5845/statm: 255047 877 113 282 0 254763 0
[pid=5843/tid=5851] ppid=5738 vsize=574720 CPUtime=0 cores=0-7
/proc/5843/task/5851/stat : 5851 (python) S 5738 5738 5504 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 668274061 588513280 7020 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 514 18446604449152790912 0 0 -1 0 0 0 0
[pid=5852] ppid=5738 vsize=585172 CPUtime=1.06 cores=0-7
/proc/5852/stat : 5852 (python) S 5738 5738 5504 0 -1 4202560 1313 0 0 0 52 54 0 0 18 0 2 0 668274067 599216128 7031 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/5852/statm: 146293 7031 408 364 0 82142 0
[pid=5854] ppid=5852 vsize=268420 CPUtime=296.85 cores=0-7
/proc/5854/stat : 5854 (hybridGM3) T 5852 5854 5854 0 -1 4202496 5666 0 0 0 29684 1 0 0 25 0 1 0 668274067 274862080 5377 33554432000 134512640 135204385 4289376912 18446744073709551615 134538435 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/5854/statm: 67105 5377 63 169 0 66935 0
[pid=5852/tid=5867] ppid=5738 vsize=585172 CPUtime=0 cores=0-7
/proc/5852/task/5867/stat : 5867 (python) S 5738 5738 5504 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 668295542 599216128 7031 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 514 18446604448118700736 0 0 -1 0 0 0 0
[pid=5856] ppid=5738 vsize=595436 CPUtime=2.18 cores=0-7
/proc/5856/stat : 5856 (python) S 5738 5738 5504 0 -1 4202560 1116 0 0 0 114 104 0 0 18 0 1 0 668278865 609726464 6999 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 1865686514382373121 0 0 17 1 0 0 0
/proc/5856/statm: 148859 6999 373 364 0 84705 0
[pid=5858] ppid=5856 vsize=459764 CPUtime=645.14 cores=0-7
/proc/5858/stat : 5858 (TNM) R 5856 5858 5858 0 -1 4202496 1948 0 0 0 64512 2 0 0 25 0 1 0 668278865 470798336 1657 33554432000 134512640 135008748 4290251968 18446744073709551615 134529422 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/5858/statm: 114941 1657 46 122 0 113841 0
[pid=5863] ppid=5738 vsize=605612 CPUtime=0.37 cores=0-7
/proc/5863/stat : 5863 (python) S 5738 5738 5504 0 -1 4202560 1246 0 0 0 19 18 0 0 19 0 2 0 668291598 620146688 7089 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/5863/statm: 151403 7089 400 364 0 87246 0
[pid=5865] ppid=5863 vsize=335996 CPUtime=97.29 cores=0-7
/proc/5865/stat : 5865 (iPAWS) T 5863 5865 5865 0 -1 4202496 2034 0 0 0 9729 0 0 0 25 0 1 0 668291599 344059904 1749 33554432000 134512640 135114423 4291451264 18446744073709551615 134514877 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/5865/statm: 83999 1749 59 147 0 83851 0
[pid=5863/tid=5873] ppid=5738 vsize=605612 CPUtime=0 cores=0-7
/proc/5863/task/5873/stat : 5873 (python) S 5738 5738 5504 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 668304035 620146688 7089 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 514 18446604443732280320 0 0 -1 1 0 0 0
[pid=5868] ppid=5738 vsize=615868 CPUtime=1.65 cores=0-7
/proc/5868/stat : 5868 (python) S 5738 5738 5504 0 -1 4202560 1276 0 0 0 85 80 0 0 18 0 2 0 668295741 630648832 7093 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/5868/statm: 153967 7093 400 364 0 89807 0
[pid=5870] ppid=5868 vsize=268420 CPUtime=476.31 cores=0-7
/proc/5870/stat : 5870 (hybridGM3) R 5868 5870 5870 0 -1 4202496 5664 0 0 0 47631 0 0 0 25 0 1 0 668295741 274862080 5377 33554432000 134512640 135204385 4286746704 18446744073709551615 134538584 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/5870/statm: 67105 5377 63 169 0 66935 0
[pid=5868/tid=5883] ppid=5738 vsize=615868 CPUtime=0 cores=0-7
/proc/5868/task/5883/stat : 5883 (python) S 5738 5738 5504 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 668316513 630648832 7093 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 514 18446604443484517440 0 0 -1 2 0 0 0
[pid=5875] ppid=5738 vsize=626256 CPUtime=0.35 cores=0-7
/proc/5875/stat : 5875 (python) S 5738 5738 5504 0 -1 4202560 1272 0 0 0 19 16 0 0 19 0 2 0 668307490 641286144 7115 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/5875/statm: 156564 7115 401 364 0 92401 0
[pid=5877] ppid=5875 vsize=1020188 CPUtime=97.5 cores=0-7
/proc/5877/stat : 5877 (gnovelty+2) T 5875 5877 5877 0 -1 4202496 1165 0 0 0 9750 0 0 0 25 0 1 0 668307491 1044672512 877 33554432000 134512640 135663704 4290156608 18446744073709551615 134525541 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/5877/statm: 255047 877 113 282 0 254763 0
[pid=5875/tid=5885] ppid=5738 vsize=626256 CPUtime=0 cores=0-7
/proc/5875/task/5885/stat : 5885 (python) S 5738 5738 5504 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 668318733 641286144 7115 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 514 18446604471138828480 0 0 -1 7 0 0 0
[pid=5879] ppid=5738 vsize=636736 CPUtime=0.75 cores=0-7
/proc/5879/stat : 5879 (python) S 5738 5738 5504 0 -1 4202560 1317 0 0 0 40 35 0 0 19 0 2 0 668310988 652017664 7126 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/5879/statm: 159184 7126 408 364 0 95018 0
[pid=5881] ppid=5879 vsize=268420 CPUtime=197.73 cores=0-7
/proc/5881/stat : 5881 (hybridGM3) T 5879 5881 5881 0 -1 4202496 5679 0 0 0 19771 2 0 0 25 0 1 0 668310988 274862080 5377 33554432000 134512640 135204385 4291722480 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/5881/statm: 67105 5377 63 169 0 66935 0
[pid=5879/tid=5893] ppid=5738 vsize=636736 CPUtime=0 cores=0-7
/proc/5879/task/5893/stat : 5893 (python) S 5738 5738 5504 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 668334877 652017664 7126 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 514 18446604469892550848 0 0 -1 0 0 0 0
[pid=5886] ppid=5738 vsize=647020 CPUtime=0.91 cores=0-7
/proc/5886/stat : 5886 (python) S 5738 5738 5504 0 -1 4202560 1169 0 0 0 45 46 0 0 18 0 1 0 668318739 662548480 7101 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 1865686514382373127 0 0 17 5 0 0 0
/proc/5886/statm: 161755 7101 380 364 0 97586 0
[pid=5888] ppid=5886 vsize=421348 CPUtime=268.59 cores=0-7
/proc/5888/stat : 5888 (NCVWr) R 5886 5888 5888 0 -1 4202496 2001 0 0 0 26859 0 0 0 25 0 1 0 668318740 431460352 1712 33554432000 134512640 135113558 4291823344 18446744073709551615 134533845 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/5888/statm: 105337 1712 58 147 0 104212 0
[pid=5894] ppid=5738 vsize=657336 CPUtime=0.41 cores=0-7
/proc/5894/stat : 5894 (python) S 5738 5738 5504 0 -1 4202560 1314 0 0 0 24 17 0 0 19 0 2 0 668334883 673112064 7133 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/5894/statm: 164334 7133 407 364 0 100162 0
[pid=5896] ppid=5894 vsize=335996 CPUtime=99.53 cores=0-7
/proc/5896/stat : 5896 (iPAWS) T 5894 5896 5896 0 -1 4202496 2043 0 0 0 9953 0 0 0 25 0 1 0 668334890 344059904 1751 33554432000 134512640 135114423 4292473056 18446744073709551615 134546160 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/5896/statm: 83999 1751 59 147 0 83851 0
[pid=5894/tid=5904] ppid=5738 vsize=657336 CPUtime=0 cores=0-7
/proc/5894/task/5904/stat : 5904 (python) S 5738 5738 5504 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 668347930 673112064 7133 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 514 18446604457368951552 0 0 -1 0 0 0 0
[pid=5898] ppid=5738 vsize=667148 CPUtime=0.31 cores=0-7
/proc/5898/stat : 5898 (python) S 5738 5738 5504 0 -1 4202560 1174 0 0 0 17 14 0 0 18 0 1 0 668337460 683159552 7106 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 1865686514382373127 0 0 17 0 0 0 0
/proc/5898/statm: 166787 7106 378 364 0 102612 0
[pid=5900] ppid=5898 vsize=251292 CPUtime=72.76 cores=0-7
/proc/5900/stat : 5900 (FH) R 5898 5900 5900 0 -1 4202496 1989 0 0 0 7276 0 0 0 25 0 1 0 668337460 257323008 1694 33554432000 134512640 134936988 4290553248 18446744073709551615 134553505 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5900/statm: 62823 1694 41 104 0 62327 0
[pid=5905] ppid=5738 vsize=677724 CPUtime=0 cores=0-7
/proc/5905/stat : 5905 (python) S 5738 5738 5504 0 -1 4202560 962 0 0 0 0 0 0 0 19 0 1 0 668347935 693989376 7086 33554432000 4194304 5683644 140733563443696 18446744073709551615 255377321542 0 0 16781312 514 10856459344577298431 0 0 17 2 0 0 0
/proc/5905/statm: 169431 7086 353 364 0 105253 0
[pid=5907] ppid=5905 vsize=268424 CPUtime=0 cores=0-7
/proc/5907/stat : 5907 (hybridGM3) R 5905 5907 5907 0 -1 4202496 1370 0 0 0 0 0 0 0 21 0 1 0 668347936 274866176 1078 33554432000 134512640 135204385 4293800880 18446744073709551615 134856348 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/5907/statm: 67106 1078 57 169 0 66936 0
[pid=5738/tid=5745] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5745/stat : 5745 (python) S 5736 5738 5504 0 -1 4202560 26 938 0 0 0 0 0 0 22 0 34 0 668204995 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 0 0 0 0
[pid=5738/tid=5748] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5748/stat : 5748 (python) S 5736 5738 5504 0 -1 4202560 23 938 0 0 0 0 0 0 24 0 34 0 668204998 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 4 0 0 0
[pid=5738/tid=5751] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5751/stat : 5751 (python) S 5736 5738 5504 0 -1 4202560 27 938 0 0 0 0 0 0 18 0 34 0 668205001 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 0 0 0 0
[pid=5738/tid=5754] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5754/stat : 5754 (python) S 5736 5738 5504 0 -1 4202560 36 938 0 0 0 0 0 0 18 0 34 0 668205005 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 3 0 0 0
[pid=5738/tid=5757] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5757/stat : 5757 (python) S 5736 5738 5504 0 -1 4202560 29 938 0 0 0 0 0 0 18 0 34 0 668205008 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 0 0 0 0
[pid=5738/tid=5760] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5760/stat : 5760 (python) S 5736 5738 5504 0 -1 4202560 28 938 0 0 0 0 0 0 20 0 34 0 668205011 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 4 0 0 0
[pid=5738/tid=5763] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5763/stat : 5763 (python) S 5736 5738 5504 0 -1 4202560 27 938 0 0 0 0 0 0 18 0 34 0 668205014 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 2 0 0 0
[pid=5738/tid=5766] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5766/stat : 5766 (python) S 5736 5738 5504 0 -1 4202560 34 938 0 0 0 0 0 0 18 0 34 0 668205017 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 2 0 0 0
[pid=5738/tid=5772] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5772/stat : 5772 (python) S 5736 5738 5504 0 -1 4202560 39 938 0 0 0 0 0 0 18 0 34 0 668215040 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 2 0 0 0
[pid=5738/tid=5777] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5777/stat : 5777 (python) S 5736 5738 5504 0 -1 4202560 43 938 0 0 0 0 0 0 18 0 34 0 668215045 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 5 0 0 0
[pid=5738/tid=5783] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5783/stat : 5783 (python) S 5736 5738 5504 0 -1 4202560 37 938 0 0 0 0 0 0 18 0 34 0 668215050 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 5 0 0 0
[pid=5738/tid=5786] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5786/stat : 5786 (python) S 5736 5738 5504 0 -1 4202560 23 938 0 0 0 0 0 0 23 0 34 0 668215054 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 5 0 0 0
[pid=5738/tid=5789] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5789/stat : 5789 (python) S 5736 5738 5504 0 -1 4202560 26 938 0 0 0 0 0 0 18 0 34 0 668215058 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 1 0 0 0
[pid=5738/tid=5792] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5792/stat : 5792 (python) S 5736 5738 5504 0 -1 4202560 42 938 0 0 0 0 0 0 18 0 34 0 668215063 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 1 0 0 0
[pid=5738/tid=5797] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5797/stat : 5797 (python) S 5736 5738 5504 0 -1 4202560 36 938 0 0 0 0 0 0 18 0 34 0 668217945 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 2 0 0 0
[pid=5738/tid=5802] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5802/stat : 5802 (python) S 5736 5738 5504 0 -1 4202560 136 938 0 0 0 0 0 0 18 0 34 0 668219866 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 1 0 0 0
[pid=5738/tid=5808] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5808/stat : 5808 (python) S 5736 5738 5504 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 34 0 668225073 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 1 0 0 0
[pid=5738/tid=5811] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5811/stat : 5811 (python) S 5736 5738 5504 0 -1 4202560 30 938 0 0 0 0 0 0 18 0 34 0 668225078 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 7 0 0 0
[pid=5738/tid=5822] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5822/stat : 5822 (python) S 5736 5738 5504 0 -1 4202560 28 938 0 0 0 0 0 0 20 0 34 0 668239929 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 3 0 0 0
[pid=5738/tid=5829] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5829/stat : 5829 (python) S 5736 5738 5504 0 -1 4202560 38 938 0 0 0 0 0 0 18 0 34 0 668245766 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 6 0 0 0
[pid=5738/tid=5833] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5833/stat : 5833 (python) S 5736 5738 5504 0 -1 4202560 31 938 0 0 0 0 0 0 19 0 34 0 668247271 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 6 0 0 0
[pid=5738/tid=5838] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5838/stat : 5838 (python) S 5736 5738 5504 0 -1 4202560 31 938 0 0 0 0 0 0 19 0 34 0 668254281 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 6 0 0 0
[pid=5738/tid=5844] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5844/stat : 5844 (python) S 5736 5738 5504 0 -1 4202560 25 938 0 0 0 0 0 0 19 0 34 0 668262215 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 6 0 0 0
[pid=5738/tid=5853] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5853/stat : 5853 (python) S 5736 5738 5504 0 -1 4202560 32 938 0 0 0 0 0 0 18 0 34 0 668274067 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 6 0 0 0
[pid=5738/tid=5857] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5857/stat : 5857 (python) S 5736 5738 5504 0 -1 4202560 25 938 0 0 0 0 0 0 19 0 34 0 668278865 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 6 0 0 0
[pid=5738/tid=5864] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5864/stat : 5864 (python) S 5736 5738 5504 0 -1 4202560 28 938 0 0 0 0 0 0 20 0 34 0 668291599 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 6 0 0 0
[pid=5738/tid=5869] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5869/stat : 5869 (python) S 5736 5738 5504 0 -1 4202560 39 938 0 0 0 0 0 0 18 0 34 0 668295741 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 2 0 0 0
[pid=5738/tid=5876] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5876/stat : 5876 (python) S 5736 5738 5504 0 -1 4202560 28 938 0 0 0 0 0 0 19 0 34 0 668307490 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 5 0 0 0
[pid=5738/tid=5880] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5880/stat : 5880 (python) S 5736 5738 5504 0 -1 4202560 28 938 0 0 0 0 0 0 19 0 34 0 668310988 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 5 0 0 0
[pid=5738/tid=5887] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5887/stat : 5887 (python) S 5736 5738 5504 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 34 0 668318739 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 5 0 0 0
[pid=5738/tid=5895] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5895/stat : 5895 (python) S 5736 5738 5504 0 -1 4202560 25 938 0 0 0 0 0 0 19 0 34 0 668334883 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 5 0 0 0
[pid=5738/tid=5899] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5899/stat : 5899 (python) S 5736 5738 5504 0 -1 4202560 29 938 0 0 0 0 0 0 19 0 34 0 668337460 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 5 0 0 0
[pid=5738/tid=5906] ppid=5736 vsize=687648 CPUtime=0 cores=0-7
/proc/5738/task/5906/stat : 5906 (python) S 5736 5738 5504 0 -1 4202560 31 938 0 0 0 0 0 0 19 0 34 0 668347936 704151552 8678 33554432000 4194304 5683644 140733563443696 18446744073709551615 255389125041 0 0 16781312 2 18446604443839615232 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10150.2
Current children cumulated vsize (KiB) 31919068

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5738 and gives
#  childrusage.ru_utime.tv_sec=3114
#  childrusage.ru_utime.tv_usec=593509
#  childrusage.ru_stime.tv_sec=16
#  childrusage.ru_stime.tv_usec=218534
# CPU time returned by wait4() is 3130.81
# while last known CPU time is 10150.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1432.31
CPU time (s): 10150.2
CPU user time (s): 10132.8
CPU system time (s): 17.37
CPU usage (%): 708.655
Max. virtual memory (cumulated for all children) (KiB): 31919068

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3114.59
system time used= 16.2185
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 95486
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17148
involuntary context switches= 37141

runsolver used 15.6066 second user time and 37.7363 second system time

The end

Launcher Data 

Begin job on node135 at 2011-05-16 19:14:28
IDJOB=3385378
IDBENCH=82643
IDSOLVER=1870
FILE ID=node135/3385378-1305566068
RUNJOBID= node135-1305564962-5518
PBS_JOBID= 13350115
Free space on /tmp= 73516 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S817927155-033-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385378-1305566068/watcher-3385378-1305566068 -o /tmp/evaluation-result-3385378-1305566068/solver-3385378-1305566068 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385378-1305566068.cnf -seed 216506747 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= bdd02c131ae0dd9fa14ba01f07a63379
RANDOM SEED=216506747

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13659880 kB
Buffers:        320904 kB
Cached:        6490060 kB
SwapCached:      18108 kB
Active:       10443868 kB
Inactive:      8575204 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13659880 kB
SwapTotal:    67111528 kB
SwapFree:     63308188 kB
Dirty:           32656 kB
Writeback:           0 kB
AnonPages:    12195684 kB
Mapped:          20148 kB
Slab:           146600 kB
PageTables:      55488 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 92296180 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73484 MiB
End job on node135 at 2011-05-16 19:38:23