Trace number 3385355

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 9353.4 1177.13

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S943787219-031-UNKNOWN.cnf
MD5SUM6105ec111e1e16da586afadcc6f09041
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.47	c INFO: solving HOME/instance-3385355-1305565677.cnf
0.31/0.47	c INFO: computing task features
0.60/0.70	c INFO: computed variable-clause graph statistics
0.60/0.70	c INFO: computed clause balance statistics
1.70/1.87	c INFO: computed variable balance statistics
2.20/2.34	c INFO: computed small-clause counts
2.20/2.34	c INFO: computed Horn-clause counts
2.20/2.38	c INFO: computed variable graph statistics
2.20/2.38	c INFO: collected features for HOME/instance-3385355-1305565677.cnf in 1.92 s
2.30/2.41	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.38)
2.30/2.44	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
2.30/2.48	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
2.39/2.51	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.07)
2.39/2.54	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.05)
2.39/2.57	c INFO: running gnovelty+2@0 for 97 with 4997 remaining (b = 0.04)
2.49/2.60	c INFO: running FH@0 for 97 with 4997 remaining (b = 0.03)
2.49/2.64	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.03)
786.36/100.78	c INFO: running adaptg2wsat2009++@0 for 97 with 4899 remaining (b = 0.02)
802.31/102.77	c INFO: running FH@0 for 97 with 4897 remaining (b = 0.02)
803.05/102.82	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.04)
803.05/102.86	c INFO: running gnovelty+2@0 for 97 with 4897 remaining (b = 0.02)
803.60/102.90	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
803.60/102.95	c INFO: running adaptg2wsat2009++@0 for 97 with 4897 remaining (b = 0.01)
803.87/103.00	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
803.87/103.05	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.02)
1586.22/201.13	c INFO: running TNM@0 for 1552 with 4799 remaining (b = 0.18)
1602.15/203.14	c INFO: running FH@0 for 97 with 4797 remaining (b = 0.01)
1602.90/203.28	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1603.56/203.33	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
2370.22/299.58	c INFO: running hybridGM3@100 for 97 with 4700 remaining (b = 0.01)
2371.79/299.74	c INFO: running hybridGM3@100 for 97 with 4700 remaining (b = 0.01)
2378.93/300.60	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.01)
2394.16/302.56	c INFO: running hybridGM3@100 for 97 with 4697 remaining (b = 0.01)
2401.23/303.47	c INFO: running adaptg2wsat2009++@98 for 97 with 4697 remaining (b = 0.01)
2411.69/304.77	c INFO: running hybridGM3@99 for 97 with 4695 remaining (b = 0.01)
2426.72/306.67	c INFO: running hybridGM3@0 for 194 with 4693 remaining (b = 0.02)
3137.47/395.88	c INFO: running hybridGM3@0 for 194 with 4604 remaining (b = 0.02)
3154.18/397.93	c INFO: running TNM@0 for 1455 with 4602 remaining (b = 0.13)
3176.47/400.80	c INFO: running adaptg2wsat2009++@100 for 97 with 4599 remaining (b = 0.01)
3178.04/400.91	c INFO: running hybridGM3@296 for 97 with 4599 remaining (b = 0.01)
3178.78/401.07	c INFO: running iPAWS@0 for 97 with 4599 remaining (b = 0.01)
3211.40/405.14	c INFO: running FH@0 for 291 with 4595 remaining (b = 0.03)
3937.23/496.22	c INFO: running hybridGM3@397 for 97 with 4504 remaining (b = 0.01)
3952.36/498.14	c INFO: running adaptg2wsat2009++@296 for 291 with 4502 remaining (b = 0.03)
3978.63/501.40	c INFO: running gnovelty+2@0 for 97 with 4499 remaining (b = 0.01)
3993.80/503.38	c INFO: running hybridGM3@93 for 97 with 4497 remaining (b = 0.01)
4695.99/591.54	c INFO: running hybridGM3@0 for 194 with 4408 remaining (b = 0.02)
4696.70/591.60	c INFO: running hybridGM3@97 for 97 with 4408 remaining (b = 0.01)
4777.88/601.80	c INFO: running FH@98 for 291 with 4398 remaining (b = 0.02)
4800.94/604.73	c INFO: running hybridGM3@188 for 97 with 4395 remaining (b = 0.01)
5502.89/692.95	c INFO: running hybridGM3@0 for 194 with 4307 remaining (b = 0.01)
5559.32/700.06	c INFO: running TNM@0 for 1552 with 4300 remaining (b = 0.11)
5615.01/707.04	c INFO: running iPAWS@0 for 97 with 4293 remaining (b = 0.01)
6261.19/788.29	c INFO: running adaptg2wsat2009++@99 for 97 with 4212 remaining (b = 0.01)
6307.34/794.05	c INFO: running adaptg2wsat2009++@396 for 194 with 4206 remaining (b = 0.01)
6398.06/805.43	c INFO: running FH@100 for 291 with 4195 remaining (b = 0.02)
7021.14/883.74	c INFO: running adaptg2wsat2009++@394 for 194 with 4116 remaining (b = 0.02)
7084.02/891.69	c INFO: running gnovelty+2@0 for 97 with 4108 remaining (b = 0.01)
7156.39/900.71	c INFO: running hybridGM3@94 for 97 with 4099 remaining (b = 0.01)
7879.78/991.67	c INFO: running adaptg2wsat2009++@493 for 97 with 4008 remaining (b = 0.01)
7882.95/992.11	c INFO: running hybridGM3@0 for 194 with 4008 remaining (b = 0.01)
7914.73/996.04	c INFO: running hybridGM3@0 for 194 with 4004 remaining (b = 0.01)
8594.16/1081.46	c INFO: running adaptg2wsat2009++@683 for 97 with 3919 remaining (b = 0.01)
8637.88/1087.00	c INFO: running NCVWr@0 for 485 with 3913 remaining (b = 0.03)
8704.72/1095.32	c INFO: running iPAWS@0 for 97 with 3905 remaining (b = 0.01)
9352.48/1176.83	c INFO: running hybridGM3@0 for 194 with 3823 remaining (b = 0.01)
9353.40/1177.08	c INFO: running FH@199 for 194 with 3823 remaining (b = 0.01)
9353.40/1177.08	Traceback (most recent call last):
9353.40/1177.08	  File "HOME/solve", line 33, in <module>
9353.40/1177.08	    plac.call(main)
9353.40/1177.08	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385355-1305565677/watcher-3385355-1305565677 -o /tmp/evaluation-result-3385355-1305565677/solver-3385355-1305565677 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385355-1305565677.cnf -seed 616990486 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.73 7.57 4.37 2/345 3365
/proc/meminfo: memFree=12944896/32950928 swapFree=54713412/67111528
[pid=3365] ppid=3363 vsize=15184 CPUtime=0 cores=0-7
/proc/3365/stat : 3365 (python) S 3363 3365 3087 0 -1 4202496 733 0 0 0 0 0 0 0 23 0 1 0 668166488 15548416 622 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 2 0 0 0
/proc/3365/statm: 3796 622 322 364 0 283 0

[startup+0.099565 s]
/proc/loadavg: 8.73 7.57 4.37 2/345 3365
/proc/meminfo: memFree=12944896/32950928 swapFree=54713412/67111528
[pid=3365] ppid=3363 vsize=104220 CPUtime=0.07 cores=0-7
/proc/3365/stat : 3365 (python) S 3363 3365 3087 0 -1 4202496 3045 0 0 0 5 2 0 0 23 0 1 0 668166488 106721280 2731 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 2 0 0 0
/proc/3365/statm: 26055 2731 847 364 0 1803 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104220

[startup+0.10058 s]
/proc/loadavg: 8.73 7.57 4.37 2/345 3365
/proc/meminfo: memFree=12944896/32950928 swapFree=54713412/67111528
[pid=3365] ppid=3363 vsize=104228 CPUtime=0.07 cores=0-7
/proc/3365/stat : 3365 (python) R 3363 3365 3087 0 -1 4202496 3055 0 0 0 5 2 0 0 23 0 1 0 668166488 106729472 2739 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594527429 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/3365/statm: 26056 2740 847 364 0 1804 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104228

[startup+0.300529 s]
/proc/loadavg: 8.73 7.57 4.37 2/345 3365
/proc/meminfo: memFree=12944896/32950928 swapFree=54713412/67111528
[pid=3365] ppid=3363 vsize=168676 CPUtime=0.23 cores=0-7
/proc/3365/stat : 3365 (python) R 3363 3365 3087 0 -1 4202496 6717 931 1 0 17 6 0 0 24 0 1 0 668166488 172724224 4794 33554432000 4194304 5683644 140734323059456 18446744073709551615 4870104 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/3365/statm: 42169 4794 1331 364 0 3454 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 168676

[startup+0.700458 s]
/proc/loadavg: 8.73 7.57 4.37 2/345 3365
/proc/meminfo: memFree=12944896/32950928 swapFree=54713412/67111528
[pid=3365] ppid=3363 vsize=289124 CPUtime=0.6 cores=0-7
/proc/3365/stat : 3365 (python) R 3363 3365 3087 0 -1 4202496 13770 931 1 0 52 8 0 0 25 0 1 0 668166488 296062976 9652 33554432000 4194304 5683644 140734323059456 18446744073709551615 46994483380144 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/3365/statm: 72281 9652 1812 364 0 8205 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 289124

[startup+1.50032 s]
/proc/loadavg: 8.73 7.57 4.37 2/346 3370
/proc/meminfo: memFree=12912772/32950928 swapFree=54713412/67111528
[pid=3365] ppid=3363 vsize=289500 CPUtime=1.4 cores=0-7
/proc/3365/stat : 3365 (python) R 3363 3365 3087 0 -1 4202496 13882 931 1 0 132 8 0 0 25 0 1 0 668166488 296448000 9759 33554432000 4194304 5683644 140734323059456 18446744073709551615 235598275521 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/3365/statm: 72375 9759 1826 364 0 8299 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 289500

[startup+3.10104 s]
/proc/loadavg: 8.73 7.57 4.37 2/346 3370
/proc/meminfo: memFree=12912152/32950928 swapFree=54713412/67111528
[pid=3365] ppid=3363 vsize=364472 CPUtime=2.53 cores=0-7
/proc/3365/stat : 3365 (python) S 3363 3365 3087 0 -1 4202496 20266 931 1 0 244 9 0 0 25 0 9 0 668166488 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/3365/statm: 91118 8084 1891 364 0 27015 0
Current children cumulated CPU time (s) 2.53
Current children cumulated vsize (KiB) 364472

[startup+6.30148 s]
/proc/loadavg: 8.19 7.48 4.36 9/370 3396
/proc/meminfo: memFree=12848356/32950928 swapFree=54713412/67111528
[pid=3365] ppid=3363 vsize=364472 CPUtime=2.53 cores=0-7
/proc/3365/stat : 3365 (python) S 3363 3365 3087 0 -1 4202496 20266 931 1 0 244 9 0 0 25 0 9 0 668166488 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/3365/statm: 91118 8084 1891 364 0 27015 0
[pid=3371] ppid=3365 vsize=282312 CPUtime=0 cores=0-7
/proc/3371/stat : 3371 (python) S 3365 3365 3087 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 668166730 289087488 6331 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886671 0 0 16781312 514 11380967347834552578 0 0 17 7 0 0 0
/proc/3371/statm: 70578 6331 355 364 0 6496 0
[pid=3373] ppid=3371 vsize=1020188 CPUtime=3.87 cores=0-7
/proc/3373/stat : 3373 (gnovelty+2) R 3371 3373 3373 0 -1 4202496 1142 0 0 0 387 0 0 0 25 0 1 0 668166730 1044672512 877 33554432000 134512640 135663704 4294756000 18446744073709551615 134525691 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/3373/statm: 255047 877 113 282 0 254763 0
[pid=3374] ppid=3365 vsize=293176 CPUtime=0 cores=0-7
/proc/3374/stat : 3374 (python) S 3365 3365 3087 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 668166733 300212224 6380 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 11380975044415947009 0 0 17 2 0 0 0
/proc/3374/statm: 73294 6380 349 364 0 9209 0
[pid=3376] ppid=3374 vsize=1020188 CPUtime=3.84 cores=0-7
/proc/3376/stat : 3376 (gnovelty+2) R 3374 3376 3376 0 -1 4202496 1139 0 0 0 384 0 0 0 25 0 1 0 668166733 1044672512 876 33554432000 134512640 135663704 4291578272 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/3376/statm: 255047 876 113 282 0 254763 0
[pid=3377] ppid=3365 vsize=302948 CPUtime=0 cores=0-7
/proc/3377/stat : 3377 (python) S 3365 3365 3087 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 668166736 310218752 6517 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 2057207150584758532 0 0 17 0 0 0 0
/proc/3377/statm: 75737 6517 347 364 0 11649 0
[pid=3380] ppid=3377 vsize=421140 CPUtime=3.8 cores=0-7
/proc/3380/stat : 3380 (adaptg2wsat2009) R 3377 3380 3380 0 -1 4202496 1806 0 0 0 380 0 0 0 25 0 1 0 668166736 431247360 1540 33554432000 134512640 135107411 4293914576 18446744073709551615 134523331 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/3380/statm: 105285 1540 49 146 0 104161 0
[pid=3381] ppid=3365 vsize=313204 CPUtime=0 cores=0-7
/proc/3381/stat : 3381 (python) S 3365 3365 3087 0 -1 4202560 748 0 0 0 0 0 0 0 18 0 1 0 668166739 320720896 6521 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 8710268722251530499 0 0 17 0 0 0 0
/proc/3381/statm: 78301 6521 347 364 0 14210 0
[pid=3383] ppid=3381 vsize=421140 CPUtime=3.73 cores=0-7
/proc/3383/stat : 3383 (adaptg2wsat2009) R 3381 3383 3383 0 -1 4202496 1801 0 0 0 373 0 0 0 25 0 1 0 668166740 431247360 1538 33554432000 134512640 135107411 4288589040 18446744073709551615 134523245 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/3383/statm: 105285 1538 49 146 0 104161 0
[pid=3384] ppid=3365 vsize=323460 CPUtime=0 cores=0-7
/proc/3384/stat : 3384 (python) S 3365 3365 3087 0 -1 4202560 751 0 0 0 0 0 0 0 18 0 1 0 668166742 331223040 6525 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 9687418999507222787 0 0 17 2 0 0 0
/proc/3384/statm: 80865 6525 347 364 0 16771 0
[pid=3386] ppid=3384 vsize=421140 CPUtime=3.74 cores=0-7
/proc/3386/stat : 3386 (adaptg2wsat2009) R 3384 3386 3386 0 -1 4202496 1803 0 0 0 374 0 0 0 25 0 1 0 668166743 431247360 1538 33554432000 134512640 135107411 4287466208 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/3386/statm: 105285 1538 49 146 0 104161 0
[pid=3388] ppid=3365 vsize=333716 CPUtime=0 cores=0-7
/proc/3388/stat : 3388 (python) S 3365 3365 3087 0 -1 4202560 761 0 0 0 0 0 0 0 18 0 1 0 668166746 341725184 6529 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 4334991722569236737 0 0 17 0 0 0 0
/proc/3388/statm: 83429 6529 347 364 0 19332 0
[pid=3390] ppid=3388 vsize=1020188 CPUtime=3.7 cores=0-7
/proc/3390/stat : 3390 (gnovelty+2) R 3388 3390 3390 0 -1 4202496 1141 0 0 0 370 0 0 0 25 0 1 0 668166746 1044672512 876 33554432000 134512640 135663704 4288007760 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/3390/statm: 255047 876 113 282 0 254763 0
[pid=3391] ppid=3365 vsize=344592 CPUtime=0 cores=0-7
/proc/3391/stat : 3391 (python) S 3365 3365 3087 0 -1 4202560 770 0 0 0 0 0 0 0 18 0 1 0 668166749 352862208 6535 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 9687430544379314435 0 0 17 2 0 0 0
/proc/3391/statm: 86148 6535 349 364 0 22048 0
[pid=3393] ppid=3391 vsize=249144 CPUtime=3.62 cores=0-7
/proc/3393/stat : 3393 (FH) R 3391 3393 3393 0 -1 4202496 1562 0 0 0 362 0 0 0 25 0 1 0 668166749 255123456 1295 33554432000 134512640 134936988 4286861776 18446744073709551615 134523665 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/3393/statm: 62286 1295 37 104 0 61790 0
[pid=3394] ppid=3365 vsize=354228 CPUtime=0 cores=0-7
/proc/3394/stat : 3394 (python) S 3365 3365 3087 0 -1 4202560 803 0 0 0 0 0 0 0 18 0 1 0 668166752 362729472 6543 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 18328220572820930818 0 0 17 0 0 0 0
/proc/3394/statm: 88557 6543 353 364 0 24454 0
[pid=3396] ppid=3394 vsize=421140 CPUtime=3.65 cores=0-7
/proc/3396/stat : 3396 (adaptg2wsat2009) R 3394 3396 3396 0 -1 4202496 1815 0 0 0 365 0 0 0 25 0 1 0 668166752 431247360 1540 33554432000 134512640 135107411 4290511472 18446744073709551615 134523245 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/3396/statm: 105285 1540 49 146 0 104161 0
[pid=3365/tid=3372] ppid=3363 vsize=364472 CPUtime=0 cores=0-7
/proc/3365/task/3372/stat : 3372 (python) S 3363 3365 3087 0 -1 4202560 27 931 0 0 0 0 0 0 25 0 9 0 668166730 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 0 0 0 0
[pid=3365/tid=3375] ppid=3363 vsize=364472 CPUtime=0 cores=0-7
/proc/3365/task/3375/stat : 3375 (python) S 3363 3365 3087 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 9 0 668166733 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 4 0 0 0
[pid=3365/tid=3379] ppid=3363 vsize=364472 CPUtime=0 cores=0-7
/proc/3365/task/3379/stat : 3379 (python) S 3363 3365 3087 0 -1 4202560 22 931 0 0 0 0 0 0 18 0 9 0 668166736 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 2 0 0 0
[pid=3365/tid=3382] ppid=3363 vsize=364472 CPUtime=0 cores=0-7
/proc/3365/task/3382/stat : 3382 (python) S 3363 3365 3087 0 -1 4202560 25 931 0 0 0 0 0 0 22 0 9 0 668166739 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 6 0 0 0
[pid=3365/tid=3385] ppid=3363 vsize=364472 CPUtime=0 cores=0-7
/proc/3365/task/3385/stat : 3385 (python) S 3363 3365 3087 0 -1 4202560 24 931 0 0 0 0 0 0 20 0 9 0 668166743 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 6 0 0 0
[pid=3365/tid=3389] ppid=3363 vsize=364472 CPUtime=0 cores=0-7
/proc/3365/task/3389/stat : 3389 (python) S 3363 3365 3087 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 9 0 668166746 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 0 0 0 0
[pid=3365/tid=3392] ppid=3363 vsize=364472 CPUtime=0 cores=0-7
/proc/3365/task/3392/stat : 3392 (python) S 3363 3365 3087 0 -1 4202560 28 931 0 0 0 0 0 0 24 0 9 0 668166749 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 2 0 0 0
[pid=3365/tid=3395] ppid=3363 vsize=364472 CPUtime=0 cores=0-7
/proc/3365/task/3395/stat : 3395 (python) S 3363 3365 3087 0 -1 4202560 29 931 0 0 0 0 0 0 25 0 9 0 668166752 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 32.48
Current children cumulated vsize (KiB) 7906376

[startup+12.7014 s]
/proc/loadavg: 8.17 7.49 4.38 9/370 3397
/proc/meminfo: memFree=12839276/32950928 swapFree=54713412/67111528
[pid=3365] ppid=3363 vsize=364472 CPUtime=2.53 cores=0-7
/proc/3365/stat : 3365 (python) S 3363 3365 3087 0 -1 4202496 20266 931 1 0 244 9 0 0 25 0 9 0 668166488 373219328 8084 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/3365/statm: 91118 8084 1891 364 0 27015 0
[pid=3371] ppid=3365 vsize=282312 CPUtime=0.02 cores=0-7
/proc/3371/stat : 3371 (python) S 3365 3365 3087 0 -1 4202560 908 0 0 0 1 1 0 0 18 0 1 0 668166730 289087488 6354 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886671 0 0 16781312 514 13723523595760533762 0 0 17 7 0 0 0
/proc/3371/statm: 70578 6354 378 364 0 6496 0
[pid=3373] ppid=3371 vsize=1020188 CPUtime=10.27 cores=0-7
/proc/3373/stat : 3373 (gnovelty+2) R 3371 3373 3373 0 -1 4202496 1142 0 0 0 1027 0 0 0 25 0 1 0 668166730 1044672512 877 33554432000 134512640 135663704 4294756000 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/3373/statm: 255047 877 113 282 0 254763 0
[pid=3374] ppid=3365 vsize=293176 CPUtime=0.02 cores=0-7
/proc/3374/stat : 3374 (python) S 3365 3365 3087 0 -1 4202560 907 0 0 0 1 1 0 0 18 0 1 0 668166733 300212224 6403 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533761 0 0 17 2 0 0 0
/proc/3374/statm: 73294 6403 372 364 0 9209 0
[pid=3376] ppid=3374 vsize=1020188 CPUtime=10.24 cores=0-7
/proc/3376/stat : 3376 (gnovelty+2) R 3374 3376 3376 0 -1 4202496 1139 0 0 0 1024 0 0 0 25 0 1 0 668166733 1044672512 876 33554432000 134512640 135663704 4291578272 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/3376/statm: 255047 876 113 282 0 254763 0
[pid=3377] ppid=3365 vsize=302948 CPUtime=0.02 cores=0-7
/proc/3377/stat : 3377 (python) S 3365 3365 3087 0 -1 4202560 915 0 0 0 1 1 0 0 18 0 1 0 668166736 310218752 6540 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533764 0 0 17 0 0 0 0
/proc/3377/statm: 75737 6540 370 364 0 11649 0
[pid=3380] ppid=3377 vsize=421804 CPUtime=10.2 cores=0-7
/proc/3380/stat : 3380 (adaptg2wsat2009) R 3377 3380 3380 0 -1 4202496 2139 0 0 0 1020 0 0 0 25 0 1 0 668166736 431927296 1873 33554432000 134512640 135107411 4293914576 18446744073709551615 134531411 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/3380/statm: 105451 1873 59 146 0 104327 0
[pid=3381] ppid=3365 vsize=313204 CPUtime=0.02 cores=0-7
/proc/3381/stat : 3381 (python) S 3365 3365 3087 0 -1 4202560 915 0 0 0 1 1 0 0 18 0 1 0 668166739 320720896 6544 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533763 0 0 17 0 0 0 0
/proc/3381/statm: 78301 6544 370 364 0 14210 0
[pid=3383] ppid=3381 vsize=421804 CPUtime=10.01 cores=0-7
/proc/3383/stat : 3383 (adaptg2wsat2009) R 3381 3383 3383 0 -1 4202496 2134 0 0 0 1001 0 0 0 25 0 1 0 668166740 431927296 1871 33554432000 134512640 135107411 4288589040 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/3383/statm: 105451 1871 59 146 0 104327 0
[pid=3384] ppid=3365 vsize=323460 CPUtime=0.02 cores=0-7
/proc/3384/stat : 3384 (python) S 3365 3365 3087 0 -1 4202560 944 0 0 0 1 1 0 0 18 0 1 0 668166742 331223040 6548 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533763 0 0 17 2 0 0 0
/proc/3384/statm: 80865 6548 370 364 0 16771 0
[pid=3386] ppid=3384 vsize=421804 CPUtime=10.14 cores=0-7
/proc/3386/stat : 3386 (adaptg2wsat2009) R 3384 3386 3386 0 -1 4202496 2136 0 0 0 1014 0 0 0 25 0 1 0 668166743 431927296 1871 33554432000 134512640 135107411 4287466208 18446744073709551615 134531323 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/3386/statm: 105451 1871 59 146 0 104327 0
[pid=3388] ppid=3365 vsize=333716 CPUtime=0.03 cores=0-7
/proc/3388/stat : 3388 (python) S 3365 3365 3087 0 -1 4202560 959 0 0 0 1 2 0 0 18 0 1 0 668166746 341725184 6552 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533761 0 0 17 0 0 0 0
/proc/3388/statm: 83429 6552 370 364 0 19332 0
[pid=3390] ppid=3388 vsize=1020188 CPUtime=10.1 cores=0-7
/proc/3390/stat : 3390 (gnovelty+2) R 3388 3390 3390 0 -1 4202496 1141 0 0 0 1010 0 0 0 25 0 1 0 668166746 1044672512 876 33554432000 134512640 135663704 4288007760 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/3390/statm: 255047 876 113 282 0 254763 0
[pid=3391] ppid=3365 vsize=344596 CPUtime=0.02 cores=0-7
/proc/3391/stat : 3391 (python) R 3365 3365 3087 0 -1 4202560 967 0 0 0 1 1 0 0 18 0 1 0 668166749 352866304 6558 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594866491 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/3391/statm: 86148 6558 372 364 0 22048 0

################
# More data... #
################

/proc/3464/statm: 138383 7100 372 364 0 74241 0
[pid=3466] ppid=3464 vsize=459768 CPUtime=777.95 cores=0-7
/proc/3466/stat : 3466 (TNM) R 3464 3466 3466 0 -1 4202496 1932 0 0 0 77793 2 0 0 25 0 1 0 668206282 470802432 1658 33554432000 134512640 135008748 4293017872 18446744073709551615 134528967 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/3466/statm: 114942 1658 46 122 0 113842 0
[pid=3467] ppid=3365 vsize=563788 CPUtime=0.28 cores=0-7
/proc/3467/stat : 3467 (python) S 3365 3365 3087 0 -1 4202560 1188 0 0 0 14 14 0 0 19 0 2 0 668206595 577318912 7070 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/3467/statm: 140947 7070 406 364 0 76802 0
[pid=3470] ppid=3467 vsize=335996 CPUtime=99.97 cores=0-7
/proc/3470/stat : 3470 (iPAWS) T 3467 3470 3470 0 -1 4202496 2028 0 0 0 9997 0 0 0 25 0 1 0 668206595 344059904 1750 33554432000 134512640 135114423 4290878528 18446744073709551615 134515649 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/3470/statm: 83999 1750 59 147 0 83851 0
[pid=3467/tid=3475] ppid=3365 vsize=563788 CPUtime=0 cores=0-7
/proc/3467/task/3475/stat : 3475 (python) S 3365 3365 3087 0 -1 4202560 105 0 0 0 0 0 0 0 19 0 2 0 668216623 577318912 7070 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 514 18446604458885690560 0 0 -1 3 0 0 0
[pid=3476] ppid=3365 vsize=574044 CPUtime=0.28 cores=0-7
/proc/3476/stat : 3476 (python) S 3365 3365 3087 0 -1 4202560 1184 0 0 0 14 14 0 0 19 0 2 0 668216629 587821056 7120 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/3476/statm: 143511 7120 407 364 0 79363 0
[pid=3478] ppid=3476 vsize=1020188 CPUtime=100 cores=0-7
/proc/3478/stat : 3478 (gnovelty+2) T 3476 3478 3478 0 -1 4202496 1159 0 0 0 10000 0 0 0 25 0 1 0 668216629 1044672512 877 33554432000 134512640 135663704 4293276896 18446744073709551615 134545631 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/3478/statm: 255047 877 113 282 0 254763 0
[pid=3476/tid=3486] ppid=3365 vsize=574044 CPUtime=0 cores=0-7
/proc/3476/task/3486/stat : 3486 (python) S 3365 3365 3087 0 -1 4202560 100 0 0 0 0 0 0 0 19 0 2 0 668226663 587821056 7120 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 514 18446604465105853376 0 0 -1 5 0 0 0
[pid=3483] ppid=3365 vsize=584300 CPUtime=0.59 cores=0-7
/proc/3483/stat : 3483 (python) S 3365 3365 3087 0 -1 4202560 1199 0 0 0 31 28 0 0 19 0 2 0 668225642 598323200 7125 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/3483/statm: 146075 7125 407 364 0 81924 0
[pid=3485] ppid=3483 vsize=268424 CPUtime=195.71 cores=0-7
/proc/3485/stat : 3485 (hybridGM3) T 3483 3485 3485 0 -1 4202496 5660 0 0 0 19571 0 0 0 25 0 1 0 668225645 274866176 5378 33554432000 134512640 135204385 4292733072 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/3485/statm: 67106 5378 63 169 0 66936 0
[pid=3483/tid=3503] ppid=3365 vsize=584300 CPUtime=0 cores=0-7
/proc/3483/task/3503/stat : 3503 (python) S 3365 3365 3087 0 -1 4202560 102 0 0 0 0 0 0 0 19 0 2 0 668245311 598323200 7125 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 514 18446604470969970944 0 0 -1 1 0 0 0
[pid=3490] ppid=3365 vsize=594764 CPUtime=0.91 cores=0-7
/proc/3490/stat : 3490 (python) S 3365 3365 3087 0 -1 4202560 1298 0 0 0 50 41 0 0 18 0 2 0 668235783 609038336 7078 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/3490/statm: 148691 7078 401 364 0 84537 0
[pid=3492] ppid=3490 vsize=268420 CPUtime=294.17 cores=0-7
/proc/3492/stat : 3492 (hybridGM3) T 3490 3492 3492 0 -1 4202496 5671 0 0 0 29417 0 0 0 25 0 1 0 668235784 274862080 5377 33554432000 134512640 135204385 4288199872 18446744073709551615 134538284 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/3492/statm: 67105 5377 63 169 0 66935 0
[pid=3490/tid=3512] ppid=3365 vsize=594764 CPUtime=0 cores=0-7
/proc/3490/task/3512/stat : 3512 (python) S 3365 3365 3087 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 668256553 609038336 7078 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 514 18446604471118959616 0 0 -1 3 0 0 0
[pid=3493] ppid=3365 vsize=604812 CPUtime=1.41 cores=0-7
/proc/3493/stat : 3493 (python) S 3365 3365 3087 0 -1 4202560 967 0 0 0 70 71 0 0 18 0 1 0 668236494 619327488 7101 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533767 0 0 17 5 0 0 0
/proc/3493/statm: 151203 7101 372 364 0 87046 0
[pid=3497] ppid=3493 vsize=459768 CPUtime=475.97 cores=0-7
/proc/3497/stat : 3497 (TNM) R 3493 3497 3497 0 -1 4202496 1939 0 0 0 47594 3 0 0 25 0 1 0 668236495 470802432 1658 33554432000 134512640 135008748 4287431760 18446744073709551615 134527795 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/3497/statm: 114942 1658 46 122 0 113842 0
[pid=3498] ppid=3365 vsize=615068 CPUtime=0.3 cores=0-7
/proc/3498/stat : 3498 (python) S 3365 3365 3087 0 -1 4202560 1178 0 0 0 18 12 0 0 19 0 2 0 668237192 629829632 7187 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/3498/statm: 153767 7187 400 364 0 89607 0
[pid=3500] ppid=3498 vsize=335996 CPUtime=97.09 cores=0-7
/proc/3500/stat : 3500 (iPAWS) T 3498 3500 3500 0 -1 4202496 2029 0 0 0 9709 0 0 0 25 0 1 0 668237193 344059904 1750 33554432000 134512640 135114423 4288934240 18446744073709551615 134515512 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/3500/statm: 83999 1750 59 147 0 83851 0
[pid=3498/tid=3505] ppid=3365 vsize=615068 CPUtime=0 cores=0-7
/proc/3498/task/3505/stat : 3505 (python) S 3365 3365 3087 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 668247025 629829632 7187 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 514 18446604456525185216 0 0 -1 4 0 0 0
[pid=3509] ppid=3365 vsize=625324 CPUtime=0.3 cores=0-7
/proc/3509/stat : 3509 (python) S 3365 3365 3087 0 -1 4202560 1198 0 0 0 17 13 0 0 19 0 2 0 668255658 640331776 7164 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/3509/statm: 156331 7164 400 364 0 92168 0
[pid=3511] ppid=3509 vsize=1020188 CPUtime=99.15 cores=0-7
/proc/3511/stat : 3511 (gnovelty+2) T 3509 3511 3511 0 -1 4202496 1163 0 0 0 9915 0 0 0 25 0 1 0 668255658 1044672512 877 33554432000 134512640 135663704 4291672336 18446744073709551615 134525260 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/3511/statm: 255047 877 113 282 0 254763 0
[pid=3509/tid=3516] ppid=3365 vsize=625324 CPUtime=0 cores=0-7
/proc/3509/task/3516/stat : 3516 (python) S 3365 3365 3087 0 -1 4202560 100 0 0 0 0 0 0 0 19 0 2 0 668265693 640331776 7164 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 514 18446604451714036800 0 0 -1 3 0 0 0
[pid=3517] ppid=3365 vsize=635580 CPUtime=0.56 cores=0-7
/proc/3517/stat : 3517 (python) S 3365 3365 3087 0 -1 4202560 1028 0 0 0 29 27 0 0 18 0 1 0 668265699 650833920 7206 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533762 0 0 17 6 0 0 0
/proc/3517/statm: 158895 7206 379 364 0 94729 0
[pid=3519] ppid=3517 vsize=268424 CPUtime=184.23 cores=0-7
/proc/3519/stat : 3519 (hybridGM3) R 3517 3519 3519 0 -1 4202496 5671 0 0 0 18423 0 0 0 25 0 1 0 668265700 274866176 5378 33554432000 134512640 135204385 4286844976 18446744073709551615 134538395 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/3519/statm: 67106 5378 63 169 0 66936 0
[pid=3520] ppid=3365 vsize=645836 CPUtime=0.53 cores=0-7
/proc/3520/stat : 3520 (python) S 3365 3365 3087 0 -1 4202560 1026 0 0 0 30 23 0 0 18 0 1 0 668266092 661336064 7299 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533764 0 0 17 4 0 0 0
/proc/3520/statm: 161459 7299 378 364 0 97290 0
[pid=3522] ppid=3520 vsize=268424 CPUtime=175.74 cores=0-7
/proc/3522/stat : 3522 (hybridGM3) R 3520 3522 3522 0 -1 4202496 5664 0 0 0 17573 1 0 0 25 0 1 0 668266093 274866176 5376 33554432000 134512640 135204385 4291620288 18446744073709551615 134538264 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/3522/statm: 67106 5376 63 169 0 66936 0
[pid=3531] ppid=3365 vsize=656092 CPUtime=0.27 cores=0-7
/proc/3531/stat : 3531 (python) S 3365 3365 3087 0 -1 4202560 1036 0 0 0 14 13 0 0 18 0 1 0 668275188 671838208 7137 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533763 0 0 17 4 0 0 0
/proc/3531/statm: 164023 7137 378 364 0 99851 0
[pid=3533] ppid=3531 vsize=421344 CPUtime=89.63 cores=0-7
/proc/3533/stat : 3533 (NCVWr) R 3531 3533 3533 0 -1 4202496 1998 0 0 0 8963 0 0 0 25 0 1 0 668275189 431456256 1712 33554432000 134512640 135113558 4287221328 18446744073709551615 134531443 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/3533/statm: 105336 1712 58 147 0 104211 0
[pid=3534] ppid=3365 vsize=666348 CPUtime=0.23 cores=0-7
/proc/3534/stat : 3534 (python) S 3365 3365 3087 0 -1 4202560 1039 0 0 0 12 11 0 0 18 0 1 0 668276020 682340352 7264 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 13723523595760533762 0 0 17 4 0 0 0
/proc/3534/statm: 166587 7264 378 364 0 102412 0
[pid=3536] ppid=3534 vsize=335996 CPUtime=80.82 cores=0-7
/proc/3536/stat : 3536 (iPAWS) R 3534 3536 3536 0 -1 4202496 2039 0 0 0 8082 0 0 0 25 0 1 0 668276021 344059904 1751 33554432000 134512640 135114423 4290712688 18446744073709551615 134514760 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/3536/statm: 83999 1751 59 147 0 83851 0
[pid=3540] ppid=3365 vsize=676604 CPUtime=0 cores=0-7
/proc/3540/stat : 3540 (python) S 3365 3365 3087 0 -1 4202560 958 0 0 0 0 0 0 0 19 0 1 0 668284171 692842496 7126 33554432000 4194304 5683644 140734323059456 18446744073709551615 235594886726 0 0 16781312 514 302238983218266111 0 0 17 4 0 0 0
/proc/3540/statm: 169151 7126 356 364 0 104973 0
[pid=3542] ppid=3540 vsize=268424 CPUtime=0.08 cores=0-7
/proc/3542/stat : 3542 (hybridGM3) R 3540 3542 3542 0 -1 4202496 5613 0 0 0 8 0 0 0 21 0 1 0 668284171 274866176 5320 33554432000 134512640 135204385 4290535136 18446744073709551615 134544822 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/3542/statm: 67106 5320 63 169 0 66936 0
[pid=3365/tid=3372] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3372/stat : 3372 (python) S 3363 3365 3087 0 -1 4202560 27 931 0 0 0 0 0 0 25 0 34 0 668166730 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 0 0 0 0
[pid=3365/tid=3375] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3375/stat : 3375 (python) S 3363 3365 3087 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 34 0 668166733 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 4 0 0 0
[pid=3365/tid=3379] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3379/stat : 3379 (python) S 3363 3365 3087 0 -1 4202560 26 931 0 0 0 0 0 0 18 0 34 0 668166736 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 2 0 0 0
[pid=3365/tid=3382] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3382/stat : 3382 (python) S 3363 3365 3087 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 34 0 668166739 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 6 0 0 0
[pid=3365/tid=3385] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3385/stat : 3385 (python) S 3363 3365 3087 0 -1 4202560 28 931 0 0 0 0 0 0 18 0 34 0 668166743 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 6 0 0 0
[pid=3365/tid=3389] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3389/stat : 3389 (python) S 3363 3365 3087 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 34 0 668166746 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 0 0 0 0
[pid=3365/tid=3392] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3392/stat : 3392 (python) S 3363 3365 3087 0 -1 4202560 35 931 0 0 0 0 0 0 18 0 34 0 668166749 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 2 0 0 0
[pid=3365/tid=3395] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3395/stat : 3395 (python) S 3363 3365 3087 0 -1 4202560 51 931 0 0 0 0 0 0 18 0 34 0 668166752 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 2 0 0 0
[pid=3365/tid=3403] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3403/stat : 3403 (python) S 3363 3365 3087 0 -1 4202560 38 931 0 0 0 0 0 0 18 0 34 0 668176566 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 2 0 0 0
[pid=3365/tid=3408] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3408/stat : 3408 (python) S 3363 3365 3087 0 -1 4202560 31 931 0 0 0 0 0 0 18 0 34 0 668176766 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 1 0 0 0
[pid=3365/tid=3413] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3413/stat : 3413 (python) S 3363 3365 3087 0 -1 4202560 102 931 0 0 0 0 0 0 18 0 34 0 668176770 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 5 0 0 0
[pid=3365/tid=3417] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3417/stat : 3417 (python) S 3363 3365 3087 0 -1 4202560 30 931 0 0 0 0 0 0 23 0 34 0 668176774 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 5 0 0 0
[pid=3365/tid=3421] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3421/stat : 3421 (python) S 3363 3365 3087 0 -1 4202560 43 931 0 0 0 0 0 0 18 0 34 0 668176779 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 3 0 0 0
[pid=3365/tid=3426] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3426/stat : 3426 (python) S 3363 3365 3087 0 -1 4202560 37 931 0 0 0 0 0 0 18 0 34 0 668176783 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 7 0 0 0
[pid=3365/tid=3429] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3429/stat : 3429 (python) S 3363 3365 3087 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 34 0 668176789 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 7 0 0 0
[pid=3365/tid=3432] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3432/stat : 3432 (python) S 3363 3365 3087 0 -1 4202560 38 931 0 0 0 0 0 0 18 0 34 0 668176794 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 3 0 0 0
[pid=3365/tid=3439] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3439/stat : 3439 (python) S 3363 3365 3087 0 -1 4202560 22 931 0 0 0 0 0 0 20 0 34 0 668186601 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 3 0 0 0
[pid=3365/tid=3444] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3444/stat : 3444 (python) S 3363 3365 3087 0 -1 4202560 34 931 0 0 0 0 0 0 18 0 34 0 668186803 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 3 0 0 0
[pid=3365/tid=3456] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3456/stat : 3456 (python) S 3363 3365 3087 0 -1 4202560 41 931 0 0 0 0 0 0 18 0 34 0 668197156 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 2 0 0 0
[pid=3365/tid=3462] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3462/stat : 3462 (python) S 3363 3365 3087 0 -1 4202560 135 931 0 0 0 0 0 0 18 0 34 0 668206077 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 0 0 0 0
[pid=3365/tid=3465] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3465/stat : 3465 (python) S 3363 3365 3087 0 -1 4202560 36 931 0 0 0 0 0 0 20 0 34 0 668206282 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 3 0 0 0
[pid=3365/tid=3469] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3469/stat : 3469 (python) S 3363 3365 3087 0 -1 4202560 40 931 0 0 0 0 0 0 19 0 34 0 668206595 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 3 0 0 0
[pid=3365/tid=3477] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3477/stat : 3477 (python) S 3363 3365 3087 0 -1 4202560 39 931 0 0 0 0 0 0 19 0 34 0 668216629 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 3 0 0 0
[pid=3365/tid=3484] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3484/stat : 3484 (python) S 3363 3365 3087 0 -1 4202560 32 931 0 0 0 0 0 0 19 0 34 0 668225643 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 4 0 0 0
[pid=3365/tid=3491] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3491/stat : 3491 (python) S 3363 3365 3087 0 -1 4202560 37 931 0 0 0 0 0 0 18 0 34 0 668235783 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 0 0 0 0
[pid=3365/tid=3496] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3496/stat : 3496 (python) S 3363 3365 3087 0 -1 4202560 149 931 0 0 0 0 0 0 20 0 34 0 668236495 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 0 0 0 0
[pid=3365/tid=3499] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3499/stat : 3499 (python) S 3363 3365 3087 0 -1 4202560 35 931 0 0 0 0 0 0 20 0 34 0 668237193 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 3 0 0 0
[pid=3365/tid=3510] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3510/stat : 3510 (python) S 3363 3365 3087 0 -1 4202560 39 931 0 0 0 0 0 0 20 0 34 0 668255658 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 4 0 0 0
[pid=3365/tid=3518] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3518/stat : 3518 (python) S 3363 3365 3087 0 -1 4202560 41 931 0 0 0 0 0 0 20 0 34 0 668265699 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 4 0 0 0
[pid=3365/tid=3521] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3521/stat : 3521 (python) S 3363 3365 3087 0 -1 4202560 37 931 0 0 0 0 0 0 20 0 34 0 668266093 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 4 0 0 0
[pid=3365/tid=3532] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3532/stat : 3532 (python) S 3363 3365 3087 0 -1 4202560 36 931 0 0 0 0 0 0 20 0 34 0 668275189 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 1 0 0 0
[pid=3365/tid=3535] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3535/stat : 3535 (python) S 3363 3365 3087 0 -1 4202560 37 931 0 0 0 0 0 0 20 0 34 0 668276021 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 4 0 0 0
[pid=3365/tid=3541] ppid=3363 vsize=686848 CPUtime=0 cores=0-7
/proc/3365/task/3541/stat : 3541 (python) S 3363 3365 3087 0 -1 4202560 34 931 0 0 0 0 0 0 20 0 34 0 668284171 703332352 8716 33554432000 4194304 5683644 140734323059456 18446744073709551615 235606690225 0 0 16781312 2 18446604451267566592 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 9353.4
Current children cumulated vsize (KiB) 32381128

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3365 and gives
#  childrusage.ru_utime.tv_sec=5
#  childrusage.ru_utime.tv_usec=640142
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=829873
# CPU time returned by wait4() is 6.47002
# while last known CPU time is 9353.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1177.13
CPU time (s): 9353.4
CPU user time (s): 9339.5
CPU system time (s): 13.9
CPU usage (%): 794.596
Max. virtual memory (cumulated for all children) (KiB): 32381128

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5.64014
system time used= 0.829873
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 53761
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2243
involuntary context switches= 119

runsolver used 12.7031 second user time and 30.0134 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-16 19:07:57
IDJOB=3385355
IDBENCH=82620
IDSOLVER=1870
FILE ID=node120/3385355-1305565677
RUNJOBID= node120-1305564964-3102
PBS_JOBID= 13350130
Free space on /tmp= 73508 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S943787219-031-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385355-1305565677/watcher-3385355-1305565677 -o /tmp/evaluation-result-3385355-1305565677/solver-3385355-1305565677 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385355-1305565677.cnf -seed 616990486 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6105ec111e1e16da586afadcc6f09041
RANDOM SEED=616990486

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12945300 kB
Buffers:        121148 kB
Cached:        1482280 kB
SwapCached:      32584 kB
Active:        6619724 kB
Inactive:     13143952 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12945300 kB
SwapTotal:    67111528 kB
SwapFree:     54713412 kB
Dirty:           33432 kB
Writeback:           0 kB
AnonPages:    18133748 kB
Mapped:          20656 kB
Slab:            95280 kB
PageTables:      77916 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 66185248 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73476 MiB
End job on node120 at 2011-05-16 19:27:36