Trace number 3321754

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 7217.98 913.102

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v40000-c168000-S895938734-057-UNKNOWN.cnf
MD5SUM4f5a8cb56de51e6630c119bd6436cc16
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark168.805
Satisfiable
(Un)Satisfiability was proved
Number of variables40000
Number of clauses168000
Sum of the clauses size504000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3168000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.34/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.68	c INFO: solving HOME/instance-3321754-1304366621.cnf
0.34/0.68	c INFO: computing task features
0.91/1.29	c INFO: computed variable-clause graph statistics
1.01/1.31	c INFO: computed clause balance statistics
3.92/4.26	c INFO: computed variable balance statistics
6.22/6.57	c INFO: computed small-clause counts
6.22/6.58	c INFO: computed Horn-clause counts
8.21/8.59	c INFO: computed variable graph statistics
8.21/8.59	c INFO: collected features for HOME/instance-3321754-1304366621.cnf in 7.89 s
8.31/8.63	c INFO: running hybridGM3@0 for 97 with 39992 remaining (b = 0.35)
8.31/8.67	c INFO: running hybridGM3@0 for 97 with 39992 remaining (b = 0.21)
8.31/8.70	c INFO: running hybridGM3@0 for 97 with 39992 remaining (b = 0.14)
8.50/8.74	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.18)
8.50/8.78	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.13)
8.79/8.83	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.10)
8.79/8.87	c INFO: running TNM@0 for 97 with 39991 remaining (b = 0.04)
9.06/8.91	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.07)
802.91/108.24	c INFO: running hybridGM3@0 for 97 with 39892 remaining (b = 0.03)
810.06/109.10	c INFO: running hybridGM3@0 for 194 with 39891 remaining (b = 0.05)
810.76/109.28	c INFO: running hybridGM3@0 for 97 with 39891 remaining (b = 0.02)
811.47/109.33	c INFO: running hybridGM3@0 for 97 with 39891 remaining (b = 0.02)
929.80/124.19	c INFO: running hybridGM3@0 for 194 with 39876 remaining (b = 0.04)
1562.85/203.44	c INFO: running hybridGM3@99 for 97 with 39797 remaining (b = 0.02)
1570.77/204.48	c INFO: running hybridGM3@100 for 97 with 39796 remaining (b = 0.02)
1571.62/204.53	c INFO: running hybridGM3@112 for 97 with 39796 remaining (b = 0.02)
1579.55/205.57	c INFO: running TNM@0 for 97 with 39795 remaining (b = 0.02)
1581.18/205.71	c INFO: running hybridGM3@0 for 97 with 39795 remaining (b = 0.02)
1627.40/211.55	c INFO: running hybridGM3@99 for 97 with 39789 remaining (b = 0.02)
2341.02/300.91	c INFO: running hybridGM3@0 for 97 with 39699 remaining (b = 0.02)
2370.60/304.66	c INFO: running hybridGM3@0 for 194 with 39696 remaining (b = 0.03)
2377.58/305.70	c INFO: running TNM@0 for 1940 with 39695 remaining (b = 0.21)
2379.35/305.75	c INFO: running hybridGM3@309 for 97 with 39694 remaining (b = 0.02)
2380.15/305.81	c INFO: running TNM@0 for 97 with 39694 remaining (b = 0.01)
2380.81/305.99	c INFO: running hybridGM3@100 for 97 with 39694 remaining (b = 0.02)
2403.22/308.77	c INFO: running hybridGM3@0 for 194 with 39691 remaining (b = 0.03)
2501.32/321.05	c INFO: running hybridGM3@94 for 97 with 39679 remaining (b = 0.01)
2649.77/339.68	c INFO: running hybridGM3@0 for 194 with 39661 remaining (b = 0.02)
2912.38/372.59	c INFO: running adaptg2wsat2009++@0 for 97 with 39628 remaining (b = 0.01)
3116.72/398.14	c INFO: running hybridGM3@100 for 97 with 39602 remaining (b = 0.01)
3179.71/406.05	c INFO: running TNM@0 for 97 with 39594 remaining (b = 0.01)
3308.95/422.28	c INFO: running hybridGM3@123 for 97 with 39578 remaining (b = 0.01)
3576.29/455.71	c INFO: running TNM@0 for 97 with 39545 remaining (b = 0.01)
3712.75/472.83	c INFO: running hybridGM3@0 for 194 with 39527 remaining (b = 0.02)
3941.60/501.52	c INFO: running hybridGM3@101 for 97 with 39499 remaining (b = 0.01)
3974.24/505.65	c INFO: running TNM@0 for 97 with 39495 remaining (b = 0.01)
3979.00/506.30	c INFO: running TNM@0 for 97 with 39494 remaining (b = 0.01)
4069.02/517.51	c INFO: running hybridGM3@175 for 97 with 39483 remaining (b = 0.01)
4183.83/531.95	c INFO: running TNM@0 for 97 with 39468 remaining (b = 0.01)
4220.45/536.58	c INFO: running hybridGM3@65 for 97 with 39464 remaining (b = 0.01)
4367.15/554.97	c INFO: running hybridGM3@0 for 194 with 39445 remaining (b = 0.01)
4700.37/596.76	c INFO: running hybridGM3@297 for 194 with 39403 remaining (b = 0.02)
4765.82/604.99	c INFO: running adaptg2wsat2009++@95 for 97 with 39395 remaining (b = 0.01)
4818.45/611.60	c INFO: running TNM@0 for 97 with 39389 remaining (b = 0.01)
4980.11/631.83	c INFO: running hybridGM3@164 for 97 with 39368 remaining (b = 0.01)
4983.31/632.23	c INFO: running TNM@0 for 97 with 39368 remaining (b = 0.01)
5282.21/669.74	c INFO: running adaptg2wsat2009++@0 for 194 with 39331 remaining (b = 0.01)
5419.27/686.95	c INFO: running TNM@0 for 97 with 39313 remaining (b = 0.01)
5541.18/702.26	c INFO: running TNM@0 for 97 with 39298 remaining (b = 0.01)
5618.39/711.92	c INFO: running TNM@0 for 97 with 39288 remaining (b = 0.01)
5782.44/732.52	c INFO: running TNM@0 for 97 with 39268 remaining (b = 0.01)
5786.57/733.11	c INFO: running TNM@0 for 97 with 39267 remaining (b = 0.01)
5935.97/751.90	c INFO: running hybridGM3@94 for 97 with 39248 remaining (b = 0.01)
6266.39/793.33	c INFO: running hybridGM3@199 for 291 with 39207 remaining (b = 0.02)
6340.46/802.65	c INFO: running TNM@0 for 97 with 39198 remaining (b = 0.01)
6416.84/812.23	c INFO: running TNM@0 for 97 with 39188 remaining (b = 0.01)
6572.88/831.83	c INFO: running TNM@0 for 97 with 39168 remaining (b = 0.01)
6577.79/832.51	c INFO: running adaptg2wsat2009++@0 for 194 with 39168 remaining (b = 0.01)
6742.29/853.20	c INFO: running hybridGM3@194 for 291 with 39147 remaining (b = 0.02)
6846.52/866.30	c INFO: running TNM@0 for 97 with 39134 remaining (b = 0.01)
7138.37/902.97	c INFO: running TNM@0 for 97 with 39097 remaining (b = 0.00)
7214.66/912.56	c INFO: running TNM@0 for 97 with 39088 remaining (b = 0.00)
7217.98/913.05	c INFO: running adaptg2wsat2009++@89 for 97 with 39087 remaining (b = 0.00)
7217.98/913.05	Traceback (most recent call last):
7217.98/913.05	  File "HOME/solve", line 33, in <module>
7217.98/913.05	    plac.call(main)
7217.98/913.05	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
7217.98/913.05	    cmd, result = parser_from(obj).consume(arglist)
7217.98/913.05	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
7217.98/913.05	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
7217.98/913.05	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
7217.98/913.05	    (_, answer, _) = solver(input_path, budget, cores)
7217.98/913.05	  File "HOME/borg/build/lib/borg/bilevel.py", line 202, in __call__
7217.98/913.05	    solver.go(max_cost * borg.defaults.machine_speed)
7217.98/913.05	  File "HOME/borg/build/lib/borg/solvers.py", line 179, in go
7217.98/913.05	    self._process.start()
7217.98/913.05	  File "/home/evaluation/evaluation/tools64/lib/python2.7/multiprocessing/process.py", line 94, in start
7217.98/913.05	    assert self._popen is None, 'cannot start a process twice'
7217.98/913.05	AssertionError: cannot start a process twice

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321754-1304366621/watcher-3321754-1304366621 -o /tmp/evaluation-result-3321754-1304366621/solver-3321754-1304366621 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321754-1304366621.cnf -seed 977768611 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.25 3.05 1.20 2/230 26243
/proc/meminfo: memFree=6907508/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=15380 CPUtime=0 cores=0-7
/proc/26243/stat : 26243 (python) S 26241 26243 26145 0 -1 4202496 795 0 0 0 0 0 0 0 17 0 1 0 626892819 15749120 681 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/26243/statm: 3845 681 322 364 0 332 0

[startup+0.017757 s]
/proc/loadavg: 7.25 3.05 1.20 2/230 26243
/proc/meminfo: memFree=6907508/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=16236 CPUtime=0 cores=0-7
/proc/26243/stat : 26243 (python) R 26241 26243 26145 0 -1 4202496 997 0 0 0 0 0 0 0 17 0 1 0 626892819 16625664 869 33554432000 4194304 5683644 140733615665040 18446744073709551615 4884886 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/26243/statm: 4059 869 368 364 0 546 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16236

[startup+0.100725 s]
/proc/loadavg: 7.25 3.05 1.20 2/230 26243
/proc/meminfo: memFree=6907508/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=85616 CPUtime=0.05 cores=0-7
/proc/26243/stat : 26243 (python) R 26241 26243 26145 0 -1 4202496 2629 0 0 0 4 1 0 0 17 0 1 0 626892819 87670784 2347 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367544832 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/26243/statm: 21404 2347 713 364 0 1621 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85616

[startup+0.300699 s]
/proc/loadavg: 7.25 3.05 1.20 2/230 26243
/proc/meminfo: memFree=6907508/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=135748 CPUtime=0.17 cores=0-7
/proc/26243/stat : 26243 (python) S 26241 26243 26145 0 -1 4202496 5961 934 1 0 12 5 0 0 18 0 1 0 626892819 139005952 4151 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367542789 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/26243/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135748

[startup+0.700618 s]
/proc/loadavg: 7.25 3.05 1.20 2/230 26243
/proc/meminfo: memFree=6907508/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=282412 CPUtime=0.41 cores=0-7
/proc/26243/stat : 26243 (python) R 26241 26243 26145 0 -1 4202496 10239 934 1 0 29 12 0 0 17 0 1 0 626892819 289189888 7922 33554432000 4194304 5683644 140733615665040 18446744073709551615 4626744 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/26243/statm: 70603 7922 1761 364 0 6527 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 282412

[startup+1.50049 s]
/proc/loadavg: 7.25 3.05 1.20 2/231 26248
/proc/meminfo: memFree=6864224/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=317984 CPUtime=1.21 cores=0-7
/proc/26243/stat : 26243 (python) R 26241 26243 26145 0 -1 4202496 23796 934 1 0 107 14 0 0 18 0 1 0 626892819 325615616 16881 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367204592 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/26243/statm: 79496 16881 1826 364 0 15420 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 317984

[startup+3.10118 s]
/proc/loadavg: 6.75 3.01 1.20 2/231 26248
/proc/meminfo: memFree=6846452/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=317984 CPUtime=2.82 cores=0-7
/proc/26243/stat : 26243 (python) R 26241 26243 26145 0 -1 4202496 23796 934 1 0 268 14 0 0 21 0 1 0 626892819 325615616 16881 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367202988 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/26243/statm: 79496 16881 1826 364 0 15420 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 317984

[startup+6.30058 s]
/proc/loadavg: 6.75 3.01 1.20 2/231 26248
/proc/meminfo: memFree=6846204/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=317984 CPUtime=6.01 cores=0-7
/proc/26243/stat : 26243 (python) R 26241 26243 26145 0 -1 4202496 23797 934 1 0 587 14 0 0 25 0 1 0 626892819 325615616 16882 33554432000 4194304 5683644 140733615665040 18446744073709551615 47459369264526 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/26243/statm: 79496 16882 1827 364 0 15420 0
Current children cumulated CPU time (s) 6.01
Current children cumulated vsize (KiB) 317984

[startup+12.7013 s]
/proc/loadavg: 6.43 3.06 1.23 9/255 26272
/proc/meminfo: memFree=6553464/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=396916 CPUtime=8.62 cores=0-7
/proc/26243/stat : 26243 (python) S 26241 26243 26145 0 -1 4202496 30596 934 1 0 845 17 0 0 20 0 9 0 626892819 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26243/statm: 99229 16194 1889 364 0 35126 0
[pid=26249] ppid=26243 vsize=314880 CPUtime=0 cores=0-7
/proc/26249/stat : 26249 (python) S 26243 26243 26145 0 -1 4202560 741 0 0 0 0 0 0 0 15 0 1 0 626893682 322437120 14626 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566863 0 0 16781312 514 10266804177862623492 0 0 17 7 0 0 0
/proc/26249/statm: 78720 14626 353 364 0 14638 0
[pid=26251] ppid=26249 vsize=276236 CPUtime=4.06 cores=0-7
/proc/26251/stat : 26251 (hybridGM3) R 26249 26251 26251 0 -1 4202496 8557 0 0 0 405 1 0 0 25 0 1 0 626893683 282865664 8297 33554432000 134512640 135204385 4292669104 18446744073709551615 134537100 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/26251/statm: 69059 8297 64 169 0 68889 0
[pid=26252] ppid=26243 vsize=325136 CPUtime=0 cores=0-7
/proc/26252/stat : 26252 (python) S 26243 26243 26145 0 -1 4202560 741 0 0 0 0 0 0 0 15 0 1 0 626893686 332939264 14624 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 17718480352323797252 0 0 17 6 0 0 0
/proc/26252/statm: 81284 14624 347 364 0 17199 0
[pid=26254] ppid=26252 vsize=276240 CPUtime=4.02 cores=0-7
/proc/26254/stat : 26254 (hybridGM3) R 26252 26254 26254 0 -1 4202496 8560 0 0 0 401 1 0 0 25 0 1 0 626893687 282869760 8298 33554432000 134512640 135204385 4291279568 18446744073709551615 134536922 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/26254/statm: 69060 8298 64 169 0 68890 0
[pid=26255] ppid=26243 vsize=335392 CPUtime=0 cores=0-7
/proc/26255/stat : 26255 (python) S 26243 26243 26145 0 -1 4202560 755 0 0 0 0 0 0 0 15 0 1 0 626893690 343441408 14628 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 1911817628532310276 0 0 17 4 0 0 0
/proc/26255/statm: 83848 14628 347 364 0 19760 0
[pid=26257] ppid=26255 vsize=276240 CPUtime=3.98 cores=0-7
/proc/26257/stat : 26257 (hybridGM3) R 26255 26257 26257 0 -1 4202496 8563 0 0 0 397 1 0 0 25 0 1 0 626893691 282869760 8301 33554432000 134512640 135204385 4290786192 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/26257/statm: 69060 8301 64 169 0 68890 0
[pid=26258] ppid=26243 vsize=345648 CPUtime=0 cores=0-7
/proc/26258/stat : 26258 (python) S 26243 26243 26145 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 626893694 353943552 14632 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 4356137530194624772 0 0 17 2 0 0 0
/proc/26258/statm: 86412 14632 347 364 0 22321 0
[pid=26260] ppid=26258 vsize=276240 CPUtime=3.91 cores=0-7
/proc/26260/stat : 26260 (hybridGM3) R 26258 26260 26260 0 -1 4202496 8565 0 0 0 390 1 0 0 25 0 1 0 626893695 282869760 8299 33554432000 134512640 135204385 4288636768 18446744073709551615 134537272 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/26260/statm: 69060 8299 64 169 0 68890 0
[pid=26261] ppid=26243 vsize=355904 CPUtime=0 cores=0-7
/proc/26261/stat : 26261 (python) S 26243 26243 26145 0 -1 4202560 760 0 0 0 0 0 0 0 15 0 1 0 626893698 364445696 14636 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 17837478296774738178 0 0 17 4 0 0 0
/proc/26261/statm: 88976 14636 347 364 0 24882 0
[pid=26263] ppid=26261 vsize=276240 CPUtime=3.9 cores=0-7
/proc/26263/stat : 26263 (hybridGM3) R 26261 26263 26263 0 -1 4202496 8559 0 0 0 389 1 0 0 25 0 1 0 626893699 282869760 8295 33554432000 134512640 135204385 4294830272 18446744073709551615 134536744 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26263/statm: 69060 8295 64 169 0 68890 0
[pid=26264] ppid=26243 vsize=366160 CPUtime=0 cores=0-7
/proc/26264/stat : 26264 (python) S 26243 26243 26145 0 -1 4202560 764 0 0 0 0 0 0 0 15 0 1 0 626893703 374947840 14640 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 14889929515265392898 0 0 17 4 0 0 0
/proc/26264/statm: 91540 14640 347 364 0 27443 0
[pid=26266] ppid=26264 vsize=276236 CPUtime=3.85 cores=0-7
/proc/26266/stat : 26266 (hybridGM3) R 26264 26266 26266 0 -1 4202496 8559 0 0 0 384 1 0 0 25 0 1 0 626893703 282865664 8296 33554432000 134512640 135204385 4290875120 18446744073709551615 134536663 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/26266/statm: 69059 8296 64 169 0 68889 0
[pid=26267] ppid=26243 vsize=376416 CPUtime=0 cores=0-7
/proc/26267/stat : 26267 (python) S 26243 26243 26145 0 -1 4202560 764 0 0 0 0 0 0 0 18 0 1 0 626893707 385449984 14644 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 12807278295519297794 0 0 17 4 0 0 0
/proc/26267/statm: 94104 14644 347 364 0 30004 0
[pid=26269] ppid=26267 vsize=467024 CPUtime=3.81 cores=0-7
/proc/26269/stat : 26269 (TNM) R 26267 26269 26269 0 -1 4202496 6820 0 0 0 380 1 0 0 25 0 1 0 626893708 478232576 6556 33554432000 134512640 135008748 4291812096 18446744073709551615 134529409 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26269/statm: 116756 6556 46 122 0 115656 0
[pid=26270] ppid=26243 vsize=386672 CPUtime=0 cores=0-7
/proc/26270/stat : 26270 (python) S 26243 26243 26145 0 -1 4202560 808 0 0 0 0 0 0 0 15 0 1 0 626893711 395952128 14654 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 2722685463784554756 0 0 17 0 0 0 0
/proc/26270/statm: 96668 14654 353 364 0 32565 0
[pid=26272] ppid=26270 vsize=276240 CPUtime=3.77 cores=0-7
/proc/26272/stat : 26272 (hybridGM3) R 26270 26272 26272 0 -1 4202496 8569 0 0 0 376 1 0 0 25 0 1 0 626893712 282869760 8301 33554432000 134512640 135204385 4291061296 18446744073709551615 134537328 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26272/statm: 69060 8301 64 169 0 68890 0
[pid=26243/tid=26250] ppid=26241 vsize=396916 CPUtime=0 cores=0-7
/proc/26243/task/26250/stat : 26250 (python) S 26241 26243 26145 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 9 0 626893683 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26253] ppid=26241 vsize=396916 CPUtime=0 cores=0-7
/proc/26243/task/26253/stat : 26253 (python) S 26241 26243 26145 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 9 0 626893687 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26256] ppid=26241 vsize=396916 CPUtime=0 cores=0-7
/proc/26243/task/26256/stat : 26256 (python) S 26241 26243 26145 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 9 0 626893691 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26259] ppid=26241 vsize=396916 CPUtime=0 cores=0-7
/proc/26243/task/26259/stat : 26259 (python) S 26241 26243 26145 0 -1 4202560 21 934 0 0 0 0 0 0 20 0 9 0 626893694 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26262] ppid=26241 vsize=396916 CPUtime=0 cores=0-7
/proc/26243/task/26262/stat : 26262 (python) S 26241 26243 26145 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 9 0 626893698 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 2 0 0 0
[pid=26243/tid=26265] ppid=26241 vsize=396916 CPUtime=0 cores=0-7
/proc/26243/task/26265/stat : 26265 (python) S 26241 26243 26145 0 -1 4202560 25 934 0 0 0 0 0 0 24 0 9 0 626893703 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 4 0 0 0
[pid=26243/tid=26268] ppid=26241 vsize=396916 CPUtime=0 cores=0-7
/proc/26243/task/26268/stat : 26268 (python) S 26241 26243 26145 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 9 0 626893707 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 4 0 0 0
[pid=26243/tid=26271] ppid=26241 vsize=396916 CPUtime=0 cores=0-7
/proc/26243/task/26271/stat : 26271 (python) S 26241 26243 26145 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 9 0 626893712 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39.92
Current children cumulated vsize (KiB) 5603820

[startup+25.5019 s]
/proc/loadavg: 6.67 3.22 1.31 9/255 26272
/proc/meminfo: memFree=6553652/32950928 swapFree=63349320/67111528
[pid=26243] ppid=26241 vsize=396916 CPUtime=8.62 cores=0-7
/proc/26243/stat : 26243 (python) S 26241 26243 26145 0 -1 4202496 30596 934 1 0 845 17 0 0 20 0 9 0 626892819 406441984 16194 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26243/statm: 99229 16194 1889 364 0 35126 0
[pid=26249] ppid=26243 vsize=314880 CPUtime=0.02 cores=0-7
/proc/26249/stat : 26249 (python) S 26243 26243 26145 0 -1 4202560 915 0 0 0 1 1 0 0 15 0 1 0 626893682 322437120 14649 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566863 0 0 16781312 514 18144123289373475076 0 0 17 7 0 0 0
/proc/26249/statm: 78720 14649 376 364 0 14638 0
[pid=26251] ppid=26249 vsize=276236 CPUtime=16.86 cores=0-7
/proc/26251/stat : 26251 (hybridGM3) R 26249 26251 26251 0 -1 4202496 8557 0 0 0 1685 1 0 0 25 0 1 0 626893683 282865664 8297 33554432000 134512640 135204385 4292669104 18446744073709551615 134546153 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/26251/statm: 69059 8297 64 169 0 68889 0
[pid=26252] ppid=26243 vsize=325136 CPUtime=0.02 cores=0-7
/proc/26252/stat : 26252 (python) S 26243 26243 26145 0 -1 4202560 908 0 0 0 1 1 0 0 15 0 1 0 626893686 332939264 14647 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 18144123289373475076 0 0 17 6 0 0 0
/proc/26252/statm: 81284 14647 370 364 0 17199 0
[pid=26254] ppid=26252 vsize=276240 CPUtime=16.82 cores=0-7
/proc/26254/stat : 26254 (hybridGM3) R 26252 26254 26254 0 -1 4202496 8560 0 0 0 1681 1 0 0 25 0 1 0 626893687 282869760 8298 33554432000 134512640 135204385 4291279568 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/26254/statm: 69060 8298 64 169 0 68890 0
[pid=26255] ppid=26243 vsize=335392 CPUtime=0.02 cores=0-7
/proc/26255/stat : 26255 (python) S 26243 26243 26145 0 -1 4202560 919 0 0 0 1 1 0 0 15 0 1 0 626893690 343441408 14651 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 18144123289373475076 0 0 17 4 0 0 0
/proc/26255/statm: 83848 14651 370 364 0 19760 0
[pid=26257] ppid=26255 vsize=276240 CPUtime=16.74 cores=0-7
/proc/26257/stat : 26257 (hybridGM3) R 26255 26257 26257 0 -1 4202496 8568 0 0 0 1673 1 0 0 25 0 1 0 626893691 282869760 8306 33554432000 134512640 135204385 4290786192 18446744073709551615 134537401 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/26257/statm: 69060 8306 64 169 0 68890 0
[pid=26258] ppid=26243 vsize=345648 CPUtime=0.02 cores=0-7
/proc/26258/stat : 26258 (python) S 26243 26243 26145 0 -1 4202560 912 0 0 0 1 1 0 0 15 0 1 0 626893694 353943552 14655 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 18144123289373475076 0 0 17 2 0 0 0
/proc/26258/statm: 86412 14655 370 364 0 22321 0
[pid=26260] ppid=26258 vsize=276240 CPUtime=16.55 cores=0-7
/proc/26260/stat : 26260 (hybridGM3) R 26258 26260 26260 0 -1 4202496 8565 0 0 0 1654 1 0 0 25 0 1 0 626893695 282869760 8299 33554432000 134512640 135204385 4288636768 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/26260/statm: 69060 8299 64 169 0 68890 0
[pid=26261] ppid=26243 vsize=355904 CPUtime=0.03 cores=0-7
/proc/26261/stat : 26261 (python) S 26243 26243 26145 0 -1 4202560 957 0 0 0 1 2 0 0 15 0 1 0 626893698 364445696 14659 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 18144123289373475074 0 0 17 4 0 0 0
/proc/26261/statm: 88976 14659 370 364 0 24882 0
[pid=26263] ppid=26261 vsize=276240 CPUtime=16.67 cores=0-7
/proc/26263/stat : 26263 (hybridGM3) R 26261 26263 26263 0 -1 4202496 8559 0 0 0 1666 1 0 0 25 0 1 0 626893699 282869760 8295 33554432000 134512640 135204385 4294830272 18446744073709551615 134537573 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26263/statm: 69060 8295 64 169 0 68890 0

################
# More data... #
################

[pid=26370] ppid=26243 vsize=657328 CPUtime=0.2 cores=0-7
/proc/26370/stat : 26370 (python) S 26243 26243 26145 0 -1 4202560 1184 0 0 0 9 11 0 0 19 0 2 0 626963046 673103872 15135 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26370/statm: 164332 15135 401 364 0 100169 0
[pid=26372] ppid=26370 vsize=467024 CPUtime=100.12 cores=0-7
/proc/26372/stat : 26372 (TNM) T 26370 26372 26372 0 -1 4202496 6839 0 0 0 10010 2 0 0 25 0 1 0 626963047 478232576 6557 33554432000 134512640 135008748 4292499744 18446744073709551615 134527773 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/26372/statm: 116756 6557 46 122 0 115656 0
[pid=26370/tid=26389] ppid=26243 vsize=657328 CPUtime=0 cores=0-7
/proc/26370/task/26389/stat : 26389 (python) S 26243 26243 26145 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 626973075 673103872 15135 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 514 18446604446371973184 0 0 -1 3 0 0 0
[pid=26375] ppid=26243 vsize=667584 CPUtime=0.2 cores=0-7
/proc/26375/stat : 26375 (python) S 26243 26243 26145 0 -1 4202560 1212 0 0 0 11 9 0 0 19 0 2 0 626964012 683606016 15189 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26375/statm: 166896 15189 406 364 0 102730 0
[pid=26377] ppid=26375 vsize=467024 CPUtime=99.84 cores=0-7
/proc/26377/stat : 26377 (TNM) T 26375 26377 26377 0 -1 4202496 6848 0 0 0 9983 1 0 0 25 0 1 0 626964013 478232576 6558 33554432000 134512640 135008748 4292213600 18446744073709551615 134527477 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26377/statm: 116756 6558 46 122 0 115656 0
[pid=26375/tid=26393] ppid=26243 vsize=667584 CPUtime=0 cores=0-7
/proc/26375/task/26393/stat : 26393 (python) S 26243 26243 26145 0 -1 4202560 99 0 0 0 0 0 0 0 19 0 2 0 626974032 683606016 15189 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 514 18446604453858492800 0 0 -1 0 0 0 0
[pid=26379] ppid=26243 vsize=677840 CPUtime=0.2 cores=0-7
/proc/26379/stat : 26379 (python) S 26243 26243 26145 0 -1 4202560 1219 0 0 0 10 10 0 0 19 0 2 0 626966071 694108160 15196 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/26379/statm: 169460 15196 407 364 0 105291 0
[pid=26381] ppid=26379 vsize=467024 CPUtime=99.18 cores=0-7
/proc/26381/stat : 26381 (TNM) T 26379 26381 26381 0 -1 4202496 6848 0 0 0 9917 1 0 0 25 0 1 0 626966072 478232576 6558 33554432000 134512640 135008748 4293398144 18446744073709551615 134524952 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/26381/statm: 116756 6558 46 122 0 115656 0
[pid=26379/tid=26398] ppid=26243 vsize=677840 CPUtime=0 cores=0-7
/proc/26379/task/26398/stat : 26398 (python) S 26243 26243 26145 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 626975992 694108160 15196 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 514 18446604453854518016 0 0 -1 1 0 0 0
[pid=26382] ppid=26243 vsize=688096 CPUtime=0.2 cores=0-7
/proc/26382/stat : 26382 (python) S 26243 26243 26145 0 -1 4202560 1290 0 0 0 11 9 0 0 19 0 2 0 626966131 704610304 15075 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26382/statm: 172024 15075 407 364 0 107852 0
[pid=26384] ppid=26382 vsize=467024 CPUtime=98.96 cores=0-7
/proc/26384/stat : 26384 (TNM) T 26382 26384 26384 0 -1 4202496 6850 0 0 0 9894 2 0 0 25 0 1 0 626966133 478232576 6558 33554432000 134512640 135008748 4290443984 18446744073709551615 134529448 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/26384/statm: 116756 6558 46 122 0 115656 0
[pid=26382/tid=26402] ppid=26243 vsize=688096 CPUtime=0 cores=0-7
/proc/26382/task/26402/stat : 26402 (python) S 26243 26243 26145 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 626976061 704610304 15075 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 514 18446604453590697152 0 0 -1 3 0 0 0
[pid=26390] ppid=26243 vsize=698352 CPUtime=0.2 cores=0-7
/proc/26390/stat : 26390 (python) S 26243 26243 26145 0 -1 4202560 1296 0 0 0 11 9 0 0 19 0 2 0 626973085 715112448 15078 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26390/statm: 174588 15078 406 364 0 110413 0
[pid=26392] ppid=26390 vsize=467024 CPUtime=100.11 cores=0-7
/proc/26392/stat : 26392 (TNM) T 26390 26392 26392 0 -1 4202496 6853 0 0 0 10010 1 0 0 25 0 1 0 626973086 478232576 6558 33554432000 134512640 135008748 4292869616 18446744073709551615 134527475 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26392/statm: 116756 6558 46 122 0 115656 0
[pid=26390/tid=26412] ppid=26243 vsize=698352 CPUtime=0 cores=0-7
/proc/26390/task/26412/stat : 26412 (python) S 26243 26243 26145 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 626983105 715112448 15078 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 514 18446604443313302528 0 0 -1 2 0 0 0
[pid=26394] ppid=26243 vsize=708608 CPUtime=0.22 cores=0-7
/proc/26394/stat : 26394 (python) S 26243 26243 26145 0 -1 4202560 1361 0 0 0 12 10 0 0 19 0 2 0 626974042 725614592 15181 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26394/statm: 177152 15181 400 364 0 112974 0
[pid=26396] ppid=26394 vsize=467024 CPUtime=97.11 cores=0-7
/proc/26396/stat : 26396 (TNM) T 26394 26396 26396 0 -1 4202496 6848 0 0 0 9709 2 0 0 25 0 1 0 626974044 478232576 6557 33554432000 134512640 135008748 4291643264 18446744073709551615 134529176 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/26396/statm: 116756 6557 46 122 0 115656 0
[pid=26394/tid=26416] ppid=26243 vsize=708608 CPUtime=0 cores=0-7
/proc/26394/task/26416/stat : 26416 (python) S 26243 26243 26145 0 -1 4202560 236 0 0 0 0 0 0 0 19 0 2 0 626984064 725614592 15181 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 514 18446604443313299840 0 0 -1 7 0 0 0
[pid=26399] ppid=26243 vsize=718864 CPUtime=0.17 cores=0-7
/proc/26399/stat : 26399 (python) S 26243 26243 26145 0 -1 4202560 1027 0 0 0 9 8 0 0 18 0 1 0 626976003 736116736 15233 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 18144123289373475073 0 0 17 0 0 0 0
/proc/26399/statm: 179716 15233 373 364 0 115535 0
[pid=26401] ppid=26399 vsize=467024 CPUtime=80.93 cores=0-7
/proc/26401/stat : 26401 (TNM) R 26399 26401 26401 0 -1 4202496 6849 0 0 0 8092 1 0 0 25 0 1 0 626976003 478232576 6559 33554432000 134512640 135008748 4291790304 18446744073709551615 134536488 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26401/statm: 116756 6559 46 122 0 115656 0
[pid=26403] ppid=26243 vsize=729120 CPUtime=0.15 cores=0-7
/proc/26403/stat : 26403 (python) S 26243 26243 26145 0 -1 4202560 1032 0 0 0 7 8 0 0 18 0 1 0 626976071 746618880 15168 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 18144123289373475073 0 0 17 0 0 0 0
/proc/26403/statm: 182280 15168 373 364 0 118096 0
[pid=26405] ppid=26403 vsize=434080 CPUtime=79.97 cores=0-7
/proc/26405/stat : 26405 (adaptg2wsat2009) R 26403 26405 26405 0 -1 4202496 7109 0 0 0 7995 2 0 0 25 0 1 0 626976072 444497920 6818 33554432000 134512640 135107411 4294748304 18446744073709551615 134532326 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26405/statm: 108520 6818 59 146 0 107396 0
[pid=26408] ppid=26243 vsize=739376 CPUtime=0.1 cores=0-7
/proc/26408/stat : 26408 (python) S 26243 26243 26145 0 -1 4202560 1063 0 0 0 5 5 0 0 18 0 1 0 626979450 757121024 15182 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 18144123289373475076 0 0 17 1 0 0 0
/proc/26408/statm: 184844 15182 379 364 0 120657 0
[pid=26410] ppid=26408 vsize=467024 CPUtime=46.4 cores=0-7
/proc/26410/stat : 26410 (TNM) R 26408 26410 26410 0 -1 4202496 6854 0 0 0 4639 1 0 0 25 0 1 0 626979451 478232576 6558 33554432000 134512640 135008748 4294040592 18446744073709551615 134529448 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/26410/statm: 116756 6558 46 122 0 115656 0
[pid=26413] ppid=26243 vsize=749632 CPUtime=0 cores=0-7
/proc/26413/stat : 26413 (python) S 26243 26243 26145 0 -1 4202560 1070 0 0 0 0 0 0 0 18 0 1 0 626983116 767623168 15281 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 3900738780545384706 0 0 17 0 0 0 0
/proc/26413/statm: 187408 15281 379 364 0 123218 0
[pid=26415] ppid=26413 vsize=467024 CPUtime=9.91 cores=0-7
/proc/26415/stat : 26415 (TNM) R 26413 26415 26415 0 -1 4202496 6854 0 0 0 991 0 0 0 25 0 1 0 626983117 478232576 6557 33554432000 134512640 135008748 4291132512 18446744073709551615 134527693 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/26415/statm: 116756 6557 46 122 0 115656 0
[pid=26417] ppid=26243 vsize=759888 CPUtime=0 cores=0-7
/proc/26417/stat : 26417 (python) S 26243 26243 26145 0 -1 4202560 963 0 0 0 0 0 0 0 19 0 1 0 626984076 778125312 15182 33554432000 4194304 5683644 140733615665040 18446744073709551615 251367566918 0 0 16781312 514 5582522904211357695 0 0 17 0 0 0 0
/proc/26417/statm: 189972 15182 352 364 0 125779 0
[pid=26419] ppid=26417 vsize=462800 CPUtime=0.35 cores=0-7
/proc/26419/stat : 26419 (TNM) R 26417 26419 26419 0 -1 4202496 4198 0 0 0 34 1 0 0 21 0 1 0 626984077 473907200 3907 33554432000 134512640 135008748 4293862480 18446744073709551615 134523184 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/26419/statm: 115700 3907 45 122 0 114600 0
[pid=26243/tid=26250] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26250/stat : 26250 (python) S 26241 26243 26145 0 -1 4202560 40 60192 0 0 0 0 184598 240 18 0 39 0 626893683 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26253] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26253/stat : 26253 (python) S 26241 26243 26145 0 -1 4202560 32 60192 0 0 0 0 184598 240 18 0 39 0 626893687 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26256] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26256/stat : 26256 (python) S 26241 26243 26145 0 -1 4202560 35 60192 0 0 0 0 184598 240 18 0 39 0 626893691 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 2 0 0 0
[pid=26243/tid=26259] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26259/stat : 26259 (python) S 26241 26243 26145 0 -1 4202560 29 60192 0 0 0 0 184598 240 18 0 39 0 626893694 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26262] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26262/stat : 26262 (python) S 26241 26243 26145 0 -1 4202560 36 60192 0 0 0 0 184598 240 18 0 39 0 626893698 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 2 0 0 0
[pid=26243/tid=26265] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26265/stat : 26265 (python) S 26241 26243 26145 0 -1 4202560 25 60192 0 0 0 0 184598 240 24 0 39 0 626893703 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 4 0 0 0
[pid=26243/tid=26268] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26268/stat : 26268 (python) S 26241 26243 26145 0 -1 4202560 31 60192 0 0 0 0 184598 240 17 0 39 0 626893707 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 4 0 0 0
[pid=26243/tid=26271] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26271/stat : 26271 (python) S 26241 26243 26145 0 -1 4202560 35 60192 0 0 0 0 184598 240 18 0 39 0 626893712 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26278] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26278/stat : 26278 (python) S 26241 26243 26145 0 -1 4202560 36 60192 0 0 0 0 184598 240 18 0 39 0 626903730 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26285] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26285/stat : 26285 (python) S 26241 26243 26145 0 -1 4202560 44 60192 0 0 0 0 184598 240 18 0 39 0 626905239 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26291] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26291/stat : 26291 (python) S 26241 26243 26145 0 -1 4202560 27 60192 0 0 0 0 184598 240 20 0 39 0 626913377 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26299] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26299/stat : 26299 (python) S 26241 26243 26145 0 -1 4202560 45 60192 0 0 0 0 184598 240 18 0 39 0 626923286 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26303] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26303/stat : 26303 (python) S 26241 26243 26145 0 -1 4202560 93 60192 0 0 0 0 184598 240 20 0 39 0 626923401 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26307] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26307/stat : 26307 (python) S 26241 26243 26145 0 -1 4202560 29 60192 0 0 0 0 184598 240 20 0 39 0 626923697 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26312] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26312/stat : 26312 (python) S 26241 26243 26145 0 -1 4202560 42 60192 0 0 0 0 184598 240 18 0 39 0 626926788 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26316] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26316/stat : 26316 (python) S 26241 26243 26145 0 -1 4202560 92 60192 0 0 0 0 184598 240 18 0 39 0 626930079 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26320] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26320/stat : 26320 (python) S 26241 26243 26145 0 -1 4202560 140 60192 0 0 0 0 184598 240 20 0 39 0 626933425 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26325] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26325/stat : 26325 (python) S 26241 26243 26145 0 -1 4202560 37 60192 0 0 0 0 184598 240 20 0 39 0 626938391 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26329] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26329/stat : 26329 (python) S 26241 26243 26145 0 -1 4202560 36 60192 0 0 0 0 184598 240 19 0 39 0 626940103 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26335] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26335/stat : 26335 (python) S 26241 26243 26145 0 -1 4202560 39 60192 0 0 0 0 184598 240 20 0 39 0 626943385 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26339] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26339/stat : 26339 (python) S 26241 26243 26145 0 -1 4202560 33 60192 0 0 0 0 184598 240 20 0 39 0 626943450 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26343] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26343/stat : 26343 (python) S 26241 26243 26145 0 -1 4202560 33 60192 0 0 0 0 184598 240 19 0 39 0 626946015 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26348] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26348/stat : 26348 (python) S 26241 26243 26145 0 -1 4202560 35 60192 0 0 0 0 184598 240 18 0 39 0 626948318 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26355] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26355/stat : 26355 (python) S 26241 26243 26145 0 -1 4202560 29 60192 0 0 0 0 184598 240 20 0 39 0 626953980 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26359] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26359/stat : 26359 (python) S 26241 26243 26145 0 -1 4202560 154 60192 0 0 0 0 184598 240 20 0 39 0 626956043 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26365] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26365/stat : 26365 (python) S 26241 26243 26145 0 -1 4202560 34 60192 0 0 0 0 184598 240 19 0 39 0 626959794 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26368] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26368/stat : 26368 (python) S 26241 26243 26145 0 -1 4202560 36 60192 0 0 0 0 184598 240 20 0 39 0 626961515 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26371] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26371/stat : 26371 (python) S 26241 26243 26145 0 -1 4202560 36 60192 0 0 0 0 184598 240 20 0 39 0 626963047 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26376] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26376/stat : 26376 (python) S 26241 26243 26145 0 -1 4202560 37 60192 0 0 0 0 184598 240 20 0 39 0 626964012 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26380] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26380/stat : 26380 (python) S 26241 26243 26145 0 -1 4202560 34 60192 0 0 0 0 184598 240 19 0 39 0 626966072 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26383] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26383/stat : 26383 (python) S 26241 26243 26145 0 -1 4202560 23 60192 0 0 0 0 184598 240 19 0 39 0 626966131 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26391] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26391/stat : 26391 (python) S 26241 26243 26145 0 -1 4202560 32 60192 0 0 0 0 184598 240 20 0 39 0 626973085 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26395] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26395/stat : 26395 (python) S 26241 26243 26145 0 -1 4202560 180 60192 0 0 0 0 184598 240 20 0 39 0 626974043 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26400] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26400/stat : 26400 (python) S 26241 26243 26145 0 -1 4202560 37 60192 0 0 0 0 184598 240 20 0 39 0 626976003 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26404] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26404/stat : 26404 (python) S 26241 26243 26145 0 -1 4202560 35 60192 0 0 0 0 184598 240 20 0 39 0 626976072 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26409] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26409/stat : 26409 (python) S 26241 26243 26145 0 -1 4202560 41 60192 0 0 0 0 184598 240 19 0 39 0 626979450 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
[pid=26243/tid=26414] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26414/stat : 26414 (python) S 26241 26243 26145 0 -1 4202560 35 60192 0 0 0 0 184598 240 20 0 39 0 626983117 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 1 0 0 0
[pid=26243/tid=26418] ppid=26241 vsize=770132 CPUtime=1848.38 cores=0-7
/proc/26243/task/26418/stat : 26418 (python) S 26241 26243 26145 0 -1 4202560 35 60192 0 0 0 0 184598 240 20 0 39 0 626984076 788615168 16784 33554432000 4194304 5683644 140733615665040 18446744073709551615 251379370417 0 0 16781312 2 18446604453877524672 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7217.98
Current children cumulated vsize (KiB) 32827216

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26243 and gives
#  childrusage.ru_utime.tv_sec=2847
#  childrusage.ru_utime.tv_usec=797069
#  childrusage.ru_stime.tv_sec=8
#  childrusage.ru_stime.tv_usec=72772
# CPU time returned by wait4() is 2855.87
# while last known CPU time is 7217.98
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 913.102
CPU time (s): 7217.98
CPU user time (s): 7209.78
CPU system time (s): 8.2
CPU usage (%): 790.49
Max. virtual memory (cumulated for all children) (KiB): 32827216

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2847.8
system time used= 8.07277
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 225291
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11882
involuntary context switches= 17098

runsolver used 6.15006 second user time and 16.4785 second system time

The end

Launcher Data 

Begin job on node113 at 2011-05-02 22:03:41
IDJOB=3321754
IDBENCH=82532
IDSOLVER=1712
FILE ID=node113/3321754-1304366621
RUNJOBID= node113-1304366468-26159
PBS_JOBID= 13181757
Free space on /tmp= 73556 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v40000-c168000-S895938734-057-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321754-1304366621/watcher-3321754-1304366621 -o /tmp/evaluation-result-3321754-1304366621/solver-3321754-1304366621 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321754-1304366621.cnf -seed 977768611 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4f5a8cb56de51e6630c119bd6436cc16
RANDOM SEED=977768611

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       6907548 kB
Buffers:         16588 kB
Cached:         208204 kB
SwapCached:      80324 kB
Active:       14447252 kB
Inactive:     11375348 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       6907548 kB
SwapTotal:    67111528 kB
SwapFree:     63349320 kB
Dirty:           34928 kB
Writeback:           0 kB
AnonPages:    25528104 kB
Mapped:          12656 kB
Slab:            85144 kB
PageTables:      71144 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 33966944 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73328 MiB
End job on node113 at 2011-05-02 22:18:57