Trace number 3321865

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 9496.38 1194.72

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S817927155-033-UNKNOWN.cnf
MD5SUMbdd02c131ae0dd9fa14ba01f07a63379
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.47	c INFO: solving HOME/instance-3321865-1304368739.cnf
0.32/0.47	c INFO: computing task features
0.50/0.70	c INFO: computed variable-clause graph statistics
0.61/0.70	c INFO: computed clause balance statistics
1.71/1.85	c INFO: computed variable balance statistics
2.21/2.31	c INFO: computed small-clause counts
2.21/2.31	c INFO: computed Horn-clause counts
2.21/2.35	c INFO: computed variable graph statistics
2.21/2.35	c INFO: collected features for HOME/instance-3321865-1304368739.cnf in 1.88 s
2.21/2.39	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
2.30/2.43	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
2.30/2.47	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
2.40/2.50	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.07)
2.40/2.55	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.05)
2.40/2.59	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.04)
2.50/2.63	c INFO: running FH@0 for 97 with 39997 remaining (b = 0.03)
2.50/2.67	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.03)
786.67/100.71	c INFO: running adaptg2wsat2009++@0 for 97 with 39899 remaining (b = 0.02)
802.63/102.72	c INFO: running FH@0 for 97 with 39897 remaining (b = 0.02)
802.63/102.77	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.04)
803.21/102.82	c INFO: running gnovelty+2@0 for 97 with 39897 remaining (b = 0.02)
803.21/102.88	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
803.67/102.94	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.01)
803.87/103.00	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
803.87/103.06	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.02)
1585.41/200.98	c INFO: running TNM@0 for 1552 with 39799 remaining (b = 0.18)
1601.33/203.00	c INFO: running FH@0 for 97 with 39797 remaining (b = 0.01)
1602.82/203.17	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
1603.48/203.25	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
2369.59/299.33	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2370.38/299.46	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2371.14/299.59	c INFO: running hybridGM3@99 for 97 with 39700 remaining (b = 0.01)
2379.04/300.54	c INFO: running adaptg2wsat2009++@0 for 97 with 39699 remaining (b = 0.01)
2400.53/303.29	c INFO: running adaptg2wsat2009++@98 for 97 with 39697 remaining (b = 0.01)
2412.57/304.76	c INFO: running hybridGM3@99 for 97 with 39695 remaining (b = 0.01)
2426.05/306.47	c INFO: running hybridGM3@0 for 194 with 39694 remaining (b = 0.02)
3129.05/394.61	c INFO: running hybridGM3@296 for 97 with 39605 remaining (b = 0.01)
3129.84/394.81	c INFO: running hybridGM3@296 for 97 with 39605 remaining (b = 0.01)
3154.54/397.83	c INFO: running TNM@0 for 1552 with 39602 remaining (b = 0.15)
3164.07/399.05	c INFO: running adaptg2wsat2009++@98 for 97 with 39601 remaining (b = 0.01)
3176.02/400.59	c INFO: running iPAWS@0 for 97 with 39599 remaining (b = 0.01)
3178.21/400.89	c INFO: running FH@0 for 291 with 39599 remaining (b = 0.03)
3930.01/495.20	c INFO: running hybridGM3@393 for 97 with 39505 remaining (b = 0.01)
3936.36/495.91	c INFO: running gnovelty+2@0 for 97 with 39504 remaining (b = 0.01)
3939.52/496.36	c INFO: running hybridGM3@391 for 97 with 39504 remaining (b = 0.01)
3975.36/500.90	c INFO: running hybridGM3@0 for 194 with 39499 remaining (b = 0.02)
3986.47/502.22	c INFO: running hybridGM3@94 for 97 with 39498 remaining (b = 0.01)
4698.55/591.65	c INFO: running adaptg2wsat2009++@296 for 291 with 39408 remaining (b = 0.02)
4729.61/595.51	c INFO: running FH@100 for 291 with 39405 remaining (b = 0.02)
4735.26/596.28	c INFO: running iPAWS@0 for 97 with 39404 remaining (b = 0.01)
4793.25/603.54	c INFO: running hybridGM3@189 for 97 with 39397 remaining (b = 0.01)
5486.67/690.62	c INFO: running hybridGM3@0 for 194 with 39309 remaining (b = 0.01)
5533.58/696.57	c INFO: running TNM@0 for 1552 with 39303 remaining (b = 0.11)
5534.28/696.67	c INFO: running adaptg2wsat2009++@99 for 97 with 39303 remaining (b = 0.01)
5551.80/698.84	c INFO: running hybridGM3@479 for 97 with 39301 remaining (b = 0.01)
6308.87/793.99	c INFO: running FH@0 for 97 with 39206 remaining (b = 0.01)
6358.18/800.16	c INFO: running iPAWS@0 for 97 with 39200 remaining (b = 0.01)
7004.60/881.40	c INFO: running adaptg2wsat2009++@393 for 194 with 39119 remaining (b = 0.01)
7035.65/885.28	c INFO: running FH@200 for 194 with 39115 remaining (b = 0.01)
7036.42/885.38	c INFO: running hybridGM3@0 for 194 with 39115 remaining (b = 0.01)
7155.77/900.35	c INFO: running NCVWr@0 for 485 with 39100 remaining (b = 0.03)
7157.22/900.56	c INFO: running adaptg2wsat2009++@99 for 97 with 39099 remaining (b = 0.01)
7932.55/997.90	c INFO: running gnovelty+2@0 for 97 with 39002 remaining (b = 0.01)
8577.17/1078.97	c INFO: running adaptg2wsat2009++@683 for 97 with 38921 remaining (b = 0.01)
8608.17/1082.85	c INFO: running hybridGM3@0 for 194 with 38917 remaining (b = 0.01)
8690.03/1093.12	c INFO: running hybridGM3@102 for 97 with 38907 remaining (b = 0.01)
8731.36/1098.32	c INFO: running FH@99 for 291 with 38902 remaining (b = 0.02)
9334.79/1174.30	c INFO: running adaptg2wsat2009++@880 for 97 with 38826 remaining (b = 0.01)
9495.42/1194.47	c INFO: running hybridGM3@0 for 194 with 38806 remaining (b = 0.01)
9496.38/1194.68	c INFO: running hybridGM3@200 for 291 with 38805 remaining (b = 0.01)
9496.38/1194.68	Traceback (most recent call last):
9496.38/1194.68	  File "HOME/solve", line 33, in <module>
9496.38/1194.68	    plac.call(main)
9496.38/1194.68	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
9496.38/1194.68	    cmd, result = parser_from(obj).consume(arglist)
9496.38/1194.68	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
9496.38/1194.68	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
9496.38/1194.68	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
9496.38/1194.68	    (_, answer, _) = solver(input_path, budget, cores)
9496.38/1194.68	  File "HOME/borg/build/lib/borg/bilevel.py", line 202, in __call__
9496.38/1194.68	    solver.go(max_cost * borg.defaults.machine_speed)
9496.38/1194.68	  File "HOME/borg/build/lib/borg/solvers.py", line 179, in go
9496.38/1194.68	    self._process.start()
9496.38/1194.68	  File "/home/evaluation/evaluation/tools64/lib/python2.7/multiprocessing/process.py", line 94, in start
9496.38/1194.68	    assert self._popen is None, 'cannot start a process twice'
9496.38/1194.68	AssertionError: cannot start a process twice

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321865-1304368739/watcher-3321865-1304368739 -o /tmp/evaluation-result-3321865-1304368739/solver-3321865-1304368739 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321865-1304368739.cnf -seed 1601470800 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.25 8.42 7.57 3/280 26765
/proc/meminfo: memFree=5863288/32950928 swapFree=63349320/67111528
[pid=26765] ppid=26763 vsize=15912 CPUtime=0 cores=0-7
/proc/26765/stat : 26765 (python) R 26763 26765 26145 0 -1 4202496 945 0 0 0 0 0 0 0 25 0 1 0 627104602 16293888 821 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367544832 0 2147483391 16781312 2 0 0 0 17 6 0 0 0
/proc/26765/statm: 3978 821 357 364 0 465 0

[startup+0.0447561 s]
/proc/loadavg: 8.25 8.42 7.57 3/280 26765
/proc/meminfo: memFree=5863288/32950928 swapFree=63349320/67111528
[pid=26765] ppid=26763 vsize=29792 CPUtime=0.03 cores=0-7
/proc/26765/stat : 26765 (python) R 26763 26765 26145 0 -1 4202496 1376 0 0 0 3 0 0 0 25 0 1 0 627104602 30507008 1219 33554432000 4194304 5683644 140734811948944 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26765/statm: 7448 1221 443 364 0 818 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 29792

[startup+0.100751 s]
/proc/loadavg: 8.25 8.42 7.57 3/280 26765
/proc/meminfo: memFree=5863288/32950928 swapFree=63349320/67111528
[pid=26765] ppid=26763 vsize=104228 CPUtime=0.06 cores=0-7
/proc/26765/stat : 26765 (python) S 26763 26765 26145 0 -1 4202496 3059 0 0 0 5 1 0 0 17 0 1 0 627104602 106729472 2741 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/26765/statm: 26057 2741 847 364 0 1805 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104228

[startup+0.30071 s]
/proc/loadavg: 8.25 8.42 7.57 3/280 26765
/proc/meminfo: memFree=5863288/32950928 swapFree=63349320/67111528
[pid=26765] ppid=26763 vsize=170756 CPUtime=0.23 cores=0-7
/proc/26765/stat : 26765 (python) R 26763 26765 26145 0 -1 4202496 6738 934 1 0 17 6 0 0 18 0 1 0 627104602 174854144 4807 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367544832 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26765/statm: 42689 4807 1336 364 0 3454 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 170756

[startup+0.700651 s]
/proc/loadavg: 8.25 8.42 7.57 3/280 26765
/proc/meminfo: memFree=5863288/32950928 swapFree=63349320/67111528
[pid=26765] ppid=26763 vsize=289500 CPUtime=0.61 cores=0-7
/proc/26765/stat : 26765 (python) R 26763 26765 26145 0 -1 4202496 13875 934 1 0 51 10 0 0 18 0 1 0 627104602 296448000 9751 33554432000 4194304 5683644 140734811948944 18446744073709551615 46918519970954 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26765/statm: 72375 9751 1818 364 0 8299 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 289500

[startup+1.5005 s]
/proc/loadavg: 8.25 8.42 7.57 2/280 26770
/proc/meminfo: memFree=5849524/32950928 swapFree=63349320/67111528
[pid=26765] ppid=26763 vsize=289500 CPUtime=1.41 cores=0-7
/proc/26765/stat : 26765 (python) R 26763 26765 26145 0 -1 4202496 13883 934 1 0 131 10 0 0 20 0 1 0 627104602 296448000 9759 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367206823 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26765/statm: 72375 9759 1826 364 0 8299 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 289500

[startup+3.10013 s]
/proc/loadavg: 8.25 8.42 7.57 2/280 26770
/proc/meminfo: memFree=5849028/32950928 swapFree=63349320/67111528
[pid=26765] ppid=26763 vsize=364420 CPUtime=2.56 cores=0-7
/proc/26765/stat : 26765 (python) S 26763 26765 26145 0 -1 4202496 20258 934 1 0 245 11 0 0 24 0 9 0 627104602 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26765/statm: 91105 8071 1891 364 0 27002 0
Current children cumulated CPU time (s) 2.56
Current children cumulated vsize (KiB) 364420

[startup+6.30154 s]
/proc/loadavg: 8.31 8.43 7.58 9/304 26794
/proc/meminfo: memFree=5786960/32950928 swapFree=63349320/67111528
[pid=26765] ppid=26763 vsize=364420 CPUtime=2.56 cores=0-7
/proc/26765/stat : 26765 (python) S 26763 26765 26145 0 -1 4202496 20258 934 1 0 245 11 0 0 24 0 9 0 627104602 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26765/statm: 91105 8071 1891 364 0 27002 0
[pid=26771] ppid=26765 vsize=282240 CPUtime=0 cores=0-7
/proc/26771/stat : 26771 (python) S 26765 26765 26145 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 627104841 289013760 6331 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566863 0 0 16781312 514 4813090989285540099 0 0 17 7 0 0 0
/proc/26771/statm: 70560 6331 355 364 0 6478 0
[pid=26773] ppid=26771 vsize=1020188 CPUtime=3.89 cores=0-7
/proc/26773/stat : 26773 (gnovelty+2) R 26771 26773 26773 0 -1 4202496 1140 0 0 0 389 0 0 0 25 0 1 0 627104841 1044672512 876 33554432000 134512640 135663704 4291119936 18446744073709551615 134524530 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/26773/statm: 255047 876 113 282 0 254763 0
[pid=26774] ppid=26765 vsize=293124 CPUtime=0 cores=0-7
/proc/26774/stat : 26774 (python) S 26765 26765 26145 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 627104845 300158976 6367 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 4813083292704145667 0 0 17 4 0 0 0
/proc/26774/statm: 73281 6367 349 364 0 9196 0
[pid=26776] ppid=26774 vsize=1020188 CPUtime=3.86 cores=0-7
/proc/26776/stat : 26776 (gnovelty+2) R 26774 26776 26776 0 -1 4202496 1140 0 0 0 386 0 0 0 25 0 1 0 627104845 1044672512 876 33554432000 134512640 135663704 4294374656 18446744073709551615 134544183 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/26776/statm: 255047 876 113 282 0 254763 0
[pid=26777] ppid=26765 vsize=302896 CPUtime=0 cores=0-7
/proc/26777/stat : 26777 (python) S 26765 26765 26145 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 627104849 310165504 6504 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 16343643041493385473 0 0 17 0 0 0 0
/proc/26777/statm: 75724 6504 347 364 0 11636 0
[pid=26779] ppid=26777 vsize=421140 CPUtime=3.78 cores=0-7
/proc/26779/stat : 26779 (adaptg2wsat2009) R 26777 26779 26779 0 -1 4202496 1805 0 0 0 378 0 0 0 25 0 1 0 627104849 431247360 1538 33554432000 134512640 135107411 4290714320 18446744073709551615 134523300 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/26779/statm: 105285 1538 49 146 0 104161 0
[pid=26780] ppid=26765 vsize=313152 CPUtime=0 cores=0-7
/proc/26780/stat : 26780 (python) S 26765 26765 26145 0 -1 4202560 745 0 0 0 0 0 0 0 18 0 1 0 627104853 320667648 6507 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 14111151476625604865 0 0 17 6 0 0 0
/proc/26780/statm: 78288 6507 347 364 0 14197 0
[pid=26782] ppid=26780 vsize=421140 CPUtime=3.77 cores=0-7
/proc/26782/stat : 26782 (adaptg2wsat2009) R 26780 26782 26782 0 -1 4202496 1802 0 0 0 377 0 0 0 25 0 1 0 627104853 431247360 1538 33554432000 134512640 135107411 4286999520 18446744073709551615 134523300 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26782/statm: 105285 1538 49 146 0 104161 0
[pid=26783] ppid=26765 vsize=323408 CPUtime=0 cores=0-7
/proc/26783/stat : 26783 (python) S 26765 26765 26145 0 -1 4202560 753 0 0 0 0 0 0 0 18 0 1 0 627104857 331169792 6512 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 8658206846676336900 0 0 17 0 0 0 0
/proc/26783/statm: 80852 6512 347 364 0 16758 0
[pid=26785] ppid=26783 vsize=421140 CPUtime=3.74 cores=0-7
/proc/26785/stat : 26785 (adaptg2wsat2009) R 26783 26785 26785 0 -1 4202496 1809 0 0 0 374 0 0 0 25 0 1 0 627104857 431247360 1538 33554432000 134512640 135107411 4293576640 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26785/statm: 105285 1538 49 146 0 104161 0
[pid=26786] ppid=26765 vsize=333664 CPUtime=0 cores=0-7
/proc/26786/stat : 26786 (python) S 26765 26765 26145 0 -1 4202560 758 0 0 0 0 0 0 0 18 0 1 0 627104861 341671936 6516 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 17714113092138270976 0 0 17 6 0 0 0
/proc/26786/statm: 83416 6516 347 364 0 19319 0
[pid=26788] ppid=26786 vsize=1020188 CPUtime=3.7 cores=0-7
/proc/26788/stat : 26788 (gnovelty+2) R 26786 26788 26788 0 -1 4202496 1142 0 0 0 370 0 0 0 25 0 1 0 627104861 1044672512 877 33554432000 134512640 135663704 4291637968 18446744073709551615 134524455 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/26788/statm: 255047 877 113 282 0 254763 0
[pid=26789] ppid=26765 vsize=344552 CPUtime=0 cores=0-7
/proc/26789/stat : 26789 (python) S 26765 26765 26145 0 -1 4202560 769 0 0 0 0 0 0 0 18 0 1 0 627104865 352821248 6522 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 4813094837576237314 0 0 17 0 0 0 0
/proc/26789/statm: 86138 6522 349 364 0 22038 0
[pid=26791] ppid=26789 vsize=249144 CPUtime=3.61 cores=0-7
/proc/26791/stat : 26791 (FH) R 26789 26791 26791 0 -1 4202496 1560 0 0 0 361 0 0 0 25 0 1 0 627104865 255123456 1296 33554432000 134512640 134936988 4288848832 18446744073709551615 134523622 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/26791/statm: 62286 1296 37 104 0 61790 0
[pid=26792] ppid=26765 vsize=354740 CPUtime=0 cores=0-7
/proc/26792/stat : 26792 (python) S 26765 26765 26145 0 -1 4202560 798 0 0 0 0 0 0 0 18 0 1 0 627104869 363253760 6532 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 8658210694967034114 0 0 17 6 0 0 0
/proc/26792/statm: 88685 6532 355 364 0 24582 0
[pid=26794] ppid=26792 vsize=421140 CPUtime=3.62 cores=0-7
/proc/26794/stat : 26794 (adaptg2wsat2009) R 26792 26794 26794 0 -1 4202496 1811 0 0 0 362 0 0 0 25 0 1 0 627104869 431247360 1539 33554432000 134512640 135107411 4291039488 18446744073709551615 134523298 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26794/statm: 105285 1539 49 146 0 104161 0
[pid=26765/tid=26772] ppid=26763 vsize=364420 CPUtime=0 cores=0-7
/proc/26765/task/26772/stat : 26772 (python) S 26763 26765 26145 0 -1 4202560 27 934 0 0 0 0 0 0 23 0 9 0 627104841 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26775] ppid=26763 vsize=364420 CPUtime=0 cores=0-7
/proc/26765/task/26775/stat : 26775 (python) S 26763 26765 26145 0 -1 4202560 23 934 0 0 0 0 0 0 18 0 9 0 627104845 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 6 0 0 0
[pid=26765/tid=26778] ppid=26763 vsize=364420 CPUtime=0 cores=0-7
/proc/26765/task/26778/stat : 26778 (python) S 26763 26765 26145 0 -1 4202560 20 934 0 0 0 0 0 0 25 0 9 0 627104849 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 2 0 0 0
[pid=26765/tid=26781] ppid=26763 vsize=364420 CPUtime=0 cores=0-7
/proc/26765/task/26781/stat : 26781 (python) S 26763 26765 26145 0 -1 4202560 20 934 0 0 0 0 0 0 18 0 9 0 627104853 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 6 0 0 0
[pid=26765/tid=26784] ppid=26763 vsize=364420 CPUtime=0 cores=0-7
/proc/26765/task/26784/stat : 26784 (python) S 26763 26765 26145 0 -1 4202560 26 934 0 0 0 0 0 0 22 0 9 0 627104857 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26787] ppid=26763 vsize=364420 CPUtime=0 cores=0-7
/proc/26765/task/26787/stat : 26787 (python) S 26763 26765 26145 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 9 0 627104861 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 6 0 0 0
[pid=26765/tid=26790] ppid=26763 vsize=364420 CPUtime=0 cores=0-7
/proc/26765/task/26790/stat : 26790 (python) S 26763 26765 26145 0 -1 4202560 27 934 0 0 0 0 0 0 22 0 9 0 627104865 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26793] ppid=26763 vsize=364420 CPUtime=0 cores=0-7
/proc/26765/task/26793/stat : 26793 (python) S 26763 26765 26145 0 -1 4202560 82 934 0 0 0 0 0 0 25 0 9 0 627104869 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 32.53
Current children cumulated vsize (KiB) 7906464

[startup+12.7013 s]
/proc/loadavg: 8.28 8.43 7.58 9/304 26794
/proc/meminfo: memFree=5778592/32950928 swapFree=63349320/67111528
[pid=26765] ppid=26763 vsize=364420 CPUtime=2.56 cores=0-7
/proc/26765/stat : 26765 (python) S 26763 26765 26145 0 -1 4202496 20258 934 1 0 245 11 0 0 24 0 9 0 627104602 373166080 8071 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26765/statm: 91105 8071 1891 364 0 27002 0
[pid=26771] ppid=26765 vsize=282240 CPUtime=0.01 cores=0-7
/proc/26771/stat : 26771 (python) S 26765 26765 26145 0 -1 4202560 908 0 0 0 0 1 0 0 18 0 1 0 627104841 289013760 6354 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566863 0 0 16781312 514 917538055332528387 0 0 17 7 0 0 0
/proc/26771/statm: 70560 6354 378 364 0 6478 0
[pid=26773] ppid=26771 vsize=1020188 CPUtime=10.29 cores=0-7
/proc/26773/stat : 26773 (gnovelty+2) R 26771 26773 26773 0 -1 4202496 1140 0 0 0 1029 0 0 0 25 0 1 0 627104841 1044672512 876 33554432000 134512640 135663704 4291119936 18446744073709551615 134524540 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/26773/statm: 255047 876 113 282 0 254763 0
[pid=26774] ppid=26765 vsize=293124 CPUtime=0.01 cores=0-7
/proc/26774/stat : 26774 (python) S 26765 26765 26145 0 -1 4202560 918 0 0 0 1 0 0 0 18 0 1 0 627104845 300158976 6390 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 917538055332528387 0 0 17 4 0 0 0
/proc/26774/statm: 73281 6390 372 364 0 9196 0
[pid=26776] ppid=26774 vsize=1020188 CPUtime=10.26 cores=0-7
/proc/26776/stat : 26776 (gnovelty+2) R 26774 26776 26776 0 -1 4202496 1140 0 0 0 1026 0 0 0 25 0 1 0 627104845 1044672512 876 33554432000 134512640 135663704 4294374656 18446744073709551615 134525187 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/26776/statm: 255047 876 113 282 0 254763 0
[pid=26777] ppid=26765 vsize=302896 CPUtime=0.02 cores=0-7
/proc/26777/stat : 26777 (python) S 26765 26765 26145 0 -1 4202560 899 0 0 0 1 1 0 0 18 0 1 0 627104849 310165504 6527 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 917538055332528385 0 0 17 0 0 0 0
/proc/26777/statm: 75724 6527 370 364 0 11636 0
[pid=26779] ppid=26777 vsize=421804 CPUtime=10.09 cores=0-7
/proc/26779/stat : 26779 (adaptg2wsat2009) R 26777 26779 26779 0 -1 4202496 2138 0 0 0 1009 0 0 0 25 0 1 0 627104849 431927296 1871 33554432000 134512640 135107411 4290714320 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/26779/statm: 105451 1871 59 146 0 104327 0
[pid=26780] ppid=26765 vsize=313152 CPUtime=0.02 cores=0-7
/proc/26780/stat : 26780 (python) S 26765 26765 26145 0 -1 4202560 925 0 0 0 0 2 0 0 18 0 1 0 627104853 320667648 6530 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 917538055332528385 0 0 17 6 0 0 0
/proc/26780/statm: 78288 6530 370 364 0 14197 0
[pid=26782] ppid=26780 vsize=421804 CPUtime=10.17 cores=0-7
/proc/26782/stat : 26782 (adaptg2wsat2009) R 26780 26782 26782 0 -1 4202496 2135 0 0 0 1017 0 0 0 25 0 1 0 627104853 431927296 1871 33554432000 134512640 135107411 4286999520 18446744073709551615 134532313 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26782/statm: 105451 1871 59 146 0 104327 0
[pid=26783] ppid=26765 vsize=323408 CPUtime=0.02 cores=0-7
/proc/26783/stat : 26783 (python) S 26765 26765 26145 0 -1 4202560 946 0 0 0 1 1 0 0 18 0 1 0 627104857 331169792 6535 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 917538055332528388 0 0 17 0 0 0 0
/proc/26783/statm: 80852 6535 370 364 0 16758 0
[pid=26785] ppid=26783 vsize=421804 CPUtime=10.11 cores=0-7
/proc/26785/stat : 26785 (adaptg2wsat2009) R 26783 26785 26785 0 -1 4202496 2143 0 0 0 1011 0 0 0 25 0 1 0 627104857 431927296 1872 33554432000 134512640 135107411 4293576640 18446744073709551615 134531246 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26785/statm: 105451 1872 59 146 0 104327 0
[pid=26786] ppid=26765 vsize=333664 CPUtime=0.02 cores=0-7
/proc/26786/stat : 26786 (python) S 26765 26765 26145 0 -1 4202560 962 0 0 0 1 1 0 0 18 0 1 0 627104861 341671936 6539 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 917538055332528384 0 0 17 6 0 0 0
/proc/26786/statm: 83416 6539 370 364 0 19319 0
[pid=26788] ppid=26786 vsize=1020188 CPUtime=10.1 cores=0-7
/proc/26788/stat : 26788 (gnovelty+2) R 26786 26788 26788 0 -1 4202496 1142 0 0 0 1010 0 0 0 25 0 1 0 627104861 1044672512 877 33554432000 134512640 135663704 4291637968 18446744073709551615 134545693 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/26788/statm: 255047 877 113 282 0 254763 0
[pid=26789] ppid=26765 vsize=344552 CPUtime=0 cores=0-7
/proc/26789/stat : 26789 (python) R 26765 26765 26145 0 -1 4202560 972 0 0 0 0 0 0 0 18 0 1 0 627104865 352821248 6545 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367590023 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/26789/statm: 86139 6545 372 364 0 22039 0

################
# More data... #
################

[pid=26864] ppid=26765 vsize=563296 CPUtime=0.23 cores=0-7
/proc/26864/stat : 26864 (python) S 26765 26765 26145 0 -1 4202560 1172 0 0 0 13 10 0 0 19 0 2 0 627154193 576815104 7006 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/26864/statm: 140824 7006 407 364 0 76679 0
[pid=26866] ppid=26864 vsize=1020188 CPUtime=100.17 cores=0-7
/proc/26866/stat : 26866 (gnovelty+2) T 26864 26866 26866 0 -1 4202496 1156 0 0 0 10017 0 0 0 25 0 1 0 627154194 1044672512 876 33554432000 134512640 135663704 4288646384 18446744073709551615 134524498 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/26866/statm: 255047 876 113 282 0 254763 0
[pid=26864/tid=26875] ppid=26765 vsize=563296 CPUtime=0 cores=0-7
/proc/26864/task/26875/stat : 26875 (python) S 26765 26765 26145 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 627164222 576815104 7006 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 514 18446604469589853376 0 0 -1 3 0 0 0
[pid=26869] ppid=26765 vsize=573552 CPUtime=0.46 cores=0-7
/proc/26869/stat : 26869 (python) S 26765 26765 26145 0 -1 4202560 1188 0 0 0 23 23 0 0 19 0 2 0 627154692 587317248 7015 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/26869/statm: 143388 7015 407 364 0 79240 0
[pid=26871] ppid=26869 vsize=268424 CPUtime=195.09 cores=0-7
/proc/26871/stat : 26871 (hybridGM3) T 26869 26871 26871 0 -1 4202496 5656 0 0 0 19507 2 0 0 25 0 1 0 627154692 274866176 5377 33554432000 134512640 135204385 4291116880 18446744073709551615 134538264 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26871/statm: 67106 5377 63 169 0 66936 0
[pid=26869/tid=26885] ppid=26765 vsize=573552 CPUtime=0 cores=0-7
/proc/26869/task/26885/stat : 26885 (python) S 26765 26765 26145 0 -1 4202560 89 0 0 0 0 0 0 0 19 0 2 0 627174249 587317248 7015 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 514 18446604469589854272 0 0 -1 0 0 0 0
[pid=26876] ppid=26765 vsize=583808 CPUtime=0.23 cores=0-7
/proc/26876/stat : 26876 (python) S 26765 26765 26145 0 -1 4202560 1195 0 0 0 13 10 0 0 19 0 2 0 627164230 597819392 7040 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26876/statm: 145952 7040 406 364 0 81801 0
[pid=26878] ppid=26876 vsize=335996 CPUtime=100.14 cores=0-7
/proc/26878/stat : 26878 (iPAWS) T 26876 26878 26878 0 -1 4202496 2032 0 0 0 10014 0 0 0 25 0 1 0 627164231 344059904 1750 33554432000 134512640 135114423 4294444656 18446744073709551615 134515629 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26878/statm: 83999 1750 59 147 0 83851 0
[pid=26876/tid=26886] ppid=26765 vsize=583808 CPUtime=0 cores=0-7
/proc/26876/task/26886/stat : 26886 (python) S 26765 26765 26145 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 627174253 597819392 7040 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 514 18446604471139924800 0 0 -1 0 0 0 0
[pid=26881] ppid=26765 vsize=594880 CPUtime=0.47 cores=0-7
/proc/26881/stat : 26881 (python) S 26765 26765 26145 0 -1 4202560 1282 0 0 0 24 23 0 0 19 0 2 0 627173664 609157120 7003 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/26881/statm: 148720 7003 401 364 0 84566 0
[pid=26883] ppid=26881 vsize=268424 CPUtime=194.3 cores=0-7
/proc/26883/stat : 26883 (hybridGM3) T 26881 26883 26883 0 -1 4202496 5662 0 0 0 19430 0 0 0 25 0 1 0 627173664 274866176 5378 33554432000 134512640 135204385 4290793920 18446744073709551615 134537891 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/26883/statm: 67106 5378 63 169 0 66936 0
[pid=26881/tid=26901] ppid=26765 vsize=594880 CPUtime=0 cores=0-7
/proc/26881/task/26901/stat : 26901 (python) S 26765 26765 26145 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 627193130 609157120 7003 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 514 18446604464502149312 0 0 -1 5 0 0 0
[pid=26887] ppid=26765 vsize=604596 CPUtime=1.21 cores=0-7
/proc/26887/stat : 26887 (python) S 26765 26765 26145 0 -1 4202560 969 0 0 0 64 57 0 0 18 0 1 0 627174259 619106304 7080 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 917538055332528391 0 0 17 0 0 0 0
/proc/26887/statm: 151149 7080 373 364 0 86992 0
[pid=26889] ppid=26887 vsize=459764 CPUtime=494.96 cores=0-7
/proc/26889/stat : 26889 (TNM) R 26887 26889 26889 0 -1 4202496 1938 0 0 0 49489 7 0 0 25 0 1 0 627174261 470798336 1657 33554432000 134512640 135008748 4286747280 18446744073709551615 134529367 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26889/statm: 114941 1657 46 122 0 113841 0
[pid=26892] ppid=26765 vsize=614852 CPUtime=0.25 cores=0-7
/proc/26892/stat : 26892 (python) S 26765 26765 26145 0 -1 4202560 1183 0 0 0 14 11 0 0 19 0 2 0 627184002 629608448 7219 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26892/statm: 153713 7219 400 364 0 89553 0
[pid=26894] ppid=26892 vsize=251292 CPUtime=102.06 cores=0-7
/proc/26894/stat : 26894 (FH) T 26892 26894 26894 0 -1 4202496 1977 0 0 0 10206 0 0 0 25 0 1 0 627184002 257323008 1693 33554432000 134512640 134936988 4292807776 18446744073709551615 134544756 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/26894/statm: 62823 1693 41 104 0 62327 0
[pid=26892/tid=26905] ppid=26765 vsize=614852 CPUtime=0 cores=0-7
/proc/26892/task/26905/stat : 26905 (python) S 26765 26765 26145 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 627194627 629608448 7219 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 514 18446604466467512512 0 0 -1 7 0 0 0
[pid=26896] ppid=26765 vsize=625108 CPUtime=0.24 cores=0-7
/proc/26896/stat : 26896 (python) S 26765 26765 26145 0 -1 4202560 1198 0 0 0 12 12 0 0 19 0 2 0 627184618 640110592 7181 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/26896/statm: 156277 7181 401 364 0 92114 0
[pid=26898] ppid=26896 vsize=335996 CPUtime=99.42 cores=0-7
/proc/26898/stat : 26898 (iPAWS) T 26896 26898 26898 0 -1 4202496 2032 0 0 0 9942 0 0 0 25 0 1 0 627184619 344059904 1750 33554432000 134512640 135114423 4293639200 18446744073709551615 134515441 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/26898/statm: 83999 1750 59 147 0 83851 0
[pid=26896/tid=26909] ppid=26765 vsize=625108 CPUtime=0 cores=0-7
/proc/26896/task/26909/stat : 26909 (python) S 26765 26765 26145 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 627194647 640110592 7181 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 514 18446604466467514304 0 0 -1 3 0 0 0
[pid=26902] ppid=26765 vsize=635364 CPUtime=0.78 cores=0-7
/proc/26902/stat : 26902 (python) S 26765 26765 26145 0 -1 4202560 1243 0 0 0 37 41 0 0 18 0 2 0 627193140 650612736 7143 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/26902/statm: 158841 7143 406 364 0 94675 0
[pid=26904] ppid=26902 vsize=268424 CPUtime=295.73 cores=0-7
/proc/26904/stat : 26904 (hybridGM3) T 26902 26904 26904 0 -1 4202496 5667 0 0 0 29572 1 0 0 25 0 1 0 627193141 274866176 5377 33554432000 134512640 135204385 4287639232 18446744073709551615 134538475 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/26904/statm: 67106 5377 63 169 0 66936 0
[pid=26902/tid=26921] ppid=26765 vsize=635364 CPUtime=0 cores=0-7
/proc/26902/task/26921/stat : 26921 (python) S 26765 26765 26145 0 -1 4202560 99 0 0 0 0 0 0 0 18 0 2 0 627213903 650612736 7143 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 514 18446604459618799680 0 0 -1 7 0 0 0
[pid=26906] ppid=26765 vsize=645620 CPUtime=0.72 cores=0-7
/proc/26906/stat : 26906 (python) S 26765 26765 26145 0 -1 4202560 1031 0 0 0 36 36 0 0 18 0 1 0 627194637 661114880 7236 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 917538055332528389 0 0 17 3 0 0 0
/proc/26906/statm: 161405 7236 379 364 0 97236 0
[pid=26908] ppid=26906 vsize=421344 CPUtime=292.91 cores=0-7
/proc/26908/stat : 26908 (NCVWr) R 26906 26908 26908 0 -1 4202496 2001 0 0 0 29291 0 0 0 25 0 1 0 627194638 431456256 1713 33554432000 134512640 135113558 4294851184 18446744073709551615 134534138 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/26908/statm: 105336 1713 58 147 0 104211 0
[pid=26913] ppid=26765 vsize=655876 CPUtime=0.25 cores=0-7
/proc/26913/stat : 26913 (python) S 26765 26765 26145 0 -1 4202560 1255 0 0 0 13 12 0 0 19 0 2 0 627204393 671617024 7191 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/26913/statm: 163969 7191 407 364 0 99797 0
[pid=26915] ppid=26913 vsize=1020188 CPUtime=99.23 cores=0-7
/proc/26915/stat : 26915 (gnovelty+2) T 26913 26915 26915 0 -1 4202496 1165 0 0 0 9923 0 0 0 25 0 1 0 627204393 1044672512 877 33554432000 134512640 135663704 4293982416 18446744073709551615 134524882 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/26915/statm: 255047 877 113 282 0 254763 0
[pid=26913/tid=26923] ppid=26765 vsize=655876 CPUtime=0 cores=0-7
/proc/26913/task/26923/stat : 26923 (python) S 26765 26765 26145 0 -1 4202560 100 0 0 0 0 0 0 0 19 0 2 0 627214423 671617024 7191 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 514 18446604460269816704 0 0 -1 4 0 0 0
[pid=26918] ppid=26765 vsize=666132 CPUtime=0.26 cores=0-7
/proc/26918/stat : 26918 (python) S 26765 26765 26145 0 -1 4202560 1049 0 0 0 12 14 0 0 18 0 1 0 627212887 682119168 7322 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 917538055332528388 0 0 17 3 0 0 0
/proc/26918/statm: 166533 7322 379 364 0 102358 0
[pid=26920] ppid=26918 vsize=268424 CPUtime=111.37 cores=0-7
/proc/26920/stat : 26920 (hybridGM3) R 26918 26920 26920 0 -1 4202496 5668 0 0 0 11137 0 0 0 25 0 1 0 627212888 274866176 5378 33554432000 134512640 135204385 4293154464 18446744073709551615 134538323 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26920/statm: 67106 5378 63 169 0 66936 0
[pid=26926] ppid=26765 vsize=676388 CPUtime=0 cores=0-7
/proc/26926/stat : 26926 (python) S 26765 26765 26145 0 -1 4202560 918 0 0 0 0 0 0 0 19 0 1 0 627224049 692621312 7146 33554432000 4194304 5683644 140734811948944 18446744073709551615 251367566918 0 0 16781312 514 6425977240453906431 0 0 17 3 0 0 0
/proc/26926/statm: 169097 7146 346 364 0 104919 0
[pid=26928] ppid=26926 vsize=268420 CPUtime=0.04 cores=0-7
/proc/26928/stat : 26928 (hybridGM3) R 26926 26928 26928 0 -1 4202496 1557 0 0 0 4 0 0 0 21 0 1 0 627224050 274862080 1267 33554432000 134512640 135204385 4292550976 18446744073709551615 134542911 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/26928/statm: 67105 1267 57 169 0 66935 0
[pid=26765/tid=26772] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26772/stat : 26772 (python) S 26763 26765 26145 0 -1 4202560 27 934 0 0 0 0 0 0 23 0 34 0 627104841 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26775] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26775/stat : 26775 (python) S 26763 26765 26145 0 -1 4202560 23 934 0 0 0 0 0 0 18 0 34 0 627104845 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 6 0 0 0
[pid=26765/tid=26778] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26778/stat : 26778 (python) S 26763 26765 26145 0 -1 4202560 31 934 0 0 0 0 0 0 15 0 34 0 627104849 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 2 0 0 0
[pid=26765/tid=26781] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26781/stat : 26781 (python) S 26763 26765 26145 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 34 0 627104853 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 6 0 0 0
[pid=26765/tid=26784] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26784/stat : 26784 (python) S 26763 26765 26145 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 34 0 627104857 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26787] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26787/stat : 26787 (python) S 26763 26765 26145 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 34 0 627104861 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 6 0 0 0
[pid=26765/tid=26790] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26790/stat : 26790 (python) S 26763 26765 26145 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 34 0 627104865 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26793] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26793/stat : 26793 (python) S 26763 26765 26145 0 -1 4202560 112 934 0 0 0 0 0 0 18 0 34 0 627104869 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26800] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26800/stat : 26800 (python) S 26763 26765 26145 0 -1 4202560 39 934 0 0 0 0 0 0 18 0 34 0 627114673 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 1 0 0 0
[pid=26765/tid=26806] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26806/stat : 26806 (python) S 26763 26765 26145 0 -1 4202560 110 934 0 0 0 0 0 0 18 0 34 0 627114874 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 6 0 0 0
[pid=26765/tid=26810] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26810/stat : 26810 (python) S 26763 26765 26145 0 -1 4202560 49 934 0 0 0 0 0 0 18 0 34 0 627114879 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 2 0 0 0
[pid=26765/tid=26813] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26813/stat : 26813 (python) S 26763 26765 26145 0 -1 4202560 30 934 0 0 0 0 0 0 22 0 34 0 627114885 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 2 0 0 0
[pid=26765/tid=26818] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26818/stat : 26818 (python) S 26763 26765 26145 0 -1 4202560 43 934 0 0 0 0 0 0 18 0 34 0 627114890 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 1 0 0 0
[pid=26765/tid=26822] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26822/stat : 26822 (python) S 26763 26765 26145 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 34 0 627114896 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 5 0 0 0
[pid=26765/tid=26825] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26825/stat : 26825 (python) S 26763 26765 26145 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 34 0 627114902 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26828] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26828/stat : 26828 (python) S 26763 26765 26145 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 34 0 627114909 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 7 0 0 0
[pid=26765/tid=26835] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26835/stat : 26835 (python) S 26763 26765 26145 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 34 0 627124701 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26839] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26839/stat : 26839 (python) S 26763 26765 26145 0 -1 4202560 138 934 0 0 0 0 0 0 18 0 34 0 627124902 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26851] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26851/stat : 26851 (python) S 26763 26765 26145 0 -1 4202560 66 934 0 0 0 0 0 0 18 0 34 0 627135250 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 2 0 0 0
[pid=26765/tid=26857] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26857/stat : 26857 (python) S 26763 26765 26145 0 -1 4202560 36 934 0 0 0 0 0 0 20 0 34 0 627144386 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26860] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26860/stat : 26860 (python) S 26763 26765 26145 0 -1 4202560 41 934 0 0 0 0 0 0 19 0 34 0 627144661 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 3 0 0 0
[pid=26765/tid=26865] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26865/stat : 26865 (python) S 26763 26765 26145 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 34 0 627154193 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26870] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26870/stat : 26870 (python) S 26763 26765 26145 0 -1 4202560 40 934 0 0 0 0 0 0 20 0 34 0 627154692 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26877] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26877/stat : 26877 (python) S 26763 26765 26145 0 -1 4202560 43 934 0 0 0 0 0 0 19 0 34 0 627164231 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 3 0 0 0
[pid=26765/tid=26882] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26882/stat : 26882 (python) S 26763 26765 26145 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 34 0 627173664 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26888] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26888/stat : 26888 (python) S 26763 26765 26145 0 -1 4202560 153 934 0 0 0 0 0 0 19 0 34 0 627174259 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26893] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26893/stat : 26893 (python) S 26763 26765 26145 0 -1 4202560 40 934 0 0 0 0 0 0 19 0 34 0 627184002 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 3 0 0 0
[pid=26765/tid=26897] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26897/stat : 26897 (python) S 26763 26765 26145 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 34 0 627184619 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 3 0 0 0
[pid=26765/tid=26903] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26903/stat : 26903 (python) S 26763 26765 26145 0 -1 4202560 47 934 0 0 0 0 0 0 18 0 34 0 627193140 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26907] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26907/stat : 26907 (python) S 26763 26765 26145 0 -1 4202560 34 934 0 0 0 0 0 0 20 0 34 0 627194638 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 3 0 0 0
[pid=26765/tid=26914] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26914/stat : 26914 (python) S 26763 26765 26145 0 -1 4202560 36 934 0 0 0 0 0 0 20 0 34 0 627204393 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
[pid=26765/tid=26919] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26919/stat : 26919 (python) S 26763 26765 26145 0 -1 4202560 36 934 0 0 0 0 0 0 20 0 34 0 627212887 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 3 0 0 0
[pid=26765/tid=26927] ppid=26763 vsize=686632 CPUtime=0 cores=0-7
/proc/26765/task/26927/stat : 26927 (python) S 26763 26765 26145 0 -1 4202560 37 934 0 0 0 0 0 0 20 0 34 0 627224049 703111168 8740 33554432000 4194304 5683644 140734811948944 18446744073709551615 251379370417 0 0 16781312 2 18446604444321224576 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9496.38
Current children cumulated vsize (KiB) 32160488

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26765 and gives
#  childrusage.ru_utime.tv_sec=3384
#  childrusage.ru_utime.tv_usec=70543
#  childrusage.ru_stime.tv_sec=11
#  childrusage.ru_stime.tv_usec=557243
# CPU time returned by wait4() is 3395.63
# while last known CPU time is 9496.38
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1194.72
CPU time (s): 9496.38
CPU user time (s): 9485.03
CPU system time (s): 11.35
CPU usage (%): 794.864
Max. virtual memory (cumulated for all children) (KiB): 32160488

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3384.07
system time used= 11.5572
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 128718
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13085
involuntary context switches= 17915

runsolver used 12.3621 second user time and 28.0687 second system time

The end

Launcher Data 

Begin job on node113 at 2011-05-02 22:38:59
IDJOB=3321865
IDBENCH=82643
IDSOLVER=1712
FILE ID=node113/3321865-1304368739
RUNJOBID= node113-1304366468-26159
PBS_JOBID= 13181757
Free space on /tmp= 73536 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S817927155-033-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321865-1304368739/watcher-3321865-1304368739 -o /tmp/evaluation-result-3321865-1304368739/solver-3321865-1304368739 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321865-1304368739.cnf -seed 1601470800 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= bdd02c131ae0dd9fa14ba01f07a63379
RANDOM SEED=1601470800

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       5863320 kB
Buffers:         20972 kB
Cached:         227656 kB
SwapCached:      80484 kB
Active:       15471548 kB
Inactive:     11378300 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       5863320 kB
SwapTotal:    67111528 kB
SwapFree:     63349320 kB
Dirty:           34964 kB
Writeback:           0 kB
AnonPages:    26531080 kB
Mapped:          20088 kB
Slab:            89112 kB
PageTables:      80648 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 56044092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node113 at 2011-05-02 22:58:56