Trace number 3385250

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 8746.55 1102.31

General information on the benchmark

Namerandom/large/
unif-k7-r85-v250-c21250-S1682211323-009-UNKNOWN.cnf
MD5SUM917ee0efab4f0e89027865c1129d272b
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables250
Number of clauses21250
Sum of the clauses size148750
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521250

Solver Data 

0.41/2.71	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.41/2.71	c INFO: solving HOME/instance-3385250-1305564962.cnf
0.41/2.71	c INFO: computing task features
0.51/2.86	c INFO: computed variable-clause graph statistics
0.51/2.86	c INFO: computed clause balance statistics
1.21/3.59	c INFO: computed variable balance statistics
1.51/3.89	c INFO: computed small-clause counts
1.51/3.89	c INFO: computed Horn-clause counts
1.60/3.91	c INFO: computed variable graph statistics
1.60/3.91	c INFO: collected features for HOME/instance-3385250-1305564962.cnf in 1.19 s
1.60/3.94	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.36)
1.60/3.97	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
1.70/4.00	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
1.70/4.04	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
1.70/4.07	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.05)
1.80/4.10	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.04)
1.80/4.13	c INFO: running FH@0 for 97 with 4998 remaining (b = 0.03)
1.80/4.17	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.03)
801.51/104.25	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.02)
801.51/104.29	c INFO: running FH@0 for 97 with 4898 remaining (b = 0.02)
802.23/104.33	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.04)
802.23/104.38	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.02)
802.94/104.42	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.03)
802.94/104.47	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.03)
803.55/104.51	c INFO: running TNM@0 for 1552 with 4898 remaining (b = 0.20)
803.55/104.58	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.01)
1594.82/203.75	c INFO: running FH@0 for 97 with 4798 remaining (b = 0.01)
1601.24/204.57	c INFO: running hybridGM3@0 for 194 with 4798 remaining (b = 0.02)
1602.00/204.63	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.01)
1604.01/204.91	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
2362.11/300.06	c INFO: running hybridGM3@99 for 97 with 4702 remaining (b = 0.01)
2369.28/300.96	c INFO: running hybridGM3@99 for 97 with 4701 remaining (b = 0.01)
2379.61/302.21	c INFO: running adaptg2wsat2009++@0 for 97 with 4700 remaining (b = 0.01)
2393.94/304.07	c INFO: running adaptg2wsat2009++@100 for 97 with 4698 remaining (b = 0.01)
2394.73/304.17	c INFO: running hybridGM3@99 for 97 with 4698 remaining (b = 0.01)
2425.08/307.96	c INFO: running hybridGM3@0 for 194 with 4694 remaining (b = 0.02)
3154.93/399.53	c INFO: running hybridGM3@0 for 194 with 4603 remaining (b = 0.02)
3168.46/401.24	c INFO: running hybridGM3@100 for 97 with 4601 remaining (b = 0.01)
3169.23/401.38	c INFO: running hybridGM3@295 for 97 with 4601 remaining (b = 0.01)
3170.06/401.43	c INFO: running TNM@0 for 1552 with 4601 remaining (b = 0.15)
3175.60/402.27	c INFO: running adaptg2wsat2009++@98 for 97 with 4600 remaining (b = 0.01)
3194.67/404.53	c INFO: running iPAWS@0 for 97 with 4598 remaining (b = 0.01)
3928.48/496.69	c INFO: running hybridGM3@392 for 97 with 4506 remaining (b = 0.01)
3951.59/499.60	c INFO: running FH@0 for 291 with 4503 remaining (b = 0.03)
3975.49/502.56	c INFO: running gnovelty+2@0 for 97 with 4500 remaining (b = 0.01)
3993.84/504.87	c INFO: running adaptg2wsat2009++@296 for 291 with 4497 remaining (b = 0.03)
3994.66/504.95	c INFO: running hybridGM3@97 for 97 with 4497 remaining (b = 0.01)
4687.66/592.00	c INFO: running FH@100 for 291 with 4410 remaining (b = 0.02)
4712.40/595.20	c INFO: running iPAWS@0 for 97 with 4407 remaining (b = 0.01)
4774.37/602.94	c INFO: running hybridGM3@0 for 194 with 4399 remaining (b = 0.02)
4792.65/605.29	c INFO: running hybridGM3@192 for 97 with 4397 remaining (b = 0.01)
5511.36/695.54	c INFO: running hybridGM3@0 for 194 with 4307 remaining (b = 0.01)
5551.14/700.60	c INFO: running hybridGM3@291 for 194 with 4302 remaining (b = 0.02)
6300.80/794.70	c INFO: running adaptg2wsat2009++@493 for 97 with 4208 remaining (b = 0.01)
6306.37/795.45	c INFO: running TNM@0 for 1552 with 4207 remaining (b = 0.11)
6338.98/799.59	c INFO: running hybridGM3@99 for 97 with 4203 remaining (b = 0.01)
6993.95/881.84	c INFO: running FH@294 for 97 with 4120 remaining (b = 0.01)
7059.19/890.02	c INFO: running adaptg2wsat2009++@99 for 97 with 4112 remaining (b = 0.01)
7075.98/892.17	c INFO: running FH@0 for 97 with 4110 remaining (b = 0.01)
7108.51/896.27	c INFO: running hybridGM3@94 for 97 with 4106 remaining (b = 0.01)
7137.95/899.97	c INFO: running hybridGM3@388 for 97 with 4102 remaining (b = 0.01)
7800.07/983.17	c INFO: running NCVWr@0 for 485 with 4019 remaining (b = 0.03)
7833.46/987.35	c INFO: running FH@99 for 291 with 4015 remaining (b = 0.02)
7874.85/992.52	c INFO: running gnovelty+2@0 for 97 with 4010 remaining (b = 0.01)
7914.62/997.61	c INFO: running hybridGM3@0 for 194 with 4005 remaining (b = 0.01)
7944.83/1001.31	c INFO: running iPAWS@0 for 97 with 4001 remaining (b = 0.01)
8665.29/1091.94	c INFO: running adaptg2wsat2009++@99 for 97 with 3910 remaining (b = 0.01)
8742.43/1101.66	c INFO: running hybridGM3@0 for 194 with 3901 remaining (b = 0.01)
8746.55/1102.21	c INFO: running NCVWr@0 for 485 with 3900 remaining (b = 0.03)
8746.55/1102.28	c INFO: running FH@195 for 194 with 3900 remaining (b = 0.01)
8746.55/1102.28	Traceback (most recent call last):
8746.55/1102.28	  File "HOME/solve", line 33, in <module>
8746.55/1102.28	    plac.call(main)
8746.55/1102.28	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
8746.55/1102.28	    cmd, result = parser_from(obj).consume(arglist)
8746.55/1102.28	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
8746.55/1102.28	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
8746.55/1102.28	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
8746.55/1102.28	    (_, answer, _) = solver(input_path, budget / cores, cores)
8746.55/1102.28	  File "HOME/borg/build/lib/borg/bilevel.py", line 202, in __call__
8746.55/1102.28	    solver.go(max_cost * borg.defaults.machine_speed)
8746.55/1102.28	  File "HOME/borg/build/lib/borg/solvers.py", line 179, in go
8746.55/1102.28	    self._process.start()
8746.55/1102.28	  File "/home/evaluation/evaluation/tools64/lib/python2.7/multiprocessing/process.py", line 94, in start
8746.55/1102.28	    assert self._popen is None, 'cannot start a process twice'
8746.55/1102.28	AssertionError: cannot start a process twice

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385250-1305564962/watcher-3385250-1305564962 -o /tmp/evaluation-result-3385250-1305564962/solver-3385250-1305564962 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385250-1305564962.cnf -seed 2125973254 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.01 0.02 0.00 1/336 5530
/proc/meminfo: memFree=13909488/32951124 swapFree=63308188/67111528
[pid=5530] ppid=5528 vsize=14820 CPUtime=0 cores=0-7
/proc/5530/stat : 5530 (python) S 5528 5530 5504 0 -1 4202496 512 0 0 0 0 0 0 0 20 0 1 0 668094217 15175680 420 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377297253 0 2147483391 4096 0 18446744071699453118 0 0 17 4 0 0 0
/proc/5530/statm: 3705 420 259 364 0 192 0

[startup+0.0483969 s]
/proc/loadavg: 0.01 0.02 0.00 1/336 5530
/proc/meminfo: memFree=13909488/32951124 swapFree=63308188/67111528
[pid=5530] ppid=5528 vsize=15776 CPUtime=0 cores=0-7
/proc/5530/stat : 5530 (python) S 5528 5530 5504 0 -1 4202496 895 0 0 0 0 0 0 0 20 0 1 0 668094217 16154624 777 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377299456 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/5530/statm: 3944 777 343 364 0 431 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15776

[startup+0.10038 s]
/proc/loadavg: 0.01 0.02 0.00 1/336 5530
/proc/meminfo: memFree=13909488/32951124 swapFree=63308188/67111528
[pid=5530] ppid=5528 vsize=16240 CPUtime=0.01 cores=0-7
/proc/5530/stat : 5530 (python) S 5528 5530 5504 0 -1 4202496 1000 0 0 0 1 0 0 0 20 0 1 0 668094217 16629760 873 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377299456 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/5530/statm: 4060 873 371 364 0 547 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16240

[startup+0.300294 s]
/proc/loadavg: 0.01 0.02 0.00 1/336 5530
/proc/meminfo: memFree=13909488/32951124 swapFree=63308188/67111528
[pid=5530] ppid=5528 vsize=29788 CPUtime=0.04 cores=0-7
/proc/5530/stat : 5530 (python) S 5528 5530 5504 0 -1 4202496 1414 0 0 0 3 1 0 0 18 0 1 0 668094217 30502912 1258 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377299456 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/5530/statm: 7447 1258 443 364 0 817 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29788

[startup+0.700254 s]
/proc/loadavg: 0.01 0.02 0.00 1/336 5530
/proc/meminfo: memFree=13909488/32951124 swapFree=63308188/67111528
[pid=5530] ppid=5528 vsize=94184 CPUtime=0.07 cores=0-7
/proc/5530/stat : 5530 (python) S 5528 5530 5504 0 -1 4202496 2771 0 0 0 5 2 0 0 15 0 1 0 668094217 96444416 2478 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377299456 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/5530/statm: 23546 2478 765 364 0 1678 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 94184

[startup+1.50108 s]
/proc/loadavg: 0.01 0.02 0.00 1/337 5531
/proc/meminfo: memFree=13898196/32951124 swapFree=63308188/67111528
[pid=5530] ppid=5528 vsize=135748 CPUtime=0.18 cores=0-7
/proc/5530/stat : 5530 (python) S 5528 5530 5504 0 -1 4202496 5964 935 1 0 15 3 0 0 15 0 1 0 668094217 139005952 4151 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377297413 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/5530/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+3.10077 s]
/proc/loadavg: 0.17 0.06 0.01 1/337 5535
/proc/meminfo: memFree=13895468/32951124 swapFree=63308188/67111528
[pid=5530] ppid=5528 vsize=283912 CPUtime=0.81 cores=0-7
/proc/5530/stat : 5530 (python) R 5528 5530 5504 0 -1 4202496 11845 935 1 0 71 10 0 0 16 0 1 0 668094217 290725888 8363 33554432000 4194304 5683644 140736285546000 18446744073709551615 4619693 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5530/statm: 70978 8363 1826 364 0 6902 0
Current children cumulated CPU time (s) 0.81
Current children cumulated vsize (KiB) 283912
heavy processes:

[startup+6.30114 s]
/proc/loadavg: 0.17 0.06 0.01 9/361 5559
/proc/meminfo: memFree=13824808/32951124 swapFree=63308188/67111528
[pid=5530] ppid=5528 vsize=362128 CPUtime=1.87 cores=0-7
/proc/5530/stat : 5530 (python) S 5528 5530 5504 0 -1 4202496 18183 935 1 0 174 13 0 0 22 0 9 0 668094217 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5530/statm: 90532 7499 1891 364 0 26429 0
[pid=5536] ppid=5530 vsize=279936 CPUtime=0 cores=0-7
/proc/5536/stat : 5536 (python) S 5530 5530 5504 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 668094612 286654464 5772 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321487 0 0 16781312 514 6150236491759976704 0 0 17 1 0 0 0
/proc/5536/statm: 69984 5772 355 364 0 5902 0
[pid=5538] ppid=5536 vsize=1018820 CPUtime=2.34 cores=0-7
/proc/5538/stat : 5538 (gnovelty+2) R 5536 5538 5538 0 -1 4202496 863 0 0 0 234 0 0 0 25 0 1 0 668094612 1043271680 596 33554432000 134512640 135663704 4293205856 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/5538/statm: 254705 596 113 282 0 254421 0
[pid=5539] ppid=5530 vsize=290832 CPUtime=0 cores=0-7
/proc/5539/stat : 5539 (python) S 5530 5530 5504 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 668094615 297811968 5795 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 17424022892068176131 0 0 17 4 0 0 0
/proc/5539/statm: 72708 5795 349 364 0 8623 0
[pid=5541] ppid=5539 vsize=1018820 CPUtime=2.31 cores=0-7
/proc/5541/stat : 5541 (gnovelty+2) R 5539 5541 5541 0 -1 4202496 858 0 0 0 231 0 0 0 25 0 1 0 668094615 1043271680 595 33554432000 134512640 135663704 4293603808 18446744073709551615 134524901 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5541/statm: 254705 595 113 282 0 254421 0
[pid=5542] ppid=5530 vsize=300604 CPUtime=0 cores=0-7
/proc/5542/stat : 5542 (python) S 5530 5530 5504 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 668094618 307818496 5932 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 15910658935887986947 0 0 17 4 0 0 0
/proc/5542/statm: 75151 5932 347 364 0 11063 0
[pid=5544] ppid=5542 vsize=419160 CPUtime=2.25 cores=0-7
/proc/5544/stat : 5544 (adaptg2wsat2009) R 5542 5544 5544 0 -1 4202496 1256 0 0 0 225 0 0 0 25 0 1 0 668094618 429219840 990 33554432000 134512640 135107411 4290014352 18446744073709551615 134523298 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/5544/statm: 104790 990 49 146 0 103666 0
[pid=5545] ppid=5530 vsize=310860 CPUtime=0 cores=0-7
/proc/5545/stat : 5545 (python) S 5530 5530 5504 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 668094621 318320640 5935 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 4062304592543580420 0 0 17 0 0 0 0
/proc/5545/statm: 77715 5935 347 364 0 13624 0
[pid=5547] ppid=5545 vsize=419160 CPUtime=2.23 cores=0-7
/proc/5547/stat : 5547 (adaptg2wsat2009) R 5545 5547 5547 0 -1 4202496 1256 0 0 0 223 0 0 0 25 0 1 0 668094622 429219840 991 33554432000 134512640 135107411 4293075600 18446744073709551615 134523319 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/5547/statm: 104790 991 49 146 0 103666 0
[pid=5548] ppid=5530 vsize=321116 CPUtime=0 cores=0-7
/proc/5548/stat : 5548 (python) S 5530 5530 5504 0 -1 4202560 748 0 0 0 0 0 0 0 18 0 1 0 668094625 328822784 5940 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 1679126333478633732 0 0 17 0 0 0 0
/proc/5548/statm: 80279 5940 347 364 0 16185 0
[pid=5550] ppid=5548 vsize=419160 CPUtime=2.22 cores=0-7
/proc/5550/stat : 5550 (adaptg2wsat2009) R 5548 5550 5550 0 -1 4202496 1257 0 0 0 222 0 0 0 25 0 1 0 668094625 429219840 990 33554432000 134512640 135107411 4289822384 18446744073709551615 134523319 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/5550/statm: 104790 990 49 146 0 103666 0
[pid=5551] ppid=5530 vsize=331372 CPUtime=0 cores=0-7
/proc/5551/stat : 5551 (python) S 5530 5530 5504 0 -1 4202560 760 0 0 0 0 0 0 0 18 0 1 0 668094628 339324928 5944 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 7166005190795952388 0 0 17 6 0 0 0
/proc/5551/statm: 82843 5944 347 364 0 18746 0
[pid=5553] ppid=5551 vsize=1018820 CPUtime=2.18 cores=0-7
/proc/5553/stat : 5553 (gnovelty+2) R 5551 5553 5553 0 -1 4202496 861 0 0 0 218 0 0 0 25 0 1 0 668094628 1043271680 596 33554432000 134512640 135663704 4286595424 18446744073709551615 134524507 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/5553/statm: 254705 596 113 282 0 254421 0
[pid=5554] ppid=5530 vsize=341628 CPUtime=0 cores=0-7
/proc/5554/stat : 5554 (python) S 5530 5530 5504 0 -1 4202560 761 0 0 0 0 0 0 0 18 0 1 0 668094631 349827072 5948 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 951080860856058115 0 0 17 4 0 0 0
/proc/5554/statm: 85407 5948 347 364 0 21307 0
[pid=5556] ppid=5554 vsize=247428 CPUtime=2.15 cores=0-7
/proc/5556/stat : 5556 (FH) R 5554 5556 5556 0 -1 4202496 1099 0 0 0 215 0 0 0 25 0 1 0 668094631 253366272 833 33554432000 134512640 134936988 4293637728 18446744073709551615 134523622 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/5556/statm: 61857 833 37 104 0 61361 0
[pid=5557] ppid=5530 vsize=351884 CPUtime=0 cores=0-7
/proc/5557/stat : 5557 (python) S 5530 5530 5504 0 -1 4202560 794 0 0 0 0 0 0 0 18 0 1 0 668094634 360329216 5958 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 16846904906689249538 0 0 17 6 0 0 0
/proc/5557/statm: 87971 5958 353 364 0 23868 0
[pid=5559] ppid=5557 vsize=419160 CPUtime=2.07 cores=0-7
/proc/5559/stat : 5559 (adaptg2wsat2009) R 5557 5559 5559 0 -1 4202496 1263 0 0 0 207 0 0 0 25 0 1 0 668094635 429219840 990 33554432000 134512640 135107411 4286785792 18446744073709551615 134523285 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/5559/statm: 104790 990 49 146 0 103666 0
[pid=5530/tid=5537] ppid=5528 vsize=362128 CPUtime=0 cores=0-7
/proc/5530/task/5537/stat : 5537 (python) S 5528 5530 5504 0 -1 4202560 27 935 0 0 0 0 0 0 18 0 9 0 668094612 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 6 0 0 0
[pid=5530/tid=5540] ppid=5528 vsize=362128 CPUtime=0 cores=0-7
/proc/5530/task/5540/stat : 5540 (python) S 5528 5530 5504 0 -1 4202560 22 935 0 0 0 0 0 0 18 0 9 0 668094615 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 4 0 0 0
[pid=5530/tid=5543] ppid=5528 vsize=362128 CPUtime=0 cores=0-7
/proc/5530/task/5543/stat : 5543 (python) S 5528 5530 5504 0 -1 4202560 24 935 0 0 0 0 0 0 18 0 9 0 668094618 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 4 0 0 0
[pid=5530/tid=5546] ppid=5528 vsize=362128 CPUtime=0 cores=0-7
/proc/5530/task/5546/stat : 5546 (python) S 5528 5530 5504 0 -1 4202560 23 935 0 0 0 0 0 0 24 0 9 0 668094622 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5549] ppid=5528 vsize=362128 CPUtime=0 cores=0-7
/proc/5530/task/5549/stat : 5549 (python) S 5528 5530 5504 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 9 0 668094625 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 6 0 0 0
[pid=5530/tid=5552] ppid=5528 vsize=362128 CPUtime=0 cores=0-7
/proc/5530/task/5552/stat : 5552 (python) S 5528 5530 5504 0 -1 4202560 23 935 0 0 0 0 0 0 20 0 9 0 668094628 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 6 0 0 0
[pid=5530/tid=5555] ppid=5528 vsize=362128 CPUtime=0 cores=0-7
/proc/5530/task/5555/stat : 5555 (python) S 5528 5530 5504 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 9 0 668094631 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 4 0 0 0
[pid=5530/tid=5558] ppid=5528 vsize=362128 CPUtime=0 cores=0-7
/proc/5530/task/5558/stat : 5558 (python) S 5528 5530 5504 0 -1 4202560 31 935 0 0 0 0 0 0 22 0 9 0 668094635 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 19.62
Current children cumulated vsize (KiB) 7870888

[startup+12.701 s]
/proc/loadavg: 1.37 0.32 0.10 9/361 5559
/proc/meminfo: memFree=13820360/32951124 swapFree=63308188/67111528
[pid=5530] ppid=5528 vsize=362128 CPUtime=1.87 cores=0-7
/proc/5530/stat : 5530 (python) S 5528 5530 5504 0 -1 4202496 18183 935 1 0 174 13 0 0 22 0 9 0 668094217 370819072 7499 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5530/statm: 90532 7499 1891 364 0 26429 0
[pid=5536] ppid=5530 vsize=279936 CPUtime=0 cores=0-7
/proc/5536/stat : 5536 (python) S 5530 5530 5504 0 -1 4202560 890 0 0 0 0 0 0 0 18 0 1 0 668094612 286654464 5795 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321487 0 0 16781312 514 6150236491759976704 0 0 17 1 0 0 0
/proc/5536/statm: 69984 5795 378 364 0 5902 0
[pid=5538] ppid=5536 vsize=1018820 CPUtime=8.74 cores=0-7
/proc/5538/stat : 5538 (gnovelty+2) R 5536 5538 5538 0 -1 4202496 863 0 0 0 874 0 0 0 25 0 1 0 668094612 1043271680 596 33554432000 134512640 135663704 4293205856 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/5538/statm: 254705 596 113 282 0 254421 0
[pid=5539] ppid=5530 vsize=290832 CPUtime=0 cores=0-7
/proc/5539/stat : 5539 (python) S 5530 5530 5504 0 -1 4202560 892 0 0 0 0 0 0 0 18 0 1 0 668094615 297811968 5818 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 17424022892068176131 0 0 17 4 0 0 0
/proc/5539/statm: 72708 5818 372 364 0 8623 0
[pid=5541] ppid=5539 vsize=1018820 CPUtime=8.71 cores=0-7
/proc/5541/stat : 5541 (gnovelty+2) R 5539 5541 5541 0 -1 4202496 858 0 0 0 871 0 0 0 25 0 1 0 668094615 1043271680 595 33554432000 134512640 135663704 4293603808 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5541/statm: 254705 595 113 282 0 254421 0
[pid=5542] ppid=5530 vsize=300604 CPUtime=0.01 cores=0-7
/proc/5542/stat : 5542 (python) S 5530 5530 5504 0 -1 4202560 902 0 0 0 0 1 0 0 18 0 1 0 668094618 307818496 5955 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 15910658935887986947 0 0 17 4 0 0 0
/proc/5542/statm: 75151 5955 370 364 0 11063 0
[pid=5544] ppid=5542 vsize=419428 CPUtime=8.57 cores=0-7
/proc/5544/stat : 5544 (adaptg2wsat2009) R 5542 5544 5544 0 -1 4202496 1441 0 0 0 857 0 0 0 25 0 1 0 668094618 429494272 1175 33554432000 134512640 135107411 4290014352 18446744073709551615 134531435 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/5544/statm: 104857 1175 59 146 0 103733 0
[pid=5545] ppid=5530 vsize=310860 CPUtime=0 cores=0-7
/proc/5545/stat : 5545 (python) S 5530 5530 5504 0 -1 4202560 915 0 0 0 0 0 0 0 18 0 1 0 668094621 318320640 5958 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 4062304592543580420 0 0 17 0 0 0 0
/proc/5545/statm: 77715 5958 370 364 0 13624 0
[pid=5547] ppid=5545 vsize=419428 CPUtime=8.58 cores=0-7
/proc/5547/stat : 5547 (adaptg2wsat2009) R 5545 5547 5547 0 -1 4202496 1441 0 0 0 858 0 0 0 25 0 1 0 668094622 429494272 1176 33554432000 134512640 135107411 4293075600 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/5547/statm: 104857 1176 59 146 0 103733 0
[pid=5548] ppid=5530 vsize=321116 CPUtime=0.01 cores=0-7
/proc/5548/stat : 5548 (python) S 5530 5530 5504 0 -1 4202560 927 0 0 0 0 1 0 0 18 0 1 0 668094625 328822784 5962 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 1679126333478633732 0 0 17 0 0 0 0
/proc/5548/statm: 80279 5962 369 364 0 16185 0
[pid=5550] ppid=5548 vsize=419428 CPUtime=8.58 cores=0-7
/proc/5550/stat : 5550 (adaptg2wsat2009) R 5548 5550 5550 0 -1 4202496 1442 0 0 0 858 0 0 0 25 0 1 0 668094625 429494272 1175 33554432000 134512640 135107411 4289822384 18446744073709551615 134531817 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/5550/statm: 104857 1175 59 146 0 103733 0
[pid=5551] ppid=5530 vsize=331372 CPUtime=0.01 cores=0-7
/proc/5551/stat : 5551 (python) S 5530 5530 5504 0 -1 4202560 934 0 0 0 0 1 0 0 18 0 1 0 668094628 339324928 5967 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 7166005190795952388 0 0 17 6 0 0 0
/proc/5551/statm: 82843 5967 370 364 0 18746 0
[pid=5553] ppid=5551 vsize=1018820 CPUtime=8.55 cores=0-7
/proc/5553/stat : 5553 (gnovelty+2) R 5551 5553 5553 0 -1 4202496 861 0 0 0 855 0 0 0 25 0 1 0 668094628 1043271680 596 33554432000 134512640 135663704 4286595424 18446744073709551615 134544212 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/5553/statm: 254705 596 113 282 0 254421 0
[pid=5554] ppid=5530 vsize=341628 CPUtime=0.01 cores=0-7
/proc/5554/stat : 5554 (python) S 5530 5530 5504 0 -1 4202560 942 0 0 0 0 1 0 0 18 0 1 0 668094631 349827072 5971 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 951080860856058115 0 0 17 4 0 0 0

################
# More data... #
################

[pid=5636] ppid=5530 vsize=561280 CPUtime=0.28 cores=0-7
/proc/5636/stat : 5636 (python) S 5530 5530 5504 0 -1 4202560 1182 0 0 0 14 14 0 0 18 0 2 0 668134671 574750720 6418 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5636/statm: 140320 6418 406 364 0 76175 0
[pid=5638] ppid=5636 vsize=335996 CPUtime=99.7 cores=0-7
/proc/5638/stat : 5638 (iPAWS) T 5636 5638 5638 0 -1 4202496 1711 0 0 0 9969 1 0 0 25 0 1 0 668134671 344059904 1430 33554432000 134512640 135114423 4292580704 18446744073709551615 134514774 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/5638/statm: 83999 1430 59 147 0 83851 0
[pid=5636/tid=5647] ppid=5530 vsize=561280 CPUtime=0 cores=0-7
/proc/5636/task/5647/stat : 5647 (python) S 5530 5530 5504 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 668144699 574750720 6418 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 514 18446604469892552640 0 0 -1 0 0 0 0
[pid=5643] ppid=5530 vsize=571536 CPUtime=0.28 cores=0-7
/proc/5643/stat : 5643 (python) S 5530 5530 5504 0 -1 4202560 1180 0 0 0 15 13 0 0 19 0 2 0 668144474 585252864 6513 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/5643/statm: 142884 6513 407 364 0 78736 0
[pid=5645] ppid=5643 vsize=1018820 CPUtime=97.38 cores=0-7
/proc/5645/stat : 5645 (gnovelty+2) T 5643 5645 5645 0 -1 4202496 881 0 0 0 9738 0 0 0 25 0 1 0 668144475 1043271680 596 33554432000 134512640 135663704 4290143712 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/5645/statm: 254705 596 113 282 0 254421 0
[pid=5643/tid=5656] ppid=5530 vsize=571536 CPUtime=0 cores=0-7
/proc/5643/task/5656/stat : 5656 (python) S 5530 5530 5504 0 -1 4202560 95 0 0 0 0 0 0 0 18 0 2 0 668154506 585252864 6513 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 514 18446604467955859584 0 0 -1 5 0 0 0
[pid=5653] ppid=5530 vsize=581792 CPUtime=0.28 cores=0-7
/proc/5653/stat : 5653 (python) S 5530 5530 5504 0 -1 4202560 1186 0 0 0 14 14 0 0 19 0 2 0 668153738 595755008 6520 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/5653/statm: 145448 6520 406 364 0 81297 0
[pid=5655] ppid=5653 vsize=335996 CPUtime=99.74 cores=0-7
/proc/5655/stat : 5655 (iPAWS) T 5653 5655 5655 0 -1 4202496 1712 0 0 0 9974 0 0 0 25 0 1 0 668153738 344059904 1428 33554432000 134512640 135114423 4288902192 18446744073709551615 134516234 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/5655/statm: 83999 1428 59 147 0 83851 0
[pid=5653/tid=5663] ppid=5530 vsize=581792 CPUtime=0 cores=0-7
/proc/5653/task/5663/stat : 5663 (python) S 5530 5530 5504 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 668163765 595755008 6520 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 514 18446604452322259328 0 0 -1 2 0 0 0
[pid=5657] ppid=5530 vsize=592328 CPUtime=1.14 cores=0-7
/proc/5657/stat : 5657 (python) S 5530 5530 5504 0 -1 4202560 1296 0 0 0 58 56 0 0 18 0 2 0 668154512 606543872 6427 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5657/statm: 148082 6427 402 364 0 83928 0
[pid=5659] ppid=5657 vsize=268424 CPUtime=392.61 cores=0-7
/proc/5659/stat : 5659 (hybridGM3) T 5657 5659 5659 0 -1 4202496 5297 0 0 0 39261 0 0 0 25 0 1 0 668154512 274866176 5008 33554432000 134512640 135204385 4294466864 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/5659/statm: 67106 5008 63 169 0 66936 0
[pid=5657/tid=5672] ppid=5530 vsize=592328 CPUtime=0 cores=0-7
/proc/5657/task/5672/stat : 5672 (python) S 5530 5530 5504 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 668174171 606543872 6427 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 514 18446604457156497728 0 0 -1 6 0 0 0
[pid=5664] ppid=5530 vsize=602544 CPUtime=0.87 cores=0-7
/proc/5664/stat : 5664 (python) S 5530 5530 5504 0 -1 4202560 1311 0 0 0 45 42 0 0 18 0 2 0 668163771 617005056 6489 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5664/statm: 150636 6489 400 364 0 86479 0
[pid=5666] ppid=5664 vsize=268428 CPUtime=296.83 cores=0-7
/proc/5666/stat : 5666 (hybridGM3) T 5664 5666 5666 0 -1 4202496 5295 0 0 0 29683 0 0 0 25 0 1 0 668163772 274870272 5010 33554432000 134512640 135204385 4290016992 18446744073709551615 134538034 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/5666/statm: 67107 5010 63 169 0 66937 0
[pid=5664/tid=5679] ppid=5530 vsize=602544 CPUtime=0 cores=0-7
/proc/5664/task/5679/stat : 5679 (python) S 5530 5530 5504 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 668183839 617005056 6489 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 514 18446604464030343360 0 0 -1 0 0 0 0
[pid=5669] ppid=5530 vsize=613080 CPUtime=0.88 cores=0-7
/proc/5669/stat : 5669 (python) S 5530 5530 5504 0 -1 4202560 1133 0 0 0 46 42 0 0 18 0 1 0 668173763 627793920 6481 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 16639428432622485765 0 0 17 5 0 0 0
/proc/5669/statm: 153270 6481 374 364 0 89110 0
[pid=5671] ppid=5669 vsize=457668 CPUtime=301.45 cores=0-7
/proc/5671/stat : 5671 (TNM) R 5669 5671 5671 0 -1 4202496 1324 0 0 0 30145 0 0 0 25 0 1 0 668173763 468652032 1036 33554432000 134512640 135008748 4287776592 18446744073709551615 134529123 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/5671/statm: 114417 1036 46 122 0 113317 0
[pid=5676] ppid=5530 vsize=623056 CPUtime=0.28 cores=0-7
/proc/5676/stat : 5676 (python) S 5530 5530 5504 0 -1 4202560 1243 0 0 0 14 14 0 0 19 0 2 0 668183435 638009344 6566 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5676/statm: 155764 6566 401 364 0 91601 0
[pid=5678] ppid=5676 vsize=249192 CPUtime=99.85 cores=0-7
/proc/5678/stat : 5678 (FH) T 5676 5678 5678 0 -1 4202496 1346 0 0 0 9985 0 0 0 25 0 1 0 668183435 255172608 1059 33554432000 134512640 134936988 4291166880 18446744073709551615 134552375 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/5678/statm: 62298 1059 41 104 0 61802 0
[pid=5676/tid=5686] ppid=5530 vsize=623056 CPUtime=0 cores=0-7
/proc/5676/task/5686/stat : 5686 (python) S 5530 5530 5504 0 -1 4202560 148 0 0 0 0 0 0 0 19 0 2 0 668193464 638009344 6566 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 514 18446604466851895232 0 0 -1 0 0 0 0
[pid=5682] ppid=5530 vsize=633312 CPUtime=0.35 cores=0-7
/proc/5682/stat : 5682 (python) S 5530 5530 5504 0 -1 4202560 1085 0 0 0 18 17 0 0 18 0 1 0 668192535 648511488 6606 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 16639428432622485765 0 0 17 0 0 0 0
/proc/5682/statm: 158328 6606 378 364 0 94162 0
[pid=5684] ppid=5682 vsize=419068 CPUtime=117.94 cores=0-7
/proc/5684/stat : 5684 (NCVWr) R 5682 5684 5684 0 -1 4202496 1359 0 0 0 11794 0 0 0 25 0 1 0 668192537 429125632 1077 33554432000 134512640 135113558 4288102816 18446744073709551615 134533464 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/5684/statm: 104767 1077 58 147 0 103642 0
[pid=5687] ppid=5530 vsize=643568 CPUtime=0.3 cores=0-7
/proc/5687/stat : 5687 (python) S 5530 5530 5504 0 -1 4202560 1249 0 0 0 15 15 0 0 19 0 2 0 668193470 659013632 6653 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5687/statm: 160892 6653 407 364 0 96723 0
[pid=5689] ppid=5687 vsize=1018820 CPUtime=98.41 cores=0-7
/proc/5689/stat : 5689 (gnovelty+2) T 5687 5689 5689 0 -1 4202496 884 0 0 0 9840 1 0 0 25 0 1 0 668193470 1043271680 596 33554432000 134512640 135663704 4291122016 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/5689/statm: 254705 596 113 282 0 254421 0
[pid=5687/tid=5698] ppid=5530 vsize=643568 CPUtime=0 cores=0-7
/proc/5687/task/5698/stat : 5698 (python) S 5530 5530 5504 0 -1 4202560 104 0 0 0 0 0 0 0 19 0 2 0 668203406 659013632 6653 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 514 18446604464362050816 0 0 -1 0 0 0 0
[pid=5690] ppid=5530 vsize=653824 CPUtime=0.3 cores=0-7
/proc/5690/stat : 5690 (python) S 5530 5530 5504 0 -1 4202560 1040 0 0 0 16 14 0 0 18 0 1 0 668193978 669515776 6688 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 16639428432622485767 0 0 17 0 0 0 0
/proc/5690/statm: 163456 6688 379 364 0 99284 0
[pid=5692] ppid=5690 vsize=268424 CPUtime=100 cores=0-7
/proc/5692/stat : 5692 (hybridGM3) R 5690 5692 5692 0 -1 4202496 5301 0 0 0 9998 2 0 0 25 0 1 0 668193979 274866176 5010 33554432000 134512640 135204385 4289467248 18446744073709551615 134537792 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/5692/statm: 67106 5010 63 169 0 66936 0
[pid=5693] ppid=5530 vsize=664080 CPUtime=0.3 cores=0-7
/proc/5693/stat : 5693 (python) S 5530 5530 5504 0 -1 4202560 1259 0 0 0 14 16 0 0 18 0 2 0 668194348 680017920 6691 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5693/statm: 166020 6691 407 364 0 101845 0
[pid=5695] ppid=5693 vsize=335996 CPUtime=100.27 cores=0-7
/proc/5695/stat : 5695 (iPAWS) T 5693 5695 5695 0 -1 4202496 1719 0 0 0 10027 0 0 0 25 0 1 0 668194349 344059904 1429 33554432000 134512640 135114423 4288685264 18446744073709551615 134515504 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/5695/statm: 83999 1429 59 147 0 83851 0
[pid=5693/tid=5699] ppid=5530 vsize=664080 CPUtime=0 cores=0-7
/proc/5693/task/5699/stat : 5699 (python) S 5530 5530 5504 0 -1 4202560 103 0 0 0 0 0 0 0 19 0 2 0 668204378 680017920 6691 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 514 18446604470122893376 0 0 -1 2 0 0 0
[pid=5700] ppid=5530 vsize=674336 CPUtime=0 cores=0-7
/proc/5700/stat : 5700 (python) S 5530 5530 5504 0 -1 4202560 960 0 0 0 0 0 0 0 19 0 1 0 668204384 690520064 6770 33554432000 4194304 5683644 140736285546000 18446744073709551615 255377321542 0 0 16781312 514 12549644579189555199 0 0 17 5 0 0 0
/proc/5700/statm: 168584 6770 355 364 0 104406 0
[pid=5702] ppid=5700 vsize=268420 CPUtime=0.44 cores=0-7
/proc/5702/stat : 5702 (hybridGM3) R 5700 5702 5702 0 -1 4202496 5301 0 0 0 44 0 0 0 21 0 1 0 668204385 274862080 5008 33554432000 134512640 135204385 4287041472 18446744073709551615 134538016 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5702/statm: 67105 5008 63 169 0 66935 0
[pid=5530/tid=5537] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5537/stat : 5537 (python) S 5528 5530 5504 0 -1 4202560 27 935 0 0 0 0 0 0 18 0 34 0 668094612 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 6 0 0 0
[pid=5530/tid=5540] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5540/stat : 5540 (python) S 5528 5530 5504 0 -1 4202560 22 935 0 0 0 0 0 0 18 0 34 0 668094615 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 4 0 0 0
[pid=5530/tid=5543] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5543/stat : 5543 (python) S 5528 5530 5504 0 -1 4202560 38 935 0 0 0 0 0 0 15 0 34 0 668094618 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 4 0 0 0
[pid=5530/tid=5546] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5546/stat : 5546 (python) S 5528 5530 5504 0 -1 4202560 28 935 0 0 0 0 0 0 18 0 34 0 668094622 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5549] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5549/stat : 5549 (python) S 5528 5530 5504 0 -1 4202560 27 935 0 0 0 0 0 0 18 0 34 0 668094625 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 6 0 0 0
[pid=5530/tid=5552] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5552/stat : 5552 (python) S 5528 5530 5504 0 -1 4202560 23 935 0 0 0 0 0 0 20 0 34 0 668094628 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 6 0 0 0
[pid=5530/tid=5555] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5555/stat : 5555 (python) S 5528 5530 5504 0 -1 4202560 36 935 0 0 0 0 0 0 18 0 34 0 668094631 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 4 0 0 0
[pid=5530/tid=5558] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5558/stat : 5558 (python) S 5528 5530 5504 0 -1 4202560 48 935 0 0 0 0 0 0 18 0 34 0 668094635 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 6 0 0 0
[pid=5530/tid=5566] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5566/stat : 5566 (python) S 5528 5530 5504 0 -1 4202560 41 935 0 0 0 0 0 0 18 0 34 0 668104643 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 3 0 0 0
[pid=5530/tid=5571] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5571/stat : 5571 (python) S 5528 5530 5504 0 -1 4202560 109 935 0 0 0 0 0 0 18 0 34 0 668104647 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 6 0 0 0
[pid=5530/tid=5575] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5575/stat : 5575 (python) S 5528 5530 5504 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 34 0 668104651 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 3 0 0 0
[pid=5530/tid=5579] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5579/stat : 5579 (python) S 5528 5530 5504 0 -1 4202560 32 935 0 0 0 0 0 0 25 0 34 0 668104656 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 3 0 0 0
[pid=5530/tid=5583] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5583/stat : 5583 (python) S 5528 5530 5504 0 -1 4202560 45 935 0 0 0 0 0 0 15 0 34 0 668104660 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 3 0 0 0
[pid=5530/tid=5586] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5586/stat : 5586 (python) S 5528 5530 5504 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 34 0 668104665 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 7 0 0 0
[pid=5530/tid=5589] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5589/stat : 5589 (python) S 5528 5530 5504 0 -1 4202560 26 935 0 0 0 0 0 0 22 0 34 0 668104669 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 3 0 0 0
[pid=5530/tid=5593] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5593/stat : 5593 (python) S 5528 5530 5504 0 -1 4202560 33 935 0 0 0 0 0 0 18 0 34 0 668104676 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 3 0 0 0
[pid=5530/tid=5600] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5600/stat : 5600 (python) S 5528 5530 5504 0 -1 4202560 39 935 0 0 0 0 0 0 18 0 34 0 668114593 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5605] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5605/stat : 5605 (python) S 5528 5530 5504 0 -1 4202560 124 935 0 0 0 0 0 0 18 0 34 0 668114675 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 3 0 0 0
[pid=5530/tid=5624] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5624/stat : 5624 (python) S 5528 5530 5504 0 -1 4202560 69 935 0 0 0 0 0 0 18 0 34 0 668125014 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5630] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5630/stat : 5630 (python) S 5528 5530 5504 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 34 0 668134171 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5634] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5634/stat : 5634 (python) S 5528 5530 5504 0 -1 4202560 43 935 0 0 0 0 0 0 19 0 34 0 668134361 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 5 0 0 0
[pid=5530/tid=5637] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5637/stat : 5637 (python) S 5528 5530 5504 0 -1 4202560 40 935 0 0 0 0 0 0 20 0 34 0 668134671 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5644] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5644/stat : 5644 (python) S 5528 5530 5504 0 -1 4202560 44 935 0 0 0 0 0 0 18 0 34 0 668144474 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5654] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5654/stat : 5654 (python) S 5528 5530 5504 0 -1 4202560 43 935 0 0 0 0 0 0 20 0 34 0 668153738 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 4 0 0 0
[pid=5530/tid=5658] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5658/stat : 5658 (python) S 5528 5530 5504 0 -1 4202560 36 935 0 0 0 0 0 0 18 0 34 0 668154512 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 5 0 0 0
[pid=5530/tid=5665] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5665/stat : 5665 (python) S 5528 5530 5504 0 -1 4202560 65 935 0 0 0 0 0 0 18 0 34 0 668163772 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5670] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5670/stat : 5670 (python) S 5528 5530 5504 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 34 0 668173763 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5677] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5677/stat : 5677 (python) S 5528 5530 5504 0 -1 4202560 95 935 0 0 0 0 0 0 20 0 34 0 668183435 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
[pid=5530/tid=5683] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5683/stat : 5683 (python) S 5528 5530 5504 0 -1 4202560 35 935 0 0 0 0 0 0 19 0 34 0 668192535 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 5 0 0 0
[pid=5530/tid=5688] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5688/stat : 5688 (python) S 5528 5530 5504 0 -1 4202560 39 935 0 0 0 0 0 0 20 0 34 0 668193470 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 5 0 0 0
[pid=5530/tid=5691] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5691/stat : 5691 (python) S 5528 5530 5504 0 -1 4202560 34 935 0 0 0 0 0 0 19 0 34 0 668193979 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 2 0 0 0
[pid=5530/tid=5694] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5694/stat : 5694 (python) S 5528 5530 5504 0 -1 4202560 39 935 0 0 0 0 0 0 20 0 34 0 668194349 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 5 0 0 0
[pid=5530/tid=5701] ppid=5528 vsize=684580 CPUtime=0 cores=0-7
/proc/5530/task/5701/stat : 5701 (python) S 5528 5530 5504 0 -1 4202560 38 935 0 0 0 0 0 0 20 0 34 0 668204385 701009920 8361 33554432000 4194304 5683644 140736285546000 18446744073709551615 255389125041 0 0 16781312 2 18446604449152792704 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 8746.55
Current children cumulated vsize (KiB) 32176896

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5530 and gives
#  childrusage.ru_utime.tv_sec=1741
#  childrusage.ru_utime.tv_usec=354273
#  childrusage.ru_stime.tv_sec=12
#  childrusage.ru_stime.tv_usec=233140
# CPU time returned by wait4() is 1753.59
# while last known CPU time is 8746.55
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1102.31
CPU time (s): 8746.55
CPU user time (s): 8734.51
CPU system time (s): 12.04
CPU usage (%): 793.475
Max. virtual memory (cumulated for all children) (KiB): 32176896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1741.35
system time used= 12.2331
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 109954
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17034
involuntary context switches= 33436

runsolver used 11.4523 second user time and 26.153 second system time

The end

Launcher Data 

Begin job on node135 at 2011-05-16 18:56:03
IDJOB=3385250
IDBENCH=82515
IDSOLVER=1870
FILE ID=node135/3385250-1305564962
RUNJOBID= node135-1305564962-5518
PBS_JOBID= 13350115
Free space on /tmp= 73532 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v250-c21250-S1682211323-009-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385250-1305564962/watcher-3385250-1305564962 -o /tmp/evaluation-result-3385250-1305564962/solver-3385250-1305564962 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385250-1305564962.cnf -seed 2125973254 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 917ee0efab4f0e89027865c1129d272b
RANDOM SEED=2125973254

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13910024 kB
Buffers:        320272 kB
Cached:        6474284 kB
SwapCached:      18108 kB
Active:       10197416 kB
Inactive:      8581144 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13910024 kB
SwapTotal:    67111528 kB
SwapFree:     63308188 kB
Dirty:           32296 kB
Writeback:           0 kB
AnonPages:    11971600 kB
Mapped:          18432 kB
Slab:           145008 kB
PageTables:      52188 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 79783040 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73500 MiB
End job on node135 at 2011-05-16 19:14:28