Trace number 3385277

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 9488.9 1193.6

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S942666749-061-UNKNOWN.cnf
MD5SUM456ae67a44e812130272597099547869
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.41/0.82	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.41/0.82	c INFO: solving HOME/instance-3385277-1305564966.cnf
0.41/0.82	c INFO: computing task features
0.50/0.99	c INFO: computed variable-clause graph statistics
0.50/1.00	c INFO: computed clause balance statistics
1.50/1.91	c INFO: computed variable balance statistics
1.80/2.28	c INFO: computed small-clause counts
1.80/2.28	c INFO: computed Horn-clause counts
1.90/2.31	c INFO: computed variable graph statistics
1.90/2.31	c INFO: collected features for HOME/instance-3385277-1305564966.cnf in 1.48 s
1.90/2.35	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.37)
1.90/2.38	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
1.98/2.41	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
1.98/2.44	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
1.98/2.47	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.05)
2.08/2.51	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.04)
2.08/2.54	c INFO: running FH@0 for 97 with 4998 remaining (b = 0.03)
2.08/2.57	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.03)
802.17/102.60	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.02)
802.17/102.63	c INFO: running FH@0 for 97 with 4898 remaining (b = 0.02)
802.17/102.67	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.04)
802.64/102.71	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.02)
802.64/102.76	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.03)
802.92/102.81	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.01)
802.92/102.85	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.03)
803.03/102.90	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.02)
1601.33/202.82	c INFO: running TNM@0 for 1552 with 4798 remaining (b = 0.19)
1601.33/202.88	c INFO: running FH@0 for 97 with 4797 remaining (b = 0.01)
1602.61/203.00	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1602.61/203.05	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
2369.05/299.16	c INFO: running hybridGM3@99 for 97 with 4701 remaining (b = 0.01)
2369.86/299.23	c INFO: running hybridGM3@99 for 97 with 4701 remaining (b = 0.01)
2369.86/299.28	c INFO: running adaptg2wsat2009++@0 for 97 with 4701 remaining (b = 0.01)
2372.94/299.65	c INFO: running hybridGM3@99 for 97 with 4701 remaining (b = 0.01)
2377.78/300.29	c INFO: running adaptg2wsat2009++@100 for 97 with 4700 remaining (b = 0.01)
2400.84/303.12	c INFO: running hybridGM3@0 for 194 with 4697 remaining (b = 0.02)
2418.38/305.37	c INFO: running hybridGM3@99 for 97 with 4695 remaining (b = 0.01)
3131.90/394.88	c INFO: running hybridGM3@0 for 194 with 4605 remaining (b = 0.02)
3145.40/396.52	c INFO: running TNM@0 for 1455 with 4604 remaining (b = 0.14)
3175.72/400.40	c INFO: running hybridGM3@296 for 97 with 4600 remaining (b = 0.01)
3176.50/400.47	c INFO: running adaptg2wsat2009++@100 for 97 with 4600 remaining (b = 0.01)
3177.23/400.60	c INFO: running iPAWS@0 for 97 with 4600 remaining (b = 0.01)
3201.12/403.54	c INFO: running FH@0 for 97 with 4597 remaining (b = 0.01)
3934.42/495.63	c INFO: running hybridGM3@396 for 97 with 4505 remaining (b = 0.01)
3951.15/497.71	c INFO: running adaptg2wsat2009++@99 for 97 with 4503 remaining (b = 0.01)
3958.33/498.64	c INFO: running gnovelty+2@0 for 97 with 4502 remaining (b = 0.01)
3975.84/500.85	c INFO: running hybridGM3@0 for 194 with 4500 remaining (b = 0.02)
3999.75/503.81	c INFO: running FH@0 for 291 with 4497 remaining (b = 0.02)
4692.43/590.87	c INFO: running hybridGM3@0 for 194 with 4410 remaining (b = 0.01)
4695.98/591.38	c INFO: running hybridGM3@97 for 97 with 4409 remaining (b = 0.01)
4756.88/599.00	c INFO: running TNM@0 for 1552 with 4401 remaining (b = 0.11)
4796.77/603.97	c INFO: running adaptg2wsat2009++@295 for 291 with 4396 remaining (b = 0.02)
5502.86/692.63	c INFO: running FH@100 for 291 with 4308 remaining (b = 0.02)
5533.10/696.44	c INFO: running hybridGM3@99 for 97 with 4304 remaining (b = 0.01)
6241.76/785.50	c INFO: running iPAWS@0 for 97 with 4215 remaining (b = 0.01)
6305.34/793.41	c INFO: running hybridGM3@0 for 194 with 4207 remaining (b = 0.01)
6338.79/797.69	c INFO: running hybridGM3@293 for 194 with 4203 remaining (b = 0.02)
7040.21/885.77	c INFO: running NCVWr@0 for 485 with 4115 remaining (b = 0.03)
7087.14/891.63	c INFO: running adaptg2wsat2009++@392 for 194 with 4109 remaining (b = 0.01)
7863.38/989.13	c INFO: running hybridGM3@393 for 97 with 4011 remaining (b = 0.01)
7869.76/989.95	c INFO: running hybridGM3@100 for 97 with 4010 remaining (b = 0.01)
7903.97/994.28	c INFO: running FH@295 for 97 with 4006 remaining (b = 0.01)
8658.73/1089.08	c INFO: running adaptg2wsat2009++@98 for 97 with 3911 remaining (b = 0.01)
8662.63/1089.53	c INFO: running iPAWS@0 for 97 with 3911 remaining (b = 0.01)
8668.98/1090.40	c INFO: running gnovelty+2@0 for 97 with 3910 remaining (b = 0.01)
8676.16/1091.21	c INFO: running hybridGM3@391 for 97 with 3909 remaining (b = 0.01)
9432.36/1186.36	c INFO: running FH@100 for 291 with 3814 remaining (b = 0.02)
9459.35/1189.80	c INFO: running adaptg2wsat2009++@193 for 97 with 3811 remaining (b = 0.01)
9480.87/1192.49	c INFO: running hybridGM3@0 for 194 with 3808 remaining (b = 0.01)
9488.90/1193.50	c INFO: running TNM@0 for 1552 with 3807 remaining (b = 0.08)
9488.90/1193.57	c INFO: running NCVWr@0 for 485 with 3807 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385277-1305564966/watcher-3385277-1305564966 -o /tmp/evaluation-result-3385277-1305564966/solver-3385277-1305564966 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385277-1305564966.cnf -seed 1960073158 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 1/239 27781
/proc/meminfo: memFree=22226068/32951124 swapFree=61559568/67111528
[pid=27781] ppid=27779 vsize=15184 CPUtime=0 cores=0-7
/proc/27781/stat : 27781 (python) R 27779 27781 27755 0 -1 4202496 712 0 0 0 0 0 0 0 22 0 1 0 668097427 15548416 604 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921775104 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/27781/statm: 3796 604 319 364 0 283 0

[startup+0.025889 s]
/proc/loadavg: 0.00 0.00 0.00 1/239 27781
/proc/meminfo: memFree=22226068/32951124 swapFree=61559568/67111528
[pid=27781] ppid=27779 vsize=16240 CPUtime=0 cores=0-7
/proc/27781/stat : 27781 (python) R 27779 27781 27755 0 -1 4202496 1045 0 0 0 0 0 0 0 22 0 1 0 668097427 16629760 917 33554432000 4194304 5683644 140736549211568 18446744073709551615 4509206 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/27781/statm: 4060 918 381 364 0 547 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16240

[startup+0.100862 s]
/proc/loadavg: 0.00 0.00 0.00 1/239 27781
/proc/meminfo: memFree=22226068/32951124 swapFree=61559568/67111528
[pid=27781] ppid=27779 vsize=52412 CPUtime=0.05 cores=0-7
/proc/27781/stat : 27781 (python) S 27779 27781 27755 0 -1 4202496 2015 0 0 0 4 1 0 0 22 0 1 0 668097427 53669888 1775 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921775104 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/27781/statm: 13103 1775 484 364 0 1284 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 52412

[startup+0.300827 s]
/proc/loadavg: 0.00 0.00 0.00 1/239 27781
/proc/meminfo: memFree=22226068/32951124 swapFree=61559568/67111528
[pid=27781] ppid=27779 vsize=135588 CPUtime=0.17 cores=0-7
/proc/27781/stat : 27781 (python) R 27779 27781 27755 0 -1 4202496 5911 933 1 0 12 5 0 0 23 0 1 0 668097427 138842112 4133 33554432000 4194304 5683644 140736549211568 18446744073709551615 4880968 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/27781/statm: 33897 4133 1031 364 0 3083 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135588

[startup+0.700722 s]
/proc/loadavg: 0.00 0.00 0.00 1/239 27781
/proc/meminfo: memFree=22226068/32951124 swapFree=61559568/67111528
[pid=27781] ppid=27779 vsize=246316 CPUtime=0.37 cores=0-7
/proc/27781/stat : 27781 (python) R 27779 27781 27755 0 -1 4202496 8168 933 1 0 26 11 0 0 21 0 1 0 668097427 252227584 6066 33554432000 4194304 5683644 140736549211568 18446744073709551615 4579681 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/27781/statm: 61579 6066 1621 364 0 4581 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 246316

[startup+1.50057 s]
/proc/loadavg: 0.00 0.00 0.00 2/240 27786
/proc/meminfo: memFree=22198040/32951124 swapFree=61559568/67111528
[pid=27781] ppid=27779 vsize=285640 CPUtime=1.1 cores=0-7
/proc/27781/stat : 27781 (python) R 27779 27781 27755 0 -1 4202496 12499 933 1 0 97 13 0 0 22 0 1 0 668097427 292495360 8795 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921437713 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/27781/statm: 71410 8795 1826 364 0 7334 0
Current children cumulated CPU time (s) 1.1
Current children cumulated vsize (KiB) 285640

[startup+3.10024 s]
/proc/loadavg: 0.08 0.02 0.01 2/240 27786
/proc/meminfo: memFree=22197544/32951124 swapFree=61559568/67111528
[pid=27781] ppid=27779 vsize=427988 CPUtime=2.16 cores=0-7
/proc/27781/stat : 27781 (python) S 27779 27781 27755 0 -1 4202496 18685 933 1 0 201 15 0 0 19 0 9 0 668097427 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/27781/statm: 106997 7716 1891 364 0 42894 0
Current children cumulated CPU time (s) 2.16
Current children cumulated vsize (KiB) 427988
heavy processes:

[startup+6.30165 s]
/proc/loadavg: 0.08 0.02 0.01 9/264 27810
/proc/meminfo: memFree=22139192/32951124 swapFree=61559568/67111528
[pid=27781] ppid=27779 vsize=427988 CPUtime=2.16 cores=0-7
/proc/27781/stat : 27781 (python) S 27779 27781 27755 0 -1 4202496 18685 933 1 0 201 15 0 0 19 0 9 0 668097427 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/27781/statm: 106997 7716 1891 364 0 42894 0
[pid=27787] ppid=27781 vsize=280764 CPUtime=0 cores=0-7
/proc/27787/stat : 27787 (python) S 27781 27781 27755 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 668097663 287502336 5979 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797135 0 0 16781312 514 184846050865938690 0 0 17 1 0 0 0
/proc/27787/statm: 70191 5979 355 364 0 6109 0
[pid=27789] ppid=27787 vsize=1019708 CPUtime=3.94 cores=0-7
/proc/27789/stat : 27789 (gnovelty+2) R 27787 27789 27789 0 -1 4202496 956 0 0 0 394 0 0 0 25 0 1 0 668097663 1044180992 690 33554432000 134512640 135663704 4289538368 18446744073709551615 134545598 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/27789/statm: 254927 690 113 282 0 254643 0
[pid=27790] ppid=27781 vsize=291088 CPUtime=0 cores=0-7
/proc/27790/stat : 27790 (python) S 27781 27781 27755 0 -1 4202560 745 0 0 0 0 0 0 0 18 0 1 0 668097666 298074112 5977 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 184849899156635908 0 0 17 6 0 0 0
/proc/27790/statm: 72772 5977 349 364 0 8687 0
[pid=27792] ppid=27790 vsize=1019708 CPUtime=3.91 cores=0-7
/proc/27792/stat : 27792 (gnovelty+2) R 27790 27792 27792 0 -1 4202496 954 0 0 0 391 0 0 0 25 0 1 0 668097666 1044180992 690 33554432000 134512640 135663704 4287670112 18446744073709551615 134545772 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/27792/statm: 254927 690 113 282 0 254643 0
[pid=27793] ppid=27781 vsize=301344 CPUtime=0 cores=0-7
/proc/27793/stat : 27793 (python) S 27781 27781 27755 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 668097669 308576256 5998 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 184853747447333124 0 0 17 7 0 0 0
/proc/27793/statm: 75336 5998 349 364 0 11248 0
[pid=27795] ppid=27793 vsize=419820 CPUtime=3.87 cores=0-7
/proc/27795/stat : 27795 (adaptg2wsat2009) R 27793 27795 27795 0 -1 4202496 1438 0 0 0 387 0 0 0 25 0 1 0 668097669 429895680 1172 33554432000 134512640 135107411 4291728896 18446744073709551615 134523438 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/27795/statm: 104955 1172 49 146 0 103831 0
[pid=27796] ppid=27781 vsize=311668 CPUtime=0 cores=0-7
/proc/27796/stat : 27796 (python) S 27781 27781 27755 0 -1 4202560 751 0 0 0 0 0 0 0 18 0 1 0 668097672 319148032 6002 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 6710420898559525124 0 0 17 2 0 0 0
/proc/27796/statm: 77917 6002 349 364 0 13826 0
[pid=27798] ppid=27796 vsize=419820 CPUtime=3.84 cores=0-7
/proc/27798/stat : 27798 (adaptg2wsat2009) R 27796 27798 27798 0 -1 4202496 1440 0 0 0 384 0 0 0 25 0 1 0 668097672 429895680 1174 33554432000 134512640 135107411 4288540816 18446744073709551615 134523314 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/27798/statm: 104955 1174 49 146 0 103831 0
[pid=27799] ppid=27781 vsize=321856 CPUtime=0 cores=0-7
/proc/27799/stat : 27799 (python) S 27781 27781 27755 0 -1 4202560 757 0 0 0 0 0 0 0 18 0 1 0 668097675 329580544 6023 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 4022536081600643329 0 0 17 1 0 0 0
/proc/27799/statm: 80464 6023 349 364 0 16370 0
[pid=27801] ppid=27799 vsize=419820 CPUtime=3.8 cores=0-7
/proc/27801/stat : 27801 (adaptg2wsat2009) R 27799 27801 27801 0 -1 4202496 1441 0 0 0 380 0 0 0 25 0 1 0 668097676 429895680 1172 33554432000 134512640 135107411 4290386736 18446744073709551615 134523312 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/27801/statm: 104955 1172 49 146 0 103831 0
[pid=27802] ppid=27781 vsize=332180 CPUtime=0 cores=0-7
/proc/27802/stat : 27802 (python) S 27781 27781 27755 0 -1 4202560 765 0 0 0 0 0 0 0 18 0 1 0 668097678 340152320 6027 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 4022528385019248897 0 0 17 1 0 0 0
/proc/27802/statm: 83045 6027 349 364 0 18948 0
[pid=27804] ppid=27802 vsize=1019708 CPUtime=3.74 cores=0-7
/proc/27804/stat : 27804 (gnovelty+2) R 27802 27804 27804 0 -1 4202496 953 0 0 0 374 0 0 0 25 0 1 0 668097679 1044180992 689 33554432000 134512640 135663704 4287562912 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/27804/statm: 254927 689 113 282 0 254643 0
[pid=27805] ppid=27781 vsize=407488 CPUtime=0 cores=0-7
/proc/27805/stat : 27805 (python) S 27781 27781 27755 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 668097682 417267712 6202 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 3936652128843432193 0 0 17 0 0 0 0
/proc/27805/statm: 101872 6202 348 364 0 37772 0
[pid=27807] ppid=27805 vsize=247956 CPUtime=3.72 cores=0-7
/proc/27807/stat : 27807 (FH) R 27805 27807 27807 0 -1 4202496 1244 0 0 0 372 0 0 0 25 0 1 0 668097684 253906944 986 33554432000 134512640 134936988 4289572368 18446744073709551615 134523665 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/27807/statm: 61989 986 37 104 0 61493 0
[pid=27808] ppid=27781 vsize=417744 CPUtime=0 cores=0-7
/proc/27808/stat : 27808 (python) S 27781 27781 27755 0 -1 4202560 771 0 0 0 0 0 0 0 18 0 1 0 668097685 427769856 6175 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 15733936081222992130 0 0 17 1 0 0 0
/proc/27808/statm: 104436 6175 354 364 0 40333 0
[pid=27810] ppid=27808 vsize=419820 CPUtime=3.69 cores=0-7
/proc/27810/stat : 27810 (adaptg2wsat2009) R 27808 27810 27810 0 -1 4202496 1437 0 0 0 369 0 0 0 25 0 1 0 668097687 429895680 1173 33554432000 134512640 135107411 4291933440 18446744073709551615 134523312 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/27810/statm: 104955 1173 49 146 0 103831 0
[pid=27781/tid=27788] ppid=27779 vsize=427988 CPUtime=0 cores=0-7
/proc/27781/task/27788/stat : 27788 (python) S 27779 27781 27755 0 -1 4202560 26 933 0 0 0 0 0 0 25 0 9 0 668097663 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27791] ppid=27779 vsize=427988 CPUtime=0 cores=0-7
/proc/27781/task/27791/stat : 27791 (python) S 27779 27781 27755 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 9 0 668097666 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27794] ppid=27779 vsize=427988 CPUtime=0 cores=0-7
/proc/27781/task/27794/stat : 27794 (python) S 27779 27781 27755 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 9 0 668097669 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27797] ppid=27779 vsize=427988 CPUtime=0 cores=0-7
/proc/27781/task/27797/stat : 27797 (python) S 27779 27781 27755 0 -1 4202560 23 933 0 0 0 0 0 0 18 0 9 0 668097672 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 2 0 0 0
[pid=27781/tid=27800] ppid=27779 vsize=427988 CPUtime=0 cores=0-7
/proc/27781/task/27800/stat : 27800 (python) S 27779 27781 27755 0 -1 4202560 24 933 0 0 0 0 0 0 21 0 9 0 668097675 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 2 0 0 0
[pid=27781/tid=27803] ppid=27779 vsize=427988 CPUtime=0 cores=0-7
/proc/27781/task/27803/stat : 27803 (python) S 27779 27781 27755 0 -1 4202560 26 933 0 0 0 0 0 0 22 0 9 0 668097679 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 7 0 0 0
[pid=27781/tid=27806] ppid=27779 vsize=427988 CPUtime=0 cores=0-7
/proc/27781/task/27806/stat : 27806 (python) S 27779 27781 27755 0 -1 4202560 100 933 0 0 0 0 0 0 19 0 9 0 668097682 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27809] ppid=27779 vsize=427988 CPUtime=0 cores=0-7
/proc/27781/task/27809/stat : 27809 (python) S 27779 27781 27755 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 9 0 668097685 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 32.67
Current children cumulated vsize (KiB) 8078480

[startup+12.7015 s]
/proc/loadavg: 1.37 0.30 0.10 9/264 27810
/proc/meminfo: memFree=22133264/32951124 swapFree=61559568/67111528
[pid=27781] ppid=27779 vsize=427988 CPUtime=2.16 cores=0-7
/proc/27781/stat : 27781 (python) S 27779 27781 27755 0 -1 4202496 18685 933 1 0 201 15 0 0 19 0 9 0 668097427 438259712 7716 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/27781/statm: 106997 7716 1891 364 0 42894 0
[pid=27787] ppid=27781 vsize=280764 CPUtime=0.02 cores=0-7
/proc/27787/stat : 27787 (python) S 27781 27781 27755 0 -1 4202560 890 0 0 0 1 1 0 0 18 0 1 0 668097663 287502336 6002 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797135 0 0 16781312 514 1605761965576126722 0 0 17 1 0 0 0
/proc/27787/statm: 70191 6002 378 364 0 6109 0
[pid=27789] ppid=27787 vsize=1019708 CPUtime=10.34 cores=0-7
/proc/27789/stat : 27789 (gnovelty+2) R 27787 27789 27789 0 -1 4202496 956 0 0 0 1034 0 0 0 25 0 1 0 668097663 1044180992 690 33554432000 134512640 135663704 4289538368 18446744073709551615 134545598 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/27789/statm: 254927 690 113 282 0 254643 0
[pid=27790] ppid=27781 vsize=291088 CPUtime=0.02 cores=0-7
/proc/27790/stat : 27790 (python) S 27781 27781 27755 0 -1 4202560 903 0 0 0 1 1 0 0 18 0 1 0 668097666 298074112 6000 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 1605761965576126724 0 0 17 6 0 0 0
/proc/27790/statm: 72772 6000 372 364 0 8687 0
[pid=27792] ppid=27790 vsize=1019708 CPUtime=10.31 cores=0-7
/proc/27792/stat : 27792 (gnovelty+2) R 27790 27792 27792 0 -1 4202496 954 0 0 0 1031 0 0 0 25 0 1 0 668097666 1044180992 690 33554432000 134512640 135663704 4287670112 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/27792/statm: 254927 690 113 282 0 254643 0
[pid=27793] ppid=27781 vsize=301344 CPUtime=0.02 cores=0-7
/proc/27793/stat : 27793 (python) S 27781 27781 27755 0 -1 4202560 912 0 0 0 1 1 0 0 18 0 1 0 668097669 308576256 6021 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 1605761965576126724 0 0 17 7 0 0 0
/proc/27793/statm: 75336 6021 372 364 0 11248 0
[pid=27795] ppid=27793 vsize=420220 CPUtime=10.27 cores=0-7
/proc/27795/stat : 27795 (adaptg2wsat2009) R 27793 27795 27795 0 -1 4202496 1666 0 0 0 1027 0 0 0 25 0 1 0 668097669 430305280 1400 33554432000 134512640 135107411 4291728896 18446744073709551615 134531822 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/27795/statm: 105055 1400 59 146 0 103931 0
[pid=27796] ppid=27781 vsize=311668 CPUtime=0.02 cores=0-7
/proc/27796/stat : 27796 (python) S 27781 27781 27755 0 -1 4202560 930 0 0 0 1 1 0 0 18 0 1 0 668097672 319148032 6025 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 1605761965576126724 0 0 17 2 0 0 0
/proc/27796/statm: 77917 6025 372 364 0 13826 0
[pid=27798] ppid=27796 vsize=420220 CPUtime=10.22 cores=0-7
/proc/27798/stat : 27798 (adaptg2wsat2009) R 27796 27798 27798 0 -1 4202496 1667 0 0 0 1022 0 0 0 25 0 1 0 668097672 430305280 1401 33554432000 134512640 135107411 4288540816 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/27798/statm: 105055 1401 59 146 0 103931 0
[pid=27799] ppid=27781 vsize=321856 CPUtime=0.01 cores=0-7
/proc/27799/stat : 27799 (python) S 27781 27781 27755 0 -1 4202560 931 0 0 0 1 0 0 0 18 0 1 0 668097675 329580544 6046 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 1605761965576126721 0 0 17 1 0 0 0
/proc/27799/statm: 80464 6046 372 364 0 16370 0
[pid=27801] ppid=27799 vsize=420220 CPUtime=10.18 cores=0-7
/proc/27801/stat : 27801 (adaptg2wsat2009) R 27799 27801 27801 0 -1 4202496 1668 0 0 0 1018 0 0 0 25 0 1 0 668097676 430305280 1399 33554432000 134512640 135107411 4290386736 18446744073709551615 134531561 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/27801/statm: 105055 1399 59 146 0 103931 0
[pid=27802] ppid=27781 vsize=332180 CPUtime=0.01 cores=0-7
/proc/27802/stat : 27802 (python) S 27781 27781 27755 0 -1 4202560 940 0 0 0 1 0 0 0 18 0 1 0 668097678 340152320 6050 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 1605761965576126721 0 0 17 1 0 0 0
/proc/27802/statm: 83045 6050 372 364 0 18948 0
[pid=27804] ppid=27802 vsize=1019708 CPUtime=10.06 cores=0-7
/proc/27804/stat : 27804 (gnovelty+2) R 27802 27804 27804 0 -1 4202496 953 0 0 0 1006 0 0 0 25 0 1 0 668097679 1044180992 689 33554432000 134512640 135663704 4287562912 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/27804/statm: 254927 689 113 282 0 254643 0
[pid=27805] ppid=27781 vsize=407488 CPUtime=0.02 cores=0-7
/proc/27805/stat : 27805 (python) S 27781 27781 27755 0 -1 4202560 810 0 0 0 1 1 0 0 18 0 1 0 668097682 417267712 6225 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 1605761965576126721 0 0 17 0 0 0 0

################
# More data... #
################

/proc/27888/statm: 83999 1535 59 147 0 83851 0
[pid=27886/tid=27902] ppid=27781 vsize=561328 CPUtime=0 cores=0-7
/proc/27886/task/27902/stat : 27902 (python) S 27781 27781 27755 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 668147507 574799872 6523 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 514 18446604441486452800 0 0 -1 1 0 0 0
[pid=27889] ppid=27781 vsize=571584 CPUtime=0.2 cores=0-7
/proc/27889/stat : 27889 (python) S 27781 27781 27755 0 -1 4202560 1184 0 0 0 12 8 0 0 19 0 2 0 668137782 585302016 6572 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/27889/statm: 142896 6572 407 364 0 78748 0
[pid=27891] ppid=27889 vsize=249868 CPUtime=99.38 cores=0-7
/proc/27891/stat : 27891 (FH) T 27889 27891 27891 0 -1 4202496 1547 0 0 0 9938 0 0 0 25 0 1 0 668137783 255864832 1263 33554432000 134512640 134936988 4292276384 18446744073709551615 134554983 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/27891/statm: 62467 1263 41 104 0 61971 0
[pid=27889/tid=27906] ppid=27781 vsize=571584 CPUtime=0 cores=0-7
/proc/27889/task/27906/stat : 27906 (python) S 27781 27781 27755 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 668147801 585302016 6572 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 514 18446604453846569344 0 0 -1 1 0 0 0
[pid=27899] ppid=27781 vsize=581840 CPUtime=0.21 cores=0-7
/proc/27899/stat : 27899 (python) S 27781 27781 27755 0 -1 4202560 1188 0 0 0 12 9 0 0 18 0 2 0 668147292 595804160 6569 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/27899/statm: 145460 6569 406 364 0 81309 0
[pid=27901] ppid=27899 vsize=1019708 CPUtime=101.32 cores=0-7
/proc/27901/stat : 27901 (gnovelty+2) T 27899 27901 27901 0 -1 4202496 975 0 0 0 10132 0 0 0 25 0 1 0 668147292 1044180992 690 33554432000 134512640 135663704 4292991056 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/27901/statm: 254927 690 113 282 0 254643 0
[pid=27899/tid=27917] ppid=27781 vsize=581840 CPUtime=0 cores=0-7
/proc/27899/task/27917/stat : 27917 (python) S 27781 27781 27755 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 668157818 595804160 6569 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 514 18446604446326067584 0 0 -1 7 0 0 0
[pid=27903] ppid=27781 vsize=592096 CPUtime=1.23 cores=0-7
/proc/27903/stat : 27903 (python) S 27781 27781 27755 0 -1 4202560 1197 0 0 0 70 53 0 0 18 0 2 0 668147513 606306304 6633 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/27903/statm: 148024 6633 400 364 0 83870 0
[pid=27905] ppid=27903 vsize=268420 CPUtime=586.74 cores=0-7
/proc/27905/stat : 27905 (hybridGM3) T 27903 27905 27905 0 -1 4202496 5411 0 0 0 58673 1 0 0 25 0 1 0 668147514 274862080 5126 33554432000 134512640 135204385 4293829696 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/27905/statm: 67105 5126 63 169 0 66935 0
[pid=27903/tid=27920] ppid=27781 vsize=592096 CPUtime=0 cores=0-7
/proc/27903/task/27920/stat : 27920 (python) S 27781 27781 27755 0 -1 4202560 94 0 0 0 0 0 0 0 18 0 2 0 668167065 606306304 6633 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 514 18446604446326068480 0 0 -1 6 0 0 0
[pid=27909] ppid=27781 vsize=602352 CPUtime=0.39 cores=0-7
/proc/27909/stat : 27909 (python) S 27781 27781 27755 0 -1 4202560 1197 0 0 0 23 16 0 0 19 0 2 0 668156514 616808448 6540 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/27909/statm: 150588 6540 401 364 0 86431 0
[pid=27911] ppid=27909 vsize=268424 CPUtime=194.55 cores=0-7
/proc/27911/stat : 27911 (hybridGM3) T 27909 27911 27911 0 -1 4202496 5412 0 0 0 19455 0 0 0 25 0 1 0 668156515 274866176 5127 33554432000 134512640 135204385 4293899600 18446744073709551615 134537949 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/27911/statm: 67106 5127 63 169 0 66936 0
[pid=27909/tid=27924] ppid=27781 vsize=602352 CPUtime=0 cores=0-7
/proc/27909/task/27924/stat : 27924 (python) S 27781 27781 27755 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 668175972 616808448 6540 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 514 18446604453850486848 0 0 -1 6 0 0 0
[pid=27914] ppid=27781 vsize=612608 CPUtime=1.27 cores=0-7
/proc/27914/stat : 27914 (python) S 27781 27781 27755 0 -1 4202560 1004 0 0 0 69 58 0 0 18 0 1 0 668157327 627310592 6621 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 1605761965576126721 0 0 17 3 0 0 0
/proc/27914/statm: 153152 6621 372 364 0 88992 0
[pid=27916] ppid=27914 vsize=458352 CPUtime=591.78 cores=0-7
/proc/27916/stat : 27916 (TNM) R 27914 27916 27916 0 -1 4202496 1522 0 0 0 59178 0 0 0 25 0 1 0 668157328 469352448 1240 33554432000 134512640 135008748 4288067008 18446744073709551615 134527524 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/27916/statm: 114588 1240 46 122 0 113488 0
[pid=27925] ppid=27781 vsize=622864 CPUtime=0.21 cores=0-7
/proc/27925/stat : 27925 (python) S 27781 27781 27755 0 -1 4202560 1217 0 0 0 11 10 0 0 19 0 2 0 668175978 637812736 6574 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/27925/statm: 155716 6574 401 364 0 91553 0
[pid=27927] ppid=27925 vsize=335996 CPUtime=99.67 cores=0-7
/proc/27927/stat : 27927 (iPAWS) T 27925 27927 27927 0 -1 4202496 1821 0 0 0 9967 0 0 0 25 0 1 0 668175978 344059904 1536 33554432000 134512640 135114423 4289598912 18446744073709551615 134514760 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/27927/statm: 83999 1536 59 147 0 83851 0
[pid=27925/tid=27933] ppid=27781 vsize=622864 CPUtime=0 cores=0-7
/proc/27925/task/27933/stat : 27933 (python) S 27781 27781 27755 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 668185999 637812736 6574 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 514 18446604444844249216 0 0 -1 3 0 0 0
[pid=27928] ppid=27781 vsize=633120 CPUtime=0.87 cores=0-7
/proc/27928/stat : 27928 (python) S 27781 27781 27755 0 -1 4202560 1253 0 0 0 41 46 0 0 17 0 2 0 668176769 648314880 6696 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/27928/statm: 158280 6696 406 364 0 94114 0
[pid=27930] ppid=27928 vsize=268424 CPUtime=393.89 cores=0-7
/proc/27930/stat : 27930 (hybridGM3) T 27928 27930 27930 0 -1 4202496 5421 0 0 0 39388 1 0 0 25 0 1 0 668176769 274866176 5127 33554432000 134512640 135204385 4293227184 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/27930/statm: 67106 5127 63 169 0 66936 0
[pid=27928/tid=27940] ppid=27781 vsize=633120 CPUtime=0 cores=0-7
/proc/27928/task/27940/stat : 27940 (python) S 27781 27781 27755 0 -1 4202560 98 0 0 0 0 0 0 0 18 0 2 0 668196416 648314880 6696 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 514 18446604444844251904 0 0 -1 4 0 0 0
[pid=27934] ppid=27781 vsize=643376 CPUtime=0.65 cores=0-7
/proc/27934/stat : 27934 (python) S 27781 27781 27755 0 -1 4202560 1041 0 0 0 34 31 0 0 18 0 1 0 668186005 658817024 6557 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 1605761965576126721 0 0 17 6 0 0 0
/proc/27934/statm: 160844 6557 379 364 0 96675 0
[pid=27936] ppid=27934 vsize=419780 CPUtime=307.56 cores=0-7
/proc/27936/stat : 27936 (NCVWr) R 27934 27936 27936 0 -1 4202496 1569 0 0 0 30756 0 0 0 25 0 1 0 668186006 429854720 1281 33554432000 134512640 135113558 4286806048 18446744073709551615 134534097 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/27936/statm: 104945 1281 58 147 0 103820 0
[pid=27944] ppid=27781 vsize=653632 CPUtime=0.21 cores=0-7
/proc/27944/stat : 27944 (python) S 27781 27781 27755 0 -1 4202560 1255 0 0 0 10 11 0 0 19 0 2 0 668206381 669319168 6574 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/27944/statm: 163408 6574 406 364 0 99236 0
[pid=27946] ppid=27944 vsize=335996 CPUtime=100.19 cores=0-7
/proc/27946/stat : 27946 (iPAWS) T 27944 27946 27946 0 -1 4202496 1829 0 0 0 10019 0 0 0 25 0 1 0 668206381 344059904 1535 33554432000 134512640 135114423 4289221360 18446744073709551615 134515630 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/27946/statm: 83999 1535 59 147 0 83851 0
[pid=27944/tid=27952] ppid=27781 vsize=653632 CPUtime=0 cores=0-7
/proc/27944/task/27952/stat : 27952 (python) S 27781 27781 27755 0 -1 4202560 99 0 0 0 0 0 0 0 19 0 2 0 668216402 669319168 6574 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 514 18446604453841881088 0 0 -1 6 0 0 0
[pid=27947] ppid=27781 vsize=663888 CPUtime=0.21 cores=0-7
/proc/27947/stat : 27947 (python) S 27781 27781 27755 0 -1 4202560 1058 0 0 0 11 10 0 0 18 0 1 0 668206468 679821312 6731 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 1605761965576126723 0 0 17 6 0 0 0
/proc/27947/statm: 165972 6731 378 364 0 101797 0
[pid=27949] ppid=27947 vsize=1019708 CPUtime=97.84 cores=0-7
/proc/27949/stat : 27949 (gnovelty+2) R 27947 27949 27949 0 -1 4202496 981 0 0 0 9784 0 0 0 25 0 1 0 668206468 1044180992 690 33554432000 134512640 135663704 4287934624 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/27949/statm: 254927 690 113 282 0 254643 0
[pid=27953] ppid=27781 vsize=674144 CPUtime=0 cores=0-7
/proc/27953/stat : 27953 (python) S 27781 27781 27755 0 -1 4202560 960 0 0 0 0 0 0 0 19 0 1 0 668216677 690323456 6662 33554432000 4194304 5683644 140736549211568 18446744073709551615 222921797190 0 0 16781312 514 15649807223901650943 0 0 17 6 0 0 0
/proc/27953/statm: 168536 6662 355 364 0 104358 0
[pid=27955] ppid=27953 vsize=268420 CPUtime=0.9 cores=0-7
/proc/27955/stat : 27955 (hybridGM3) R 27953 27955 27955 0 -1 4202496 5417 0 0 0 90 0 0 0 23 0 1 0 668216677 274862080 5125 33554432000 134512640 135204385 4292280256 18446744073709551615 134537792 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/27955/statm: 67105 5125 63 169 0 66935 0
[pid=27781/tid=27788] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27788/stat : 27788 (python) S 27779 27781 27755 0 -1 4202560 26 933 0 0 0 0 0 0 25 0 34 0 668097663 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27791] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27791/stat : 27791 (python) S 27779 27781 27755 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 34 0 668097666 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27794] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27794/stat : 27794 (python) S 27779 27781 27755 0 -1 4202560 42 933 0 0 0 0 0 0 15 0 34 0 668097669 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27797] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27797/stat : 27797 (python) S 27779 27781 27755 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 34 0 668097672 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 2 0 0 0
[pid=27781/tid=27800] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27800/stat : 27800 (python) S 27779 27781 27755 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 34 0 668097675 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 2 0 0 0
[pid=27781/tid=27803] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27803/stat : 27803 (python) S 27779 27781 27755 0 -1 4202560 26 933 0 0 0 0 0 0 22 0 34 0 668097679 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 7 0 0 0
[pid=27781/tid=27806] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27806/stat : 27806 (python) S 27779 27781 27755 0 -1 4202560 106 933 0 0 0 0 0 0 18 0 34 0 668097682 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27809] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27809/stat : 27809 (python) S 27779 27781 27755 0 -1 4202560 39 933 0 0 0 0 0 0 18 0 34 0 668097685 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27817] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27817/stat : 27817 (python) S 27779 27781 27755 0 -1 4202560 48 933 0 0 0 0 0 0 18 0 34 0 668107688 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27821] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27821/stat : 27821 (python) S 27779 27781 27755 0 -1 4202560 42 933 0 0 0 0 0 0 18 0 34 0 668107691 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27825] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27825/stat : 27825 (python) S 27779 27781 27755 0 -1 4202560 50 933 0 0 0 0 0 0 18 0 34 0 668107695 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 2 0 0 0
[pid=27781/tid=27828] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27828/stat : 27828 (python) S 27779 27781 27755 0 -1 4202560 33 933 0 0 0 0 0 0 25 0 34 0 668107699 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27832] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27832/stat : 27832 (python) S 27779 27781 27755 0 -1 4202560 38 933 0 0 0 0 0 0 17 0 34 0 668107704 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 3 0 0 0
[pid=27781/tid=27837] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27837/stat : 27837 (python) S 27779 27781 27755 0 -1 4202560 52 933 0 0 0 0 0 0 18 0 34 0 668107709 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 7 0 0 0
[pid=27781/tid=27840] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27840/stat : 27840 (python) S 27779 27781 27755 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 34 0 668107713 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27843] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27843/stat : 27843 (python) S 27779 27781 27755 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 34 0 668107718 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27851] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27851/stat : 27851 (python) S 27779 27781 27755 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 34 0 668117710 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 0 0 0 0
[pid=27781/tid=27854] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27854/stat : 27854 (python) S 27779 27781 27755 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 34 0 668117716 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27875] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27875/stat : 27875 (python) S 27779 27781 27755 0 -1 4202560 43 933 0 0 0 0 0 0 20 0 34 0 668127740 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 1 0 0 0
[pid=27781/tid=27881] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27881/stat : 27881 (python) S 27779 27781 27755 0 -1 4202560 42 933 0 0 0 0 0 0 18 0 34 0 668136916 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 1 0 0 0
[pid=27781/tid=27884] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27884/stat : 27884 (python) S 27779 27781 27755 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 668137080 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27887] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27887/stat : 27887 (python) S 27779 27781 27755 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 668137488 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27890] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27890/stat : 27890 (python) S 27779 27781 27755 0 -1 4202560 31 933 0 0 0 0 0 0 19 0 34 0 668137782 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27900] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27900/stat : 27900 (python) S 27779 27781 27755 0 -1 4202560 37 933 0 0 0 0 0 0 19 0 34 0 668147292 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27904] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27904/stat : 27904 (python) S 27779 27781 27755 0 -1 4202560 48 933 0 0 0 0 0 0 18 0 34 0 668147514 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27910] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27910/stat : 27910 (python) S 27779 27781 27755 0 -1 4202560 34 933 0 0 0 0 0 0 19 0 34 0 668156515 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27915] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27915/stat : 27915 (python) S 27779 27781 27755 0 -1 4202560 34 933 0 0 0 0 0 0 20 0 34 0 668157328 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27926] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27926/stat : 27926 (python) S 27779 27781 27755 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 668175978 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 1 0 0 0
[pid=27781/tid=27929] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27929/stat : 27929 (python) S 27779 27781 27755 0 -1 4202560 45 933 0 0 0 0 0 0 18 0 34 0 668176769 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27935] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27935/stat : 27935 (python) S 27779 27781 27755 0 -1 4202560 34 933 0 0 0 0 0 0 20 0 34 0 668186005 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 1 0 0 0
[pid=27781/tid=27945] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27945/stat : 27945 (python) S 27779 27781 27755 0 -1 4202560 40 933 0 0 0 0 0 0 20 0 34 0 668206381 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 1 0 0 0
[pid=27781/tid=27948] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27948/stat : 27948 (python) S 27779 27781 27755 0 -1 4202560 32 933 0 0 0 0 0 0 20 0 34 0 668206468 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
[pid=27781/tid=27954] ppid=27779 vsize=684388 CPUtime=0 cores=0-7
/proc/27781/task/27954/stat : 27954 (python) S 27779 27781 27755 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 668216677 700813312 8253 33554432000 4194304 5683644 140736549211568 18446744073709551615 222933600689 0 0 16781312 2 18446604449367303296 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 9488.9
Current children cumulated vsize (KiB) 32261668

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 27781 and gives
#  childrusage.ru_utime.tv_sec=2687
#  childrusage.ru_utime.tv_usec=620419
#  childrusage.ru_stime.tv_sec=8
#  childrusage.ru_stime.tv_usec=891648
# CPU time returned by wait4() is 2696.51
# while last known CPU time is 9488.9
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1193.6
CPU time (s): 9488.9
CPU user time (s): 9479.63
CPU system time (s): 9.27
CPU usage (%): 794.979
Max. virtual memory (cumulated for all children) (KiB): 32261668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2687.62
system time used= 8.89165
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 95435
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13319
involuntary context switches= 21446

runsolver used 11.0603 second user time and 27.7018 second system time

The end

Launcher Data 

Begin job on node109 at 2011-05-16 18:56:07
IDJOB=3385277
IDBENCH=82542
IDSOLVER=1870
FILE ID=node109/3385277-1305564966
RUNJOBID= node109-1305564966-27769
PBS_JOBID= 13350141
Free space on /tmp= 73192 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S942666749-061-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385277-1305564966/watcher-3385277-1305564966 -o /tmp/evaluation-result-3385277-1305564966/solver-3385277-1305564966 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385277-1305564966.cnf -seed 1960073158 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 456ae67a44e812130272597099547869
RANDOM SEED=1960073158

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22226604 kB
Buffers:        290240 kB
Cached:        2927848 kB
SwapCached:      28404 kB
Active:        1777268 kB
Inactive:      8716348 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22226604 kB
SwapTotal:    67111528 kB
SwapFree:     61559568 kB
Dirty:           32592 kB
Writeback:           4 kB
AnonPages:     7253784 kB
Mapped:          18780 kB
Slab:           133996 kB
PageTables:      33544 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 19351216 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73160 MiB
End job on node109 at 2011-05-16 19:16:02