Trace number 3385374

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 9876.24 1395.02

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1500-c30000-S377999798-061-UNKNOWN.cnf
MD5SUMa4ba28fb1550ba8a4eca95d91f4669c6
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark214.322
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of clauses30000
Sum of the clauses size150000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530000
Number of clauses of size over 50

Solver Data 

0.38/0.66	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.38/0.67	c INFO: solving HOME/instance-3385374-1305565995.cnf
0.38/0.67	c INFO: computing task features
0.56/0.82	c INFO: computed variable-clause graph statistics
0.56/0.82	c INFO: computed clause balance statistics
1.36/1.64	c INFO: computed variable balance statistics
1.86/2.10	c INFO: computed small-clause counts
1.86/2.10	c INFO: computed Horn-clause counts
1.86/2.13	c INFO: computed variable graph statistics
1.86/2.13	c INFO: collected features for HOME/instance-3385374-1305565995.cnf in 1.46 s
1.86/2.16	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.38)
1.86/2.19	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.14)
2.01/2.22	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.09)
2.01/2.26	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
2.01/2.29	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.06)
2.20/2.32	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.05)
2.20/2.35	c INFO: running FH@0 for 97 with 4998 remaining (b = 0.04)
2.20/2.39	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.03)
707.84/102.58	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.03)
709.25/102.79	c INFO: running FH@0 for 97 with 4897 remaining (b = 0.02)
753.40/108.63	c INFO: running hybridGM3@0 for 194 with 4892 remaining (b = 0.04)
754.72/108.83	c INFO: running gnovelty+2@0 for 97 with 4891 remaining (b = 0.02)
795.16/114.65	c INFO: running hybridGM3@0 for 194 with 4886 remaining (b = 0.03)
879.49/126.76	c INFO: running hybridGM3@0 for 194 with 4873 remaining (b = 0.03)
880.20/126.81	c INFO: running TNM@0 for 1552 with 4873 remaining (b = 0.21)
908.87/130.99	c INFO: running adaptg2wsat2009++@0 for 97 with 4869 remaining (b = 0.02)
1441.36/202.22	c INFO: running FH@0 for 97 with 4798 remaining (b = 0.01)
1494.46/209.32	c INFO: running hybridGM3@0 for 194 with 4791 remaining (b = 0.02)
1626.85/227.09	c INFO: running adaptg2wsat2009++@0 for 97 with 4773 remaining (b = 0.01)
1916.76/267.53	c INFO: running adaptg2wsat2009++@100 for 97 with 4733 remaining (b = 0.01)
2224.69/311.55	c INFO: running hybridGM3@97 for 97 with 4689 remaining (b = 0.01)
2307.49/322.65	c INFO: running hybridGM3@102 for 97 with 4678 remaining (b = 0.01)
2308.22/322.70	c INFO: running hybridGM3@101 for 97 with 4678 remaining (b = 0.01)
2338.19/326.74	c INFO: running gnovelty+2@0 for 97 with 4673 remaining (b = 0.01)
2366.18/330.52	c INFO: running hybridGM3@0 for 194 with 4670 remaining (b = 0.02)
2647.56/370.97	c INFO: running hybridGM3@0 for 194 with 4629 remaining (b = 0.02)
3031.77/424.08	c INFO: running hybridGM3@297 for 97 with 4576 remaining (b = 0.01)
3032.52/424.14	c INFO: running TNM@0 for 1552 with 4576 remaining (b = 0.14)
3085.59/431.30	c INFO: running adaptg2wsat2009++@0 for 97 with 4569 remaining (b = 0.01)
3125.85/437.07	c INFO: running hybridGM3@296 for 97 with 4563 remaining (b = 0.01)
3204.56/448.38	c INFO: running hybridGM3@97 for 97 with 4552 remaining (b = 0.01)
3742.27/525.51	c INFO: running hybridGM3@394 for 97 with 4475 remaining (b = 0.01)
3806.50/534.75	c INFO: running adaptg2wsat2009++@0 for 97 with 4465 remaining (b = 0.01)
3880.93/545.48	c INFO: running adaptg2wsat2009++@97 for 97 with 4455 remaining (b = 0.01)
3958.32/556.56	c INFO: running iPAWS@0 for 97 with 4444 remaining (b = 0.01)
3995.22/561.85	c INFO: running hybridGM3@95 for 97 with 4438 remaining (b = 0.01)
4470.98/628.18	c INFO: running hybridGM3@92 for 97 with 4372 remaining (b = 0.01)
4586.95/644.05	c INFO: running hybridGM3@0 for 194 with 4356 remaining (b = 0.02)
4633.27/650.25	c INFO: running FH@0 for 291 with 4350 remaining (b = 0.03)
4728.95/663.03	c INFO: running adaptg2wsat2009++@294 for 291 with 4337 remaining (b = 0.03)
4758.79/667.00	c INFO: running FH@99 for 291 with 4333 remaining (b = 0.03)
4788.94/671.34	c INFO: running hybridGM3@291 for 97 with 4329 remaining (b = 0.01)
5236.07/735.63	c INFO: running iPAWS@0 for 97 with 4265 remaining (b = 0.01)
5545.50/778.83	c INFO: running hybridGM3@389 for 97 with 4221 remaining (b = 0.01)
6064.36/852.99	c INFO: running hybridGM3@191 for 97 with 4147 remaining (b = 0.01)
6338.52/892.31	c INFO: running gnovelty+2@0 for 97 with 4108 remaining (b = 0.01)
6394.14/900.34	c INFO: running hybridGM3@95 for 97 with 4100 remaining (b = 0.01)
6807.75/956.44	c INFO: running hybridGM3@0 for 194 with 4044 remaining (b = 0.01)
6939.41/975.21	c INFO: running TNM@0 for 1552 with 4025 remaining (b = 0.11)
6976.97/980.61	c INFO: running FH@200 for 194 with 4020 remaining (b = 0.01)
7112.74/998.88	c INFO: running adaptg2wsat2009++@99 for 97 with 4001 remaining (b = 0.01)
7182.25/1008.87	c INFO: running hybridGM3@191 for 97 with 3991 remaining (b = 0.01)
7187.71/1009.63	c INFO: running adaptg2wsat2009++@396 for 194 with 3991 remaining (b = 0.01)
7903.38/1112.37	c INFO: running hybridGM3@481 for 97 with 3888 remaining (b = 0.01)
8072.80/1136.53	c INFO: running NCVWr@0 for 485 with 3864 remaining (b = 0.03)
8321.91/1171.43	c INFO: running FH@0 for 97 with 3829 remaining (b = 0.01)
8552.10/1204.56	c INFO: running FH@298 for 97 with 3796 remaining (b = 0.01)
8838.41/1245.73	c INFO: running adaptg2wsat2009++@487 for 97 with 3754 remaining (b = 0.01)
8839.80/1245.99	c INFO: running adaptg2wsat2009++@97 for 97 with 3754 remaining (b = 0.01)
9063.15/1277.90	c INFO: running FH@195 for 194 with 3722 remaining (b = 0.01)
9342.60/1318.05	c INFO: running iPAWS@0 for 97 with 3682 remaining (b = 0.01)
9540.09/1346.50	c INFO: running iPAWS@0 for 97 with 3654 remaining (b = 0.01)
9872.57/1394.37	c INFO: running hybridGM3@0 for 194 with 3606 remaining (b = 0.01)
9876.24/1395.01	c INFO: running hybridGM3@0 for 194 with 3605 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385374-1305565995/watcher-3385374-1305565995 -o /tmp/evaluation-result-3385374-1305565995/solver-3385374-1305565995 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385374-1305565995.cnf -seed 825455913 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.89 8.34 5.58 2/465 16678
/proc/meminfo: memFree=19816000/32951124 swapFree=56449236/67111528
[pid=16678] ppid=16676 vsize=16240 CPUtime=0 cores=0-7
/proc/16678/stat : 16678 (python) R 16676 16678 16377 0 -1 4202496 1014 0 0 0 0 0 0 0 25 0 1 0 668199940 16629760 887 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640859392 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/16678/statm: 4060 892 372 364 0 547 0

[startup+0.115203 s]
/proc/loadavg: 8.89 8.34 5.58 2/465 16678
/proc/meminfo: memFree=19816000/32951124 swapFree=56449236/67111528
[pid=16678] ppid=16676 vsize=99372 CPUtime=0.07 cores=0-7
/proc/16678/stat : 16678 (python) R 16676 16678 16377 0 -1 4202496 2884 0 0 0 5 2 0 0 25 0 1 0 668199940 101756928 2581 33554432000 4194304 5683644 140734382927504 18446744073709551615 47002611541280 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/16678/statm: 24843 2583 831 364 0 1694 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 99372

[startup+0.201187 s]
/proc/loadavg: 8.89 8.34 5.58 2/465 16678
/proc/meminfo: memFree=19816000/32951124 swapFree=56449236/67111528
[pid=16678] ppid=16676 vsize=124236 CPUtime=0.12 cores=0-7
/proc/16678/stat : 16678 (python) S 16676 16678 16377 0 -1 4202496 4312 0 1 0 9 3 0 0 25 0 1 0 668199940 127217664 3880 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640859392 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/16678/statm: 31059 3880 997 364 0 2870 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 124236

[startup+0.301202 s]
/proc/loadavg: 8.89 8.34 5.58 2/465 16678
/proc/meminfo: memFree=19816000/32951124 swapFree=56449236/67111528
[pid=16678] ppid=16676 vsize=135748 CPUtime=0.19 cores=0-7
/proc/16678/stat : 16678 (python) R 16676 16678 16377 0 -1 4202496 5959 937 1 0 14 5 0 0 17 0 1 0 668199940 139005952 4151 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640855557 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/16678/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.70112 s]
/proc/loadavg: 8.89 8.34 5.58 2/465 16678
/proc/meminfo: memFree=19816000/32951124 swapFree=56449236/67111528
[pid=16678] ppid=16676 vsize=280956 CPUtime=0.46 cores=0-7
/proc/16678/stat : 16678 (python) R 16676 16678 16377 0 -1 4202496 9883 937 1 0 34 12 0 0 16 0 1 0 668199940 287698944 7570 33554432000 4194304 5683644 140734382927504 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/16678/statm: 70239 7570 1761 364 0 6163 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 280956

[startup+1.50095 s]
/proc/loadavg: 8.89 8.34 5.58 3/466 16683
/proc/meminfo: memFree=19784372/32951124 swapFree=56449236/67111528
[pid=16678] ppid=16676 vsize=287584 CPUtime=1.26 cores=0-7
/proc/16678/stat : 16678 (python) R 16676 16678 16377 0 -1 4202496 12676 937 1 0 114 12 0 0 17 0 1 0 668199940 294486016 9281 33554432000 4194304 5683644 140734382927504 18446744073709551615 4533102 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/16678/statm: 71896 9281 1826 364 0 7820 0
Current children cumulated CPU time (s) 1.26
Current children cumulated vsize (KiB) 287584

[startup+3.10063 s]
/proc/loadavg: 8.34 8.23 5.56 5/471 16688
/proc/meminfo: memFree=19782596/32951124 swapFree=56449236/67111528
[pid=16678] ppid=16676 vsize=365064 CPUtime=2.14 cores=0-7
/proc/16678/stat : 16678 (python) S 16676 16678 16377 0 -1 4202496 19200 937 1 0 200 14 0 0 25 0 9 0 668199940 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/16678/statm: 91266 8233 1891 364 0 27163 0
[pid=16684] ppid=16678 vsize=283512 CPUtime=0 cores=0-7
/proc/16684/stat : 16684 (python) S 16678 16678 16377 0 -1 4202560 735 0 0 0 0 0 0 0 19 0 1 0 668200157 290316288 6583 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879631 0 0 16781312 514 13639235038670225407 0 0 17 2 0 0 0
/proc/16684/statm: 70878 6583 355 364 0 6796 0
[pid=16686] ppid=16684 vsize=1018996 CPUtime=0.92 cores=0-7
/proc/16686/stat : 16686 (gnovelty+2) R 16684 16686 16686 0 -1 4202496 959 0 0 0 92 0 0 0 23 0 1 0 668200158 1043451904 698 33554432000 134512640 135663704 4287468736 18446744073709551615 134544212 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/16686/statm: 254749 698 113 282 0 254465 0
[pid=16687] ppid=16678 vsize=293700 CPUtime=0 cores=0-7
/proc/16687/stat : 16687 (python) S 16678 16678 16377 0 -1 4202560 737 0 0 0 0 0 0 0 19 0 1 0 668200160 300748800 6664 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 6464112701751689215 0 0 17 2 0 0 0
/proc/16687/statm: 73425 6664 349 364 0 9340 0
[pid=16678/tid=16685] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16685/stat : 16685 (python) S 16676 16678 16377 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 9 0 668200157 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16688] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16688/stat : 16688 (python) S 16676 16678 16377 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 9 0 668200161 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 1961272

[startup+6.30104 s]
/proc/loadavg: 8.34 8.23 5.56 10/490 16707
/proc/meminfo: memFree=19713996/32951124 swapFree=56449236/67111528
[pid=16678] ppid=16676 vsize=365064 CPUtime=2.14 cores=0-7
/proc/16678/stat : 16678 (python) S 16676 16678 16377 0 -1 4202496 19200 937 1 0 200 14 0 0 25 0 9 0 668199940 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/16678/statm: 91266 8233 1891 364 0 27163 0
[pid=16684] ppid=16678 vsize=283512 CPUtime=0.01 cores=0-7
/proc/16684/stat : 16684 (python) S 16678 16678 16377 0 -1 4202560 901 0 0 0 0 1 0 0 18 0 1 0 668200157 290316288 6606 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879631 0 0 16781312 514 13639235038670192899 0 0 17 2 0 0 0
/proc/16684/statm: 70878 6606 378 364 0 6796 0
[pid=16686] ppid=16684 vsize=1018996 CPUtime=4.12 cores=0-7
/proc/16686/stat : 16686 (gnovelty+2) R 16684 16686 16686 0 -1 4202496 959 0 0 0 412 0 0 0 25 0 1 0 668200158 1043451904 698 33554432000 134512640 135663704 4287468736 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/16686/statm: 254749 698 113 282 0 254465 0
[pid=16687] ppid=16678 vsize=293700 CPUtime=0.02 cores=0-7
/proc/16687/stat : 16687 (python) S 16678 16678 16377 0 -1 4202560 902 0 0 0 1 1 0 0 18 0 1 0 668200160 300748800 6687 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 6464112701751656705 0 0 17 2 0 0 0
/proc/16687/statm: 73425 6687 372 364 0 9340 0
[pid=16689] ppid=16687 vsize=1018996 CPUtime=4.09 cores=0-7
/proc/16689/stat : 16689 (gnovelty+2) R 16687 16689 16689 0 -1 4202496 961 0 0 0 409 0 0 0 25 0 1 0 668200161 1043451904 698 33554432000 134512640 135663704 4291871888 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16689/statm: 254749 698 113 282 0 254465 0
[pid=16690] ppid=16678 vsize=303956 CPUtime=0.01 cores=0-7
/proc/16690/stat : 16690 (python) S 16678 16678 16377 0 -1 4202560 893 0 0 0 0 1 0 0 18 0 1 0 668200163 311250944 6691 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 74913030030196995 0 0 17 0 0 0 0
/proc/16690/statm: 75989 6691 372 364 0 11901 0
[pid=16692] ppid=16690 vsize=421428 CPUtime=4.02 cores=0-7
/proc/16692/stat : 16692 (adaptg2wsat2009) R 16690 16692 16692 0 -1 4202496 2049 0 0 0 402 0 0 0 25 0 1 0 668200164 431542272 1782 33554432000 134512640 135107411 4288673600 18446744073709551615 134531582 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/16692/statm: 105357 1782 59 146 0 104233 0
[pid=16693] ppid=16678 vsize=314212 CPUtime=0.02 cores=0-7
/proc/16693/stat : 16693 (python) S 16678 16678 16377 0 -1 4202560 938 0 0 0 1 1 0 0 18 0 1 0 668200167 321753088 6695 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 6464116550042353924 0 0 17 1 0 0 0
/proc/16693/statm: 78553 6695 372 364 0 14462 0
[pid=16695] ppid=16693 vsize=421428 CPUtime=3.97 cores=0-7
/proc/16695/stat : 16695 (adaptg2wsat2009) R 16693 16695 16695 0 -1 4202496 2047 0 0 0 397 0 0 0 25 0 1 0 668200167 431542272 1782 33554432000 134512640 135107411 4291338400 18446744073709551615 134531856 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/16695/statm: 105357 1782 59 146 0 104233 0
[pid=16696] ppid=16678 vsize=324468 CPUtime=0 cores=0-7
/proc/16696/stat : 16696 (python) R 16678 16678 16377 0 -1 4202560 928 0 0 0 0 0 0 0 18 0 1 0 668200170 332255232 6693 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640902791 0 0 16781312 514 0 0 0 17 4 0 0 0
/proc/16696/statm: 81118 6693 366 364 0 17024 0
[pid=16698] ppid=16696 vsize=421428 CPUtime=3.97 cores=0-7
/proc/16698/stat : 16698 (adaptg2wsat2009) R 16696 16698 16698 0 -1 4202496 2047 0 0 0 397 0 0 0 25 0 1 0 668200170 431542272 1782 33554432000 134512640 135107411 4287345536 18446744073709551615 134531401 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/16698/statm: 105357 1782 59 146 0 104233 0
[pid=16699] ppid=16678 vsize=334724 CPUtime=0 cores=0-7
/proc/16699/stat : 16699 (python) S 16678 16678 16377 0 -1 4202560 762 0 0 0 0 0 0 0 18 0 1 0 668200173 342757376 6680 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 8952008173368082692 0 0 17 0 0 0 0
/proc/16699/statm: 83681 6680 349 364 0 19584 0
[pid=16701] ppid=16699 vsize=1018996 CPUtime=2.01 cores=0-7
/proc/16701/stat : 16701 (gnovelty+2) R 16699 16701 16701 0 -1 4202496 964 0 0 0 201 0 0 0 25 0 1 0 668200173 1043451904 698 33554432000 134512640 135663704 4294064096 18446744073709551615 134545646 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/16701/statm: 254749 698 113 282 0 254465 0
[pid=16702] ppid=16678 vsize=344980 CPUtime=0 cores=0-7
/proc/16702/stat : 16702 (python) S 16678 16678 16377 0 -1 4202560 769 0 0 0 0 0 0 0 18 0 1 0 668200176 353259520 6684 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 2876137154847670531 0 0 17 4 0 0 0
/proc/16702/statm: 86245 6684 349 364 0 22145 0
[pid=16704] ppid=16702 vsize=251292 CPUtime=1.9 cores=0-7
/proc/16704/stat : 16704 (FH) R 16702 16704 16704 0 -1 4202496 1947 0 0 0 190 0 0 0 25 0 1 0 668200179 257323008 1683 33554432000 134512640 134936988 4287844192 18446744073709551615 134553505 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/16704/statm: 62823 1683 41 104 0 62327 0
[pid=16705] ppid=16678 vsize=355236 CPUtime=0 cores=0-7
/proc/16705/stat : 16705 (python) S 16678 16678 16377 0 -1 4202560 798 0 0 0 0 0 0 0 18 0 1 0 668200180 363761664 6694 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 17881437321409036546 0 0 17 4 0 0 0
/proc/16705/statm: 88809 6694 355 364 0 24706 0
[pid=16707] ppid=16705 vsize=421428 CPUtime=3.88 cores=0-7
/proc/16707/stat : 16707 (adaptg2wsat2009) R 16705 16707 16707 0 -1 4202496 2054 0 0 0 388 0 0 0 25 0 1 0 668200180 431542272 1781 33554432000 134512640 135107411 4290775984 18446744073709551615 134531604 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/16707/statm: 105357 1781 59 146 0 104233 0
[pid=16678/tid=16685] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16685/stat : 16685 (python) S 16676 16678 16377 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 9 0 668200157 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16688] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16688/stat : 16688 (python) S 16676 16678 16377 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 9 0 668200161 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16691] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16691/stat : 16691 (python) S 16676 16678 16377 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 9 0 668200164 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 0 0 0 0
[pid=16678/tid=16694] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16694/stat : 16694 (python) S 16676 16678 16377 0 -1 4202560 24 937 0 0 0 0 0 0 19 0 9 0 668200167 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 0 0 0 0
[pid=16678/tid=16697] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16697/stat : 16697 (python) S 16676 16678 16377 0 -1 4202560 28 937 0 0 0 0 0 0 21 0 9 0 668200170 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 0 0 0 0
[pid=16678/tid=16700] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16700/stat : 16700 (python) S 16676 16678 16377 0 -1 4202560 25 937 0 0 0 0 0 0 23 0 9 0 668200173 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 0 0 0 0
[pid=16678/tid=16703] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16703/stat : 16703 (python) S 16676 16678 16377 0 -1 4202560 24 937 0 0 0 0 0 0 25 0 9 0 668200176 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 4 0 0 0
[pid=16678/tid=16706] ppid=16676 vsize=365064 CPUtime=0 cores=0-7
/proc/16678/task/16706/stat : 16706 (python) S 16676 16678 16377 0 -1 4202560 31 937 0 0 0 0 0 0 25 0 9 0 668200180 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 30.16
Current children cumulated vsize (KiB) 7913844

[startup+12.7019 s]
/proc/loadavg: 8.44 8.26 5.60 10/490 16707
/proc/meminfo: memFree=19712796/32951124 swapFree=56449236/67111528
[pid=16678] ppid=16676 vsize=365064 CPUtime=2.14 cores=0-7
/proc/16678/stat : 16678 (python) S 16676 16678 16377 0 -1 4202496 19200 937 1 0 200 14 0 0 25 0 9 0 668199940 373825536 8233 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/16678/statm: 91266 8233 1891 364 0 27163 0
[pid=16684] ppid=16678 vsize=283512 CPUtime=0.04 cores=0-7
/proc/16684/stat : 16684 (python) S 16678 16678 16377 0 -1 4202560 903 0 0 0 2 2 0 0 18 0 1 0 668200157 290316288 6606 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879631 0 0 16781312 514 11739934250508452099 0 0 17 2 0 0 0
/proc/16684/statm: 70878 6606 378 364 0 6796 0
[pid=16686] ppid=16684 vsize=1018996 CPUtime=10.52 cores=0-7
/proc/16686/stat : 16686 (gnovelty+2) R 16684 16686 16686 0 -1 4202496 959 0 0 0 1052 0 0 0 25 0 1 0 668200158 1043451904 698 33554432000 134512640 135663704 4287468736 18446744073709551615 134525342 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/16686/statm: 254749 698 113 282 0 254465 0
[pid=16687] ppid=16678 vsize=293700 CPUtime=0.04 cores=0-7
/proc/16687/stat : 16687 (python) S 16678 16678 16377 0 -1 4202560 906 0 0 0 2 2 0 0 18 0 1 0 668200160 300748800 6687 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 11739934250508452097 0 0 17 2 0 0 0
/proc/16687/statm: 73425 6687 372 364 0 9340 0
[pid=16689] ppid=16687 vsize=1018996 CPUtime=10.49 cores=0-7
/proc/16689/stat : 16689 (gnovelty+2) R 16687 16689 16689 0 -1 4202496 961 0 0 0 1049 0 0 0 25 0 1 0 668200161 1043451904 698 33554432000 134512640 135663704 4291871888 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16689/statm: 254749 698 113 282 0 254465 0
[pid=16690] ppid=16678 vsize=303956 CPUtime=0.04 cores=0-7
/proc/16690/stat : 16690 (python) S 16678 16678 16377 0 -1 4202560 895 0 0 0 2 2 0 0 18 0 1 0 668200163 311250944 6691 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 11739934250508452099 0 0 17 0 0 0 0
/proc/16690/statm: 75989 6691 372 364 0 11901 0
[pid=16692] ppid=16690 vsize=421428 CPUtime=10.38 cores=0-7
/proc/16692/stat : 16692 (adaptg2wsat2009) R 16690 16692 16692 0 -1 4202496 2049 0 0 0 1038 0 0 0 25 0 1 0 668200164 431542272 1782 33554432000 134512640 135107411 4288673600 18446744073709551615 134539223 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/16692/statm: 105357 1782 59 146 0 104233 0
[pid=16693] ppid=16678 vsize=314212 CPUtime=0.04 cores=0-7
/proc/16693/stat : 16693 (python) S 16678 16678 16377 0 -1 4202560 941 0 0 0 2 2 0 0 18 0 1 0 668200167 321753088 6695 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 11739934250508452100 0 0 17 1 0 0 0
/proc/16693/statm: 78553 6695 372 364 0 14462 0
[pid=16695] ppid=16693 vsize=421428 CPUtime=10.25 cores=0-7
/proc/16695/stat : 16695 (adaptg2wsat2009) R 16693 16695 16695 0 -1 4202496 2047 0 0 0 1025 0 0 0 25 0 1 0 668200167 431542272 1782 33554432000 134512640 135107411 4291338400 18446744073709551615 134531724 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/16695/statm: 105357 1782 59 146 0 104233 0
[pid=16696] ppid=16678 vsize=324468 CPUtime=0.04 cores=0-7
/proc/16696/stat : 16696 (python) S 16678 16678 16377 0 -1 4202560 949 0 0 0 2 2 0 0 18 0 1 0 668200170 332255232 6699 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 11739934250508452100 0 0 17 4 0 0 0

################
# More data... #
################

/proc/16772/stat : 16772 (hybridGM3) T 16770 16772 16772 0 -1 4202496 5823 0 0 0 39123 1 0 0 25 0 1 0 668237040 274862080 5543 33554432000 134512640 135204385 4294677776 18446744073709551615 134538264 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/16772/statm: 67105 5543 63 169 0 66935 0
[pid=16770/tid=16789] ppid=16678 vsize=555136 CPUtime=0 cores=0-7
/proc/16770/task/16789/stat : 16789 (python) S 16678 16678 16377 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 668262752 568459264 7182 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 514 18446604469284524992 0 0 -1 1 0 0 0
[pid=16774] ppid=16678 vsize=564616 CPUtime=3.76 cores=0-7
/proc/16774/stat : 16774 (python) S 16678 16678 16377 0 -1 4202560 979 0 0 0 197 179 0 0 18 0 1 0 668242355 578166784 7248 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 11739934250508452101 0 0 17 4 0 0 0
/proc/16774/statm: 141154 7248 379 364 0 77009 0
[pid=16776] ppid=16774 vsize=459768 CPUtime=906.01 cores=0-7
/proc/16776/stat : 16776 (TNM) R 16774 16776 16776 0 -1 4202496 1934 0 0 0 90601 0 0 0 25 0 1 0 668242355 470802432 1654 33554432000 134512640 135008748 4293222672 18446744073709551615 134527773 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/16776/statm: 114942 1654 46 122 0 113842 0
[pid=16784] ppid=16678 vsize=574872 CPUtime=0.41 cores=0-7
/proc/16784/stat : 16784 (python) S 16678 16678 16377 0 -1 4202560 1179 0 0 0 22 19 0 0 19 0 2 0 668255597 588668928 7285 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/16784/statm: 143718 7285 407 364 0 79570 0
[pid=16786] ppid=16784 vsize=335996 CPUtime=100.17 cores=0-7
/proc/16786/stat : 16786 (iPAWS) T 16784 16786 16786 0 -1 4202496 1826 0 0 0 10017 0 0 0 25 0 1 0 668255598 344059904 1546 33554432000 134512640 135114423 4293128672 18446744073709551615 134514760 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/16786/statm: 83999 1546 59 147 0 83851 0
[pid=16784/tid=16794] ppid=16678 vsize=574872 CPUtime=0 cores=0-7
/proc/16784/task/16794/stat : 16794 (python) S 16678 16678 16377 0 -1 4202560 102 0 0 0 0 0 0 0 19 0 2 0 668266238 588668928 7285 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 514 18446604469507493952 0 0 -1 5 0 0 0
[pid=16790] ppid=16678 vsize=585128 CPUtime=2.22 cores=0-7
/proc/16790/stat : 16790 (python) S 16678 16678 16377 0 -1 4202560 1206 0 0 0 113 109 0 0 15 0 2 0 668264346 599171072 7382 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/16790/statm: 146282 7382 406 364 0 82131 0
[pid=16792] ppid=16790 vsize=268424 CPUtime=486.82 cores=0-7
/proc/16792/stat : 16792 (hybridGM3) T 16790 16792 16792 0 -1 4202496 5828 0 0 0 48681 1 0 0 25 0 1 0 668264346 274866176 5544 33554432000 134512640 135204385 4289871904 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/16792/statm: 67106 5544 63 169 0 66936 0
[pid=16790/tid=16803] ppid=16678 vsize=585128 CPUtime=0 cores=0-7
/proc/16790/task/16803/stat : 16803 (python) S 16678 16678 16377 0 -1 4202560 107 0 0 0 0 0 0 0 18 0 2 0 668285234 599171072 7382 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 514 18446604465890373760 0 0 -1 5 0 0 0
[pid=16797] ppid=16678 vsize=596072 CPUtime=0.64 cores=0-7
/proc/16797/stat : 16797 (python) S 16678 16678 16377 0 -1 4202560 1248 0 0 0 32 32 0 0 19 0 2 0 668273504 610377728 7217 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/16797/statm: 149018 7217 401 364 0 84864 0
[pid=16799] ppid=16797 vsize=335996 CPUtime=101.86 cores=0-7
/proc/16799/stat : 16799 (iPAWS) T 16797 16799 16799 0 -1 4202496 1833 0 0 0 10186 0 0 0 25 0 1 0 668273504 344059904 1547 33554432000 134512640 135114423 4290064256 18446744073709551615 134546177 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/16799/statm: 83999 1547 59 147 0 83851 0
[pid=16797/tid=16808] ppid=16678 vsize=596072 CPUtime=0 cores=0-7
/proc/16797/task/16808/stat : 16808 (python) S 16678 16678 16377 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 668289969 610377728 7217 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 514 18446604465890375552 0 0 -1 1 0 0 0
[pid=16805] ppid=16678 vsize=606044 CPUtime=0.4 cores=0-7
/proc/16805/stat : 16805 (python) S 16678 16678 16377 0 -1 4202560 1256 0 0 0 21 19 0 0 19 0 2 0 668289172 620589056 7271 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/16805/statm: 151511 7271 401 364 0 87354 0
[pid=16807] ppid=16805 vsize=1018996 CPUtime=97.87 cores=0-7
/proc/16807/stat : 16807 (gnovelty+2) T 16805 16807 16807 0 -1 4202496 985 0 0 0 9786 1 0 0 25 0 1 0 668289173 1043451904 697 33554432000 134512640 135663704 4289553376 18446744073709551615 134546971 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/16807/statm: 254749 697 113 282 0 254465 0
[pid=16805/tid=16818] ppid=16678 vsize=606044 CPUtime=0 cores=0-7
/proc/16805/task/16818/stat : 16818 (python) S 16678 16678 16377 0 -1 4202560 70 0 0 0 0 0 0 0 19 0 2 0 668299823 620589056 7271 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 514 18446604465890374656 0 0 -1 7 0 0 0
[pid=16811] ppid=16678 vsize=616644 CPUtime=0.82 cores=0-7
/proc/16811/stat : 16811 (python) S 16678 16678 16377 0 -1 4202560 1253 0 0 0 43 39 0 0 19 0 2 0 668295585 631443456 7292 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/16811/statm: 154161 7292 401 364 0 90001 0
[pid=16813] ppid=16811 vsize=268420 CPUtime=194.61 cores=0-7
/proc/16813/stat : 16813 (hybridGM3) T 16811 16813 16813 0 -1 4202496 5830 0 0 0 19461 0 0 0 25 0 1 0 668295586 274862080 5543 33554432000 134512640 135204385 4288670752 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/16813/statm: 67105 5543 63 169 0 66935 0
[pid=16811/tid=16826] ppid=16678 vsize=616644 CPUtime=0 cores=0-7
/proc/16811/task/16826/stat : 16826 (python) S 16678 16678 16377 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 668317078 631443456 7292 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 514 18446604455880733696 0 0 -1 0 0 0 0
[pid=16814] ppid=16678 vsize=626556 CPUtime=1.71 cores=0-7
/proc/16814/stat : 16814 (python) S 16678 16678 16377 0 -1 4202560 979 0 0 0 86 85 0 0 18 0 1 0 668297462 641593344 7321 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 11739934250508452101 0 0 17 7 0 0 0
/proc/16814/statm: 156639 7321 373 364 0 92476 0
[pid=16816] ppid=16814 vsize=459772 CPUtime=351.59 cores=0-7
/proc/16816/stat : 16816 (TNM) R 16814 16816 16816 0 -1 4202496 1935 0 0 0 35159 0 0 0 25 0 1 0 668297462 470806528 1653 33554432000 134512640 135008748 4287715888 18446744073709551615 134529176 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16816/statm: 114943 1653 46 122 0 113843 0
[pid=16822] ppid=16678 vsize=636812 CPUtime=1.02 cores=0-7
/proc/16822/stat : 16822 (python) S 16678 16678 16377 0 -1 4202560 1091 0 0 0 54 48 0 0 18 0 1 0 668313594 652095488 7406 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 11739934250508452100 0 0 17 0 0 0 0
/proc/16822/statm: 159203 7406 378 364 0 95037 0
[pid=16824] ppid=16822 vsize=421372 CPUtime=222.67 cores=0-7
/proc/16824/stat : 16824 (NCVWr) R 16822 16824 16824 0 -1 4202496 1997 0 0 0 22267 0 0 0 25 0 1 0 668313594 431484928 1710 33554432000 134512640 135113558 4293424832 18446744073709551615 134533736 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16824/statm: 105343 1710 58 147 0 104218 0
[pid=16827] ppid=16678 vsize=647068 CPUtime=0.87 cores=0-7
/proc/16827/stat : 16827 (python) S 16678 16678 16377 0 -1 4202560 1239 0 0 0 46 41 0 0 18 0 2 0 668317084 662597632 7530 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/16827/statm: 161767 7530 407 364 0 97598 0
[pid=16829] ppid=16827 vsize=251296 CPUtime=204.4 cores=0-7
/proc/16829/stat : 16829 (FH) R 16827 16829 16829 0 -1 4202496 1969 0 0 0 20439 1 0 0 25 0 1 0 668317085 257327104 1683 33554432000 134512640 134936988 4291536512 18446744073709551615 134547117 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/16829/statm: 62824 1683 41 104 0 62328 0
[pid=16827/tid=16833] ppid=16678 vsize=647068 CPUtime=0 cores=0-7
/proc/16827/task/16833/stat : 16833 (python) S 16678 16678 16377 0 -1 4202560 100 0 0 0 0 0 0 0 19 0 2 0 668327725 662597632 7530 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 514 18446604471127013504 0 0 -1 0 0 0 0
[pid=16835] ppid=16678 vsize=657324 CPUtime=0.29 cores=0-7
/proc/16835/stat : 16835 (python) S 16678 16678 16377 0 -1 4202560 1043 0 0 0 14 15 0 0 18 0 1 0 668331746 673099776 7498 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 11739934250508452104 0 0 17 0 0 0 0
/proc/16835/statm: 164331 7498 379 364 0 100159 0
[pid=16837] ppid=16835 vsize=335996 CPUtime=69.41 cores=0-7
/proc/16837/stat : 16837 (iPAWS) R 16835 16837 16837 0 -1 4202496 1832 0 0 0 6940 1 0 0 25 0 1 0 668331747 344059904 1548 33554432000 134512640 135114423 4294160224 18446744073709551615 134515593 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/16837/statm: 83999 1548 59 147 0 83851 0
[pid=16839] ppid=16678 vsize=667580 CPUtime=0.19 cores=0-7
/proc/16839/stat : 16839 (python) S 16678 16678 16377 0 -1 4202560 1051 0 0 0 10 9 0 0 18 0 1 0 668334591 683601920 7459 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 11739934250508452100 0 0 17 7 0 0 0
/proc/16839/statm: 166895 7459 379 364 0 102720 0
[pid=16841] ppid=16839 vsize=335996 CPUtime=37.24 cores=0-7
/proc/16841/stat : 16841 (iPAWS) R 16839 16841 16841 0 -1 4202496 1835 0 0 0 3724 0 0 0 25 0 1 0 668334592 344059904 1548 33554432000 134512640 135114423 4294489216 18446744073709551615 134517246 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/16841/statm: 83999 1548 59 147 0 83851 0
[pid=16843] ppid=16678 vsize=677836 CPUtime=0 cores=0-7
/proc/16843/stat : 16843 (python) S 16678 16678 16377 0 -1 4202560 965 0 0 0 0 0 0 0 19 0 1 0 668339378 694104064 7503 33554432000 4194304 5683644 140734382927504 18446744073709551615 253640879686 0 0 16781312 514 9458605407086837759 0 0 17 7 0 0 0
/proc/16843/statm: 169459 7503 355 364 0 105281 0
[pid=16845] ppid=16843 vsize=268424 CPUtime=0.39 cores=0-7
/proc/16845/stat : 16845 (hybridGM3) R 16843 16845 16845 0 -1 4202496 5833 0 0 0 39 0 0 0 21 0 1 0 668339379 274866176 5544 33554432000 134512640 135204385 4291862256 18446744073709551615 134538375 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/16845/statm: 67106 5544 63 169 0 66936 0
[pid=16678/tid=16685] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16685/stat : 16685 (python) S 16676 16678 16377 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 34 0 668200157 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16688] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16688/stat : 16688 (python) S 16676 16678 16377 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 34 0 668200161 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16691] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16691/stat : 16691 (python) S 16676 16678 16377 0 -1 4202560 34 937 0 0 0 0 0 0 18 0 34 0 668200164 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16694] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16694/stat : 16694 (python) S 16676 16678 16377 0 -1 4202560 30 937 0 0 0 0 0 0 18 0 34 0 668200167 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 0 0 0 0
[pid=16678/tid=16697] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16697/stat : 16697 (python) S 16676 16678 16377 0 -1 4202560 33 937 0 0 0 0 0 0 18 0 34 0 668200170 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 0 0 0 0
[pid=16678/tid=16700] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16700/stat : 16700 (python) S 16676 16678 16377 0 -1 4202560 25 937 0 0 0 0 0 0 23 0 34 0 668200173 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 0 0 0 0
[pid=16678/tid=16703] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16703/stat : 16703 (python) S 16676 16678 16377 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 34 0 668200176 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 4 0 0 0
[pid=16678/tid=16706] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16706/stat : 16706 (python) S 16676 16678 16377 0 -1 4202560 47 937 0 0 0 0 0 0 18 0 34 0 668200180 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16713] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16713/stat : 16713 (python) S 16676 16678 16377 0 -1 4202560 40 937 0 0 0 0 0 0 18 0 34 0 668210199 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 4 0 0 0
[pid=16678/tid=16717] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16717/stat : 16717 (python) S 16676 16678 16377 0 -1 4202560 48 937 0 0 0 0 0 0 18 0 34 0 668210220 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 4 0 0 0
[pid=16678/tid=16721] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16721/stat : 16721 (python) S 16676 16678 16377 0 -1 4202560 43 937 0 0 0 0 0 0 15 0 34 0 668210804 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16725] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16725/stat : 16725 (python) S 16676 16678 16377 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 34 0 668210824 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 4 0 0 0
[pid=16678/tid=16729] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16729/stat : 16729 (python) S 16676 16678 16377 0 -1 4202560 36 937 0 0 0 0 0 0 18 0 34 0 668211406 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 3 0 0 0
[pid=16678/tid=16734] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16734/stat : 16734 (python) S 16676 16678 16377 0 -1 4202560 116 937 0 0 0 0 0 0 18 0 34 0 668212617 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16737] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16737/stat : 16737 (python) S 16676 16678 16377 0 -1 4202560 35 937 0 0 0 0 0 0 21 0 34 0 668212622 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 3 0 0 0
[pid=16678/tid=16742] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16742/stat : 16742 (python) S 16676 16678 16377 0 -1 4202560 40 937 0 0 0 0 0 0 18 0 34 0 668213040 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16747] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16747/stat : 16747 (python) S 16676 16678 16377 0 -1 4202560 28 937 0 0 0 0 0 0 20 0 34 0 668220163 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16752] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16752/stat : 16752 (python) S 16676 16678 16377 0 -1 4202560 34 937 0 0 0 0 0 0 18 0 34 0 668220874 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16764] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16764/stat : 16764 (python) S 16676 16678 16377 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 34 0 668232615 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16767] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16767/stat : 16767 (python) S 16676 16678 16377 0 -1 4202560 46 937 0 0 0 0 0 0 18 0 34 0 668232993 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16771] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16771/stat : 16771 (python) S 16676 16678 16377 0 -1 4202560 43 937 0 0 0 0 0 0 18 0 34 0 668237038 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16775] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16775/stat : 16775 (python) S 16676 16678 16377 0 -1 4202560 143 937 0 0 0 0 0 0 20 0 34 0 668242355 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16785] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16785/stat : 16785 (python) S 16676 16678 16377 0 -1 4202560 44 937 0 0 0 0 0 0 19 0 34 0 668255598 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16791] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16791/stat : 16791 (python) S 16676 16678 16377 0 -1 4202560 51 937 0 0 0 0 0 0 18 0 34 0 668264346 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16798] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16798/stat : 16798 (python) S 16676 16678 16377 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 34 0 668273504 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16806] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16806/stat : 16806 (python) S 16676 16678 16377 0 -1 4202560 22 937 0 0 0 0 0 0 19 0 34 0 668289172 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16812] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16812/stat : 16812 (python) S 16676 16678 16377 0 -1 4202560 29 937 0 0 0 0 0 0 19 0 34 0 668295585 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 2 0 0 0
[pid=16678/tid=16815] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16815/stat : 16815 (python) S 16676 16678 16377 0 -1 4202560 157 937 0 0 0 0 0 0 20 0 34 0 668297462 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16823] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16823/stat : 16823 (python) S 16676 16678 16377 0 -1 4202560 39 937 0 0 0 0 0 0 19 0 34 0 668313594 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16828] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16828/stat : 16828 (python) S 16676 16678 16377 0 -1 4202560 35 937 0 0 0 0 0 0 18 0 34 0 668317085 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16836] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16836/stat : 16836 (python) S 16676 16678 16377 0 -1 4202560 40 937 0 0 0 0 0 0 19 0 34 0 668331746 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16840] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16840/stat : 16840 (python) S 16676 16678 16377 0 -1 4202560 36 937 0 0 0 0 0 0 20 0 34 0 668334592 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
[pid=16678/tid=16844] ppid=16676 vsize=688080 CPUtime=0 cores=0-7
/proc/16678/task/16844/stat : 16844 (python) S 16676 16678 16377 0 -1 4202560 33 937 0 0 0 0 0 0 20 0 34 0 668339378 704593920 9094 33554432000 4194304 5683644 140734382927504 18446744073709551615 253652683185 0 0 16781312 2 18446604451394245568 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 9876.24
Current children cumulated vsize (KiB) 32194300

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16678 and gives
#  childrusage.ru_utime.tv_sec=1468
#  childrusage.ru_utime.tv_usec=183802
#  childrusage.ru_stime.tv_sec=21
#  childrusage.ru_stime.tv_usec=453738
# CPU time returned by wait4() is 1489.64
# while last known CPU time is 9876.24
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1395.02
CPU time (s): 9876.24
CPU user time (s): 9854.91
CPU system time (s): 21.33
CPU usage (%): 707.963
Max. virtual memory (cumulated for all children) (KiB): 32194300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1468.18
system time used= 21.4537
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 108367
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18311
involuntary context switches= 10235

runsolver used 16.8394 second user time and 40.0039 second system time

The end

Launcher Data 

Begin job on node106 at 2011-05-16 19:13:15
IDJOB=3385374
IDBENCH=82639
IDSOLVER=1870
FILE ID=node106/3385374-1305565995
RUNJOBID= node106-1305564966-16391
PBS_JOBID= 13350144
Free space on /tmp= 73464 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k5-r20-v1500-c30000-S377999798-061-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385374-1305565995/watcher-3385374-1305565995 -o /tmp/evaluation-result-3385374-1305565995/solver-3385374-1305565995 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385374-1305565995.cnf -seed 825455913 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a4ba28fb1550ba8a4eca95d91f4669c6
RANDOM SEED=825455913

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19815916 kB
Buffers:        314020 kB
Cached:        7076024 kB
SwapCached:      27532 kB
Active:        3823020 kB
Inactive:      9035444 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19815916 kB
SwapTotal:    67111528 kB
SwapFree:     56449236 kB
Dirty:           32648 kB
Writeback:           0 kB
AnonPages:     5449804 kB
Mapped:          20548 kB
Slab:           137480 kB
PageTables:      65492 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 134051724 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73432 MiB
End job on node106 at 2011-05-16 19:36:33