Trace number 3322254

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 15906.3 2263.92

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v90-c8010-S741717046-057.UNKNOWN.cnf
MD5SUM1f00de1fd8adbfbf4cc573ef44af531f
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables90
Number of clauses8010
Sum of the clauses size56070
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58010

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.47	c INFO: solving HOME/instance-3322254-1304378168.cnf
0.32/0.47	c INFO: computing task features
0.41/0.52	c INFO: computed variable-clause graph statistics
0.41/0.52	c INFO: computed clause balance statistics
0.70/0.80	c INFO: computed variable balance statistics
0.80/0.91	c INFO: computed small-clause counts
0.80/0.91	c INFO: computed Horn-clause counts
0.80/0.92	c INFO: computed variable graph statistics
0.80/0.92	c INFO: collected features for HOME/instance-3322254-1304378168.cnf in 0.45 s
0.80/0.95	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.47)
0.80/0.99	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.11)
0.94/1.03	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.06)
0.94/1.07	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.05)
0.94/1.10	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.04)
1.15/1.14	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.03)
1.15/1.18	c INFO: running FH@0 for 97 with 39999 remaining (b = 0.03)
1.32/1.22	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.02)
700.39/101.31	c INFO: running adaptg2wsat2009++@0 for 97 with 39899 remaining (b = 0.02)
700.39/101.35	c INFO: running FH@0 for 97 with 39899 remaining (b = 0.02)
729.76/105.56	c INFO: running hybridGM3@0 for 194 with 39894 remaining (b = 0.03)
736.15/106.52	c INFO: running gnovelty+2@0 for 97 with 39893 remaining (b = 0.01)
785.46/113.57	c INFO: running hybridGM3@0 for 194 with 39886 remaining (b = 0.02)
826.60/119.48	c INFO: running adaptg2wsat2009++@0 for 97 with 39881 remaining (b = 0.01)
867.79/125.34	c INFO: running adaptg2wsat2009++@100 for 97 with 39875 remaining (b = 0.01)
1057.52/152.59	c INFO: running hybridGM3@0 for 194 with 39847 remaining (b = 0.02)
1400.06/201.68	c INFO: running march_hi@0 for 388 with 39798 remaining (b = 0.04)
1478.20/212.89	c INFO: running hybridGM3@0 for 194 with 39787 remaining (b = 0.02)
1526.30/219.75	c INFO: running TNM@0 for 1552 with 39780 remaining (b = 0.14)
1714.65/246.74	c INFO: running FH@0 for 97 with 39753 remaining (b = 0.01)
1794.13/258.11	c INFO: running adaptg2wsat2009++@0 for 97 with 39742 remaining (b = 0.01)
2242.04/322.32	c INFO: running hybridGM3@98 for 97 with 39678 remaining (b = 0.01)
2388.42/343.34	c INFO: running hybridGM3@100 for 97 with 39657 remaining (b = 0.01)
2415.68/347.09	c INFO: running adaptg2wsat2009++@0 for 97 with 39653 remaining (b = 0.01)
2431.78/349.31	c INFO: running hybridGM3@99 for 97 with 39651 remaining (b = 0.01)
2765.26/396.64	c INFO: running adaptg2wsat2009++@99 for 97 with 39603 remaining (b = 0.01)
2883.14/413.55	c INFO: running hybridGM3@100 for 97 with 39586 remaining (b = 0.01)
3104.89/444.68	c INFO: running march_hi@0 for 388 with 39555 remaining (b = 0.04)
3146.64/450.66	c INFO: running adaptg2wsat2009++@102 for 97 with 39549 remaining (b = 0.01)
3210.17/459.75	c INFO: running hybridGM3@294 for 97 with 39540 remaining (b = 0.01)
3355.00/480.52	c INFO: running gnovelty+2@0 for 97 with 39520 remaining (b = 0.01)
3567.52/511.03	c INFO: running hybridGM3@0 for 194 with 39489 remaining (b = 0.02)
3678.30/526.93	c INFO: running march_hi@0 for 388 with 39473 remaining (b = 0.03)
3867.02/554.03	c INFO: running hybridGM3@0 for 194 with 39446 remaining (b = 0.01)
3958.27/567.13	c INFO: running hybridGM3@388 for 97 with 39433 remaining (b = 0.01)
4222.45/605.03	c INFO: running TNM@0 for 1552 with 39395 remaining (b = 0.11)
4378.41/627.48	c INFO: running iPAWS@0 for 97 with 39373 remaining (b = 0.01)
4748.33/680.54	c INFO: running FH@0 for 97 with 39320 remaining (b = 0.01)
5021.38/719.77	c INFO: running march_hi@100 for 291 with 39280 remaining (b = 0.03)
5280.51/756.98	c INFO: running hybridGM3@99 for 97 with 39243 remaining (b = 0.01)
5348.86/766.80	c INFO: running hybridGM3@96 for 97 with 39233 remaining (b = 0.01)
5489.44/786.96	c INFO: running hybridGM3@0 for 194 with 39213 remaining (b = 0.01)
6000.12/860.38	c INFO: running hybridGM3@296 for 194 with 39140 remaining (b = 0.01)
6054.39/868.18	c INFO: running march_hi@0 for 2134 with 39132 remaining (b = 0.14)
6595.70/945.94	c INFO: running FH@198 for 194 with 39054 remaining (b = 0.01)
6851.00/982.67	c INFO: running march_hi@97 for 291 with 39017 remaining (b = 0.03)
7200.33/1032.88	c INFO: running march_hi@96 for 291 with 38967 remaining (b = 0.03)
7276.84/1043.83	c INFO: running march_hi@203 for 1940 with 38956 remaining (b = 0.13)
7375.59/1058.04	c INFO: running march_hi@0 for 388 with 38942 remaining (b = 0.03)
8145.42/1168.70	c INFO: running hybridGM3@392 for 97 with 38831 remaining (b = 0.01)
9036.21/1296.17	c INFO: running march_hi@0 for 388 with 38704 remaining (b = 0.03)
9093.29/1304.39	c INFO: running march_hi@491 for 1649 with 38696 remaining (b = 0.11)
9537.85/1368.23	c INFO: running march_hi@389 for 97 with 38632 remaining (b = 0.01)
10241.93/1469.44	c INFO: running march_hi@0 for 388 with 38531 remaining (b = 0.03)
10602.33/1521.29	c INFO: running march_hi@194 for 97 with 38479 remaining (b = 0.01)
11586.81/1662.77	c INFO: running march_hi@293 for 97 with 38337 remaining (b = 0.01)
12700.27/1812.80	c INFO: running march_hi@292 for 97 with 38187 remaining (b = 0.01)
12880.42/1838.59	c INFO: running hybridGM3@95 for 97 with 38161 remaining (b = 0.01)
13179.85/1881.50	c INFO: running adaptg2wsat2009++@0 for 194 with 38119 remaining (b = 0.01)
13400.55/1912.37	c INFO: running march_hi@391 for 97 with 38088 remaining (b = 0.01)
13584.11/1937.00	c INFO: running march_hi@388 for 97 with 38063 remaining (b = 0.01)
13788.51/1966.07	c INFO: running march_hi@685 for 1455 with 38034 remaining (b = 0.09)
14107.13/2009.75	c INFO: running march_hi@0 for 388 with 37990 remaining (b = 0.03)
14291.54/2036.25	c INFO: running hybridGM3@0 for 194 with 37964 remaining (b = 0.01)
15149.68/2156.43	c INFO: running march_hi@784 for 1358 with 37844 remaining (b = 0.08)
15902.01/2263.16	c INFO: running march_hi@0 for 291 with 37737 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322254-1304378168/watcher-3322254-1304378168 -o /tmp/evaluation-result-3322254-1304378168/solver-3322254-1304378168 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322254-1304378168.cnf -seed 469684950 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.46 9.36 9.47 2/365 7065
/proc/meminfo: memFree=24745884/32951132 swapFree=67111364/67111528
[pid=7065] ppid=7063 vsize=15904 CPUtime=0 cores=0-7
/proc/7065/stat : 7065 (python) S 7063 7065 5551 0 -1 4202496 944 0 0 0 0 0 0 0 21 0 1 0 549415520 16285696 820 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970548224 0 2147483391 16781312 2 18446744071699109054 0 0 17 5 0 0 0
/proc/7065/statm: 3976 820 357 364 0 463 0

[startup+0.057341 s]
/proc/loadavg: 8.46 9.36 9.47 2/365 7065
/proc/meminfo: memFree=24745884/32951132 swapFree=67111364/67111528
[pid=7065] ppid=7063 vsize=36504 CPUtime=0.04 cores=0-7
/proc/7065/stat : 7065 (python) S 7063 7065 5551 0 -1 4202496 1610 0 0 0 4 0 0 0 22 0 1 0 549415520 37380096 1443 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970548224 0 2147483391 16781312 2 18446744071699109054 0 0 17 7 0 0 0
/proc/7065/statm: 9126 1443 452 364 0 943 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 36504

[startup+0.100249 s]
/proc/loadavg: 8.46 9.36 9.47 2/365 7065
/proc/meminfo: memFree=24745884/32951132 swapFree=67111364/67111528
[pid=7065] ppid=7063 vsize=104216 CPUtime=0.08 cores=0-7
/proc/7065/stat : 7065 (python) S 7063 7065 5551 0 -1 4202496 3047 0 0 0 6 2 0 0 17 0 1 0 549415520 106717184 2731 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970548224 0 2147483391 16781312 2 18446744071699109054 0 0 17 7 0 0 0
/proc/7065/statm: 26054 2731 847 364 0 1802 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 104216

[startup+0.30113 s]
/proc/loadavg: 8.46 9.36 9.47 2/365 7065
/proc/meminfo: memFree=24745884/32951132 swapFree=67111364/67111528
[pid=7065] ppid=7063 vsize=170752 CPUtime=0.23 cores=0-7
/proc/7065/stat : 7065 (python) S 7063 7065 5551 0 -1 4202496 6738 936 1 0 17 6 0 0 17 0 1 0 549415520 174850048 4806 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970548224 0 2147483391 16781312 2 18446744071699109054 0 0 17 7 0 0 0
/proc/7065/statm: 42688 4807 1336 364 0 3453 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 170752

[startup+0.701099 s]
/proc/loadavg: 8.46 9.36 9.47 2/365 7065
/proc/meminfo: memFree=24745884/32951132 swapFree=67111364/67111528
[pid=7065] ppid=7063 vsize=280232 CPUtime=0.6 cores=0-7
/proc/7065/stat : 7065 (python) R 7063 7065 5551 0 -1 4202496 9994 936 1 0 51 9 0 0 17 0 1 0 549415520 286957568 7443 33554432000 4194304 5683644 140733683129888 18446744073709551615 242973958825 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7065/statm: 70058 7443 1826 364 0 5982 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 280232

[startup+1.50091 s]
/proc/loadavg: 8.46 9.36 9.47 5/371 7075
/proc/meminfo: memFree=24715068/32951132 swapFree=67111364/67111528
[pid=7065] ppid=7063 vsize=361768 CPUtime=1.11 cores=0-7
/proc/7065/stat : 7065 (python) S 7063 7065 5551 0 -1 4202496 16846 936 1 0 100 11 0 0 21 0 9 0 549415520 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/7065/statm: 90442 7409 1891 364 0 26339 0
[pid=7071] ppid=7065 vsize=279412 CPUtime=0 cores=0-7
/proc/7071/stat : 7071 (python) S 7065 7065 5551 0 -1 4202560 741 0 0 0 0 0 0 0 19 0 1 0 549415616 286117888 5792 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570255 0 0 16781312 514 847398288746348543 0 0 17 5 0 0 0
/proc/7071/statm: 69853 5792 354 364 0 5771 0
[pid=7073] ppid=7071 vsize=1018088 CPUtime=0.53 cores=0-7
/proc/7073/stat : 7073 (gnovelty+2) R 7071 7073 7073 0 -1 4202496 572 0 0 0 53 0 0 0 22 0 1 0 549415616 1042522112 306 33554432000 134512640 135663704 4292299392 18446744073709551615 134525316 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/7073/statm: 254522 306 113 282 0 254238 0
[pid=7074] ppid=7065 vsize=289988 CPUtime=0 cores=0-7
/proc/7074/stat : 7074 (python) S 7065 7065 5551 0 -1 4202560 740 0 0 0 0 0 0 0 19 0 1 0 549415620 296947712 5838 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 847402137037045759 0 0 17 0 0 0 0
/proc/7074/statm: 72497 5838 348 364 0 8412 0
[pid=7065/tid=7072] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7072/stat : 7072 (python) S 7063 7065 5551 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 9 0 549415616 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 5 0 0 0
[pid=7065/tid=7075] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7075/stat : 7075 (python) S 7063 7065 5551 0 -1 4202560 22 936 0 0 0 0 0 0 19 0 9 0 549415620 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.64
Current children cumulated vsize (KiB) 1949256

[startup+3.10164 s]
/proc/loadavg: 8.46 9.36 9.47 10/390 7094
/proc/meminfo: memFree=24678880/32951132 swapFree=67111364/67111528
[pid=7065] ppid=7063 vsize=361768 CPUtime=1.11 cores=0-7
/proc/7065/stat : 7065 (python) S 7063 7065 5551 0 -1 4202496 16846 936 1 0 100 11 0 0 21 0 9 0 549415520 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/7065/statm: 90442 7409 1891 364 0 26339 0
[pid=7071] ppid=7065 vsize=279412 CPUtime=0 cores=0-7
/proc/7071/stat : 7071 (python) S 7065 7065 5551 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 549415616 286117888 5792 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570255 0 0 16781312 514 847398288746316036 0 0 17 5 0 0 0
/proc/7071/statm: 69853 5792 354 364 0 5771 0
[pid=7073] ppid=7071 vsize=1018088 CPUtime=2.13 cores=0-7
/proc/7073/stat : 7073 (gnovelty+2) R 7071 7073 7073 0 -1 4202496 572 0 0 0 213 0 0 0 25 0 1 0 549415616 1042522112 306 33554432000 134512640 135663704 4292299392 18446744073709551615 134524894 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/7073/statm: 254522 306 113 282 0 254238 0
[pid=7074] ppid=7065 vsize=289988 CPUtime=0 cores=0-7
/proc/7074/stat : 7074 (python) S 7065 7065 5551 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 549415620 296947712 5838 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 847402137037013255 0 0 17 0 0 0 0
/proc/7074/statm: 72497 5838 348 364 0 8412 0
[pid=7076] ppid=7074 vsize=1018088 CPUtime=2.09 cores=0-7
/proc/7076/stat : 7076 (gnovelty+2) R 7074 7076 7076 0 -1 4202496 568 0 0 0 209 0 0 0 25 0 1 0 549415620 1042522112 306 33554432000 134512640 135663704 4292398976 18446744073709551615 134544196 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7076/statm: 254522 306 113 282 0 254238 0
[pid=7077] ppid=7065 vsize=300244 CPUtime=0 cores=0-7
/proc/7077/stat : 7077 (python) S 7065 7065 5551 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 549415623 307449856 5842 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 4118167204938088710 0 0 17 5 0 0 0
/proc/7077/statm: 75061 5842 348 364 0 10973 0
[pid=7079] ppid=7077 vsize=417192 CPUtime=2.06 cores=0-7
/proc/7079/stat : 7079 (adaptg2wsat2009) R 7077 7079 7079 0 -1 4202496 761 0 0 0 206 0 0 0 25 0 1 0 549415624 427204608 495 33554432000 134512640 135107411 4294652336 18446744073709551615 134531822 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/7079/statm: 104298 495 59 146 0 103174 0
[pid=7080] ppid=7065 vsize=310500 CPUtime=0 cores=0-7
/proc/7080/stat : 7080 (python) S 7065 7065 5551 0 -1 4202560 753 0 0 0 0 0 0 0 18 0 1 0 549415627 317952000 5846 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 847409833618407688 0 0 17 7 0 0 0
/proc/7080/statm: 77625 5846 348 364 0 13534 0
[pid=7082] ppid=7080 vsize=417192 CPUtime=2.02 cores=0-7
/proc/7082/stat : 7082 (adaptg2wsat2009) R 7080 7082 7082 0 -1 4202496 759 0 0 0 202 0 0 0 25 0 1 0 549415627 427204608 495 33554432000 134512640 135107411 4289785792 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/7082/statm: 104298 495 59 146 0 103174 0
[pid=7083] ppid=7065 vsize=320756 CPUtime=0 cores=0-7
/proc/7083/stat : 7083 (python) S 7065 7065 5551 0 -1 4202560 755 0 0 0 0 0 0 0 18 0 1 0 549415631 328454144 5850 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 9121412953516539903 0 0 17 1 0 0 0
/proc/7083/statm: 80189 5850 348 364 0 16095 0
[pid=7085] ppid=7083 vsize=417192 CPUtime=1.98 cores=0-7
/proc/7085/stat : 7085 (adaptg2wsat2009) R 7083 7085 7085 0 -1 4202496 759 0 0 0 198 0 0 0 25 0 1 0 549415632 427204608 495 33554432000 134512640 135107411 4288780448 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/7085/statm: 104298 495 59 146 0 103174 0
[pid=7086] ppid=7065 vsize=331012 CPUtime=0 cores=0-7
/proc/7086/stat : 7086 (python) S 7065 7065 5551 0 -1 4202560 764 0 0 0 0 0 0 0 18 0 1 0 549415635 338956288 5854 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 14672578881320354054 0 0 17 1 0 0 0
/proc/7086/statm: 82753 5854 348 364 0 18656 0
[pid=7088] ppid=7086 vsize=1018088 CPUtime=1.89 cores=0-7
/proc/7088/stat : 7088 (gnovelty+2) R 7086 7088 7088 0 -1 4202496 569 0 0 0 189 0 0 0 25 0 1 0 549415635 1042522112 307 33554432000 134512640 135663704 4288362512 18446744073709551615 134524919 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/7088/statm: 254522 307 113 282 0 254238 0
[pid=7089] ppid=7065 vsize=341268 CPUtime=0 cores=0-7
/proc/7089/stat : 7089 (python) S 7065 7065 5551 0 -1 4202560 766 0 0 0 0 0 0 0 18 0 1 0 549415639 349458432 5858 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 14672571184738992127 0 0 17 7 0 0 0
/proc/7089/statm: 85317 5858 348 364 0 21217 0
[pid=7091] ppid=7089 vsize=245712 CPUtime=0.97 cores=0-7
/proc/7091/stat : 7091 (FH) R 7089 7091 7091 0 -1 4202496 616 0 0 0 97 0 0 0 23 0 1 0 549415639 251609088 352 33554432000 134512640 134936988 4294728032 18446744073709551615 134523657 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7091/statm: 61428 352 37 104 0 60932 0
[pid=7092] ppid=7065 vsize=351524 CPUtime=0 cores=0-7
/proc/7092/stat : 7092 (python) S 7065 7065 5551 0 -1 4202560 803 0 0 0 0 0 0 0 18 0 1 0 549415642 359960576 5868 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 550711293787504639 0 0 17 1 0 0 0
/proc/7092/statm: 87881 5868 354 364 0 23778 0
[pid=7094] ppid=7092 vsize=417192 CPUtime=1.87 cores=0-7
/proc/7094/stat : 7094 (adaptg2wsat2009) R 7092 7094 7094 0 -1 4202496 767 0 0 0 187 0 0 0 25 0 1 0 549415643 427204608 495 33554432000 134512640 135107411 4293457968 18446744073709551615 134532107 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/7094/statm: 104298 495 59 146 0 103174 0
[pid=7065/tid=7072] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7072/stat : 7072 (python) S 7063 7065 5551 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 9 0 549415616 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 5 0 0 0
[pid=7065/tid=7075] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7075/stat : 7075 (python) S 7063 7065 5551 0 -1 4202560 22 936 0 0 0 0 0 0 19 0 9 0 549415620 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 5 0 0 0
[pid=7065/tid=7078] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7078/stat : 7078 (python) S 7063 7065 5551 0 -1 4202560 25 936 0 0 0 0 0 0 21 0 9 0 549415624 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7081] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7081/stat : 7081 (python) S 7063 7065 5551 0 -1 4202560 21 936 0 0 0 0 0 0 20 0 9 0 549415627 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 5 0 0 0
[pid=7065/tid=7084] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7084/stat : 7084 (python) S 7063 7065 5551 0 -1 4202560 24 936 0 0 0 0 0 0 22 0 9 0 549415631 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 7 0 0 0
[pid=7065/tid=7087] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7087/stat : 7087 (python) S 7063 7065 5551 0 -1 4202560 27 936 0 0 0 0 0 0 24 0 9 0 549415635 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7090] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7090/stat : 7090 (python) S 7063 7065 5551 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 9 0 549415639 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 7 0 0 0
[pid=7065/tid=7093] ppid=7063 vsize=361768 CPUtime=0 cores=0-7
/proc/7065/task/7093/stat : 7093 (python) S 7063 7065 5551 0 -1 4202560 80 936 0 0 0 0 0 0 23 0 9 0 549415643 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 16.12
Current children cumulated vsize (KiB) 7855216

[startup+6.30109 s]
/proc/loadavg: 8.50 9.36 9.47 13/390 7095
/proc/meminfo: memFree=24674408/32951132 swapFree=67111364/67111528
[pid=7065] ppid=7063 vsize=361768 CPUtime=1.11 cores=0-7
/proc/7065/stat : 7065 (python) S 7063 7065 5551 0 -1 4202496 16846 936 1 0 100 11 0 0 21 0 9 0 549415520 370450432 7409 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/7065/statm: 90442 7409 1891 364 0 26339 0
[pid=7071] ppid=7065 vsize=279412 CPUtime=0.01 cores=0-7
/proc/7071/stat : 7071 (python) S 7065 7065 5551 0 -1 4202560 907 0 0 0 1 0 0 0 18 0 1 0 549415616 286117888 5815 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570255 0 0 16781312 514 847398288746316036 0 0 17 5 0 0 0
/proc/7071/statm: 69853 5815 377 364 0 5771 0
[pid=7073] ppid=7071 vsize=1018088 CPUtime=5.33 cores=0-7
/proc/7073/stat : 7073 (gnovelty+2) R 7071 7073 7073 0 -1 4202496 572 0 0 0 533 0 0 0 25 0 1 0 549415616 1042522112 306 33554432000 134512640 135663704 4292299392 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/7073/statm: 254522 306 113 282 0 254238 0
[pid=7074] ppid=7065 vsize=289988 CPUtime=0.01 cores=0-7
/proc/7074/stat : 7074 (python) S 7065 7065 5551 0 -1 4202560 908 0 0 0 1 0 0 0 18 0 1 0 549415620 296947712 5861 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 847402137037013255 0 0 17 0 0 0 0
/proc/7074/statm: 72497 5861 371 364 0 8412 0
[pid=7076] ppid=7074 vsize=1018088 CPUtime=5.29 cores=0-7
/proc/7076/stat : 7076 (gnovelty+2) R 7074 7076 7076 0 -1 4202496 568 0 0 0 529 0 0 0 25 0 1 0 549415620 1042522112 306 33554432000 134512640 135663704 4292398976 18446744073709551615 134544204 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7076/statm: 254522 306 113 282 0 254238 0
[pid=7077] ppid=7065 vsize=300244 CPUtime=0 cores=0-7
/proc/7077/stat : 7077 (python) S 7065 7065 5551 0 -1 4202560 913 0 0 0 0 0 0 0 18 0 1 0 549415623 307449856 5865 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 4118167204938088710 0 0 17 5 0 0 0
/proc/7077/statm: 75061 5865 371 364 0 10973 0
[pid=7079] ppid=7077 vsize=417192 CPUtime=5.24 cores=0-7
/proc/7079/stat : 7079 (adaptg2wsat2009) R 7077 7079 7079 0 -1 4202496 761 0 0 0 524 0 0 0 25 0 1 0 549415624 427204608 495 33554432000 134512640 135107411 4294652336 18446744073709551615 134531731 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/7079/statm: 104298 495 59 146 0 103174 0
[pid=7080] ppid=7065 vsize=310500 CPUtime=0 cores=0-7
/proc/7080/stat : 7080 (python) S 7065 7065 5551 0 -1 4202560 932 0 0 0 0 0 0 0 18 0 1 0 549415627 317952000 5869 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 847409833618407688 0 0 17 7 0 0 0
/proc/7080/statm: 77625 5869 371 364 0 13534 0
[pid=7082] ppid=7080 vsize=417192 CPUtime=5.17 cores=0-7
/proc/7082/stat : 7082 (adaptg2wsat2009) R 7080 7082 7082 0 -1 4202496 759 0 0 0 517 0 0 0 25 0 1 0 549415627 427204608 495 33554432000 134512640 135107411 4289785792 18446744073709551615 134531674 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/7082/statm: 104298 495 59 146 0 103174 0
[pid=7083] ppid=7065 vsize=320756 CPUtime=0.01 cores=0-7
/proc/7083/stat : 7083 (python) S 7065 7065 5551 0 -1 4202560 946 0 0 0 0 1 0 0 18 0 1 0 549415631 328454144 5873 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 9121412953516507398 0 0 17 6 0 0 0
/proc/7083/statm: 80189 5873 371 364 0 16095 0
[pid=7085] ppid=7083 vsize=417192 CPUtime=4.65 cores=0-7
/proc/7085/stat : 7085 (adaptg2wsat2009) R 7083 7085 7085 0 -1 4202496 759 0 0 0 465 0 0 0 25 0 1 0 549415632 427204608 495 33554432000 134512640 135107411 4288780448 18446744073709551615 134532326 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/7085/statm: 104298 495 59 146 0 103174 0
[pid=7086] ppid=7065 vsize=331012 CPUtime=0 cores=0-7
/proc/7086/stat : 7086 (python) S 7065 7065 5551 0 -1 4202560 958 0 0 0 0 0 0 0 18 0 1 0 549415635 338956288 5877 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 14672578881320354054 0 0 17 7 0 0 0
/proc/7086/statm: 82753 5877 371 364 0 18656 0
[pid=7088] ppid=7086 vsize=1018088 CPUtime=4.83 cores=0-7
/proc/7088/stat : 7088 (gnovelty+2) R 7086 7088 7088 0 -1 4202496 569 0 0 0 483 0 0 0 25 0 1 0 549415635 1042522112 307 33554432000 134512640 135663704 4288362512 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 7 0 0 0

################
# More data... #
################

/proc/7175/stat : 7175 (TNM) R 7173 7175 7175 0 -1 4202496 725 0 0 0 149977 7 0 0 25 0 1 0 549476024 466763776 436 33554432000 134512640 135008748 4287424128 18446744073709551615 134529338 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7175/statm: 113956 436 46 122 0 112856 0
[pid=7178] ppid=7065 vsize=592516 CPUtime=0.39 cores=0-7
/proc/7178/stat : 7178 (python) S 7065 7065 5551 0 -1 4202560 1245 0 0 0 21 18 0 0 19 0 2 0 549478269 606736384 6382 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/7178/statm: 148129 6382 401 364 0 83975 0
[pid=7180] ppid=7178 vsize=335996 CPUtime=102.87 cores=0-7
/proc/7180/stat : 7180 (iPAWS) T 7178 7180 7180 0 -1 4202496 1373 0 0 0 10285 2 0 0 25 0 1 0 549478269 344059904 1090 33554432000 134512640 135114423 4287751984 18446744073709551615 134516463 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7180/statm: 83999 1090 59 147 0 83851 0
[pid=7178/tid=7189] ppid=7065 vsize=592516 CPUtime=0 cores=0-7
/proc/7178/task/7189/stat : 7189 (python) S 7065 7065 5551 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 549491210 606736384 6382 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 514 18446604459166730112 0 0 -1 6 0 0 0
[pid=7183] ppid=7065 vsize=603060 CPUtime=1 cores=0-7
/proc/7183/stat : 7183 (python) S 7065 7065 5551 0 -1 4202560 1275 0 0 0 53 47 0 0 18 0 2 0 549483575 617533440 6444 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/7183/statm: 150765 6444 401 364 0 86608 0
[pid=7185] ppid=7183 vsize=247344 CPUtime=293.39 cores=0-7
/proc/7185/stat : 7185 (FH) T 7183 7185 7185 0 -1 4202496 732 0 0 0 29336 3 0 0 25 0 1 0 549483575 253280256 443 33554432000 134512640 134936988 4292570784 18446744073709551615 134552080 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7185/statm: 61836 443 41 104 0 61340 0
[pid=7183/tid=7191] ppid=7065 vsize=603060 CPUtime=0 cores=0-7
/proc/7183/task/7191/stat : 7191 (python) S 7065 7065 5551 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 549494206 617533440 6444 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 514 18446604457404962624 0 0 -1 7 0 0 0
[pid=7192] ppid=7065 vsize=613156 CPUtime=0.99 cores=0-7
/proc/7192/stat : 7192 (python) S 7065 7065 5551 0 -1 4202560 1287 0 0 0 49 50 0 0 18 0 2 0 549494217 627871744 6416 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/7192/statm: 153289 6416 401 364 0 89129 0
[pid=7194] ppid=7192 vsize=268420 CPUtime=295.17 cores=0-7
/proc/7194/stat : 7194 (hybridGM3) T 7192 7194 7194 0 -1 4202496 4963 0 0 0 29517 0 0 0 25 0 1 0 549494217 274862080 4671 33554432000 134512640 135204385 4286816704 18446744073709551615 134537440 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7194/statm: 67105 4671 64 169 0 66935 0
[pid=7192/tid=7205] ppid=7065 vsize=613156 CPUtime=0 cores=0-7
/proc/7192/task/7205/stat : 7205 (python) S 7065 7065 5551 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 549513778 627871744 6416 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 514 18446604462893942976 0 0 -1 5 0 0 0
[pid=7197] ppid=7065 vsize=622196 CPUtime=4.39 cores=0-7
/proc/7197/stat : 7197 (python) S 7065 7065 5551 0 -1 4202560 993 0 0 0 232 207 0 0 16 0 1 0 549502338 637128704 6329 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 16487361576454553863 0 0 17 4 0 0 0
/proc/7197/statm: 155549 6329 373 364 0 91386 0
[pid=7199] ppid=7197 vsize=206864 CPUtime=1252.37 cores=0-7
/proc/7199/stat : 7199 (march_hi) R 7197 7199 7199 0 -1 4202496 37060 0 0 0 125228 9 0 0 25 0 1 0 549502339 211828736 35493 33554432000 4194304 4955518 140735648493616 18446744073709551615 4297566 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/7199/statm: 51716 35493 106 186 0 51529 0
[pid=7209] ppid=7065 vsize=632452 CPUtime=3.4 cores=0-7
/proc/7209/stat : 7209 (python) S 7065 7065 5551 0 -1 4202560 1253 0 0 0 170 170 0 0 15 0 2 0 549521325 647630848 6341 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/7209/statm: 158113 6341 407 364 0 93947 0
[pid=7211] ppid=7209 vsize=138340 CPUtime=835.79 cores=0-7
/proc/7211/stat : 7211 (march_hi) R 7209 7211 7211 0 -1 4202496 25737 0 0 0 83567 12 0 0 25 0 1 0 549521325 141660160 24164 33554432000 4194304 4955518 140736365437504 18446744073709551615 4224608 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/7211/statm: 34585 24164 106 186 0 34398 0
[pid=7209/tid=7230] ppid=7065 vsize=632452 CPUtime=0 cores=0-7
/proc/7209/task/7230/stat : 7230 (python) S 7065 7065 5551 0 -1 4202560 111 0 0 0 0 0 0 0 15 0 2 0 549567639 647630848 6341 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 514 18446604459425645824 0 0 -1 1 0 0 0
[pid=7218] ppid=7065 vsize=642708 CPUtime=2.58 cores=0-7
/proc/7218/stat : 7218 (python) S 7065 7065 5551 0 -1 4202560 1250 0 0 0 133 125 0 0 15 0 2 0 549545138 658132992 6365 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/7218/statm: 160677 6365 408 364 0 96508 0
[pid=7220] ppid=7218 vsize=94140 CPUtime=675.72 cores=0-7
/proc/7220/stat : 7220 (march_hi) R 7218 7220 7220 0 -1 4202496 21382 0 0 0 67565 7 0 0 25 0 1 0 549545146 96399360 19812 33554432000 4194304 4955518 140733705882704 18446744073709551615 4237804 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7220/statm: 23535 19812 106 186 0 23348 0
[pid=7218/tid=7239] ppid=7065 vsize=642708 CPUtime=0 cores=0-7
/proc/7218/task/7239/stat : 7239 (python) S 7065 7065 5551 0 -1 4202560 109 0 0 0 0 0 0 0 15 0 2 0 549596790 658132992 6365 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 514 18446604457653876544 0 0 -1 5 0 0 0
[pid=7226] ppid=7065 vsize=652964 CPUtime=1.78 cores=0-7
/proc/7226/stat : 7226 (python) S 7065 7065 5551 0 -1 4202560 1273 0 0 0 96 82 0 0 15 0 2 0 549562465 668635136 6381 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/7226/statm: 163241 6381 407 364 0 99069 0
[pid=7228] ppid=7226 vsize=63560 CPUtime=486.93 cores=0-7
/proc/7228/stat : 7228 (march_hi) T 7226 7228 7228 0 -1 4202496 16113 0 0 0 48689 4 0 0 25 0 1 0 549562465 65085440 14541 33554432000 4194304 4955518 140736955084928 18446744073709551615 4237818 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/7228/statm: 15890 14541 106 186 0 15703 0
[pid=7226/tid=7247] ppid=7065 vsize=652964 CPUtime=0 cores=0-7
/proc/7226/task/7247/stat : 7247 (python) S 7065 7065 5551 0 -1 4202560 115 0 0 0 0 0 0 0 15 0 2 0 549609209 668635136 6381 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 514 18446604457653875648 0 0 -1 1 0 0 0
[pid=7243] ppid=7065 vsize=663220 CPUtime=0.83 cores=0-7
/proc/7243/stat : 7243 (python) S 7065 7065 5551 0 -1 4202560 1273 0 0 0 45 38 0 0 19 0 2 0 549603671 679137280 6450 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/7243/statm: 165805 6450 408 364 0 101630 0
[pid=7245] ppid=7243 vsize=417192 CPUtime=198.31 cores=0-7
/proc/7245/stat : 7245 (adaptg2wsat2009) T 7243 7245 7245 0 -1 4202496 786 0 0 0 19831 0 0 0 25 0 1 0 549603671 427204608 496 33554432000 134512640 135107411 4289418160 18446744073709551615 134531600 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/7245/statm: 104298 496 59 146 0 103174 0
[pid=7243/tid=7260] ppid=7065 vsize=663220 CPUtime=0 cores=0-7
/proc/7243/task/7260/stat : 7260 (python) S 7065 7065 5551 0 -1 4202560 125 0 0 0 0 0 0 0 19 0 2 0 549631152 679137280 6450 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 514 18446604470960044992 0 0 -1 1 0 0 0
[pid=7250] ppid=7065 vsize=673476 CPUtime=0.8 cores=0-7
/proc/7250/stat : 7250 (python) S 7065 7065 5551 0 -1 4202560 1033 0 0 0 43 37 0 0 15 0 1 0 549616496 689639424 6358 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 16487361576454553862 0 0 17 5 0 0 0
/proc/7250/statm: 168369 6358 373 364 0 104191 0
[pid=7252] ppid=7250 vsize=43360 CPUtime=235.46 cores=0-7
/proc/7252/stat : 7252 (march_hi) R 7250 7252 7252 0 -1 4202496 9155 0 0 0 23541 5 0 0 25 0 1 0 549616496 44400640 7583 33554432000 4194304 4955518 140737207806800 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/7252/statm: 10840 7583 106 186 0 10653 0
[pid=7254] ppid=7065 vsize=684520 CPUtime=0.69 cores=0-7
/proc/7254/stat : 7254 (python) S 7065 7065 5551 0 -1 4202560 1308 0 0 0 36 33 0 0 19 0 2 0 549619146 700948480 6493 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/7254/statm: 171130 6493 402 364 0 106949 0
[pid=7256] ppid=7254 vsize=268424 CPUtime=195.63 cores=0-7
/proc/7256/stat : 7256 (hybridGM3) T 7254 7256 7256 0 -1 4202496 4967 0 0 0 19563 0 0 0 25 0 1 0 549619146 274866176 4673 33554432000 134512640 135204385 4292360144 18446744073709551615 134659313 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/7256/statm: 67106 4673 64 169 0 66936 0
[pid=7254/tid=7264] ppid=7065 vsize=684520 CPUtime=0 cores=0-7
/proc/7254/task/7264/stat : 7264 (python) S 7065 7065 5551 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 549641825 700948480 6493 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 514 18446604470960043200 0 0 -1 2 0 0 0
[pid=7265] ppid=7065 vsize=694796 CPUtime=0 cores=0-7
/proc/7265/stat : 7265 (python) S 7065 7065 5551 0 -1 4202560 943 0 0 0 0 0 0 0 19 0 1 0 549641836 711471104 6444 33554432000 4194304 5683644 140733683129888 18446744073709551615 242970570310 0 0 16781312 514 8081253788041609215 0 0 17 0 0 0 0
/proc/7265/statm: 173699 6444 345 364 0 109515 0
[pid=7267] ppid=7265 vsize=2320 CPUtime=0.31 cores=0-7
/proc/7267/stat : 7267 (march_hi) R 7265 7267 7267 0 -1 4202496 1532 0 0 0 31 0 0 0 21 0 1 0 549641837 2375680 392 33554432000 4194304 4955518 140734466868192 18446744073709551615 4224850 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/7267/statm: 580 392 89 186 0 393 0
[pid=7065/tid=7072] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7072/stat : 7072 (python) S 7063 7065 5551 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 36 0 549415616 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 5 0 0 0
[pid=7065/tid=7075] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7075/stat : 7075 (python) S 7063 7065 5551 0 -1 4202560 22 936 0 0 0 0 0 0 19 0 36 0 549415620 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 5 0 0 0
[pid=7065/tid=7078] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7078/stat : 7078 (python) S 7063 7065 5551 0 -1 4202560 34 936 0 0 0 0 0 0 18 0 36 0 549415624 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7081] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7081/stat : 7081 (python) S 7063 7065 5551 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 36 0 549415627 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 5 0 0 0
[pid=7065/tid=7084] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7084/stat : 7084 (python) S 7063 7065 5551 0 -1 4202560 27 936 0 0 0 0 0 0 18 0 36 0 549415631 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 7 0 0 0
[pid=7065/tid=7087] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7087/stat : 7087 (python) S 7063 7065 5551 0 -1 4202560 27 936 0 0 0 0 0 0 24 0 36 0 549415635 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7090] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7090/stat : 7090 (python) S 7063 7065 5551 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 36 0 549415639 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 7 0 0 0
[pid=7065/tid=7093] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7093/stat : 7093 (python) S 7063 7065 5551 0 -1 4202560 83 936 0 0 0 0 0 0 18 0 36 0 549415643 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7101] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7101/stat : 7101 (python) S 7063 7065 5551 0 -1 4202560 36 936 0 0 0 0 0 0 18 0 36 0 549425651 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 0 0 0 0
[pid=7065/tid=7103] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7103/stat : 7103 (python) S 7063 7065 5551 0 -1 4202560 106 936 0 0 0 0 0 0 21 0 36 0 549425656 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7108] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7108/stat : 7108 (python) S 7063 7065 5551 0 -1 4202560 36 936 0 0 0 0 0 0 18 0 36 0 549426077 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7112] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7112/stat : 7112 (python) S 7063 7065 5551 0 -1 4202560 36 936 0 0 0 0 0 0 19 0 36 0 549426173 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7116] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7116/stat : 7116 (python) S 7063 7065 5551 0 -1 4202560 46 936 0 0 0 0 0 0 18 0 36 0 549426877 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7123] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7123/stat : 7123 (python) S 7063 7065 5551 0 -1 4202560 38 936 0 0 0 0 0 0 18 0 36 0 549430780 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7129] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7129/stat : 7129 (python) S 7063 7065 5551 0 -1 4202560 42 936 0 0 0 0 0 0 18 0 36 0 549435689 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7133] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7133/stat : 7133 (python) S 7063 7065 5551 0 -1 4202560 28 936 0 0 0 0 0 0 18 0 36 0 549436810 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7137] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7137/stat : 7137 (python) S 7063 7065 5551 0 -1 4202560 30 936 0 0 0 0 0 0 20 0 36 0 549437495 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7141] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7141/stat : 7141 (python) S 7063 7065 5551 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 36 0 549440195 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7154] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7154/stat : 7154 (python) S 7063 7065 5551 0 -1 4202560 40 936 0 0 0 0 0 0 18 0 36 0 549459988 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7158] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7158/stat : 7158 (python) S 7063 7065 5551 0 -1 4202560 35 936 0 0 0 0 0 0 19 0 36 0 549463573 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7162] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7162/stat : 7162 (python) S 7063 7065 5551 0 -1 4202560 42 936 0 0 0 0 0 0 18 0 36 0 549466624 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7165] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7165/stat : 7165 (python) S 7063 7065 5551 0 -1 4202560 44 936 0 0 0 0 0 0 18 0 36 0 549468213 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7169] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7169/stat : 7169 (python) S 7063 7065 5551 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 36 0 549470923 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7174] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7174/stat : 7174 (python) S 7063 7065 5551 0 -1 4202560 32 936 0 0 0 0 0 0 19 0 36 0 549476024 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7179] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7179/stat : 7179 (python) S 7063 7065 5551 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 36 0 549478269 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7184] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7184/stat : 7184 (python) S 7063 7065 5551 0 -1 4202560 29 936 0 0 0 0 0 0 18 0 36 0 549483575 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7193] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7193/stat : 7193 (python) S 7063 7065 5551 0 -1 4202560 38 936 0 0 0 0 0 0 18 0 36 0 549494217 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 0 0 0 0
[pid=7065/tid=7198] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7198/stat : 7198 (python) S 7063 7065 5551 0 -1 4202560 163 936 0 0 0 0 0 0 19 0 36 0 549502338 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7210] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7210/stat : 7210 (python) S 7063 7065 5551 0 -1 4202560 57 936 0 0 0 0 0 0 18 0 36 0 549521325 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7219] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7219/stat : 7219 (python) S 7063 7065 5551 0 -1 4202560 45 936 0 0 0 0 0 0 18 0 36 0 549545138 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7227] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7227/stat : 7227 (python) S 7063 7065 5551 0 -1 4202560 40 936 0 0 0 0 0 0 18 0 36 0 549562465 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7244] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7244/stat : 7244 (python) S 7063 7065 5551 0 -1 4202560 45 936 0 0 0 0 0 0 19 0 36 0 549603671 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7251] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7251/stat : 7251 (python) S 7063 7065 5551 0 -1 4202560 42 936 0 0 0 0 0 0 20 0 36 0 549616496 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7255] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7255/stat : 7255 (python) S 7063 7065 5551 0 -1 4202560 26 936 0 0 0 0 0 0 19 0 36 0 549619146 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
[pid=7065/tid=7266] ppid=7063 vsize=705040 CPUtime=0 cores=0-7
/proc/7065/task/7266/stat : 7266 (python) S 7063 7065 5551 0 -1 4202560 28 936 0 0 0 0 0 0 19 0 36 0 549641836 721960960 8049 33554432000 4194304 5683644 140733683129888 18446744073709551615 242982373809 0 0 16781312 2 18446604467459887360 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 15906.3
Current children cumulated vsize (KiB) 31749784

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7065 and gives
#  childrusage.ru_utime.tv_sec=5
#  childrusage.ru_utime.tv_usec=787120
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=207968
# CPU time returned by wait4() is 5.99509
# while last known CPU time is 15906.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 2263.92
CPU time (s): 15906.3
CPU user time (s): 15878.6
CPU system time (s): 27.7
CPU usage (%): 702.601
Max. virtual memory (cumulated for all children) (KiB): 31749784

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5.78712
system time used= 0.207968
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 69480
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1313
involuntary context switches= 134

runsolver used 26.9389 second user time and 56.7004 second system time

The end

Launcher Data 

Begin job on node128 at 2011-05-03 01:16:09
IDJOB=3322254
IDBENCH=83032
IDSOLVER=1712
FILE ID=node128/3322254-1304378168
RUNJOBID= node128-1304366466-5565
PBS_JOBID= 13181743
Free space on /tmp= 67852 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k7-r89-v90-c8010-S741717046-057.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322254-1304378168/watcher-3322254-1304378168 -o /tmp/evaluation-result-3322254-1304378168/solver-3322254-1304378168 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322254-1304378168.cnf -seed 469684950 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1f00de1fd8adbfbf4cc573ef44af531f
RANDOM SEED=469684950

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      24746056 kB
Buffers:        534252 kB
Cached:        2248164 kB
SwapCached:          0 kB
Active:        5523692 kB
Inactive:      2213720 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      24746056 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           32508 kB
Writeback:           0 kB
AnonPages:     4955588 kB
Mapped:          30776 kB
Slab:           366076 kB
PageTables:      34104 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 89343680 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 67820 MiB
End job on node128 at 2011-05-03 01:53:55