Trace number 3321897

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 9861.1 1563.21

General information on the benchmark

Namerandom/large/
unif-k5-r20-v2000-c40000-S922811046-076-UNKNOWN.cnf
MD5SUMe99bff721d695892a53f60adc73d403b
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark625.84
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of clauses40000
Sum of the clauses size200000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 540000
Number of clauses of size over 50

Solver Data 

0.37/0.65	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.65	c INFO: solving HOME/instance-3321897-1304369197.cnf
0.37/0.65	c INFO: computing task features
0.56/0.86	c INFO: computed variable-clause graph statistics
0.56/0.87	c INFO: computed clause balance statistics
1.66/1.94	c INFO: computed variable balance statistics
2.26/2.52	c INFO: computed small-clause counts
2.26/2.52	c INFO: computed Horn-clause counts
2.26/2.57	c INFO: computed variable graph statistics
2.26/2.57	c INFO: collected features for HOME/instance-3321897-1304369197.cnf in 1.91 s
2.35/2.61	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
2.35/2.65	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
2.35/2.68	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.08)
2.46/2.72	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.07)
2.46/2.76	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.05)
2.55/2.80	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.05)
2.55/2.84	c INFO: running FH@0 for 97 with 39997 remaining (b = 0.03)
2.55/2.88	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.03)
658.82/102.95	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.02)
659.47/103.05	c INFO: running FH@0 for 97 with 39897 remaining (b = 0.02)
659.96/103.10	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.04)
659.96/103.15	c INFO: running gnovelty+2@0 for 97 with 39897 remaining (b = 0.02)
660.42/103.21	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
948.94/151.42	c INFO: running adaptg2wsat2009++@0 for 97 with 39849 remaining (b = 0.01)
1128.40/181.47	c INFO: running hybridGM3@0 for 194 with 39819 remaining (b = 0.03)
1163.20/187.21	c INFO: running hybridGM3@0 for 194 with 39813 remaining (b = 0.02)
1306.31/209.31	c INFO: running TNM@0 for 1552 with 39791 remaining (b = 0.19)
1345.76/215.48	c INFO: running FH@0 for 97 with 39785 remaining (b = 0.01)
1455.13/233.75	c INFO: running adaptg2wsat2009++@0 for 97 with 39766 remaining (b = 0.01)
1562.73/251.80	c INFO: running adaptg2wsat2009++@0 for 97 with 39748 remaining (b = 0.01)
1995.39/324.16	c INFO: running hybridGM3@99 for 97 with 39676 remaining (b = 0.01)
2053.34/333.85	c INFO: running adaptg2wsat2009++@100 for 97 with 39666 remaining (b = 0.01)
2103.54/342.22	c INFO: running hybridGM3@0 for 194 with 39658 remaining (b = 0.02)
2179.89/354.06	c INFO: running hybridGM3@98 for 97 with 39646 remaining (b = 0.01)
2666.58/433.34	c INFO: running hybridGM3@0 for 194 with 39567 remaining (b = 0.02)
2689.81/437.21	c INFO: running TNM@0 for 1552 with 39563 remaining (b = 0.15)
2691.51/437.53	c INFO: running adaptg2wsat2009++@0 for 97 with 39563 remaining (b = 0.01)
2864.66/466.50	c INFO: running adaptg2wsat2009++@100 for 97 with 39534 remaining (b = 0.01)
3012.08/491.25	c INFO: running hybridGM3@99 for 97 with 39509 remaining (b = 0.01)
3173.19/516.69	c INFO: running hybridGM3@98 for 97 with 39484 remaining (b = 0.01)
3629.30/587.14	c INFO: running iPAWS@0 for 97 with 39413 remaining (b = 0.01)
3664.81/592.60	c INFO: running hybridGM3@294 for 97 with 39408 remaining (b = 0.01)
3859.11/623.05	c INFO: running FH@0 for 291 with 39377 remaining (b = 0.03)
3872.64/625.12	c INFO: running gnovelty+2@0 for 97 with 39375 remaining (b = 0.01)
3943.82/636.15	c INFO: running hybridGM3@98 for 97 with 39364 remaining (b = 0.01)
4185.99/672.19	c INFO: running hybridGM3@298 for 97 with 39328 remaining (b = 0.01)
4331.70/693.02	c INFO: running hybridGM3@390 for 97 with 39307 remaining (b = 0.01)
4454.34/710.65	c INFO: running adaptg2wsat2009++@298 for 291 with 39290 remaining (b = 0.02)
4545.31/724.63	c INFO: running FH@98 for 291 with 39276 remaining (b = 0.02)
4706.41/749.54	c INFO: running iPAWS@0 for 97 with 39251 remaining (b = 0.01)
4959.35/791.60	c INFO: running hybridGM3@393 for 97 with 39209 remaining (b = 0.01)
5047.79/806.42	c INFO: running hybridGM3@0 for 194 with 39194 remaining (b = 0.02)
5564.71/892.97	c INFO: running TNM@0 for 1552 with 39107 remaining (b = 0.11)
5775.03/928.13	c INFO: running gnovelty+2@0 for 97 with 39072 remaining (b = 0.01)
5872.75/943.01	c INFO: running hybridGM3@0 for 194 with 39057 remaining (b = 0.01)
6509.56/1042.65	c INFO: running adaptg2wsat2009++@397 for 194 with 38958 remaining (b = 0.01)
6579.69/1052.72	c INFO: running adaptg2wsat2009++@99 for 97 with 38948 remaining (b = 0.01)
6612.04/1057.33	c INFO: running hybridGM3@96 for 97 with 38943 remaining (b = 0.01)
6890.57/1098.74	c INFO: running FH@198 for 194 with 38901 remaining (b = 0.01)
7359.10/1174.16	c INFO: running hybridGM3@0 for 194 with 38826 remaining (b = 0.01)
7692.16/1230.03	c INFO: running adaptg2wsat2009++@294 for 291 with 38770 remaining (b = 0.02)
7733.29/1236.92	c INFO: running hybridGM3@388 for 97 with 38763 remaining (b = 0.01)
7890.55/1263.39	c INFO: running adaptg2wsat2009++@500 for 97 with 38737 remaining (b = 0.01)
8660.58/1380.60	c INFO: running FH@295 for 97 with 38620 remaining (b = 0.01)
8863.89/1412.03	c INFO: running FH@0 for 97 with 38588 remaining (b = 0.01)
9005.46/1434.56	c INFO: running NCVWr@0 for 485 with 38566 remaining (b = 0.03)
9063.77/1442.98	c INFO: running adaptg2wsat2009++@694 for 97 with 38557 remaining (b = 0.01)
9376.61/1488.00	c INFO: running FH@97 for 291 with 38512 remaining (b = 0.02)
9573.56/1518.44	c INFO: running iPAWS@0 for 97 with 38482 remaining (b = 0.01)
9739.40/1544.15	c INFO: running adaptg2wsat2009++@391 for 194 with 38456 remaining (b = 0.01)
9857.37/1562.41	c INFO: running hybridGM3@0 for 194 with 38438 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321897-1304369197/watcher-3321897-1304369197 -o /tmp/evaluation-result-3321897-1304369197/solver-3321897-1304369197 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321897-1304369197.cnf -seed 1872095153 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.79 9.37 8.72 3/332 15691
/proc/meminfo: memFree=7465060/32951124 swapFree=61020456/67111528
[pid=15691] ppid=15689 vsize=15772 CPUtime=0 cores=0-7
/proc/15691/stat : 15691 (python) S 15689 15691 15120 0 -1 4202496 895 0 0 0 0 0 0 0 20 0 1 0 627150379 16150528 776 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15691/statm: 3943 776 343 364 0 430 0

[startup+0.081825 s]
/proc/loadavg: 8.79 9.37 8.72 3/332 15691
/proc/meminfo: memFree=7465060/32951124 swapFree=61020456/67111528
[pid=15691] ppid=15689 vsize=50008 CPUtime=0.05 cores=0-7
/proc/15691/stat : 15691 (python) S 15689 15691 15120 0 -1 4202496 1975 0 0 0 4 1 0 0 20 0 1 0 627150379 51208192 1736 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15691/statm: 12502 1736 480 364 0 1202 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 50008

[startup+0.100819 s]
/proc/loadavg: 8.79 9.37 8.72 3/332 15691
/proc/meminfo: memFree=7465060/32951124 swapFree=61020456/67111528
[pid=15691] ppid=15689 vsize=89764 CPUtime=0.06 cores=0-7
/proc/15691/stat : 15691 (python) R 15689 15691 15120 0 -1 4202496 2640 0 0 0 5 1 0 0 20 0 1 0 627150379 91918336 2355 33554432000 4194304 5683644 140734986707152 18446744073709551615 224279952835 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/15691/statm: 22441 2356 719 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89764

[startup+0.300825 s]
/proc/loadavg: 8.79 9.37 8.72 3/332 15691
/proc/meminfo: memFree=7465060/32951124 swapFree=61020456/67111528
[pid=15691] ppid=15689 vsize=135744 CPUtime=0.19 cores=0-7
/proc/15691/stat : 15691 (python) S 15689 15691 15120 0 -1 4202496 5963 932 1 0 14 5 0 0 20 0 1 0 627150379 139001856 4150 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284921861 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15691/statm: 33936 4150 1032 364 0 3122 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135744

[startup+0.700719 s]
/proc/loadavg: 8.79 9.37 8.72 3/332 15691
/proc/meminfo: memFree=7465060/32951124 swapFree=61020456/67111528
[pid=15691] ppid=15689 vsize=281868 CPUtime=0.46 cores=0-7
/proc/15691/stat : 15691 (python) R 15689 15691 15120 0 -1 4202496 10097 932 1 0 35 11 0 0 19 0 1 0 627150379 288632832 7781 33554432000 4194304 5683644 140734986707152 18446744073709551615 5114666 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/15691/statm: 70467 7781 1761 364 0 6391 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 281868

[startup+1.50059 s]
/proc/loadavg: 8.79 9.37 8.72 4/333 15696
/proc/meminfo: memFree=7430828/32951124 swapFree=61020456/67111528
[pid=15691] ppid=15689 vsize=290800 CPUtime=1.26 cores=0-7
/proc/15691/stat : 15691 (python) R 15689 15691 15120 0 -1 4202496 14007 932 1 0 114 12 0 0 21 0 1 0 627150379 297779200 10085 33554432000 4194304 5683644 140734986707152 18446744073709551615 4525758 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/15691/statm: 72700 10085 1826 364 0 8624 0
Current children cumulated CPU time (s) 1.26
Current children cumulated vsize (KiB) 290800

[startup+3.10029 s]
/proc/loadavg: 8.79 9.37 8.72 4/333 15696
/proc/meminfo: memFree=7431076/32951124 swapFree=61020456/67111528
[pid=15691] ppid=15689 vsize=432068 CPUtime=2.64 cores=0-7
/proc/15691/stat : 15691 (python) S 15689 15691 15120 0 -1 4202496 20217 932 1 0 250 14 0 0 22 0 9 0 627150379 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/15691/statm: 108017 8840 1891 364 0 43914 0
Current children cumulated CPU time (s) 2.64
Current children cumulated vsize (KiB) 432068

[startup+6.30175 s]
/proc/loadavg: 8.33 9.26 8.69 11/357 15720
/proc/meminfo: memFree=7351632/32951124 swapFree=61020456/67111528
[pid=15691] ppid=15689 vsize=432068 CPUtime=2.64 cores=0-7
/proc/15691/stat : 15691 (python) S 15689 15691 15120 0 -1 4202496 20217 932 1 0 250 14 0 0 22 0 9 0 627150379 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/15691/statm: 108017 8840 1891 364 0 43914 0
[pid=15697] ppid=15691 vsize=284980 CPUtime=0 cores=0-7
/proc/15697/stat : 15697 (python) S 15691 15691 15120 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 627150640 291819520 6898 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945935 0 0 16781312 514 4945299016188395776 0 0 17 7 0 0 0
/proc/15697/statm: 71245 6898 355 364 0 7163 0
[pid=15699] ppid=15697 vsize=1020308 CPUtime=3.68 cores=0-7
/proc/15699/stat : 15699 (gnovelty+2) R 15697 15699 15699 0 -1 4202496 1152 0 0 0 368 0 0 0 25 0 1 0 627150640 1044795392 891 33554432000 134512640 135663704 4287647248 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/15699/statm: 255077 891 113 282 0 254793 0
[pid=15700] ppid=15691 vsize=294900 CPUtime=0 cores=0-7
/proc/15700/stat : 15700 (python) S 15691 15691 15120 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 627150644 301977600 7031 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 15381010715770847489 0 0 17 2 0 0 0
/proc/15700/statm: 73725 7031 349 364 0 9640 0
[pid=15702] ppid=15700 vsize=1020308 CPUtime=3.64 cores=0-7
/proc/15702/stat : 15702 (gnovelty+2) R 15700 15702 15702 0 -1 4202496 1153 0 0 0 364 0 0 0 25 0 1 0 627150644 1044795392 892 33554432000 134512640 135663704 4288476944 18446744073709551615 134547041 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15702/statm: 255077 892 113 282 0 254793 0
[pid=15703] ppid=15691 vsize=305760 CPUtime=0 cores=0-7
/proc/15703/stat : 15703 (python) S 15691 15691 15120 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 627150648 313098240 7035 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 4220106501361991940 0 0 17 1 0 0 0
/proc/15703/statm: 76440 7035 349 364 0 12352 0
[pid=15705] ppid=15703 vsize=423400 CPUtime=1.88 cores=0-7
/proc/15705/stat : 15705 (adaptg2wsat2009) R 15703 15705 15705 0 -1 4202496 2624 0 0 0 188 0 0 0 25 0 1 0 627150648 433561600 2359 33554432000 134512640 135107411 4292277120 18446744073709551615 134531781 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15705/statm: 105850 2359 59 146 0 104726 0
[pid=15706] ppid=15691 vsize=316084 CPUtime=0 cores=0-7
/proc/15706/stat : 15706 (python) S 15691 15691 15120 0 -1 4202560 753 0 0 0 0 0 0 0 18 0 1 0 627150651 323670016 7039 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 4945287471316304129 0 0 17 1 0 0 0
/proc/15706/statm: 79021 7039 349 364 0 14930 0
[pid=15708] ppid=15706 vsize=423400 CPUtime=3.52 cores=0-7
/proc/15708/stat : 15708 (adaptg2wsat2009) R 15706 15708 15708 0 -1 4202496 2622 0 0 0 352 0 0 0 25 0 1 0 627150652 433561600 2358 33554432000 134512640 135107411 4291896192 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/15708/statm: 105850 2358 59 146 0 104726 0
[pid=15709] ppid=15691 vsize=391056 CPUtime=0 cores=0-7
/proc/15709/stat : 15709 (python) S 15691 15691 15120 0 -1 4202560 717 0 0 0 0 0 0 0 18 0 1 0 627150655 400441344 7214 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 11459945817813516547 0 0 17 1 0 0 0
/proc/15709/statm: 97764 7214 348 364 0 33670 0
[pid=15711] ppid=15709 vsize=423400 CPUtime=3.5 cores=0-7
/proc/15711/stat : 15711 (adaptg2wsat2009) R 15709 15711 15711 0 -1 4202496 2611 0 0 0 350 0 0 0 25 0 1 0 627150657 433561600 2358 33554432000 134512640 135107411 4286760896 18446744073709551615 134532181 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/15711/statm: 105850 2358 59 146 0 104726 0
[pid=15712] ppid=15691 vsize=401312 CPUtime=0 cores=0-7
/proc/15712/stat : 15712 (python) S 15691 15691 15120 0 -1 4202560 730 0 0 0 0 0 0 0 18 0 1 0 627150659 410943488 7190 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 11459949666104213761 0 0 17 4 0 0 0
/proc/15712/statm: 100328 7190 348 364 0 36231 0
[pid=15714] ppid=15712 vsize=1020308 CPUtime=3.41 cores=0-7
/proc/15714/stat : 15714 (gnovelty+2) R 15712 15714 15714 0 -1 4202496 1144 0 0 0 341 0 0 0 25 0 1 0 627150661 1044795392 891 33554432000 134512640 135663704 4291488704 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15714/statm: 255077 891 113 282 0 254793 0
[pid=15715] ppid=15691 vsize=411568 CPUtime=0 cores=0-7
/proc/15715/stat : 15715 (python) S 15691 15691 15120 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 627150663 421445632 7161 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 5228750365049979140 0 0 17 1 0 0 0
/proc/15715/statm: 102892 7161 348 364 0 38792 0
[pid=15720] ppid=15715 vsize=253032 CPUtime=1.71 cores=0-7
/proc/15720/stat : 15720 (FH) R 15715 15720 15720 0 -1 4202496 2493 0 0 0 171 0 0 0 25 0 1 0 627150669 259104768 2234 33554432000 134512640 134936988 4291434096 18446744073709551615 134552507 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15720/statm: 63258 2234 41 104 0 62762 0
[pid=15717] ppid=15691 vsize=421824 CPUtime=0 cores=0-7
/proc/15717/stat : 15717 (python) S 15691 15691 15120 0 -1 4202560 765 0 0 0 0 0 0 0 18 0 1 0 627150667 431947776 7299 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 15381018412352241921 0 0 17 4 0 0 0
/proc/15717/statm: 105456 7299 354 364 0 41353 0
[pid=15719] ppid=15717 vsize=423400 CPUtime=1.71 cores=0-7
/proc/15719/stat : 15719 (adaptg2wsat2009) R 15717 15719 15719 0 -1 4202496 2619 0 0 0 171 0 0 0 25 0 1 0 627150668 433561600 2358 33554432000 134512640 135107411 4293080208 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/15719/statm: 105850 2358 59 146 0 104726 0
[pid=15691/tid=15698] ppid=15689 vsize=432068 CPUtime=0 cores=0-7
/proc/15691/task/15698/stat : 15698 (python) S 15689 15691 15120 0 -1 4202560 26 932 0 0 0 0 0 0 25 0 9 0 627150640 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15701] ppid=15689 vsize=432068 CPUtime=0 cores=0-7
/proc/15691/task/15701/stat : 15701 (python) S 15689 15691 15120 0 -1 4202560 23 932 0 0 0 0 0 0 25 0 9 0 627150644 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15704] ppid=15689 vsize=432068 CPUtime=0 cores=0-7
/proc/15691/task/15704/stat : 15704 (python) S 15689 15691 15120 0 -1 4202560 24 932 0 0 0 0 0 0 25 0 9 0 627150648 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15707] ppid=15689 vsize=432068 CPUtime=0 cores=0-7
/proc/15691/task/15707/stat : 15707 (python) S 15689 15691 15120 0 -1 4202560 33 932 0 0 0 0 0 0 25 0 9 0 627150652 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 7 0 0 0
[pid=15691/tid=15710] ppid=15689 vsize=432068 CPUtime=0 cores=0-7
/proc/15691/task/15710/stat : 15710 (python) S 15689 15691 15120 0 -1 4202560 94 932 0 0 0 0 0 0 19 0 9 0 627150655 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 1 0 0 0
[pid=15691/tid=15713] ppid=15689 vsize=432068 CPUtime=0 cores=0-7
/proc/15691/task/15713/stat : 15713 (python) S 15689 15691 15120 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 9 0 627150659 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15716] ppid=15689 vsize=432068 CPUtime=0 cores=0-7
/proc/15691/task/15716/stat : 15716 (python) S 15689 15691 15120 0 -1 4202560 36 932 0 0 0 0 0 0 21 0 9 0 627150663 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15718] ppid=15689 vsize=432068 CPUtime=0 cores=0-7
/proc/15691/task/15718/stat : 15718 (python) S 15689 15691 15120 0 -1 4202560 87 932 0 0 0 0 0 0 24 0 9 0 627150668 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.69
Current children cumulated vsize (KiB) 8267108

[startup+12.7017 s]
/proc/loadavg: 8.46 9.27 8.70 11/357 15720
/proc/meminfo: memFree=7351556/32951124 swapFree=61020456/67111528
[pid=15691] ppid=15689 vsize=432068 CPUtime=2.64 cores=0-7
/proc/15691/stat : 15691 (python) S 15689 15691 15120 0 -1 4202496 20217 932 1 0 250 14 0 0 22 0 9 0 627150379 442437632 8840 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/15691/statm: 108017 8840 1891 364 0 43914 0
[pid=15697] ppid=15691 vsize=284980 CPUtime=0.02 cores=0-7
/proc/15697/stat : 15697 (python) S 15691 15691 15120 0 -1 4202560 897 0 0 0 1 1 0 0 18 0 1 0 627150640 291819520 6921 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945935 0 0 16781312 514 6929526898523341056 0 0 17 7 0 0 0
/proc/15697/statm: 71245 6921 378 364 0 7163 0
[pid=15699] ppid=15697 vsize=1020308 CPUtime=10.08 cores=0-7
/proc/15699/stat : 15699 (gnovelty+2) R 15697 15699 15699 0 -1 4202496 1152 0 0 0 1008 0 0 0 25 0 1 0 627150640 1044795392 891 33554432000 134512640 135663704 4287647248 18446744073709551615 134525132 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/15699/statm: 255077 891 113 282 0 254793 0
[pid=15700] ppid=15691 vsize=294900 CPUtime=0.01 cores=0-7
/proc/15700/stat : 15700 (python) S 15691 15691 15120 0 -1 4202560 908 0 0 0 0 1 0 0 18 0 1 0 627150644 301977600 7054 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 15381010715770847489 0 0 17 2 0 0 0
/proc/15700/statm: 73725 7054 372 364 0 9640 0
[pid=15702] ppid=15700 vsize=1020308 CPUtime=10.04 cores=0-7
/proc/15702/stat : 15702 (gnovelty+2) R 15700 15702 15702 0 -1 4202496 1153 0 0 0 1004 0 0 0 25 0 1 0 627150644 1044795392 892 33554432000 134512640 135663704 4288476944 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15702/statm: 255077 892 113 282 0 254793 0
[pid=15703] ppid=15691 vsize=305760 CPUtime=0.01 cores=0-7
/proc/15703/stat : 15703 (python) S 15691 15691 15120 0 -1 4202560 882 0 0 0 1 0 0 0 18 0 1 0 627150648 313098240 7058 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 4220106501361991940 0 0 17 1 0 0 0
/proc/15703/statm: 76440 7058 372 364 0 12352 0
[pid=15705] ppid=15703 vsize=423400 CPUtime=5.06 cores=0-7
/proc/15705/stat : 15705 (adaptg2wsat2009) R 15703 15705 15705 0 -1 4202496 2624 0 0 0 506 0 0 0 25 0 1 0 627150648 433561600 2359 33554432000 134512640 135107411 4292277120 18446744073709551615 134531768 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15705/statm: 105850 2359 59 146 0 104726 0
[pid=15706] ppid=15691 vsize=316084 CPUtime=0.01 cores=0-7
/proc/15706/stat : 15706 (python) S 15691 15691 15120 0 -1 4202560 940 0 0 0 0 1 0 0 18 0 1 0 627150651 323670016 7062 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 4945287471316304129 0 0 17 1 0 0 0
/proc/15706/statm: 79021 7062 372 364 0 14930 0
[pid=15708] ppid=15706 vsize=423400 CPUtime=9.8 cores=0-7
/proc/15708/stat : 15708 (adaptg2wsat2009) R 15706 15708 15708 0 -1 4202496 2622 0 0 0 980 0 0 0 25 0 1 0 627150652 433561600 2358 33554432000 134512640 135107411 4291896192 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/15708/statm: 105850 2358 59 146 0 104726 0
[pid=15709] ppid=15691 vsize=391056 CPUtime=0 cores=0-7
/proc/15709/stat : 15709 (python) S 15691 15691 15120 0 -1 4202560 789 0 0 0 0 0 0 0 18 0 1 0 627150655 400441344 7237 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 11459945817813516547 0 0 17 1 0 0 0
/proc/15709/statm: 97764 7237 371 364 0 33670 0
[pid=15711] ppid=15709 vsize=423400 CPUtime=9.84 cores=0-7
/proc/15711/stat : 15711 (adaptg2wsat2009) R 15709 15711 15711 0 -1 4202496 2611 0 0 0 984 0 0 0 25 0 1 0 627150657 433561600 2358 33554432000 134512640 135107411 4286760896 18446744073709551615 134532242 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/15711/statm: 105850 2358 59 146 0 104726 0
[pid=15712] ppid=15691 vsize=401312 CPUtime=0.01 cores=0-7
/proc/15712/stat : 15712 (python) S 15691 15691 15120 0 -1 4202560 805 0 0 0 1 0 0 0 18 0 1 0 627150659 410943488 7213 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 11459949666104213761 0 0 17 4 0 0 0
/proc/15712/statm: 100328 7213 371 364 0 36231 0
[pid=15714] ppid=15712 vsize=1020308 CPUtime=9.81 cores=0-7
/proc/15714/stat : 15714 (gnovelty+2) R 15712 15714 15714 0 -1 4202496 1144 0 0 0 981 0 0 0 25 0 1 0 627150661 1044795392 891 33554432000 134512640 135663704 4291488704 18446744073709551615 134525136 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15714/statm: 255077 891 113 282 0 254793 0
[pid=15715] ppid=15691 vsize=411568 CPUtime=0 cores=0-7
/proc/15715/stat : 15715 (python) S 15691 15691 15120 0 -1 4202560 813 0 0 0 0 0 0 0 18 0 1 0 627150663 421445632 7184 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 5228750365049979140 0 0 17 1 0 0 0
/proc/15715/statm: 102892 7184 371 364 0 38792 0

################
# More data... #
################

/proc/15796/statm: 83999 1773 59 147 0 83851 0
[pid=15794/tid=15805] ppid=15691 vsize=565408 CPUtime=0 cores=0-7
/proc/15794/task/15805/stat : 15805 (python) S 15691 15691 15120 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 627221435 578977792 7561 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 514 18446604465764233600 0 0 -1 3 0 0 0
[pid=15799] ppid=15691 vsize=575664 CPUtime=0.28 cores=0-7
/proc/15799/stat : 15799 (python) S 15691 15691 15120 0 -1 4202560 1191 0 0 0 13 15 0 0 19 0 2 0 627212891 589479936 7583 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/15799/statm: 143916 7583 407 364 0 79768 0
[pid=15801] ppid=15799 vsize=1020308 CPUtime=99.34 cores=0-7
/proc/15801/stat : 15801 (gnovelty+2) T 15799 15801 15801 0 -1 4202496 1173 0 0 0 9934 0 0 0 25 0 1 0 627212892 1044795392 892 33554432000 134512640 135663704 4286871104 18446744073709551615 134525218 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/15801/statm: 255077 892 113 282 0 254793 0
[pid=15799/tid=15806] ppid=15691 vsize=575664 CPUtime=0 cores=0-7
/proc/15799/task/15806/stat : 15806 (python) S 15691 15691 15120 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 627222833 589479936 7583 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 514 18446604469547941952 0 0 -1 2 0 0 0
[pid=15807] ppid=15691 vsize=585920 CPUtime=0.5 cores=0-7
/proc/15807/stat : 15807 (python) S 15691 15691 15120 0 -1 4202560 1208 0 0 0 24 26 0 0 19 0 2 0 627225333 599982080 7580 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/15807/statm: 146480 7580 407 364 0 82329 0
[pid=15809] ppid=15807 vsize=335996 CPUtime=102.1 cores=0-7
/proc/15809/stat : 15809 (iPAWS) T 15807 15809 15809 0 -1 4202496 2056 0 0 0 10210 0 0 0 25 0 1 0 627225334 344059904 1775 33554432000 134512640 135114423 4293649312 18446744073709551615 134517404 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/15809/statm: 83999 1775 59 147 0 83851 0
[pid=15807/tid=15831] ppid=15691 vsize=585920 CPUtime=0 cores=0-7
/proc/15807/task/15831/stat : 15831 (python) S 15691 15691 15120 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 627243182 599982080 7580 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 514 18446604451146197120 0 0 -1 1 0 0 0
[pid=15812] ppid=15691 vsize=596176 CPUtime=1.78 cores=0-7
/proc/15812/stat : 15812 (python) S 15691 15691 15120 0 -1 4202560 1189 0 0 0 90 88 0 0 18 0 2 0 627231021 610484224 7726 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/15812/statm: 149044 7726 401 364 0 84890 0
[pid=15814] ppid=15812 vsize=268420 CPUtime=389.32 cores=0-7
/proc/15814/stat : 15814 (hybridGM3) T 15812 15814 15814 0 -1 4202496 6199 0 0 0 38931 1 0 0 25 0 1 0 627231021 274862080 5918 33554432000 134512640 135204385 4293709344 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/15814/statm: 67105 5918 63 169 0 66935 0
[pid=15812/tid=15841] ppid=15691 vsize=596176 CPUtime=0 cores=0-7
/proc/15812/task/15841/stat : 15841 (python) S 15691 15691 15120 0 -1 4202560 85 0 0 0 0 0 0 0 18 0 2 0 627256102 610484224 7726 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 514 18446604446782751744 0 0 -1 3 0 0 0
[pid=15826] ppid=15691 vsize=606432 CPUtime=1.9 cores=0-7
/proc/15826/stat : 15826 (python) S 15691 15691 15120 0 -1 4202560 994 0 0 0 95 95 0 0 18 0 1 0 627239676 620986368 7658 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 6929526898523341058 0 0 17 1 0 0 0
/proc/15826/statm: 151608 7658 373 364 0 87451 0
[pid=15828] ppid=15826 vsize=461508 CPUtime=622.05 cores=0-7
/proc/15828/stat : 15828 (TNM) R 15826 15828 15828 0 -1 4202496 2479 0 0 0 62205 0 0 0 25 0 1 0 627239676 472584192 2194 33554432000 134512640 135008748 4288937136 18446744073709551615 134528942 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/15828/statm: 115377 2194 46 122 0 114277 0
[pid=15832] ppid=15691 vsize=616688 CPUtime=0.35 cores=0-7
/proc/15832/stat : 15832 (python) S 15691 15691 15120 0 -1 4202560 1193 0 0 0 18 17 0 0 19 0 2 0 627243192 631488512 7746 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/15832/statm: 154172 7746 401 364 0 90012 0
[pid=15834] ppid=15832 vsize=1020308 CPUtime=102.32 cores=0-7
/proc/15834/stat : 15834 (gnovelty+2) T 15832 15834 15834 0 -1 4202496 1175 0 0 0 10232 0 0 0 25 0 1 0 627243192 1044795392 891 33554432000 134512640 135663704 4291392352 18446744073709551615 134547212 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/15834/statm: 255077 891 113 282 0 254793 0
[pid=15832/tid=15840] ppid=15691 vsize=616688 CPUtime=0 cores=0-7
/proc/15832/task/15840/stat : 15840 (python) S 15691 15691 15120 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 627255641 631488512 7746 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 514 18446604448029833152 0 0 -1 2 0 0 0
[pid=15835] ppid=15691 vsize=626944 CPUtime=0.81 cores=0-7
/proc/15835/stat : 15835 (python) S 15691 15691 15120 0 -1 4202560 1210 0 0 0 39 42 0 0 19 0 2 0 627244680 641990656 7711 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/15835/statm: 156736 7711 401 364 0 92573 0
[pid=15837] ppid=15835 vsize=268420 CPUtime=196.33 cores=0-7
/proc/15837/stat : 15837 (hybridGM3) T 15835 15837 15837 0 -1 4202496 6202 0 0 0 19632 1 0 0 25 0 1 0 627244681 274862080 5918 33554432000 134512640 135204385 4287287152 18446744073709551615 134537939 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/15837/statm: 67105 5918 63 169 0 66935 0
[pid=15835/tid=15851] ppid=15691 vsize=626944 CPUtime=0 cores=0-7
/proc/15835/task/15851/stat : 15851 (python) S 15691 15691 15120 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 627273371 641990656 7711 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 514 18446604443211098304 0 0 -1 4 0 0 0
[pid=15846] ppid=15691 vsize=637200 CPUtime=0.67 cores=0-7
/proc/15846/stat : 15846 (python) S 15691 15691 15120 0 -1 4202560 1252 0 0 0 36 31 0 0 19 0 2 0 627267795 652492800 7696 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/15846/statm: 159300 7696 407 364 0 95134 0
[pid=15848] ppid=15846 vsize=268424 CPUtime=197.7 cores=0-7
/proc/15848/stat : 15848 (hybridGM3) T 15846 15848 15848 0 -1 4202496 6207 0 0 0 19769 1 0 0 25 0 1 0 627267796 274866176 5920 33554432000 134512640 135204385 4294092096 18446744073709551615 134538375 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/15848/statm: 67106 5920 63 169 0 66936 0
[pid=15846/tid=15856] ppid=15691 vsize=637200 CPUtime=0 cores=0-7
/proc/15846/task/15856/stat : 15856 (python) S 15691 15691 15120 0 -1 4202560 94 0 0 0 0 0 0 0 19 0 2 0 627291572 652492800 7696 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 514 18446604446429848768 0 0 -1 0 0 0 0
[pid=15857] ppid=15691 vsize=647456 CPUtime=0.3 cores=0-7
/proc/15857/stat : 15857 (python) S 15691 15691 15120 0 -1 4202560 1249 0 0 0 15 15 0 0 19 0 2 0 627291582 662994944 7707 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/15857/statm: 161864 7707 407 364 0 97695 0
[pid=15859] ppid=15857 vsize=253028 CPUtime=97.97 cores=0-7
/proc/15859/stat : 15859 (FH) T 15857 15859 15859 0 -1 4202496 2519 0 0 0 9797 0 0 0 25 0 1 0 627291583 259100672 2233 33554432000 134512640 134936988 4293079104 18446744073709551615 134552504 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/15859/statm: 63257 2233 41 104 0 62761 0
[pid=15857/tid=15867] ppid=15691 vsize=647456 CPUtime=0 cores=0-7
/proc/15857/task/15867/stat : 15867 (python) S 15691 15691 15120 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 627302212 662994944 7707 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 514 18446604445474174912 0 0 -1 6 0 0 0
[pid=15860] ppid=15691 vsize=657712 CPUtime=0.35 cores=0-7
/proc/15860/stat : 15860 (python) S 15691 15691 15120 0 -1 4202560 1055 0 0 0 18 17 0 0 18 0 1 0 627293835 673497088 7775 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 6929526898523341059 0 0 17 4 0 0 0
/proc/15860/statm: 164428 7775 378 364 0 100256 0
[pid=15862] ppid=15860 vsize=423308 CPUtime=63.93 cores=0-7
/proc/15862/stat : 15862 (NCVWr) R 15860 15862 15862 0 -1 4202496 2551 0 0 0 6393 0 0 0 25 0 1 0 627293835 433467392 2265 33554432000 134512640 135113558 4288843264 18446744073709551615 134533479 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/15862/statm: 105827 2265 58 147 0 104702 0
[pid=15868] ppid=15691 vsize=667968 CPUtime=0.12 cores=0-7
/proc/15868/stat : 15868 (python) S 15691 15691 15120 0 -1 4202560 1062 0 0 0 6 6 0 0 18 0 1 0 627302223 683999232 7700 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 6929526898523341058 0 0 17 6 0 0 0
/proc/15868/statm: 166992 7700 379 364 0 102817 0
[pid=15870] ppid=15868 vsize=335996 CPUtime=31.63 cores=0-7
/proc/15870/stat : 15870 (iPAWS) R 15868 15870 15870 0 -1 4202496 2061 0 0 0 3163 0 0 0 25 0 1 0 627302224 344059904 1775 33554432000 134512640 135114423 4294234832 18446744073709551615 134546547 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15870/statm: 83999 1775 59 147 0 83851 0
[pid=15871] ppid=15691 vsize=678224 CPUtime=0 cores=0-7
/proc/15871/stat : 15871 (python) S 15691 15691 15120 0 -1 4202560 939 0 0 0 0 0 0 0 18 0 1 0 627306621 694501376 7679 33554432000 4194304 5683644 140734986707152 18446744073709551615 224284945990 0 0 16781312 514 2413498945763278847 0 0 17 4 0 0 0
/proc/15871/statm: 169556 7679 350 364 0 105378 0
[pid=15873] ppid=15871 vsize=268420 CPUtime=0.31 cores=0-7
/proc/15873/stat : 15873 (hybridGM3) R 15871 15873 15873 0 -1 4202496 6212 0 0 0 31 0 0 0 21 0 1 0 627306621 274862080 5919 33554432000 134512640 135204385 4294681552 18446744073709551615 134538395 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15873/statm: 67105 5919 63 169 0 66935 0
[pid=15691/tid=15698] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15698/stat : 15698 (python) S 15689 15691 15120 0 -1 4202560 26 932 0 0 0 0 0 0 25 0 34 0 627150640 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15701] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15701/stat : 15701 (python) S 15689 15691 15120 0 -1 4202560 23 932 0 0 0 0 0 0 25 0 34 0 627150644 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15704] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15704/stat : 15704 (python) S 15689 15691 15120 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 34 0 627150648 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15707] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15707/stat : 15707 (python) S 15689 15691 15120 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 34 0 627150652 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 7 0 0 0
[pid=15691/tid=15710] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15710/stat : 15710 (python) S 15689 15691 15120 0 -1 4202560 101 932 0 0 0 0 0 0 18 0 34 0 627150655 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 1 0 0 0
[pid=15691/tid=15713] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15713/stat : 15713 (python) S 15689 15691 15120 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 34 0 627150659 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15716] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15716/stat : 15716 (python) S 15689 15691 15120 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 34 0 627150663 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15718] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15718/stat : 15718 (python) S 15689 15691 15120 0 -1 4202560 93 932 0 0 0 0 0 0 18 0 34 0 627150668 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15728] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15728/stat : 15728 (python) S 15689 15691 15120 0 -1 4202560 63 932 0 0 0 0 0 0 18 0 34 0 627160674 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15733] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15733/stat : 15733 (python) S 15689 15691 15120 0 -1 4202560 64 932 0 0 0 0 0 0 18 0 34 0 627160684 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 1 0 0 0
[pid=15691/tid=15735] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15735/stat : 15735 (python) S 15689 15691 15120 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 34 0 627160689 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 1 0 0 0
[pid=15691/tid=15740] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15740/stat : 15740 (python) S 15689 15691 15120 0 -1 4202560 54 932 0 0 0 0 0 0 24 0 34 0 627160695 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 1 0 0 0
[pid=15691/tid=15743] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15743/stat : 15743 (python) S 15689 15691 15120 0 -1 4202560 23 932 0 0 0 0 0 0 18 0 34 0 627160701 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 1 0 0 0
[pid=15691/tid=15747] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15747/stat : 15747 (python) S 15689 15691 15120 0 -1 4202560 54 932 0 0 0 0 0 0 18 0 34 0 627165521 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15753] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15753/stat : 15753 (python) S 15689 15691 15120 0 -1 4202560 53 932 0 0 0 0 0 0 18 0 34 0 627168527 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 0 0 0 0
[pid=15691/tid=15757] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15757/stat : 15757 (python) S 15689 15691 15120 0 -1 4202560 52 932 0 0 0 0 0 0 18 0 34 0 627169100 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15761] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15761/stat : 15761 (python) S 15689 15691 15120 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 34 0 627171311 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 1 0 0 0
[pid=15691/tid=15765] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15765/stat : 15765 (python) S 15689 15691 15120 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 34 0 627171927 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15776] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15776/stat : 15776 (python) S 15689 15691 15120 0 -1 4202560 44 932 0 0 0 0 0 0 20 0 34 0 627184601 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 0 0 0 0
[pid=15691/tid=15782] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15782/stat : 15782 (python) S 15689 15691 15120 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 34 0 627193714 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 0 0 0 0
[pid=15691/tid=15785] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15785/stat : 15785 (python) S 15689 15691 15120 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 34 0 627194100 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 5 0 0 0
[pid=15691/tid=15795] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15795/stat : 15795 (python) S 15689 15691 15120 0 -1 4202560 43 932 0 0 0 0 0 0 20 0 34 0 627209093 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 5 0 0 0
[pid=15691/tid=15800] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15800/stat : 15800 (python) S 15689 15691 15120 0 -1 4202560 39 932 0 0 0 0 0 0 20 0 34 0 627212892 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 5 0 0 0
[pid=15691/tid=15808] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15808/stat : 15808 (python) S 15689 15691 15120 0 -1 4202560 44 932 0 0 0 0 0 0 19 0 34 0 627225333 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 3 0 0 0
[pid=15691/tid=15813] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15813/stat : 15813 (python) S 15689 15691 15120 0 -1 4202560 43 932 0 0 0 0 0 0 18 0 34 0 627231021 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15827] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15827/stat : 15827 (python) S 15689 15691 15120 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 34 0 627239676 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 2 0 0 0
[pid=15691/tid=15833] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15833/stat : 15833 (python) S 15689 15691 15120 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 34 0 627243192 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 1 0 0 0
[pid=15691/tid=15836] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15836/stat : 15836 (python) S 15689 15691 15120 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 34 0 627244681 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15847] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15847/stat : 15847 (python) S 15689 15691 15120 0 -1 4202560 39 932 0 0 0 0 0 0 19 0 34 0 627267795 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 3 0 0 0
[pid=15691/tid=15858] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15858/stat : 15858 (python) S 15689 15691 15120 0 -1 4202560 40 932 0 0 0 0 0 0 20 0 34 0 627291582 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15861] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15861/stat : 15861 (python) S 15689 15691 15120 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 34 0 627293835 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15869] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15869/stat : 15869 (python) S 15689 15691 15120 0 -1 4202560 36 932 0 0 0 0 0 0 20 0 34 0 627302223 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
[pid=15691/tid=15872] ppid=15689 vsize=688468 CPUtime=0 cores=0-7
/proc/15691/task/15872/stat : 15872 (python) S 15689 15691 15120 0 -1 4202560 38 932 0 0 0 0 0 0 20 0 34 0 627306621 704991232 9269 33554432000 4194304 5683644 140734986707152 18446744073709551615 224296749489 0 0 16781312 2 18446604442742683584 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9861.1
Current children cumulated vsize (KiB) 32644936

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15691 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=970940
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=282956
# CPU time returned by wait4() is 7.2539
# while last known CPU time is 9861.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1563.21
CPU time (s): 9861.1
CPU user time (s): 9843.69
CPU system time (s): 17.41
CPU usage (%): 630.822
Max. virtual memory (cumulated for all children) (KiB): 32644936

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.97094
system time used= 0.282956
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 72534
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3111
involuntary context switches= 142

runsolver used 16.6355 second user time and 39.602 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-02 22:46:37
IDJOB=3321897
IDBENCH=82675
IDSOLVER=1712
FILE ID=node118/3321897-1304369197
RUNJOBID= node118-1304366467-15134
PBS_JOBID= 13181753
Free space on /tmp= 73248 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k5-r20-v2000-c40000-S922811046-076-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321897-1304369197/watcher-3321897-1304369197 -o /tmp/evaluation-result-3321897-1304369197/solver-3321897-1304369197 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321897-1304369197.cnf -seed 1872095153 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e99bff721d695892a53f60adc73d403b
RANDOM SEED=1872095153

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       7465092 kB
Buffers:         11716 kB
Cached:         205020 kB
SwapCached:      96576 kB
Active:       12214732 kB
Inactive:     13034996 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       7465092 kB
SwapTotal:    67111528 kB
SwapFree:     61020456 kB
Dirty:           32844 kB
Writeback:           0 kB
AnonPages:    24948232 kB
Mapped:          15720 kB
Slab:            79444 kB
PageTables:      86044 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 76951972 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73216 MiB
End job on node118 at 2011-05-02 23:12:42