Trace number 3385336

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 8791.59 1106.72

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S927774663-037-UNKNOWN.cnf
MD5SUM950830e22ef92fb7f22c5b3c987a21f5
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.47	c INFO: solving HOME/instance-3385336-1305565227.cnf
0.32/0.47	c INFO: computing task features
0.61/0.70	c INFO: computed variable-clause graph statistics
0.61/0.70	c INFO: computed clause balance statistics
1.71/1.86	c INFO: computed variable balance statistics
2.21/2.32	c INFO: computed small-clause counts
2.21/2.32	c INFO: computed Horn-clause counts
2.21/2.36	c INFO: computed variable graph statistics
2.21/2.36	c INFO: collected features for HOME/instance-3385336-1305565227.cnf in 1.89 s
2.21/2.39	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.38)
2.31/2.42	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
2.31/2.45	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
2.31/2.48	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
2.41/2.51	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.05)
2.41/2.54	c INFO: running gnovelty+2@0 for 97 with 4997 remaining (b = 0.04)
2.41/2.58	c INFO: running FH@0 for 97 with 4997 remaining (b = 0.03)
2.50/2.61	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.03)
787.30/100.82	c INFO: running adaptg2wsat2009++@0 for 97 with 4899 remaining (b = 0.02)
802.41/102.78	c INFO: running FH@0 for 97 with 4897 remaining (b = 0.02)
803.10/102.81	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.04)
803.10/102.85	c INFO: running gnovelty+2@0 for 97 with 4897 remaining (b = 0.02)
803.10/102.90	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
803.60/102.94	c INFO: running adaptg2wsat2009++@0 for 97 with 4897 remaining (b = 0.01)
803.60/102.99	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
803.82/103.04	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.02)
1586.49/201.17	c INFO: running TNM@0 for 1552 with 4799 remaining (b = 0.18)
1602.39/203.13	c INFO: running FH@0 for 97 with 4797 remaining (b = 0.01)
1603.12/203.27	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1603.79/203.32	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
2364.03/298.86	c INFO: running hybridGM3@99 for 97 with 4701 remaining (b = 0.01)
2369.59/299.52	c INFO: running hybridGM3@100 for 97 with 4700 remaining (b = 0.01)
2370.37/299.61	c INFO: running hybridGM3@99 for 97 with 4700 remaining (b = 0.01)
2378.32/300.66	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.01)
2401.43/303.52	c INFO: running adaptg2wsat2009++@98 for 97 with 4697 remaining (b = 0.01)
2418.10/305.65	c INFO: running hybridGM3@0 for 194 with 4694 remaining (b = 0.02)
2436.43/307.95	c INFO: running hybridGM3@100 for 97 with 4692 remaining (b = 0.01)
3154.27/398.00	c INFO: running hybridGM3@0 for 194 with 4602 remaining (b = 0.02)
3163.84/399.22	c INFO: running hybridGM3@295 for 97 with 4601 remaining (b = 0.01)
3169.38/399.97	c INFO: running TNM@0 for 1552 with 4600 remaining (b = 0.14)
3176.54/400.86	c INFO: running adaptg2wsat2009++@100 for 97 with 4599 remaining (b = 0.01)
3177.26/400.92	c INFO: running hybridGM3@296 for 97 with 4599 remaining (b = 0.01)
3195.52/403.30	c INFO: running iPAWS@0 for 97 with 4597 remaining (b = 0.01)
3922.92/494.55	c INFO: running hybridGM3@395 for 97 with 4505 remaining (b = 0.01)
3936.45/496.26	c INFO: running gnovelty+2@0 for 97 with 4504 remaining (b = 0.01)
3951.56/498.21	c INFO: running hybridGM3@391 for 97 with 4502 remaining (b = 0.01)
3977.06/501.37	c INFO: running FH@0 for 291 with 4499 remaining (b = 0.02)
3995.35/503.65	c INFO: running adaptg2wsat2009++@99 for 97 with 4496 remaining (b = 0.01)
4681.66/589.88	c INFO: running FH@100 for 291 with 4410 remaining (b = 0.02)
4720.64/594.74	c INFO: running hybridGM3@99 for 97 with 4405 remaining (b = 0.01)
4728.55/595.70	c INFO: running iPAWS@0 for 97 with 4404 remaining (b = 0.01)
4742.86/597.58	c INFO: running adaptg2wsat2009++@99 for 97 with 4402 remaining (b = 0.01)
4770.70/601.06	c INFO: running hybridGM3@0 for 194 with 4399 remaining (b = 0.01)
5517.87/694.94	c INFO: running TNM@0 for 1552 with 4305 remaining (b = 0.11)
5527.40/696.11	c INFO: running adaptg2wsat2009++@99 for 97 with 4304 remaining (b = 0.01)
5527.40/696.19	c INFO: running gnovelty+2@0 for 97 with 4304 remaining (b = 0.01)
6301.63/793.47	c INFO: running hybridGM3@0 for 194 with 4207 remaining (b = 0.01)
6327.08/796.62	c INFO: running FH@0 for 97 with 4203 remaining (b = 0.01)
6336.60/797.82	c INFO: running hybridGM3@97 for 97 with 4202 remaining (b = 0.01)
6380.32/803.34	c INFO: running hybridGM3@0 for 194 with 4197 remaining (b = 0.01)
6988.99/879.82	c INFO: running FH@295 for 97 with 4120 remaining (b = 0.01)
7125.05/897.00	c INFO: running NCVWr@0 for 485 with 4103 remaining (b = 0.03)
7142.53/899.19	c INFO: running hybridGM3@386 for 194 with 4101 remaining (b = 0.01)
7747.02/975.17	c INFO: running FH@195 for 194 with 4025 remaining (b = 0.01)
7859.18/989.28	c INFO: running hybridGM3@99 for 97 with 4011 remaining (b = 0.01)
7945.05/1000.09	c INFO: running iPAWS@0 for 97 with 4000 remaining (b = 0.01)
8665.09/1090.67	c INFO: running hybridGM3@295 for 194 with 3909 remaining (b = 0.01)
8714.35/1096.85	c INFO: running hybridGM3@481 for 97 with 3903 remaining (b = 0.01)
8790.68/1106.49	c INFO: running NCVWr@0 for 485 with 3894 remaining (b = 0.02)
8791.59/1106.71	c INFO: running adaptg2wsat2009++@0 for 194 with 3893 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385336-1305565227/watcher-3385336-1305565227 -o /tmp/evaluation-result-3385336-1305565227/solver-3385336-1305565227 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385336-1305565227.cnf -seed 1026320414 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.89 4.55 1.90 1/366 304
/proc/meminfo: memFree=12926176/32950928 swapFree=57376972/67111528
[pid=304] ppid=302 vsize=14644 CPUtime=0 cores=0-7
/proc/304/stat : 304 (python) R 302 304 32484 0 -1 4202496 396 0 0 0 0 0 0 0 25 0 1 0 668122347 14995456 312 33554432000 4194304 5683644 140733666530864 18446744073709551615 4499152 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/304/statm: 3661 317 217 364 0 148 0

[startup+0.048064 s]
/proc/loadavg: 7.89 4.55 1.90 1/366 304
/proc/meminfo: memFree=12926176/32950928 swapFree=57376972/67111528
[pid=304] ppid=302 vsize=29796 CPUtime=0.02 cores=0-7
/proc/304/stat : 304 (python) R 302 304 32484 0 -1 4202496 1415 0 0 0 2 0 0 0 25 0 1 0 668122347 30511104 1260 33554432000 4194304 5683644 140733666530864 18446744073709551615 208079893189 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/304/statm: 7449 1267 443 364 0 819 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 29796

[startup+0.101055 s]
/proc/loadavg: 7.89 4.55 1.90 1/366 304
/proc/meminfo: memFree=12926176/32950928 swapFree=57376972/67111528
[pid=304] ppid=302 vsize=104228 CPUtime=0.07 cores=0-7
/proc/304/stat : 304 (python) S 302 304 32484 0 -1 4202496 3057 0 0 0 5 2 0 0 25 0 1 0 668122347 106729472 2741 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/304/statm: 26057 2741 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104228

[startup+0.301095 s]
/proc/loadavg: 7.89 4.55 1.90 1/366 304
/proc/meminfo: memFree=12926176/32950928 swapFree=57376972/67111528
[pid=304] ppid=302 vsize=170756 CPUtime=0.24 cores=0-7
/proc/304/stat : 304 (python) R 302 304 32484 0 -1 4202496 6728 939 1 0 17 7 0 0 17 0 1 0 668122347 174854144 4804 33554432000 4194304 5683644 140733666530864 18446744073709551615 47694026330336 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/304/statm: 42689 4805 1336 364 0 3454 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 170756

[startup+0.701013 s]
/proc/loadavg: 7.89 4.55 1.90 1/366 304
/proc/meminfo: memFree=12926176/32950928 swapFree=57376972/67111528
[pid=304] ppid=302 vsize=289508 CPUtime=0.61 cores=0-7
/proc/304/stat : 304 (python) R 302 304 32484 0 -1 4202496 13873 939 1 0 50 11 0 0 17 0 1 0 668122347 296456192 9750 33554432000 4194304 5683644 140733666530864 18446744073709551615 208079899520 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/304/statm: 72377 9750 1815 364 0 8301 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 289508

[startup+1.50079 s]
/proc/loadavg: 7.89 4.55 1.90 2/367 309
/proc/meminfo: memFree=12893432/32950928 swapFree=57376972/67111528
[pid=304] ppid=302 vsize=289508 CPUtime=1.41 cores=0-7
/proc/304/stat : 304 (python) R 302 304 32484 0 -1 4202496 13885 939 1 0 130 11 0 0 19 0 1 0 668122347 296456192 9761 33554432000 4194304 5683644 140733666530864 18446744073709551615 4603005 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/304/statm: 72377 9761 1826 364 0 8301 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 289508

[startup+3.10049 s]
/proc/loadavg: 7.89 4.55 1.90 2/367 309
/proc/meminfo: memFree=12892936/32950928 swapFree=57376972/67111528
[pid=304] ppid=302 vsize=429968 CPUtime=2.52 cores=0-7
/proc/304/stat : 304 (python) S 302 304 32484 0 -1 4202496 20178 939 1 0 239 13 0 0 25 0 9 0 668122347 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/304/statm: 107492 8088 1891 364 0 43389 0
Current children cumulated CPU time (s) 2.52
Current children cumulated vsize (KiB) 429968

[startup+6.30188 s]
/proc/loadavg: 7.34 4.49 1.89 9/391 342
/proc/meminfo: memFree=12830652/32950928 swapFree=57376972/67111528
[pid=304] ppid=302 vsize=429968 CPUtime=2.52 cores=0-7
/proc/304/stat : 304 (python) S 302 304 32484 0 -1 4202496 20178 939 1 0 239 13 0 0 25 0 9 0 668122347 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/304/statm: 107492 8088 1891 364 0 43389 0
[pid=310] ppid=304 vsize=282252 CPUtime=0 cores=0-7
/proc/310/stat : 310 (python) S 304 304 32484 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 668122587 289026048 6333 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252431 0 0 16781312 514 12185152076535267584 0 0 17 1 0 0 0
/proc/310/statm: 70563 6333 355 364 0 6481 0
[pid=321] ppid=310 vsize=1020188 CPUtime=3.89 cores=0-7
/proc/321/stat : 321 (gnovelty+2) R 310 321 321 0 -1 4202496 1141 0 0 0 389 0 0 0 25 0 1 0 668122587 1044672512 877 33554432000 134512640 135663704 4288899232 18446744073709551615 134525691 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/321/statm: 255047 877 113 282 0 254763 0
[pid=322] ppid=304 vsize=293136 CPUtime=0 cores=0-7
/proc/322/stat : 322 (python) S 304 304 32484 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 668122590 300171264 6370 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 10254691408015229186 0 0 17 1 0 0 0
/proc/322/statm: 73284 6370 349 364 0 9199 0
[pid=324] ppid=322 vsize=1020188 CPUtime=3.87 cores=0-7
/proc/324/stat : 324 (gnovelty+2) R 322 324 324 0 -1 4202496 1142 0 0 0 387 0 0 0 25 0 1 0 668122590 1044672512 877 33554432000 134512640 135663704 4292597744 18446744073709551615 134524821 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/324/statm: 255047 877 113 282 0 254763 0
[pid=325] ppid=304 vsize=302908 CPUtime=0 cores=0-7
/proc/325/stat : 325 (python) S 304 304 32484 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 668122592 310177792 6507 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 5071793430917513475 0 0 17 1 0 0 0
/proc/325/statm: 75727 6507 347 364 0 11639 0
[pid=327] ppid=325 vsize=421140 CPUtime=3.83 cores=0-7
/proc/327/stat : 327 (adaptg2wsat2009) R 325 327 327 0 -1 4202496 1803 0 0 0 383 0 0 0 25 0 1 0 668122593 431247360 1539 33554432000 134512640 135107411 4293988752 18446744073709551615 134523285 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/327/statm: 105285 1539 49 146 0 104161 0
[pid=328] ppid=304 vsize=313164 CPUtime=0 cores=0-7
/proc/328/stat : 328 (python) S 304 304 32484 0 -1 4202560 748 0 0 0 0 0 0 0 18 0 1 0 668122596 320679936 6510 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 18100767626039886082 0 0 17 7 0 0 0
/proc/328/statm: 78291 6510 347 364 0 14200 0
[pid=330] ppid=328 vsize=421140 CPUtime=3.8 cores=0-7
/proc/330/stat : 330 (adaptg2wsat2009) R 328 330 330 0 -1 4202496 1805 0 0 0 380 0 0 0 25 0 1 0 668122596 431247360 1538 33554432000 134512640 135107411 4287121600 18446744073709551615 134523319 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/330/statm: 105285 1538 49 146 0 104161 0
[pid=331] ppid=304 vsize=389552 CPUtime=0 cores=0-7
/proc/331/stat : 331 (python) S 304 304 32484 0 -1 4202560 757 0 0 0 0 0 0 0 18 0 1 0 668122599 398901248 6519 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 10484697970551783682 0 0 17 1 0 0 0
/proc/331/statm: 97388 6519 349 364 0 33294 0
[pid=333] ppid=331 vsize=421140 CPUtime=3.73 cores=0-7
/proc/333/stat : 333 (adaptg2wsat2009) R 331 333 333 0 -1 4202496 1807 0 0 0 373 0 0 0 25 0 1 0 668122599 431247360 1538 33554432000 134512640 135107411 4290062576 18446744073709551615 134523314 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/333/statm: 105285 1538 49 146 0 104161 0
[pid=334] ppid=304 vsize=399744 CPUtime=0 cores=0-7
/proc/334/stat : 334 (python) S 304 304 32484 0 -1 4202560 764 0 0 0 0 0 0 0 18 0 1 0 668122602 409337856 6523 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 4198803188695924994 0 0 17 6 0 0 0
/proc/334/statm: 99936 6523 349 364 0 35839 0
[pid=336] ppid=334 vsize=1020188 CPUtime=3.73 cores=0-7
/proc/336/stat : 336 (gnovelty+2) R 334 336 336 0 -1 4202496 1142 0 0 0 373 0 0 0 25 0 1 0 668122602 1044672512 877 33554432000 134512640 135663704 4293669520 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/336/statm: 255047 877 113 282 0 254763 0
[pid=337] ppid=304 vsize=409468 CPUtime=0 cores=0-7
/proc/337/stat : 337 (python) S 304 304 32484 0 -1 4202560 766 0 0 0 0 0 0 0 18 0 1 0 668122605 419295232 6537 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 17614416799435030786 0 0 17 0 0 0 0
/proc/337/statm: 102367 6537 347 364 0 38267 0
[pid=339] ppid=337 vsize=249144 CPUtime=3.65 cores=0-7
/proc/339/stat : 339 (FH) R 337 339 339 0 -1 4202496 1563 0 0 0 365 0 0 0 25 0 1 0 668122606 255123456 1296 33554432000 134512640 134936988 4290209472 18446744073709551615 134523462 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/339/statm: 62286 1296 37 104 0 61790 0
[pid=340] ppid=304 vsize=419724 CPUtime=0 cores=0-7
/proc/340/stat : 340 (python) S 304 304 32484 0 -1 4202560 803 0 0 0 0 0 0 0 18 0 1 0 668122609 429797376 6547 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 18100771474330583298 0 0 17 6 0 0 0
/proc/340/statm: 104931 6547 353 364 0 40828 0
[pid=342] ppid=340 vsize=421140 CPUtime=3.68 cores=0-7
/proc/342/stat : 342 (adaptg2wsat2009) R 340 342 342 0 -1 4202496 1812 0 0 0 368 0 0 0 25 0 1 0 668122609 431247360 1538 33554432000 134512640 135107411 4288073184 18446744073709551615 134523314 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/342/statm: 105285 1538 49 146 0 104161 0
[pid=304/tid=320] ppid=302 vsize=429968 CPUtime=0 cores=0-7
/proc/304/task/320/stat : 320 (python) S 302 304 32484 0 -1 4202560 24 939 0 0 0 0 0 0 21 0 9 0 668122587 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 4 0 0 0
[pid=304/tid=323] ppid=302 vsize=429968 CPUtime=0 cores=0-7
/proc/304/task/323/stat : 323 (python) S 302 304 32484 0 -1 4202560 24 939 0 0 0 0 0 0 18 0 9 0 668122590 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 3 0 0 0
[pid=304/tid=326] ppid=302 vsize=429968 CPUtime=0 cores=0-7
/proc/304/task/326/stat : 326 (python) S 302 304 32484 0 -1 4202560 22 939 0 0 0 0 0 0 23 0 9 0 668122593 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 4 0 0 0
[pid=304/tid=329] ppid=302 vsize=429968 CPUtime=0 cores=0-7
/proc/304/task/329/stat : 329 (python) S 302 304 32484 0 -1 4202560 19 939 0 0 0 0 0 0 19 0 9 0 668122596 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 5 0 0 0
[pid=304/tid=332] ppid=302 vsize=429968 CPUtime=0 cores=0-7
/proc/304/task/332/stat : 332 (python) S 302 304 32484 0 -1 4202560 25 939 0 0 0 0 0 0 19 0 9 0 668122599 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 0 0 0 0
[pid=304/tid=335] ppid=302 vsize=429968 CPUtime=0 cores=0-7
/proc/304/task/335/stat : 335 (python) S 302 304 32484 0 -1 4202560 25 939 0 0 0 0 0 0 21 0 9 0 668122602 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 6 0 0 0
[pid=304/tid=338] ppid=302 vsize=429968 CPUtime=0 cores=0-7
/proc/304/task/338/stat : 338 (python) S 302 304 32484 0 -1 4202560 27 939 0 0 0 0 0 0 23 0 9 0 668122605 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 6 0 0 0
[pid=304/tid=341] ppid=302 vsize=429968 CPUtime=0 cores=0-7
/proc/304/task/341/stat : 341 (python) S 302 304 32484 0 -1 4202560 28 939 0 0 0 0 0 0 25 0 9 0 668122609 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 32.7
Current children cumulated vsize (KiB) 8234184

[startup+12.7017 s]
/proc/loadavg: 7.39 4.55 1.93 9/391 342
/proc/meminfo: memFree=12821880/32950928 swapFree=57376972/67111528
[pid=304] ppid=302 vsize=429968 CPUtime=2.52 cores=0-7
/proc/304/stat : 304 (python) S 302 304 32484 0 -1 4202496 20178 939 1 0 239 13 0 0 25 0 9 0 668122347 440287232 8088 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/304/statm: 107492 8088 1891 364 0 43389 0
[pid=310] ppid=304 vsize=282252 CPUtime=0.02 cores=0-7
/proc/310/stat : 310 (python) S 304 304 32484 0 -1 4202560 893 0 0 0 1 1 0 0 18 0 1 0 668122587 289026048 6356 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252431 0 0 16781312 514 11119880061186965760 0 0 17 6 0 0 0
/proc/310/statm: 70563 6356 378 364 0 6481 0
[pid=321] ppid=310 vsize=1020188 CPUtime=10.28 cores=0-7
/proc/321/stat : 321 (gnovelty+2) R 310 321 321 0 -1 4202496 1141 0 0 0 1028 0 0 0 25 0 1 0 668122587 1044672512 877 33554432000 134512640 135663704 4288899232 18446744073709551615 134545183 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/321/statm: 255047 877 113 282 0 254763 0
[pid=322] ppid=304 vsize=293136 CPUtime=0.03 cores=0-7
/proc/322/stat : 322 (python) S 304 304 32484 0 -1 4202560 889 0 0 0 2 1 0 0 18 0 1 0 668122590 300171264 6393 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 11119880061186965762 0 0 17 1 0 0 0
/proc/322/statm: 73284 6393 372 364 0 9199 0
[pid=324] ppid=322 vsize=1020188 CPUtime=10.27 cores=0-7
/proc/324/stat : 324 (gnovelty+2) R 322 324 324 0 -1 4202496 1142 0 0 0 1027 0 0 0 25 0 1 0 668122590 1044672512 877 33554432000 134512640 135663704 4292597744 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/324/statm: 255047 877 113 282 0 254763 0
[pid=325] ppid=304 vsize=302908 CPUtime=0.02 cores=0-7
/proc/325/stat : 325 (python) S 304 304 32484 0 -1 4202560 925 0 0 0 1 1 0 0 18 0 1 0 668122592 310177792 6530 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 11119880061186965763 0 0 17 1 0 0 0
/proc/325/statm: 75727 6530 370 364 0 11639 0
[pid=327] ppid=325 vsize=421804 CPUtime=10.23 cores=0-7
/proc/327/stat : 327 (adaptg2wsat2009) R 325 327 327 0 -1 4202496 2136 0 0 0 1023 0 0 0 25 0 1 0 668122593 431927296 1872 33554432000 134512640 135107411 4293988752 18446744073709551615 134531582 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/327/statm: 105451 1872 59 146 0 104327 0
[pid=328] ppid=304 vsize=313164 CPUtime=0.03 cores=0-7
/proc/328/stat : 328 (python) S 304 304 32484 0 -1 4202560 935 0 0 0 2 1 0 0 18 0 1 0 668122596 320679936 6533 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 11119880061186965762 0 0 17 7 0 0 0
/proc/328/statm: 78291 6533 370 364 0 14200 0
[pid=330] ppid=328 vsize=421804 CPUtime=10.2 cores=0-7
/proc/330/stat : 330 (adaptg2wsat2009) R 328 330 330 0 -1 4202496 2138 0 0 0 1020 0 0 0 25 0 1 0 668122596 431927296 1871 33554432000 134512640 135107411 4287121600 18446744073709551615 134531795 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/330/statm: 105451 1871 59 146 0 104327 0
[pid=331] ppid=304 vsize=389552 CPUtime=0.02 cores=0-7
/proc/331/stat : 331 (python) S 304 304 32484 0 -1 4202560 935 0 0 0 1 1 0 0 18 0 1 0 668122599 398901248 6542 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 11119880061186965762 0 0 17 1 0 0 0
/proc/331/statm: 97388 6542 372 364 0 33294 0
[pid=333] ppid=331 vsize=421804 CPUtime=10 cores=0-7
/proc/333/stat : 333 (adaptg2wsat2009) R 331 333 333 0 -1 4202496 2140 0 0 0 1000 0 0 0 25 0 1 0 668122599 431927296 1871 33554432000 134512640 135107411 4290062576 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/333/statm: 105451 1871 59 146 0 104327 0
[pid=334] ppid=304 vsize=399744 CPUtime=0.03 cores=0-7
/proc/334/stat : 334 (python) S 304 304 32484 0 -1 4202560 960 0 0 0 1 2 0 0 18 0 1 0 668122602 409337856 6546 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 11119880061186965762 0 0 17 6 0 0 0
/proc/334/statm: 99936 6546 372 364 0 35839 0
[pid=336] ppid=334 vsize=1020188 CPUtime=10.02 cores=0-7
/proc/336/stat : 336 (gnovelty+2) R 334 336 336 0 -1 4202496 1142 0 0 0 1002 0 0 0 25 0 1 0 668122602 1044672512 877 33554432000 134512640 135663704 4293669520 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/336/statm: 255047 877 113 282 0 254763 0
[pid=337] ppid=304 vsize=409468 CPUtime=0.02 cores=0-7
/proc/337/stat : 337 (python) S 304 304 32484 0 -1 4202560 959 0 0 0 1 1 0 0 18 0 1 0 668122605 419295232 6560 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 11119880061186965762 0 0 17 0 0 0 0
/proc/337/statm: 102367 6560 370 364 0 38267 0

################
# More data... #
################

/proc/421/statm: 140929 7097 407 364 0 76784 0
[pid=423] ppid=421 vsize=335996 CPUtime=99.25 cores=0-7
/proc/423/stat : 423 (iPAWS) T 421 423 423 0 -1 4202496 2030 0 0 0 9925 0 0 0 25 0 1 0 668162678 344059904 1750 33554432000 134512640 135114423 4291617808 18446744073709551615 134515629 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/423/statm: 83999 1750 59 147 0 83851 0
[pid=421/tid=431] ppid=304 vsize=563716 CPUtime=0 cores=0-7
/proc/421/task/431/stat : 431 (python) S 304 304 32484 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 668172707 577245184 7097 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 514 18446604453861129088 0 0 -1 1 0 0 0
[pid=427] ppid=304 vsize=573972 CPUtime=0.3 cores=0-7
/proc/427/stat : 427 (python) S 304 304 32484 0 -1 4202560 1181 0 0 0 16 14 0 0 19 0 2 0 668171973 587747328 7105 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/427/statm: 143493 7105 407 364 0 79345 0
[pid=429] ppid=427 vsize=1020188 CPUtime=98.76 cores=0-7
/proc/429/stat : 429 (gnovelty+2) T 427 429 429 0 -1 4202496 1160 0 0 0 9876 0 0 0 25 0 1 0 668171974 1044672512 877 33554432000 134512640 135663704 4292609664 18446744073709551615 134544167 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/429/statm: 255047 877 113 282 0 254763 0
[pid=427/tid=435] ppid=304 vsize=573972 CPUtime=0 cores=0-7
/proc/427/task/435/stat : 435 (python) S 304 304 32484 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 668181912 587747328 7105 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 514 18446604445188109632 0 0 -1 1 0 0 0
[pid=436] ppid=304 vsize=584228 CPUtime=0.32 cores=0-7
/proc/436/stat : 436 (python) S 304 304 32484 0 -1 4202560 1200 0 0 0 16 16 0 0 19 0 2 0 668181918 598249472 7079 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/436/statm: 146057 7079 406 364 0 81906 0
[pid=438] ppid=436 vsize=335996 CPUtime=99.51 cores=0-7
/proc/438/stat : 438 (iPAWS) T 436 438 438 0 -1 4202496 2029 0 0 0 9951 0 0 0 25 0 1 0 668181918 344059904 1749 33554432000 134512640 135114423 4291456528 18446744073709551615 134515597 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/438/statm: 83999 1749 59 147 0 83851 0
[pid=436/tid=448] ppid=304 vsize=584228 CPUtime=0 cores=0-7
/proc/436/task/448/stat : 448 (python) S 304 304 32484 0 -1 4202560 105 0 0 0 0 0 0 0 19 0 2 0 668191960 598249472 7079 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 514 18446604447236092352 0 0 -1 6 0 0 0
[pid=440] ppid=304 vsize=594912 CPUtime=1.6 cores=0-7
/proc/440/stat : 440 (python) S 304 304 32484 0 -1 4202560 1332 0 0 0 72 88 0 0 18 0 2 0 668182454 609189888 7018 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/440/statm: 148728 7018 401 364 0 84574 0
[pid=442] ppid=440 vsize=268420 CPUtime=497.91 cores=0-7
/proc/442/stat : 442 (hybridGM3) R 440 442 442 0 -1 4202496 5667 0 0 0 49790 1 0 0 25 0 1 0 668182454 274862080 5377 33554432000 134512640 135204385 4291141600 18446744073709551615 134538284 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/442/statm: 67105 5377 63 169 0 66935 0
[pid=440/tid=472] ppid=304 vsize=594912 CPUtime=0 cores=0-7
/proc/440/task/472/stat : 472 (python) S 304 304 32484 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 668202123 609189888 7018 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 514 18446604438786091904 0 0 -1 3 0 0 0
[pid=445] ppid=304 vsize=605576 CPUtime=1.32 cores=0-7
/proc/445/stat : 445 (python) S 304 304 32484 0 -1 4202560 1115 0 0 0 69 63 0 0 18 0 1 0 668191842 620109824 6994 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 11119880061186965762 0 0 17 1 0 0 0
/proc/445/statm: 151394 6994 374 364 0 87237 0
[pid=447] ppid=445 vsize=459764 CPUtime=409.27 cores=0-7
/proc/447/stat : 447 (TNM) R 445 447 447 0 -1 4202496 1943 0 0 0 40926 1 0 0 25 0 1 0 668191842 470798336 1657 33554432000 134512640 135008748 4288647968 18446744073709551615 134529509 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/447/statm: 114941 1657 46 122 0 113841 0
[pid=449] ppid=304 vsize=615720 CPUtime=0.32 cores=0-7
/proc/449/stat : 449 (python) S 304 304 32484 0 -1 4202560 1302 0 0 0 15 17 0 0 19 0 2 0 668191966 630497280 7114 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/449/statm: 153930 7114 401 364 0 89770 0
[pid=451] ppid=449 vsize=1020188 CPUtime=99.4 cores=0-7
/proc/451/stat : 451 (gnovelty+2) T 449 451 451 0 -1 4202496 1169 0 0 0 9940 0 0 0 25 0 1 0 668191967 1044672512 877 33554432000 134512640 135663704 4286767536 18446744073709551615 134525157 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/451/statm: 255047 877 113 282 0 254763 0
[pid=449/tid=466] ppid=304 vsize=615720 CPUtime=0 cores=0-7
/proc/449/task/466/stat : 466 (python) S 304 304 32484 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 668202003 630497280 7114 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 514 18446604451857405248 0 0 -1 5 0 0 0
[pid=455] ppid=304 vsize=625920 CPUtime=0.99 cores=0-7
/proc/455/stat : 455 (python) S 304 304 32484 0 -1 4202560 1289 0 0 0 48 51 0 0 18 0 2 0 668201695 640942080 7119 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/455/statm: 156480 7119 402 364 0 92317 0
[pid=457] ppid=455 vsize=268424 CPUtime=312.34 cores=0-7
/proc/457/stat : 457 (hybridGM3) R 455 457 457 0 -1 4202496 5667 0 0 0 31234 0 0 0 25 0 1 0 668201695 274866176 5378 33554432000 134512640 135204385 4292326208 18446744073709551615 134538375 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/457/statm: 67106 5378 63 169 0 66936 0
[pid=455/tid=485] ppid=304 vsize=625920 CPUtime=0 cores=0-7
/proc/455/task/485/stat : 485 (python) S 304 304 32484 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 668221269 640942080 7119 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 514 18446604451857407040 0 0 -1 2 0 0 0
[pid=467] ppid=304 vsize=635860 CPUtime=0.76 cores=0-7
/proc/467/stat : 467 (python) S 304 304 32484 0 -1 4202560 1374 0 0 0 40 36 0 0 18 0 2 0 668202010 651120640 7238 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/467/statm: 158965 7238 406 364 0 94799 0
[pid=471] ppid=467 vsize=251296 CPUtime=231.62 cores=0-7
/proc/471/stat : 471 (FH) R 467 471 471 0 -1 4202496 1987 0 0 0 23161 1 0 0 25 0 1 0 668202010 257327104 1694 33554432000 134512640 134936988 4290750288 18446744073709551615 134552080 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/471/statm: 62824 1694 41 104 0 62328 0
[pid=467/tid=478] ppid=304 vsize=635860 CPUtime=0 cores=0-7
/proc/467/task/478/stat : 478 (python) S 304 304 32484 0 -1 4202560 210 0 0 0 0 0 0 0 19 0 2 0 668212041 651120640 7238 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 514 18446604441253519424 0 0 -1 0 0 0 0
[pid=473] ppid=304 vsize=646116 CPUtime=0.62 cores=0-7
/proc/473/stat : 473 (python) S 304 304 32484 0 -1 4202560 1249 0 0 0 32 30 0 0 19 0 2 0 668202682 661622784 7247 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/473/statm: 161529 7247 407 364 0 97360 0
[pid=475] ppid=473 vsize=268420 CPUtime=195.66 cores=0-7
/proc/475/stat : 475 (hybridGM3) T 473 475 475 0 -1 4202496 5664 0 0 0 19566 0 0 0 25 0 1 0 668202682 274862080 5377 33554432000 134512640 135204385 4287966592 18446744073709551615 134537939 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/475/statm: 67105 5377 63 169 0 66935 0
[pid=473/tid=486] ppid=304 vsize=646116 CPUtime=0 cores=0-7
/proc/473/task/486/stat : 486 (python) S 304 304 32484 0 -1 4202560 97 0 0 0 0 0 0 0 19 0 2 0 668222350 661622784 7247 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 514 18446604451937356608 0 0 -1 2 0 0 0
[pid=479] ppid=304 vsize=656372 CPUtime=0.66 cores=0-7
/proc/479/stat : 479 (python) S 304 304 32484 0 -1 4202560 1053 0 0 0 35 31 0 0 18 0 1 0 668212047 672124928 7225 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 11119880061186965763 0 0 17 2 0 0 0
/proc/479/statm: 164093 7225 378 364 0 99921 0
[pid=481] ppid=479 vsize=421340 CPUtime=203.74 cores=0-7
/proc/481/stat : 481 (NCVWr) R 479 481 481 0 -1 4202496 1995 0 0 0 20373 1 0 0 25 0 1 0 668212048 431452160 1712 33554432000 134512640 135113558 4294681424 18446744073709551615 134531788 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/481/statm: 105335 1712 58 147 0 104210 0
[pid=487] ppid=304 vsize=666628 CPUtime=0.33 cores=0-7
/proc/487/stat : 487 (python) S 304 304 32484 0 -1 4202560 1265 0 0 0 16 17 0 0 19 0 2 0 668222357 682627072 7292 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/487/statm: 166657 7292 407 364 0 102482 0
[pid=489] ppid=487 vsize=335996 CPUtime=100.77 cores=0-7
/proc/489/stat : 489 (iPAWS) T 487 489 489 0 -1 4202496 2037 0 0 0 10077 0 0 0 25 0 1 0 668222357 344059904 1749 33554432000 134512640 135114423 4290698416 18446744073709551615 134515597 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/489/statm: 83999 1749 59 147 0 83851 0
[pid=487/tid=493] ppid=304 vsize=666628 CPUtime=0 cores=0-7
/proc/487/task/493/stat : 493 (python) S 304 304 32484 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 668232990 682627072 7292 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 514 18446604443853333568 0 0 -1 1 0 0 0
[pid=494] ppid=304 vsize=676884 CPUtime=0 cores=0-7
/proc/494/stat : 494 (python) S 304 304 32484 0 -1 4202560 955 0 0 0 0 0 0 0 19 0 1 0 668232996 693129216 7214 33554432000 4194304 5683644 140733666530864 18446744073709551615 208080252486 0 0 16781312 514 15752615959145218047 0 0 17 2 0 0 0
/proc/494/statm: 169221 7214 352 364 0 105043 0
[pid=496] ppid=494 vsize=412488 CPUtime=0.02 cores=0-7
/proc/496/stat : 496 (NCVWr) R 494 496 496 0 -1 4202496 580 0 0 0 2 0 0 0 21 0 1 0 668232997 422387712 293 33554432000 134512640 135113558 4287074384 18446744073709551615 134523167 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/496/statm: 103155 294 55 147 0 102030 0
[pid=304/tid=320] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/320/stat : 320 (python) S 302 304 32484 0 -1 4202560 24 939 0 0 0 0 0 0 21 0 34 0 668122587 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 4 0 0 0
[pid=304/tid=323] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/323/stat : 323 (python) S 302 304 32484 0 -1 4202560 24 939 0 0 0 0 0 0 18 0 34 0 668122590 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 3 0 0 0
[pid=304/tid=326] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/326/stat : 326 (python) S 302 304 32484 0 -1 4202560 28 939 0 0 0 0 0 0 18 0 34 0 668122593 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 4 0 0 0
[pid=304/tid=329] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/329/stat : 329 (python) S 302 304 32484 0 -1 4202560 29 939 0 0 0 0 0 0 15 0 34 0 668122596 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=332] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/332/stat : 332 (python) S 302 304 32484 0 -1 4202560 33 939 0 0 0 0 0 0 18 0 34 0 668122599 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 0 0 0 0
[pid=304/tid=335] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/335/stat : 335 (python) S 302 304 32484 0 -1 4202560 25 939 0 0 0 0 0 0 21 0 34 0 668122602 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 6 0 0 0
[pid=304/tid=338] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/338/stat : 338 (python) S 302 304 32484 0 -1 4202560 35 939 0 0 0 0 0 0 18 0 34 0 668122605 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 6 0 0 0
[pid=304/tid=341] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/341/stat : 341 (python) S 302 304 32484 0 -1 4202560 31 939 0 0 0 0 0 0 18 0 34 0 668122609 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 6 0 0 0
[pid=304/tid=356] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/356/stat : 356 (python) S 302 304 32484 0 -1 4202560 28 939 0 0 0 0 0 0 18 0 34 0 668132430 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 1 0 0 0
[pid=304/tid=362] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/362/stat : 362 (python) S 302 304 32484 0 -1 4202560 37 939 0 0 0 0 0 0 18 0 34 0 668132625 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 5 0 0 0
[pid=304/tid=366] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/366/stat : 366 (python) S 302 304 32484 0 -1 4202560 50 939 0 0 0 0 0 0 18 0 34 0 668132629 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 3 0 0 0
[pid=304/tid=369] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/369/stat : 369 (python) S 302 304 32484 0 -1 4202560 96 939 0 0 0 0 0 0 21 0 34 0 668132633 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 1 0 0 0
[pid=304/tid=374] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/374/stat : 374 (python) S 302 304 32484 0 -1 4202560 27 939 0 0 0 0 0 0 18 0 34 0 668132637 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=378] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/378/stat : 378 (python) S 302 304 32484 0 -1 4202560 37 939 0 0 0 0 0 0 18 0 34 0 668132642 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 6 0 0 0
[pid=304/tid=381] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/381/stat : 381 (python) S 302 304 32484 0 -1 4202560 44 939 0 0 0 0 0 0 18 0 34 0 668132646 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 7 0 0 0
[pid=304/tid=384] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/384/stat : 384 (python) S 302 304 32484 0 -1 4202560 29 939 0 0 0 0 0 0 18 0 34 0 668132651 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 7 0 0 0
[pid=304/tid=391] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/391/stat : 391 (python) S 302 304 32484 0 -1 4202560 29 939 0 0 0 0 0 0 20 0 34 0 668142464 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 0 0 0 0
[pid=304/tid=395] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/395/stat : 395 (python) S 302 304 32484 0 -1 4202560 124 939 0 0 0 0 0 0 20 0 34 0 668142661 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 7 0 0 0
[pid=304/tid=410] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/410/stat : 410 (python) S 302 304 32484 0 -1 4202560 48 939 0 0 0 0 0 0 19 0 34 0 668152913 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=416] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/416/stat : 416 (python) S 302 304 32484 0 -1 4202560 42 939 0 0 0 0 0 0 18 0 34 0 668162148 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=419] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/419/stat : 419 (python) S 302 304 32484 0 -1 4202560 34 939 0 0 0 0 0 0 20 0 34 0 668162345 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=422] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/422/stat : 422 (python) S 302 304 32484 0 -1 4202560 38 939 0 0 0 0 0 0 20 0 34 0 668162677 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=428] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/428/stat : 428 (python) S 302 304 32484 0 -1 4202560 39 939 0 0 0 0 0 0 20 0 34 0 668171974 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 1 0 0 0
[pid=304/tid=437] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/437/stat : 437 (python) S 302 304 32484 0 -1 4202560 44 939 0 0 0 0 0 0 20 0 34 0 668181918 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 1 0 0 0
[pid=304/tid=441] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/441/stat : 441 (python) S 302 304 32484 0 -1 4202560 44 939 0 0 0 0 0 0 18 0 34 0 668182454 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=446] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/446/stat : 446 (python) S 302 304 32484 0 -1 4202560 28 939 0 0 0 0 0 0 19 0 34 0 668191842 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=450] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/450/stat : 450 (python) S 302 304 32484 0 -1 4202560 29 939 0 0 0 0 0 0 20 0 34 0 668191967 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=456] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/456/stat : 456 (python) S 302 304 32484 0 -1 4202560 41 939 0 0 0 0 0 0 18 0 34 0 668201695 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 3 0 0 0
[pid=304/tid=469] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/469/stat : 469 (python) S 302 304 32484 0 -1 4202560 165 939 0 0 0 0 0 0 18 0 34 0 668202010 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=474] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/474/stat : 474 (python) S 302 304 32484 0 -1 4202560 39 939 0 0 0 0 0 0 20 0 34 0 668202682 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=480] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/480/stat : 480 (python) S 302 304 32484 0 -1 4202560 42 939 0 0 0 0 0 0 20 0 34 0 668212047 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=488] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/488/stat : 488 (python) S 302 304 32484 0 -1 4202560 42 939 0 0 0 0 0 0 19 0 34 0 668222357 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 2 0 0 0
[pid=304/tid=495] ppid=302 vsize=687128 CPUtime=0 cores=0-7
/proc/304/task/495/stat : 495 (python) S 302 304 32484 0 -1 4202560 39 939 0 0 0 0 0 0 20 0 34 0 668232997 703619072 8808 33554432000 4194304 5683644 140733666530864 18446744073709551615 208092055985 0 0 16781312 2 18446604446747638784 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 8791.59
Current children cumulated vsize (KiB) 32642552

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 304 and gives
#  childrusage.ru_utime.tv_sec=2381
#  childrusage.ru_utime.tv_usec=153009
#  childrusage.ru_stime.tv_sec=14
#  childrusage.ru_stime.tv_usec=300825
# CPU time returned by wait4() is 2395.45
# while last known CPU time is 8791.59
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1106.72
CPU time (s): 8791.59
CPU user time (s): 8777.49
CPU system time (s): 14.1
CPU usage (%): 794.385
Max. virtual memory (cumulated for all children) (KiB): 32642552

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2381.15
system time used= 14.3008
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 126707
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13145
involuntary context switches= 14460

runsolver used 12.3631 second user time and 28.3397 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-16 19:00:27
IDJOB=3385336
IDBENCH=82601
IDSOLVER=1870
FILE ID=node127/3385336-1305565227
RUNJOBID= node127-1305564963-32498
PBS_JOBID= 13350123
Free space on /tmp= 73392 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S927774663-037-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385336-1305565227/watcher-3385336-1305565227 -o /tmp/evaluation-result-3385336-1305565227/solver-3385336-1305565227 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385336-1305565227.cnf -seed 1026320414 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 950830e22ef92fb7f22c5b3c987a21f5
RANDOM SEED=1026320414

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12926456 kB
Buffers:         64984 kB
Cached:         440468 kB
SwapCached:     117872 kB
Active:        5316944 kB
Inactive:     14487672 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12926456 kB
SwapTotal:    67111528 kB
SwapFree:     57376972 kB
Dirty:           33404 kB
Writeback:           0 kB
AnonPages:    19188136 kB
Mapped:          25388 kB
Slab:            72068 kB
PageTables:      77596 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 72333368 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73360 MiB
End job on node127 at 2011-05-16 19:18:56