Trace number 3385413

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 10566.1 1506.02

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S1859210562-077-UNKNOWN.cnf
MD5SUM3d96bca49fe954bb59442ef617e689bb
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.31/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.46	c INFO: solving HOME/instance-3385413-1305566335.cnf
0.31/0.46	c INFO: computing task features
0.50/0.64	c INFO: computed variable-clause graph statistics
0.50/0.64	c INFO: computed clause balance statistics
1.40/1.53	c INFO: computed variable balance statistics
1.70/1.89	c INFO: computed small-clause counts
1.70/1.89	c INFO: computed Horn-clause counts
1.80/1.92	c INFO: computed variable graph statistics
1.80/1.92	c INFO: collected features for HOME/instance-3385413-1305566335.cnf in 1.46 s
1.80/1.95	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.37)
1.80/1.99	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
1.89/2.02	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
1.89/2.05	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
1.89/2.08	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.05)
2.40/2.12	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.04)
2.40/2.15	c INFO: running FH@0 for 97 with 4998 remaining (b = 0.03)
3.89/2.40	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.03)
697.29/101.63	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.02)
702.26/102.38	c INFO: running FH@0 for 97 with 4898 remaining (b = 0.02)
786.72/114.44	c INFO: running hybridGM3@0 for 194 with 4886 remaining (b = 0.04)
787.89/114.65	c INFO: running gnovelty+2@0 for 97 with 4885 remaining (b = 0.02)
828.42/120.47	c INFO: running hybridGM3@0 for 194 with 4880 remaining (b = 0.03)
832.06/120.96	c INFO: running adaptg2wsat2009++@0 for 97 with 4879 remaining (b = 0.01)
871.11/126.56	c INFO: running hybridGM3@0 for 194 with 4873 remaining (b = 0.03)
912.86/132.55	c INFO: running hybridGM3@0 for 194 with 4867 remaining (b = 0.02)
1405.87/202.04	c INFO: running TNM@0 for 1552 with 4798 remaining (b = 0.19)
1453.18/208.81	c INFO: running FH@0 for 97 with 4791 remaining (b = 0.01)
1497.14/215.12	c INFO: running adaptg2wsat2009++@0 for 97 with 4785 remaining (b = 0.01)
1792.40/257.50	c INFO: running adaptg2wsat2009++@97 for 97 with 4743 remaining (b = 0.01)
2175.45/312.53	c INFO: running hybridGM3@0 for 194 with 4687 remaining (b = 0.02)
2194.26/315.25	c INFO: running hybridGM3@0 for 194 with 4685 remaining (b = 0.02)
2334.23/335.39	c INFO: running hybridGM3@99 for 97 with 4665 remaining (b = 0.01)
2335.02/335.45	c INFO: running hybridGM3@99 for 97 with 4665 remaining (b = 0.01)
2375.97/341.38	c INFO: running hybridGM3@97 for 97 with 4659 remaining (b = 0.01)
2705.44/388.69	c INFO: running hybridGM3@100 for 97 with 4611 remaining (b = 0.01)
2764.06/397.06	c INFO: running TNM@0 for 1455 with 4603 remaining (b = 0.14)
2999.30/430.89	c INFO: running hybridGM3@297 for 97 with 4569 remaining (b = 0.01)
3082.90/442.83	c INFO: running hybridGM3@298 for 97 with 4557 remaining (b = 0.01)
3166.49/454.83	c INFO: running adaptg2wsat2009++@0 for 97 with 4545 remaining (b = 0.01)
3511.67/502.16	c INFO: running adaptg2wsat2009++@0 for 97 with 4498 remaining (b = 0.01)
3722.75/532.49	c INFO: running adaptg2wsat2009++@100 for 97 with 4468 remaining (b = 0.01)
3804.83/544.24	c INFO: running gnovelty+2@0 for 97 with 4456 remaining (b = 0.01)
3806.32/544.45	c INFO: running hybridGM3@293 for 97 with 4456 remaining (b = 0.01)
3902.27/558.27	c INFO: running hybridGM3@395 for 97 with 4442 remaining (b = 0.01)
4028.41/576.33	c INFO: running iPAWS@0 for 97 with 4424 remaining (b = 0.01)
4308.63/616.67	c INFO: running hybridGM3@393 for 97 with 4383 remaining (b = 0.01)
4486.16/641.95	c INFO: running hybridGM3@100 for 97 with 4358 remaining (b = 0.01)
4611.51/659.93	c INFO: running FH@0 for 291 with 4340 remaining (b = 0.02)
4673.45/668.83	c INFO: running hybridGM3@0 for 194 with 4331 remaining (b = 0.01)
4707.41/673.75	c INFO: running TNM@0 for 1552 with 4326 remaining (b = 0.11)
4854.10/694.83	c INFO: running adaptg2wsat2009++@102 for 97 with 4305 remaining (b = 0.01)
5030.07/720.11	c INFO: running FH@102 for 291 with 4280 remaining (b = 0.02)
5247.75/751.42	c INFO: running iPAWS@0 for 97 with 4249 remaining (b = 0.01)
5683.13/810.34	c INFO: running adaptg2wsat2009++@97 for 97 with 4190 remaining (b = 0.01)
6106.67/869.93	c INFO: running adaptg2wsat2009++@99 for 97 with 4130 remaining (b = 0.01)
6119.23/871.80	c INFO: running hybridGM3@98 for 97 with 4128 remaining (b = 0.01)
6502.73/925.84	c INFO: running NCVWr@0 for 485 with 4074 remaining (b = 0.03)
6799.35/968.13	c INFO: running FH@97 for 291 with 4032 remaining (b = 0.02)
6913.54/984.42	c INFO: running adaptg2wsat2009++@295 for 291 with 4016 remaining (b = 0.02)
7045.76/1003.34	c INFO: running hybridGM3@192 for 97 with 3997 remaining (b = 0.01)
7557.72/1076.49	c INFO: running gnovelty+2@0 for 97 with 3924 remaining (b = 0.01)
8093.19/1152.95	c INFO: running hybridGM3@480 for 97 with 3847 remaining (b = 0.01)
8514.34/1213.11	c INFO: running iPAWS@0 for 97 with 3787 remaining (b = 0.01)
9014.71/1284.49	c INFO: running hybridGM3@0 for 194 with 3716 remaining (b = 0.01)
9144.72/1302.64	c INFO: running adaptg2wsat2009++@396 for 194 with 3697 remaining (b = 0.01)
9171.23/1306.44	c INFO: running FH@198 for 194 with 3694 remaining (b = 0.01)
9346.58/1331.61	c INFO: running FH@0 for 97 with 3668 remaining (b = 0.01)
10089.01/1438.07	c INFO: running hybridGM3@0 for 194 with 3562 remaining (b = 0.01)
10317.78/1470.92	c INFO: running NCVWr@292 for 97 with 3529 remaining (b = 0.01)
10563.69/1505.53	c INFO: running hybridGM3@0 for 194 with 3494 remaining (b = 0.01)
10566.10/1505.98	c INFO: running TNM@0 for 1552 with 3494 remaining (b = 0.08)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385413-1305566335/watcher-3385413-1305566335 -o /tmp/evaluation-result-3385413-1305566335/solver-3385413-1305566335 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385413-1305566335.cnf -seed 1836209777 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.93 8.34 6.45 2/451 29344
/proc/meminfo: memFree=16633980/32951124 swapFree=45193380/67111528
[pid=29344] ppid=29342 vsize=16236 CPUtime=0 cores=0-7
/proc/29344/stat : 29344 (python) R 29342 29344 28826 0 -1 4202496 1049 0 0 0 0 0 0 0 23 0 1 0 746864178 16625664 921 33554432000 4194304 5683644 140734255250000 18446744073709551615 4522565 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29344/statm: 4059 921 381 364 0 546 0

[startup+0.081487 s]
/proc/loadavg: 7.93 8.34 6.45 2/451 29344
/proc/meminfo: memFree=16633980/32951124 swapFree=45193380/67111528
[pid=29344] ppid=29342 vsize=87704 CPUtime=0.05 cores=0-7
/proc/29344/stat : 29344 (python) R 29342 29344 28826 0 -1 4202496 2637 0 0 0 4 1 0 0 23 0 1 0 746864178 89808896 2354 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284921701 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29344/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 87704

[startup+0.100497 s]
/proc/loadavg: 7.93 8.34 6.45 2/451 29344
/proc/meminfo: memFree=16633980/32951124 swapFree=45193380/67111528
[pid=29344] ppid=29342 vsize=104220 CPUtime=0.07 cores=0-7
/proc/29344/stat : 29344 (python) S 29342 29344 28826 0 -1 4202496 3049 0 0 0 5 2 0 0 23 0 1 0 746864178 106721280 2733 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/29344/statm: 26055 2733 847 364 0 1803 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104220

[startup+0.300462 s]
/proc/loadavg: 7.93 8.34 6.45 2/451 29344
/proc/meminfo: memFree=16633980/32951124 swapFree=45193380/67111528
[pid=29344] ppid=29342 vsize=187740 CPUtime=0.23 cores=0-7
/proc/29344/stat : 29344 (python) R 29342 29344 28826 0 -1 4202496 6794 934 1 0 17 6 0 0 17 0 1 0 746864178 192245760 4860 33554432000 4194304 5683644 140734255250000 18446744073709551615 224279957347 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29344/statm: 46935 4861 1381 364 0 3723 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 187740

[startup+0.700385 s]
/proc/loadavg: 7.93 8.34 6.45 2/451 29344
/proc/meminfo: memFree=16633980/32951124 swapFree=45193380/67111528
[pid=29344] ppid=29342 vsize=285672 CPUtime=0.6 cores=0-7
/proc/29344/stat : 29344 (python) R 29342 29344 28826 0 -1 4202496 12373 934 1 0 51 9 0 0 17 0 1 0 746864178 292528128 8803 33554432000 4194304 5683644 140734255250000 18446744073709551615 47999407488560 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29344/statm: 71418 8803 1826 364 0 7342 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 285672

[startup+1.50026 s]
/proc/loadavg: 7.93 8.34 6.45 3/452 29349
/proc/meminfo: memFree=16604956/32951124 swapFree=45193380/67111528
[pid=29344] ppid=29342 vsize=285672 CPUtime=1.4 cores=0-7
/proc/29344/stat : 29344 (python) R 29342 29344 28826 0 -1 4202496 12373 934 1 0 131 9 0 0 19 0 1 0 746864178 292528128 8803 33554432000 4194304 5683644 140734255250000 18446744073709551615 4662462 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29344/statm: 71418 8803 1826 364 0 7342 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 285672

[startup+3.10095 s]
/proc/loadavg: 7.93 8.34 6.45 8/467 29364
/proc/meminfo: memFree=16575696/32951124 swapFree=45193380/67111528
[pid=29344] ppid=29342 vsize=362884 CPUtime=2.08 cores=0-7
/proc/29344/stat : 29344 (python) S 29342 29344 28826 0 -1 4202496 18622 934 1 0 197 11 0 0 25 0 9 0 746864178 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/29344/statm: 90721 7688 1891 364 0 26618 0
[pid=29350] ppid=29344 vsize=280692 CPUtime=0 cores=0-7
/proc/29350/stat : 29350 (python) S 29344 29344 28826 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 746864374 287428608 5961 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945935 0 0 16781312 514 11459941969522819330 0 0 17 6 0 0 0
/proc/29350/statm: 70173 5961 355 364 0 6091 0
[pid=29352] ppid=29350 vsize=1019708 CPUtime=1.13 cores=0-7
/proc/29352/stat : 29352 (gnovelty+2) R 29350 29352 29352 0 -1 4202496 953 0 0 0 113 0 0 0 25 0 1 0 746864374 1044180992 690 33554432000 134512640 135663704 4287762096 18446744073709551615 134544189 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29352/statm: 254927 690 113 282 0 254643 0
[pid=29353] ppid=29344 vsize=291556 CPUtime=0 cores=0-7
/proc/29353/stat : 29353 (python) S 29344 29344 28826 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 746864377 298553344 5976 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 1285778247665025283 0 0 17 2 0 0 0
/proc/29353/statm: 72889 5976 349 364 0 8804 0
[pid=29355] ppid=29353 vsize=1019708 CPUtime=1.1 cores=0-7
/proc/29355/stat : 29355 (gnovelty+2) R 29353 29355 29355 0 -1 4202496 953 0 0 0 110 0 0 0 25 0 1 0 746864378 1044180992 689 33554432000 134512640 135663704 4292685520 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29355/statm: 254927 689 113 282 0 254643 0
[pid=29356] ppid=29344 vsize=301272 CPUtime=0 cores=0-7
/proc/29356/stat : 29356 (python) S 29344 29344 28826 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 746864380 308502528 5980 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 1285782095955755007 0 0 17 6 0 0 0
/proc/29356/statm: 75318 5980 349 364 0 11230 0
[pid=29358] ppid=29356 vsize=419820 CPUtime=1.05 cores=0-7
/proc/29358/stat : 29358 (adaptg2wsat2009) R 29356 29358 29358 0 -1 4202496 1439 0 0 0 105 0 0 0 25 0 1 0 746864381 429895680 1172 33554432000 134512640 135107411 4294851040 18446744073709551615 134523302 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29358/statm: 104955 1172 49 146 0 103831 0
[pid=29359] ppid=29344 vsize=311460 CPUtime=0 cores=0-7
/proc/29359/stat : 29359 (python) S 29344 29344 28826 0 -1 4202560 750 0 0 0 0 0 0 0 18 0 1 0 746864384 318935040 5984 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 1285789792537149439 0 0 17 2 0 0 0
/proc/29359/statm: 77865 5984 349 364 0 13774 0
[pid=29361] ppid=29359 vsize=419820 CPUtime=1.03 cores=0-7
/proc/29361/stat : 29361 (adaptg2wsat2009) R 29359 29361 29361 0 -1 4202496 1436 0 0 0 103 0 0 0 25 0 1 0 746864384 429895680 1172 33554432000 134512640 135107411 4286814432 18446744073709551615 134523452 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29361/statm: 104955 1172 49 146 0 103831 0
[pid=29362] ppid=29344 vsize=322356 CPUtime=0 cores=0-7
/proc/29362/stat : 29362 (python) S 29344 29344 28826 0 -1 4202560 759 0 0 0 0 0 0 0 18 0 1 0 746864387 330092544 5996 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 1263251178557276159 0 0 17 2 0 0 0
/proc/29362/statm: 80589 5996 349 364 0 16495 0
[pid=29364] ppid=29362 vsize=419820 CPUtime=0.71 cores=0-7
/proc/29364/stat : 29364 (adaptg2wsat2009) R 29362 29364 29364 0 -1 4202496 1440 0 0 0 71 0 0 0 25 0 1 0 746864388 429895680 1172 33554432000 134512640 135107411 4287814560 18446744073709551615 134523438 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29364/statm: 104955 1172 49 146 0 103831 0
[pid=29344/tid=29351] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29351/stat : 29351 (python) S 29342 29344 28826 0 -1 4202560 25 934 0 0 0 0 0 0 22 0 9 0 746864374 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29354] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29354/stat : 29354 (python) S 29342 29344 28826 0 -1 4202560 24 934 0 0 0 0 0 0 24 0 9 0 746864377 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 2 0 0 0
[pid=29344/tid=29357] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29357/stat : 29357 (python) S 29342 29344 28826 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 746864381 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 6 0 0 0
[pid=29344/tid=29360] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29360/stat : 29360 (python) S 29342 29344 28826 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 746864384 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 6 0 0 0
[pid=29344/tid=29363] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29363/stat : 29363 (python) S 29342 29344 28826 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 746864387 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7.1
Current children cumulated vsize (KiB) 5169096

[startup+6.30142 s]
/proc/loadavg: 8.01 8.35 6.46 10/476 29373
/proc/meminfo: memFree=16548088/32951124 swapFree=45193380/67111528
[pid=29344] ppid=29342 vsize=362884 CPUtime=2.08 cores=0-7
/proc/29344/stat : 29344 (python) S 29342 29344 28826 0 -1 4202496 18622 934 1 0 197 11 0 0 25 0 9 0 746864178 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/29344/statm: 90721 7688 1891 364 0 26618 0
[pid=29350] ppid=29344 vsize=280692 CPUtime=0.02 cores=0-7
/proc/29350/stat : 29350 (python) S 29344 29344 28826 0 -1 4202560 898 0 0 0 1 1 0 0 18 0 1 0 746864374 287428608 5984 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945935 0 0 16781312 514 11459941969522819330 0 0 17 6 0 0 0
/proc/29350/statm: 70173 5984 378 364 0 6091 0
[pid=29352] ppid=29350 vsize=1019708 CPUtime=4.33 cores=0-7
/proc/29352/stat : 29352 (gnovelty+2) R 29350 29352 29352 0 -1 4202496 953 0 0 0 433 0 0 0 25 0 1 0 746864374 1044180992 690 33554432000 134512640 135663704 4287762096 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29352/statm: 254927 690 113 282 0 254643 0
[pid=29353] ppid=29344 vsize=291556 CPUtime=0.01 cores=0-7
/proc/29353/stat : 29353 (python) S 29344 29344 28826 0 -1 4202560 902 0 0 0 1 0 0 0 18 0 1 0 746864377 298553344 5999 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 1285778247665025283 0 0 17 2 0 0 0
/proc/29353/statm: 72889 5999 372 364 0 8804 0
[pid=29355] ppid=29353 vsize=1019708 CPUtime=4.3 cores=0-7
/proc/29355/stat : 29355 (gnovelty+2) R 29353 29355 29355 0 -1 4202496 953 0 0 0 430 0 0 0 25 0 1 0 746864378 1044180992 689 33554432000 134512640 135663704 4292685520 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29355/statm: 254927 689 113 282 0 254643 0
[pid=29356] ppid=29344 vsize=301272 CPUtime=0.01 cores=0-7
/proc/29356/stat : 29356 (python) S 29344 29344 28826 0 -1 4202560 919 0 0 0 0 1 0 0 18 0 1 0 746864380 308502528 6003 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 1285782095955722497 0 0 17 6 0 0 0
/proc/29356/statm: 75318 6003 372 364 0 11230 0
[pid=29358] ppid=29356 vsize=420220 CPUtime=4.19 cores=0-7
/proc/29358/stat : 29358 (adaptg2wsat2009) R 29356 29358 29358 0 -1 4202496 1666 0 0 0 419 0 0 0 25 0 1 0 746864381 430305280 1399 33554432000 134512640 135107411 4294851040 18446744073709551615 134532088 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29358/statm: 105055 1399 59 146 0 103931 0
[pid=29359] ppid=29344 vsize=311460 CPUtime=0.02 cores=0-7
/proc/29359/stat : 29359 (python) S 29344 29344 28826 0 -1 4202560 908 0 0 0 1 1 0 0 18 0 1 0 746864384 318935040 6007 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 1285789792537116928 0 0 17 2 0 0 0
/proc/29359/statm: 77865 6007 372 364 0 13774 0
[pid=29361] ppid=29359 vsize=420220 CPUtime=4.19 cores=0-7
/proc/29361/stat : 29361 (adaptg2wsat2009) R 29359 29361 29361 0 -1 4202496 1663 0 0 0 419 0 0 0 25 0 1 0 746864384 430305280 1399 33554432000 134512640 135107411 4286814432 18446744073709551615 134531856 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29361/statm: 105055 1399 59 146 0 103931 0
[pid=29362] ppid=29344 vsize=322356 CPUtime=0.02 cores=0-7
/proc/29362/stat : 29362 (python) S 29344 29344 28826 0 -1 4202560 933 0 0 0 1 1 0 0 18 0 1 0 746864387 330092544 6019 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 1263251178557243649 0 0 17 2 0 0 0
/proc/29362/statm: 80589 6019 372 364 0 16495 0
[pid=29364] ppid=29362 vsize=419820 CPUtime=2.31 cores=0-7
/proc/29364/stat : 29364 (adaptg2wsat2009) R 29362 29364 29364 0 -1 4202496 1440 0 0 0 231 0 0 0 25 0 1 0 746864388 429895680 1172 33554432000 134512640 135107411 4287814560 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29364/statm: 104955 1172 49 146 0 103831 0
[pid=29365] ppid=29344 vsize=332128 CPUtime=0.02 cores=0-7
/proc/29365/stat : 29365 (python) S 29344 29344 28826 0 -1 4202560 937 0 0 0 1 1 0 0 18 0 1 0 746864390 340099072 6156 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 10174565872530587906 0 0 17 7 0 0 0
/proc/29365/statm: 83032 6156 370 364 0 18935 0
[pid=29367] ppid=29365 vsize=1019708 CPUtime=4.1 cores=0-7
/proc/29367/stat : 29367 (gnovelty+2) R 29365 29367 29367 0 -1 4202496 958 0 0 0 410 0 0 0 25 0 1 0 746864393 1044180992 690 33554432000 134512640 135663704 4287766768 18446744073709551615 134524945 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29367/statm: 254927 690 113 282 0 254643 0
[pid=29368] ppid=29344 vsize=342384 CPUtime=0.02 cores=0-7
/proc/29368/stat : 29368 (python) S 29344 29344 28826 0 -1 4202560 951 0 0 0 1 1 0 0 18 0 1 0 746864394 350601216 6159 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 11660365621958246657 0 0 17 5 0 0 0
/proc/29368/statm: 85596 6159 370 364 0 21496 0
[pid=29370] ppid=29368 vsize=247956 CPUtime=4.02 cores=0-7
/proc/29370/stat : 29370 (FH) R 29368 29370 29370 0 -1 4202496 1251 0 0 0 402 0 0 0 25 0 1 0 746864396 253906944 987 33554432000 134512640 134936988 4292568848 18446744073709551615 134523460 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29370/statm: 61989 987 37 104 0 61493 0
[pid=29371] ppid=29344 vsize=352640 CPUtime=0 cores=0-7
/proc/29371/stat : 29371 (python) S 29344 29344 28826 0 -1 4202560 804 0 0 0 0 0 0 0 18 0 1 0 746864419 361103360 6147 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 11459762749127491843 0 0 17 1 0 0 0
/proc/29371/statm: 88160 6147 353 364 0 24057 0
[pid=29373] ppid=29371 vsize=419820 CPUtime=1.87 cores=0-7
/proc/29373/stat : 29373 (adaptg2wsat2009) R 29371 29373 29373 0 -1 4202496 1446 0 0 0 187 0 0 0 25 0 1 0 746864420 429895680 1172 33554432000 134512640 135107411 4289264896 18446744073709551615 134523455 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29373/statm: 104955 1172 49 146 0 103831 0
[pid=29344/tid=29351] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29351/stat : 29351 (python) S 29342 29344 28826 0 -1 4202560 25 934 0 0 0 0 0 0 22 0 9 0 746864374 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29354] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29354/stat : 29354 (python) S 29342 29344 28826 0 -1 4202560 24 934 0 0 0 0 0 0 24 0 9 0 746864377 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 2 0 0 0
[pid=29344/tid=29357] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29357/stat : 29357 (python) S 29342 29344 28826 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 746864381 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 6 0 0 0
[pid=29344/tid=29360] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29360/stat : 29360 (python) S 29342 29344 28826 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 746864384 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 6 0 0 0
[pid=29344/tid=29363] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29363/stat : 29363 (python) S 29342 29344 28826 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 746864387 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 2 0 0 0
[pid=29344/tid=29366] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29366/stat : 29366 (python) S 29342 29344 28826 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 746864390 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29369] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29369/stat : 29369 (python) S 29342 29344 28826 0 -1 4202560 30 934 0 0 0 0 0 0 25 0 9 0 746864394 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 7 0 0 0
[pid=29344/tid=29372] ppid=29342 vsize=362884 CPUtime=0 cores=0-7
/proc/29344/task/29372/stat : 29372 (python) S 29342 29344 28826 0 -1 4202560 30 934 0 0 0 0 0 0 25 0 9 0 746864419 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 31.51
Current children cumulated vsize (KiB) 7884532

[startup+12.7013 s]
/proc/loadavg: 8.09 8.36 6.47 10/476 29373
/proc/meminfo: memFree=16542532/32951124 swapFree=45193380/67111528
[pid=29344] ppid=29342 vsize=362884 CPUtime=2.08 cores=0-7
/proc/29344/stat : 29344 (python) S 29342 29344 28826 0 -1 4202496 18622 934 1 0 197 11 0 0 25 0 9 0 746864178 371593216 7688 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0

################
# More data... #
################

/proc/29445/task/29456/stat : 29456 (python) S 29344 29344 28826 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 746931057 576032768 6546 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 514 18446604447237112896 0 0 -1 5 0 0 0
[pid=29451] ppid=29344 vsize=573148 CPUtime=0.45 cores=0-7
/proc/29451/stat : 29451 (python) S 29344 29344 28826 0 -1 4202560 1231 0 0 0 24 21 0 0 19 0 2 0 746921812 586903552 6552 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29451/statm: 143287 6552 407 364 0 79139 0
[pid=29453] ppid=29451 vsize=335996 CPUtime=97.78 cores=0-7
/proc/29453/stat : 29453 (iPAWS) T 29451 29453 29453 0 -1 4202496 1822 0 0 0 9778 0 0 0 25 0 1 0 746921812 344059904 1536 33554432000 134512640 135114423 4289645984 18446744073709551615 134517397 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/29453/statm: 83999 1536 59 147 0 83851 0
[pid=29451/tid=29463] ppid=29344 vsize=573148 CPUtime=0 cores=0-7
/proc/29451/task/29463/stat : 29463 (python) S 29344 29344 28826 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 746933656 586903552 6552 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 514 18446604445501624576 0 0 -1 1 0 0 0
[pid=29457] ppid=29344 vsize=583292 CPUtime=2.37 cores=0-7
/proc/29457/stat : 29457 (python) S 29344 29344 28826 0 -1 4202560 1285 0 0 0 122 115 0 0 18 0 2 0 746931062 597291008 6617 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29457/statm: 145823 6617 407 364 0 81672 0
[pid=29459] ppid=29457 vsize=268424 CPUtime=485.5 cores=0-7
/proc/29459/stat : 29459 (hybridGM3) T 29457 29459 29459 0 -1 4202496 5414 0 0 0 48549 1 0 0 25 0 1 0 746931063 274866176 5125 33554432000 134512640 135204385 4288642560 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/29459/statm: 67106 5125 63 169 0 66936 0
[pid=29457/tid=29474] ppid=29344 vsize=583292 CPUtime=0 cores=0-7
/proc/29457/task/29474/stat : 29474 (python) S 29344 29344 28826 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 746951353 597291008 6617 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 514 18446604445501626368 0 0 -1 1 0 0 0
[pid=29460] ppid=29344 vsize=593876 CPUtime=3.16 cores=0-7
/proc/29460/stat : 29460 (python) S 29344 29344 28826 0 -1 4202560 1115 0 0 0 155 161 0 0 18 0 1 0 746931553 608129024 6587 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 13301047247903883524 0 0 17 1 0 0 0
/proc/29460/statm: 148469 6587 373 364 0 84315 0
[pid=29462] ppid=29460 vsize=458348 CPUtime=739.09 cores=0-7
/proc/29462/stat : 29462 (TNM) R 29460 29462 29462 0 -1 4202496 1529 0 0 0 73907 2 0 0 25 0 1 0 746931554 469348352 1239 33554432000 134512640 135008748 4292717680 18446744073709551615 134528974 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29462/statm: 114587 1239 46 122 0 113487 0
[pid=29466] ppid=29344 vsize=603960 CPUtime=0.45 cores=0-7
/proc/29466/stat : 29466 (python) S 29344 29344 28826 0 -1 4202560 1229 0 0 0 24 21 0 0 19 0 2 0 746939321 618455040 6620 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29466/statm: 150990 6620 401 364 0 86833 0
[pid=29468] ppid=29466 vsize=335996 CPUtime=99.6 cores=0-7
/proc/29468/stat : 29468 (iPAWS) T 29466 29468 29468 0 -1 4202496 1818 0 0 0 9960 0 0 0 25 0 1 0 746939321 344059904 1534 33554432000 134512640 135114423 4287877904 18446744073709551615 134514760 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/29468/statm: 83999 1534 59 147 0 83851 0
[pid=29466/tid=29473] ppid=29344 vsize=603960 CPUtime=0 cores=0-7
/proc/29466/task/29473/stat : 29473 (python) S 29344 29344 28826 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 746951166 618455040 6620 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 514 18446604445475035072 0 0 -1 1 0 0 0
[pid=29475] ppid=29344 vsize=614232 CPUtime=2.2 cores=0-7
/proc/29475/stat : 29475 (python) S 29344 29344 28826 0 -1 4202560 1282 0 0 0 111 109 0 0 18 0 2 0 746956763 628973568 6624 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29475/statm: 153558 6624 401 364 0 89398 0
[pid=29477] ppid=29475 vsize=419776 CPUtime=515.8 cores=0-7
/proc/29477/stat : 29477 (NCVWr) R 29475 29477 29477 0 -1 4202496 1564 0 0 0 51580 0 0 0 25 0 1 0 746956763 429850624 1281 33554432000 134512640 135113558 4292631584 18446744073709551615 134531984 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29477/statm: 104944 1281 58 147 0 103819 0
[pid=29475/tid=29515] ppid=29344 vsize=614232 CPUtime=0 cores=0-7
/proc/29475/task/29515/stat : 29515 (python) S 29344 29344 28826 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 747011265 628973568 6624 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 514 18446604445475034176 0 0 -1 1 0 0 0
[pid=29482] ppid=29344 vsize=624532 CPUtime=0.53 cores=0-7
/proc/29482/stat : 29482 (python) S 29344 29344 28826 0 -1 4202560 1276 0 0 0 24 29 0 0 19 0 2 0 746971827 639520768 6628 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29482/statm: 156133 6628 401 364 0 91970 0
[pid=29484] ppid=29482 vsize=1019708 CPUtime=97.32 cores=0-7
/proc/29484/stat : 29484 (gnovelty+2) T 29482 29484 29484 0 -1 4202496 979 0 0 0 9732 0 0 0 25 0 1 0 746971828 1044180992 689 33554432000 134512640 135663704 4287912800 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29484/statm: 254927 689 113 282 0 254643 0
[pid=29482/tid=29492] ppid=29344 vsize=624532 CPUtime=0 cores=0-7
/proc/29482/task/29492/stat : 29492 (python) S 29344 29344 28826 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 746985484 639520768 6628 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 514 18446604445475033280 0 0 -1 0 0 0 0
[pid=29493] ppid=29344 vsize=634792 CPUtime=0.46 cores=0-7
/proc/29493/stat : 29493 (python) S 29344 29344 28826 0 -1 4202560 1333 0 0 0 24 22 0 0 19 0 2 0 746985489 650027008 6639 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29493/statm: 158698 6639 408 364 0 94532 0
[pid=29495] ppid=29493 vsize=335996 CPUtime=100.03 cores=0-7
/proc/29495/stat : 29495 (iPAWS) T 29493 29495 29495 0 -1 4202496 1836 0 0 0 10003 0 0 0 25 0 1 0 746985490 344059904 1537 33554432000 134512640 135114423 4291516736 18446744073709551615 134516989 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/29495/statm: 83999 1537 59 147 0 83851 0
[pid=29493/tid=29503] ppid=29344 vsize=634792 CPUtime=0 cores=0-7
/proc/29493/task/29503/stat : 29503 (python) S 29344 29344 28826 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 746997334 650027008 6639 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 514 18446604447416903744 0 0 -1 3 0 0 0
[pid=29498] ppid=29344 vsize=645280 CPUtime=0.84 cores=0-7
/proc/29498/stat : 29498 (python) S 29344 29344 28826 0 -1 4202560 1316 0 0 0 43 41 0 0 19 0 2 0 746992627 660766720 6643 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29498/statm: 161320 6643 408 364 0 97151 0
[pid=29500] ppid=29498 vsize=268424 CPUtime=195.61 cores=0-7
/proc/29500/stat : 29500 (hybridGM3) T 29498 29500 29500 0 -1 4202496 5419 0 0 0 19561 0 0 0 25 0 1 0 746992628 274866176 5127 33554432000 134512640 135204385 4289163600 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29500/statm: 67106 5127 63 169 0 66936 0
[pid=29498/tid=29516] ppid=29344 vsize=645280 CPUtime=0 cores=0-7
/proc/29498/task/29516/stat : 29516 (python) S 29344 29344 28826 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 747014726 660766720 6643 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 514 18446604447416901952 0 0 -1 1 0 0 0
[pid=29504] ppid=29344 vsize=655560 CPUtime=0.41 cores=0-7
/proc/29504/stat : 29504 (python) S 29344 29344 28826 0 -1 4202560 1305 0 0 0 21 20 0 0 19 0 2 0 746997340 671293440 6662 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29504/statm: 163890 6662 408 364 0 99718 0
[pid=29506] ppid=29504 vsize=249868 CPUtime=102.29 cores=0-7
/proc/29506/stat : 29506 (FH) T 29504 29506 29506 0 -1 4202496 1555 0 0 0 10229 0 0 0 25 0 1 0 746997340 255864832 1263 33554432000 134512640 134936988 4293903280 18446744073709551615 134552400 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29506/statm: 62467 1263 41 104 0 61971 0
[pid=29504/tid=29509] ppid=29344 vsize=655560 CPUtime=0 cores=0-7
/proc/29504/task/29509/stat : 29509 (python) S 29344 29344 28826 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 747007980 671293440 6662 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 514 18446604452709447808 0 0 -1 1 0 0 0
[pid=29510] ppid=29344 vsize=666064 CPUtime=0.25 cores=0-7
/proc/29510/stat : 29510 (python) S 29344 29344 28826 0 -1 4202560 1146 0 0 0 13 12 0 0 18 0 1 0 747007986 682049536 6636 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 13301047247903883523 0 0 17 3 0 0 0
/proc/29510/statm: 166516 6636 379 364 0 102341 0
[pid=29512] ppid=29510 vsize=268420 CPUtime=51.05 cores=0-7
/proc/29512/stat : 29512 (hybridGM3) R 29510 29512 29512 0 -1 4202496 5420 0 0 0 5105 0 0 0 25 0 1 0 747007986 274862080 5126 33554432000 134512640 135204385 4288039744 18446744073709551615 134538000 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29512/statm: 67105 5126 63 169 0 66935 0
[pid=29517] ppid=29344 vsize=676092 CPUtime=0 cores=0-7
/proc/29517/stat : 29517 (python) S 29344 29344 28826 0 -1 4202560 974 0 0 0 0 0 0 0 18 0 1 0 747014732 692318208 6725 33554432000 4194304 5683644 140734255250000 18446744073709551615 224284945990 0 0 16781312 514 17573807711852691455 0 0 17 1 0 0 0
/proc/29517/statm: 169023 6725 355 364 0 104845 0
[pid=29519] ppid=29517 vsize=268424 CPUtime=0.12 cores=0-7
/proc/29519/stat : 29519 (hybridGM3) R 29517 29519 29519 0 -1 4202496 5416 0 0 0 11 1 0 0 21 0 1 0 747014732 274866176 5125 33554432000 134512640 135204385 4293168192 18446744073709551615 134537704 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29519/statm: 67106 5125 63 169 0 66936 0
[pid=29344/tid=29351] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29351/stat : 29351 (python) S 29342 29344 28826 0 -1 4202560 25 934 0 0 0 0 0 0 22 0 34 0 746864374 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29354] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29354/stat : 29354 (python) S 29342 29344 28826 0 -1 4202560 24 934 0 0 0 0 0 0 24 0 34 0 746864377 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 2 0 0 0
[pid=29344/tid=29357] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29357/stat : 29357 (python) S 29342 29344 28826 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 34 0 746864381 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 6 0 0 0
[pid=29344/tid=29360] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29360/stat : 29360 (python) S 29342 29344 28826 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 34 0 746864384 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 6 0 0 0
[pid=29344/tid=29363] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29363/stat : 29363 (python) S 29342 29344 28826 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 34 0 746864387 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 2 0 0 0
[pid=29344/tid=29366] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29366/stat : 29366 (python) S 29342 29344 28826 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 34 0 746864390 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29369] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29369/stat : 29369 (python) S 29342 29344 28826 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 34 0 746864394 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 7 0 0 0
[pid=29344/tid=29372] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29372/stat : 29372 (python) S 29342 29344 28826 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 34 0 746864419 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29378] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29378/stat : 29378 (python) S 29342 29344 28826 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 34 0 746874341 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 3 0 0 0
[pid=29344/tid=29382] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29382/stat : 29382 (python) S 29342 29344 28826 0 -1 4202560 106 934 0 0 0 0 0 0 18 0 34 0 746874416 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29388] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29388/stat : 29388 (python) S 29342 29344 28826 0 -1 4202560 46 934 0 0 0 0 0 0 18 0 34 0 746875623 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29392] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29392/stat : 29392 (python) S 29342 29344 28826 0 -1 4202560 34 934 0 0 0 0 0 0 19 0 34 0 746875644 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29396] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29396/stat : 29396 (python) S 29342 29344 28826 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 34 0 746876226 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29400] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29400/stat : 29400 (python) S 29342 29344 28826 0 -1 4202560 38 934 0 0 0 0 0 0 18 0 34 0 746876275 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29404] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29404/stat : 29404 (python) S 29342 29344 28826 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 34 0 746876835 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29408] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29408/stat : 29408 (python) S 29342 29344 28826 0 -1 4202560 39 934 0 0 0 0 0 0 18 0 34 0 746877433 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29414] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29414/stat : 29414 (python) S 29342 29344 28826 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 34 0 746884382 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29418] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29418/stat : 29418 (python) S 29342 29344 28826 0 -1 4202560 34 934 0 0 0 0 0 0 18 0 34 0 746885060 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29425] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29425/stat : 29425 (python) S 29342 29344 28826 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 34 0 746895432 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29429] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29429/stat : 29429 (python) S 29342 29344 28826 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 34 0 746895703 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29438] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29438/stat : 29438 (python) S 29342 29344 28826 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 34 0 746903885 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29446] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29446/stat : 29446 (python) S 29342 29344 28826 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 34 0 746918603 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29452] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29452/stat : 29452 (python) S 29342 29344 28826 0 -1 4202560 35 934 0 0 0 0 0 0 19 0 34 0 746921812 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 3 0 0 0
[pid=29344/tid=29458] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29458/stat : 29458 (python) S 29342 29344 28826 0 -1 4202560 43 934 0 0 0 0 0 0 18 0 34 0 746931062 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29461] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29461/stat : 29461 (python) S 29342 29344 28826 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 34 0 746931554 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29467] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29467/stat : 29467 (python) S 29342 29344 28826 0 -1 4202560 25 934 0 0 0 0 0 0 19 0 34 0 746939321 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29476] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29476/stat : 29476 (python) S 29342 29344 28826 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 34 0 746956763 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29483] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29483/stat : 29483 (python) S 29342 29344 28826 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 34 0 746971827 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29494] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29494/stat : 29494 (python) S 29342 29344 28826 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 34 0 746985490 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29499] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29499/stat : 29499 (python) S 29342 29344 28826 0 -1 4202560 28 934 0 0 0 0 0 0 19 0 34 0 746992628 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29505] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29505/stat : 29505 (python) S 29342 29344 28826 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 34 0 746997340 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29511] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29511/stat : 29511 (python) S 29342 29344 28826 0 -1 4202560 26 934 0 0 0 0 0 0 19 0 34 0 747007986 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
[pid=29344/tid=29518] ppid=29342 vsize=686336 CPUtime=0 cores=0-7
/proc/29344/task/29518/stat : 29518 (python) S 29342 29344 28826 0 -1 4202560 26 934 0 0 0 0 0 0 19 0 34 0 747014732 702808064 8315 33554432000 4194304 5683644 140734255250000 18446744073709551615 224296749489 0 0 16781312 2 18446604443181043776 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10566.1
Current children cumulated vsize (KiB) 32230732

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29344 and gives
#  childrusage.ru_utime.tv_sec=2208
#  childrusage.ru_utime.tv_usec=349279
#  childrusage.ru_stime.tv_sec=21
#  childrusage.ru_stime.tv_usec=406745
# CPU time returned by wait4() is 2229.76
# while last known CPU time is 10566.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1506.02
CPU time (s): 10566.1
CPU user time (s): 10543.7
CPU system time (s): 22.4
CPU usage (%): 701.592
Max. virtual memory (cumulated for all children) (KiB): 32230732

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2208.35
system time used= 21.4067
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 85062
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17970
involuntary context switches= 14095

runsolver used 18.7881 second user time and 42.7715 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-16 19:18:55
IDJOB=3385413
IDBENCH=82678
IDSOLVER=1870
FILE ID=node118/3385413-1305566335
RUNJOBID= node118-1305564964-28840
PBS_JOBID= 13350132
Free space on /tmp= 73172 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S1859210562-077-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385413-1305566335/watcher-3385413-1305566335 -o /tmp/evaluation-result-3385413-1305566335/solver-3385413-1305566335 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385413-1305566335.cnf -seed 1836209777 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3d96bca49fe954bb59442ef617e689bb
RANDOM SEED=1836209777

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16634384 kB
Buffers:        317520 kB
Cached:        4939940 kB
SwapCached:      22068 kB
Active:       13243072 kB
Inactive:      2738472 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16634384 kB
SwapTotal:    67111528 kB
SwapFree:     45193380 kB
Dirty:           33124 kB
Writeback:           0 kB
AnonPages:    10715384 kB
Mapped:          23252 kB
Slab:           160740 kB
PageTables:     101728 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 138437348 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73140 MiB
End job on node118 at 2011-05-16 19:44:03