Trace number 3321968

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 6572.44 1067.4

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v500-c2130-S1514125851-037.UNKNOWN.cnf
MD5SUM7ce6e28d94f25a5004daf47b6c05c693
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark954.825
Satisfiable
(Un)Satisfiability was proved
Number of variables500
Number of clauses2130
Sum of the clauses size6390
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32130
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.35/0.63	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.63	c INFO: solving HOME/instance-3321968-1304370164.cnf
0.35/0.63	c INFO: computing task features
0.35/0.63	c INFO: computed variable-clause graph statistics
0.35/0.64	c INFO: computed clause balance statistics
0.35/0.67	c INFO: computed variable balance statistics
0.44/0.70	c INFO: computed small-clause counts
0.44/0.70	c INFO: computed Horn-clause counts
0.44/0.70	c INFO: computed variable graph statistics
0.44/0.70	c INFO: collected features for HOME/instance-3321968-1304370164.cnf in 0.08 s
0.44/0.74	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.57)
0.44/0.78	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.35)
0.53/0.81	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.30)
0.53/0.85	c INFO: running march_hi@0 for 97 with 39999 remaining (b = 0.09)
0.53/0.89	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.07)
0.63/0.93	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.26)
0.63/0.97	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.23)
1.61/1.01	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.21)
647.61/107.23	c INFO: running march_hi@0 for 388 with 39893 remaining (b = 0.15)
894.39/148.47	c INFO: running march_hi@0 for 97 with 39852 remaining (b = 0.05)
1055.23/173.20	c INFO: running kcnfs-2006@0 for 582 with 39827 remaining (b = 0.18)
1726.36/278.33	c INFO: running march_hi@98 for 97 with 39722 remaining (b = 0.04)
2525.90/401.72	c INFO: running march_hi@196 for 194 with 39598 remaining (b = 0.08)
2677.55/425.11	c INFO: running march_hi@0 for 97 with 39575 remaining (b = 0.03)
3085.51/491.14	c INFO: running march_hi@0 for 97 with 39509 remaining (b = 0.04)
3445.24/546.66	c INFO: running march_hi@485 for 194 with 39454 remaining (b = 0.11)
3448.21/547.18	c INFO: running march_hi@0 for 97 with 39453 remaining (b = 0.04)
3631.28/577.79	c INFO: running march_hi@100 for 97 with 39422 remaining (b = 0.05)
3738.47/595.62	c INFO: running march_hi@101 for 97 with 39405 remaining (b = 0.05)
3764.19/599.98	c INFO: running march_hi@0 for 291 with 39400 remaining (b = 0.13)
3839.00/612.48	c INFO: running march_hi@98 for 97 with 39388 remaining (b = 0.05)
4148.97/664.24	c INFO: running march_hi@487 for 97 with 39336 remaining (b = 0.05)
4336.83/695.62	c INFO: running march_hi@491 for 97 with 39305 remaining (b = 0.04)
4436.78/712.36	c INFO: running march_hi@198 for 194 with 39288 remaining (b = 0.10)
4584.07/736.94	c INFO: running march_hi@585 for 97 with 39263 remaining (b = 0.04)
4643.92/746.97	c INFO: running march_hi@971 for 388 with 39253 remaining (b = 0.19)
4774.29/768.73	c INFO: running march_hi@202 for 194 with 39231 remaining (b = 0.10)
4944.21/797.17	c INFO: running march_hi@585 for 97 with 39203 remaining (b = 0.04)
5033.97/812.19	c INFO: running march_hi@585 for 97 with 39188 remaining (b = 0.03)
5290.70/855.05	c INFO: running kcnfs-2006@0 for 582 with 39145 remaining (b = 0.20)
5703.57/924.01	c INFO: running kcnfs-2006@0 for 582 with 39076 remaining (b = 0.18)
5759.96/932.79	c INFO: running kcnfs-2006@0 for 582 with 39067 remaining (b = 0.16)
5943.13/963.40	c INFO: running march_hi@776 for 1455 with 39037 remaining (b = 0.44)
5985.43/970.28	c INFO: running march_hi@0 for 388 with 39030 remaining (b = 0.11)
6517.32/1058.98	c INFO: running march_hi@300 for 97 with 38941 remaining (b = 0.04)
6571.73/1067.38	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321968-1304370164/watcher-3321968-1304370164 -o /tmp/evaluation-result-3321968-1304370164/solver-3321968-1304370164 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321968-1304370164.cnf -seed 1935221403 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.23 9.49 9.18 3/337 22333
/proc/meminfo: memFree=22127992/32950940 swapFree=67111364/67111528
[pid=22333] ppid=22331 vsize=15776 CPUtime=0 cores=0-7
/proc/22333/stat : 22333 (python) R 22331 22333 21550 0 -1 4202496 923 0 0 0 0 0 0 0 20 0 1 0 627247232 16154624 802 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988588389 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22333/statm: 3944 807 356 364 0 431 0

[startup+0.0254021 s]
/proc/loadavg: 9.23 9.49 9.18 3/337 22333
/proc/meminfo: memFree=22127992/32950940 swapFree=67111364/67111528
[pid=22333] ppid=22331 vsize=16400 CPUtime=0.01 cores=0-7
/proc/22333/stat : 22333 (python) R 22331 22333 21550 0 -1 4202496 1117 0 0 0 1 0 0 0 20 0 1 0 627247232 16793600 985 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988649056 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22333/statm: 4100 985 408 364 0 587 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16400

[startup+0.100389 s]
/proc/loadavg: 9.23 9.49 9.18 3/337 22333
/proc/meminfo: memFree=22127992/32950940 swapFree=67111364/67111528
[pid=22333] ppid=22331 vsize=93960 CPUtime=0.05 cores=0-7
/proc/22333/stat : 22333 (python) S 22331 22333 21550 0 -1 4202496 2695 0 0 0 4 1 0 0 20 0 1 0 627247232 96215040 2407 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988590592 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/22333/statm: 23490 2407 764 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93960

[startup+0.300353 s]
/proc/loadavg: 9.23 9.49 9.18 3/337 22333
/proc/meminfo: memFree=22127992/32950940 swapFree=67111364/67111528
[pid=22333] ppid=22331 vsize=135748 CPUtime=0.17 cores=0-7
/proc/22333/stat : 22333 (python) R 22331 22333 21550 0 -1 4202496 5961 938 1 0 13 4 0 0 20 0 1 0 627247232 139005952 4151 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988588549 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22333/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135748

[startup+0.700283 s]
/proc/loadavg: 9.23 9.49 9.18 3/337 22333
/proc/meminfo: memFree=22127992/32950940 swapFree=67111364/67111528
[pid=22333] ppid=22331 vsize=278300 CPUtime=0.44 cores=0-7
/proc/22333/stat : 22333 (python) R 22331 22333 21550 0 -1 4202496 9319 938 1 0 35 9 0 0 19 0 1 0 627247232 284979200 6992 33554432000 4194304 5683644 140735916659040 18446744073709551615 4523360 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22333/statm: 69575 6992 1827 364 0 5499 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 278300

[startup+1.50114 s]
/proc/loadavg: 9.23 9.49 9.18 11/358 22358
/proc/meminfo: memFree=22074752/32950940 swapFree=67111364/67111528
[pid=22333] ppid=22331 vsize=426660 CPUtime=0.74 cores=0-7
/proc/22333/stat : 22333 (python) S 22331 22333 21550 0 -1 4202496 15307 938 1 0 64 10 0 0 25 0 9 0 627247232 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000419275 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/22333/statm: 106665 7375 1889 364 0 42562 0
[pid=22339] ppid=22333 vsize=278672 CPUtime=0 cores=0-7
/proc/22339/stat : 22339 (python) S 22333 22333 21550 0 -1 4202560 738 0 0 0 0 0 0 0 20 0 1 0 627247307 285360128 5584 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612623 0 0 16781312 514 2076956578442903551 0 0 17 3 0 0 0
/proc/22339/statm: 69668 5584 354 364 0 5586 0
[pid=22341] ppid=22339 vsize=1017800 CPUtime=0.73 cores=0-7
/proc/22341/stat : 22341 (gnovelty+2) R 22339 22341 22341 0 -1 4202496 439 0 0 0 73 0 0 0 25 0 1 0 627247307 1042227200 177 33554432000 134512640 135663704 4291900672 18446744073709551615 134545644 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22341/statm: 254450 177 113 282 0 254166 0
[pid=22342] ppid=22333 vsize=289344 CPUtime=0 cores=0-7
/proc/22342/stat : 22342 (python) S 22333 22333 21550 0 -1 4202560 762 0 0 0 0 0 0 0 16 0 1 0 627247310 296288256 5694 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 10775803294732222722 0 0 17 5 0 0 0
/proc/22342/statm: 72336 5694 348 364 0 8251 0
[pid=22344] ppid=22342 vsize=2448 CPUtime=0.71 cores=0-7
/proc/22344/stat : 22344 (march_hi) R 22342 22344 22344 0 -1 4202496 662 0 0 0 71 0 0 0 25 0 1 0 627247311 2506752 398 33554432000 4194304 4955518 140734995840736 18446744073709551615 4224648 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/22344/statm: 612 398 104 186 0 425 0
[pid=22345] ppid=22333 vsize=365136 CPUtime=0 cores=0-7
/proc/22345/stat : 22345 (python) S 22333 22333 21550 0 -1 4202560 718 0 0 0 0 0 0 0 16 0 1 0 627247314 373899264 5871 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 11168298159522676995 0 0 17 0 0 0 0
/proc/22345/statm: 91284 5871 348 364 0 27196 0
[pid=22347] ppid=22345 vsize=2448 CPUtime=0.67 cores=0-7
/proc/22347/stat : 22347 (march_hi) R 22345 22347 22347 0 -1 4202496 652 0 0 0 67 0 0 0 25 0 1 0 627247315 2506752 397 33554432000 4194304 4955518 140737178506832 18446744073709551615 4224658 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/22347/statm: 612 397 104 186 0 425 0
[pid=22348] ppid=22333 vsize=375392 CPUtime=0 cores=0-7
/proc/22348/stat : 22348 (python) S 22333 22333 21550 0 -1 4202560 720 0 0 0 0 0 0 0 18 0 1 0 627247318 384401408 5829 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 5602227209143025922 0 0 17 7 0 0 0
/proc/22348/statm: 93848 5829 348 364 0 29757 0
[pid=22350] ppid=22348 vsize=2448 CPUtime=0.62 cores=0-7
/proc/22350/stat : 22350 (march_hi) R 22348 22350 22350 0 -1 4202496 645 0 0 0 62 0 0 0 25 0 1 0 627247318 2506752 394 33554432000 4194304 4955518 140734798684304 18446744073709551615 4261424 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/22350/statm: 612 394 104 186 0 425 0
[pid=22351] ppid=22333 vsize=385648 CPUtime=0 cores=0-7
/proc/22351/stat : 22351 (python) S 22333 22333 21550 0 -1 4202560 723 0 0 0 0 0 0 0 24 0 1 0 627247322 394903552 5952 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 17589284987281080319 0 0 17 3 0 0 0
/proc/22351/statm: 96412 5952 348 364 0 32318 0
[pid=22353] ppid=22351 vsize=1017800 CPUtime=0.36 cores=0-7
/proc/22353/stat : 22353 (gnovelty+2) R 22351 22353 22353 0 -1 4202496 432 0 0 0 36 0 0 0 25 0 1 0 627247324 1042227200 177 33554432000 134512640 135663704 4289047856 18446744073709551615 134544196 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/22353/statm: 254450 177 113 282 0 254166 0
[pid=22354] ppid=22333 vsize=395904 CPUtime=0 cores=0-7
/proc/22354/stat : 22354 (python) S 22333 22333 21550 0 -1 4202560 741 0 0 0 0 0 0 0 22 0 1 0 627247326 405405696 5973 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 10757481032966963458 0 0 17 6 0 0 0
/proc/22354/statm: 98976 5973 348 364 0 34879 0
[pid=22358] ppid=22354 vsize=2180 CPUtime=0.21 cores=0-7
/proc/22358/stat : 22358 (march_hi) R 22354 22358 22358 0 -1 4202496 610 0 0 0 21 0 0 0 25 0 1 0 627247330 2232320 354 33554432000 4194304 4955518 140737106491312 18446744073709551615 4227647 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/22358/statm: 545 354 104 186 0 358 0
[pid=22356] ppid=22333 vsize=406160 CPUtime=0 cores=0-7
/proc/22356/stat : 22356 (python) S 22333 22333 21550 0 -1 4202560 752 0 0 0 0 0 0 0 21 0 1 0 627247330 415907840 5859 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 7451816916244463876 0 0 17 1 0 0 0
/proc/22356/statm: 101540 5859 348 364 0 37440 0
[pid=22333/tid=22340] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22340/stat : 22340 (python) S 22331 22333 21550 0 -1 4202560 27 938 0 0 0 0 0 0 20 0 9 0 627247307 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 0 0 0 0
[pid=22333/tid=22343] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22343/stat : 22343 (python) S 22331 22333 21550 0 -1 4202560 23 938 0 0 0 0 0 0 21 0 9 0 627247311 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 5 0 0 0
[pid=22333/tid=22346] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22346/stat : 22346 (python) S 22331 22333 21550 0 -1 4202560 79 938 0 0 0 0 0 0 22 0 9 0 627247314 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 0 0 0 0
[pid=22333/tid=22349] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22349/stat : 22349 (python) S 22331 22333 21550 0 -1 4202560 31 938 0 0 0 0 0 0 23 0 9 0 627247318 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 7 0 0 0
[pid=22333/tid=22352] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22352/stat : 22352 (python) S 22331 22333 21550 0 -1 4202560 33 938 0 0 0 0 0 0 24 0 9 0 627247322 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22355] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22355/stat : 22355 (python) S 22331 22333 21550 0 -1 4202560 42 938 0 0 0 0 0 0 25 0 9 0 627247326 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22357] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22357/stat : 22357 (python) S 22331 22333 21550 0 -1 4202560 22 938 0 0 0 0 0 0 25 0 9 0 627247330 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.04
Current children cumulated vsize (KiB) 4968040

[startup+3.10086 s]
/proc/loadavg: 9.23 9.49 9.18 11/362 22362
/proc/meminfo: memFree=22068768/32950940 swapFree=67111364/67111528
[pid=22333] ppid=22331 vsize=426660 CPUtime=0.74 cores=0-7
/proc/22333/stat : 22333 (python) S 22331 22333 21550 0 -1 4202496 15307 938 1 0 64 10 0 0 25 0 9 0 627247232 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000419275 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/22333/statm: 106665 7375 1889 364 0 42562 0
[pid=22339] ppid=22333 vsize=278672 CPUtime=0 cores=0-7
/proc/22339/stat : 22339 (python) S 22333 22333 21550 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 627247307 285360128 5584 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612623 0 0 16781312 514 2076956578442871043 0 0 17 3 0 0 0
/proc/22339/statm: 69668 5584 354 364 0 5586 0
[pid=22341] ppid=22339 vsize=1017800 CPUtime=1.63 cores=0-7
/proc/22341/stat : 22341 (gnovelty+2) R 22339 22341 22341 0 -1 4202496 439 0 0 0 163 0 0 0 25 0 1 0 627247307 1042227200 177 33554432000 134512640 135663704 4291900672 18446744073709551615 134545742 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22341/statm: 254450 177 113 282 0 254166 0
[pid=22342] ppid=22333 vsize=289344 CPUtime=0 cores=0-7
/proc/22342/stat : 22342 (python) S 22333 22333 21550 0 -1 4202560 767 0 0 0 0 0 0 0 15 0 1 0 627247310 296288256 5694 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 3313888193115291906 0 0 17 5 0 0 0
/proc/22342/statm: 72336 5694 348 364 0 8251 0
[pid=22344] ppid=22342 vsize=2768 CPUtime=2.31 cores=0-7
/proc/22344/stat : 22344 (march_hi) R 22342 22344 22344 0 -1 4202496 734 0 0 0 231 0 0 0 25 0 1 0 627247311 2834432 470 33554432000 4194304 4955518 140734995840736 18446744073709551615 4224682 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/22344/statm: 692 470 104 186 0 505 0
[pid=22345] ppid=22333 vsize=365136 CPUtime=0 cores=0-7
/proc/22345/stat : 22345 (python) S 22333 22333 21550 0 -1 4202560 720 0 0 0 0 0 0 0 15 0 1 0 627247314 373899264 5871 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 11168298159522676995 0 0 17 0 0 0 0
/proc/22345/statm: 91284 5871 348 364 0 27196 0
[pid=22347] ppid=22345 vsize=2768 CPUtime=2.26 cores=0-7
/proc/22347/stat : 22347 (march_hi) R 22345 22347 22347 0 -1 4202496 724 0 0 0 226 0 0 0 25 0 1 0 627247315 2834432 469 33554432000 4194304 4955518 140737178506832 18446744073709551615 4238626 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/22347/statm: 692 469 104 186 0 505 0
[pid=22348] ppid=22333 vsize=375392 CPUtime=0 cores=0-7
/proc/22348/stat : 22348 (python) S 22333 22333 21550 0 -1 4202560 721 0 0 0 0 0 0 0 15 0 1 0 627247318 384401408 5829 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 10124615334158631170 0 0 17 7 0 0 0
/proc/22348/statm: 93848 5829 348 364 0 29757 0
[pid=22350] ppid=22348 vsize=2768 CPUtime=2.2 cores=0-7
/proc/22350/stat : 22350 (march_hi) R 22348 22350 22350 0 -1 4202496 716 0 0 0 220 0 0 0 25 0 1 0 627247318 2834432 465 33554432000 4194304 4955518 140734798684304 18446744073709551615 4298055 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/22350/statm: 692 465 104 186 0 505 0
[pid=22351] ppid=22333 vsize=385648 CPUtime=0 cores=0-7
/proc/22351/stat : 22351 (python) S 22333 22333 21550 0 -1 4202560 723 0 0 0 0 0 0 0 18 0 1 0 627247322 394903552 5952 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 17589284987281047809 0 0 17 3 0 0 0
/proc/22351/statm: 96412 5952 348 364 0 32318 0
[pid=22353] ppid=22351 vsize=1017800 CPUtime=1.16 cores=0-7
/proc/22353/stat : 22353 (gnovelty+2) R 22351 22353 22353 0 -1 4202496 432 0 0 0 116 0 0 0 25 0 1 0 627247324 1042227200 177 33554432000 134512640 135663704 4289047856 18446744073709551615 134544122 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/22353/statm: 254450 177 113 282 0 254166 0
[pid=22354] ppid=22333 vsize=395904 CPUtime=0 cores=0-7
/proc/22354/stat : 22354 (python) S 22333 22333 21550 0 -1 4202560 744 0 0 0 0 0 0 0 15 0 1 0 627247326 405405696 5973 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 10757481032966963458 0 0 17 6 0 0 0
/proc/22354/statm: 98976 5973 348 364 0 34879 0
[pid=22358] ppid=22354 vsize=2516 CPUtime=1.01 cores=0-7
/proc/22358/stat : 22358 (march_hi) R 22354 22358 22358 0 -1 4202496 667 0 0 0 101 0 0 0 25 0 1 0 627247330 2576384 411 33554432000 4194304 4955518 140737106491312 18446744073709551615 4209701 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/22358/statm: 629 411 104 186 0 442 0
[pid=22356] ppid=22333 vsize=406160 CPUtime=0 cores=0-7
/proc/22356/stat : 22356 (python) S 22333 22333 21550 0 -1 4202560 755 0 0 0 0 0 0 0 15 0 1 0 627247330 415907840 5859 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 7451816916244463876 0 0 17 1 0 0 0
/proc/22356/statm: 101540 5859 348 364 0 37440 0
[pid=22362] ppid=22356 vsize=2616 CPUtime=1.66 cores=0-7
/proc/22362/stat : 22362 (march_hi) R 22356 22362 22362 0 -1 4202496 703 0 0 0 166 0 0 0 25 0 1 0 627247335 2678784 443 33554432000 4194304 4955518 140735729974080 18446744073709551615 4290229 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/22362/statm: 654 443 104 186 0 467 0
[pid=22359] ppid=22333 vsize=416416 CPUtime=0 cores=0-7
/proc/22359/stat : 22359 (python) S 22333 22333 21550 0 -1 4202560 777 0 0 0 0 0 0 0 15 0 1 0 627247334 426409984 5836 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 11234594312631058691 0 0 17 6 0 0 0
/proc/22359/statm: 104104 5836 354 364 0 40001 0
[pid=22361] ppid=22359 vsize=2768 CPUtime=2.07 cores=0-7
/proc/22361/stat : 22361 (march_hi) R 22359 22361 22361 0 -1 4202496 725 0 0 0 207 0 0 0 25 0 1 0 627247334 2834432 461 33554432000 4194304 4955518 140736865705696 18446744073709551615 4227679 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/22361/statm: 692 461 104 186 0 505 0
[pid=22333/tid=22340] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22340/stat : 22340 (python) S 22331 22333 21550 0 -1 4202560 27 938 0 0 0 0 0 0 20 0 9 0 627247307 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 0 0 0 0
[pid=22333/tid=22343] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22343/stat : 22343 (python) S 22331 22333 21550 0 -1 4202560 23 938 0 0 0 0 0 0 21 0 9 0 627247311 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 5 0 0 0
[pid=22333/tid=22346] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22346/stat : 22346 (python) S 22331 22333 21550 0 -1 4202560 79 938 0 0 0 0 0 0 22 0 9 0 627247314 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 0 0 0 0
[pid=22333/tid=22349] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22349/stat : 22349 (python) S 22331 22333 21550 0 -1 4202560 31 938 0 0 0 0 0 0 23 0 9 0 627247318 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 7 0 0 0
[pid=22333/tid=22352] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22352/stat : 22352 (python) S 22331 22333 21550 0 -1 4202560 33 938 0 0 0 0 0 0 24 0 9 0 627247322 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22355] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22355/stat : 22355 (python) S 22331 22333 21550 0 -1 4202560 42 938 0 0 0 0 0 0 25 0 9 0 627247326 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22357] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22357/stat : 22357 (python) S 22331 22333 21550 0 -1 4202560 22 938 0 0 0 0 0 0 25 0 9 0 627247330 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22360] ppid=22331 vsize=426660 CPUtime=0 cores=0-7
/proc/22333/task/22360/stat : 22360 (python) S 22331 22333 21550 0 -1 4202560 67 938 0 0 0 0 0 0 25 0 9 0 627247334 436899840 7375 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 15.04
Current children cumulated vsize (KiB) 5391136

[startup+6.3013 s]

################
# More data... #
################

/proc/22415/statm: 4453 3071 104 186 0 4266 0
[pid=22333/tid=22340] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22340/stat : 22340 (python) S 22331 22333 21550 0 -1 4202560 27 938 0 0 0 0 0 0 20 0 15 0 627247307 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 0 0 0 0
[pid=22333/tid=22343] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22343/stat : 22343 (python) S 22331 22333 21550 0 -1 4202560 28 938 0 0 0 0 0 0 18 0 15 0 627247311 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 5 0 0 0
[pid=22333/tid=22346] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22346/stat : 22346 (python) S 22331 22333 21550 0 -1 4202560 84 938 0 0 0 0 0 0 18 0 15 0 627247314 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 0 0 0 0
[pid=22333/tid=22349] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22349/stat : 22349 (python) S 22331 22333 21550 0 -1 4202560 45 938 0 0 0 0 0 0 18 0 15 0 627247318 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 7 0 0 0
[pid=22333/tid=22352] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22352/stat : 22352 (python) S 22331 22333 21550 0 -1 4202560 33 938 0 0 0 0 0 0 24 0 15 0 627247322 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22355] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22355/stat : 22355 (python) S 22331 22333 21550 0 -1 4202560 51 938 0 0 0 0 0 0 18 0 15 0 627247326 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22357] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22357/stat : 22357 (python) S 22331 22333 21550 0 -1 4202560 36 938 0 0 0 0 0 0 18 0 15 0 627247330 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22360] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22360/stat : 22360 (python) S 22331 22333 21550 0 -1 4202560 82 938 0 0 0 0 0 0 18 0 15 0 627247334 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22368] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22368/stat : 22368 (python) S 22331 22333 21550 0 -1 4202560 42 938 0 0 0 0 0 0 18 0 15 0 627257955 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 3 0 0 0
[pid=22333/tid=22375] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22375/stat : 22375 (python) S 22331 22333 21550 0 -1 4202560 35 938 0 0 0 0 0 0 19 0 15 0 627264553 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22402] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22402/stat : 22402 (python) S 22331 22333 21550 0 -1 4202560 57 938 0 0 0 0 0 0 19 0 15 0 627332738 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 3 0 0 0
[pid=22333/tid=22407] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22407/stat : 22407 (python) S 22331 22333 21550 0 -1 4202560 32 938 0 0 0 0 0 0 20 0 15 0 627339634 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22410] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22410/stat : 22410 (python) S 22331 22333 21550 0 -1 4202560 33 938 0 0 0 0 0 0 20 0 15 0 627340512 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22414] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22414/stat : 22414 (python) S 22331 22333 21550 0 -1 4202560 36 938 0 0 0 0 0 0 20 0 15 0 627344261 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6570.43
Current children cumulated vsize (KiB) 9668792

[startup+1067.3 s]
/proc/loadavg: 10.14 10.10 9.79 12/389 22418
/proc/meminfo: memFree=21508868/32950940 swapFree=67111364/67111528
[pid=22333] ppid=22331 vsize=488196 CPUtime=2.03 cores=0-7
/proc/22333/stat : 22333 (python) S 22331 22333 21550 0 -1 4202496 24480 938 1 0 191 12 0 0 18 0 15 0 627247232 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000419275 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/22333/statm: 122049 7574 1902 364 0 57928 0
[pid=22339] ppid=22333 vsize=288916 CPUtime=0.43 cores=0-7
/proc/22339/stat : 22339 (python) S 22333 22333 21550 0 -1 4202560 1108 0 0 0 21 22 0 0 19 0 2 0 627247307 295849984 5645 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/22339/statm: 72229 5645 410 364 0 8147 0
[pid=22341] ppid=22339 vsize=1017800 CPUtime=98.76 cores=0-7
/proc/22341/stat : 22341 (gnovelty+2) T 22339 22341 22341 0 -1 4202496 439 0 0 0 9876 0 0 0 25 0 1 0 627247307 1042227200 177 33554432000 134512640 135663704 4291900672 18446744073709551615 134524882 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/22341/statm: 254450 177 113 282 0 254166 0
[pid=22339/tid=22373] ppid=22333 vsize=288916 CPUtime=0 cores=0-7
/proc/22339/task/22373/stat : 22373 (python) S 22333 22333 21550 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 627264548 295849984 5645 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 514 18446604453396272384 0 0 -1 6 0 0 0
[pid=22342] ppid=22333 vsize=354880 CPUtime=2.64 cores=0-7
/proc/22342/stat : 22342 (python) S 22333 22333 21550 0 -1 4202560 1150 0 0 0 139 125 0 0 16 0 2 0 627247310 363397120 5749 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/22342/statm: 88720 5749 400 364 0 24635 0
[pid=22344] ppid=22342 vsize=120756 CPUtime=682.32 cores=0-7
/proc/22344/stat : 22344 (march_hi) T 22342 22344 22344 0 -1 4202496 20555 0 0 0 68229 3 0 0 25 0 1 0 627247311 123654144 20291 33554432000 4194304 4955518 140734995840736 18446744073709551615 4224707 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/22344/statm: 30189 20291 104 186 0 30002 0
[pid=22342/tid=22392] ppid=22333 vsize=354880 CPUtime=0 cores=0-7
/proc/22342/task/22392/stat : 22392 (python) S 22333 22333 21550 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 627307226 363397120 5749 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 514 18446604453684267968 0 0 -1 0 0 0 0
[pid=22345] ppid=22333 vsize=365136 CPUtime=5.18 cores=0-7
/proc/22345/stat : 22345 (python) R 22333 22333 21550 0 -1 4202560 1046 0 0 0 359 159 0 0 18 0 2 0 627247314 373899264 5925 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000422719 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/22345/statm: 91284 5925 401 364 0 27196 0
[pid=22347] ppid=22345 vsize=0 CPUtime=956.27 cores=0-7
/proc/22347/stat : 22347 (march_hi) R 22345 22347 22347 0 -1 4202500 26877 0 0 0 95614 13 0 0 25 0 1 0 627247315 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22347/statm: 0 0 0 0 0 0 0
[pid=22345/tid=22384] ppid=22333 vsize=365136 CPUtime=0 cores=0-7
/proc/22345/task/22384/stat : 22384 (python) S 22333 22333 21550 0 -1 4202560 110 0 0 0 0 0 0 0 15 0 2 0 627289739 373899264 5925 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 514 18446604444852576448 0 0 -1 1 0 0 0
[pid=22348] ppid=22333 vsize=375392 CPUtime=2.58 cores=0-7
/proc/22348/stat : 22348 (python) S 22333 22333 21550 0 -1 4202560 990 0 0 0 135 123 0 0 15 0 2 0 627247318 384401408 5882 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/22348/statm: 93848 5882 400 364 0 29757 0
[pid=22350] ppid=22348 vsize=91288 CPUtime=670.21 cores=0-7
/proc/22350/stat : 22350 (march_hi) R 22348 22350 22350 0 -1 4202496 20236 0 0 0 67017 4 0 0 25 0 1 0 627247318 93478912 19985 33554432000 4194304 4955518 140734798684304 18446744073709551615 4263698 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22350/statm: 22822 19985 104 186 0 22635 0
[pid=22348/tid=22371] ppid=22333 vsize=375392 CPUtime=0 cores=0-7
/proc/22348/task/22371/stat : 22371 (python) S 22333 22333 21550 0 -1 4202560 75 0 0 0 0 0 0 0 15 0 2 0 627262076 384401408 5882 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 514 18446604453713558336 0 0 -1 0 0 0 0
[pid=22351] ppid=22333 vsize=385648 CPUtime=0.26 cores=0-7
/proc/22351/stat : 22351 (python) S 22333 22333 21550 0 -1 4202560 980 0 0 0 13 13 0 0 19 0 2 0 627247322 394903552 6005 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/22351/statm: 96412 6005 400 364 0 32318 0
[pid=22353] ppid=22351 vsize=1017800 CPUtime=100.91 cores=0-7
/proc/22353/stat : 22353 (gnovelty+2) T 22351 22353 22353 0 -1 4202496 432 0 0 0 10091 0 0 0 25 0 1 0 627247324 1042227200 177 33554432000 134512640 135663704 4289047856 18446744073709551615 134544137 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/22353/statm: 254450 177 113 282 0 254166 0
[pid=22351/tid=22366] ppid=22333 vsize=385648 CPUtime=0 cores=0-7
/proc/22351/task/22366/stat : 22366 (python) S 22333 22333 21550 0 -1 4202560 71 0 0 0 0 0 0 0 19 0 2 0 627257951 394903552 6005 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 514 18446604448418083200 0 0 -1 0 0 0 0
[pid=22354] ppid=22333 vsize=395904 CPUtime=2.53 cores=0-7
/proc/22354/stat : 22354 (python) S 22333 22333 21550 0 -1 4202560 1015 0 0 0 135 118 0 0 15 0 2 0 627247326 405405696 6026 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/22354/statm: 98976 6026 400 364 0 34879 0
[pid=22358] ppid=22354 vsize=120756 CPUtime=780.7 cores=0-7
/proc/22358/stat : 22358 (march_hi) T 22354 22358 22358 0 -1 4202496 23080 0 0 0 78066 4 0 0 25 0 1 0 627247330 123654144 22824 33554432000 4194304 4955518 140737106491312 18446744073709551615 4282461 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/22358/statm: 30189 22824 104 186 0 30002 0
[pid=22354/tid=22389] ppid=22333 vsize=395904 CPUtime=0 cores=0-7
/proc/22354/task/22389/stat : 22389 (python) S 22333 22333 21550 0 -1 4202560 75 0 0 0 0 0 0 0 15 0 2 0 627301946 405405696 6026 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 514 18446604450785781568 0 0 -1 2 0 0 0
[pid=22356] ppid=22333 vsize=406160 CPUtime=2.57 cores=0-7
/proc/22356/stat : 22356 (python) S 22333 22333 21550 0 -1 4202560 1056 0 0 0 135 122 0 0 15 0 2 0 627247330 415907840 5918 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/22356/statm: 101540 5918 406 364 0 37440 0
[pid=22362] ppid=22356 vsize=120756 CPUtime=878 cores=0-7
/proc/22362/stat : 22362 (march_hi) T 22356 22362 22362 0 -1 4202496 25352 0 0 0 87796 4 0 0 25 0 1 0 627247335 123654144 25092 33554432000 4194304 4955518 140735729974080 18446744073709551615 4421280 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/22362/statm: 30189 25092 104 186 0 30002 0
[pid=22356/tid=22386] ppid=22333 vsize=406160 CPUtime=0 cores=0-7
/proc/22356/task/22386/stat : 22386 (python) S 22333 22333 21550 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 2 0 627296342 415907840 5918 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 514 18446604449711378560 0 0 -1 0 0 0 0
[pid=22359] ppid=22333 vsize=416416 CPUtime=2.9 cores=0-7
/proc/22359/stat : 22359 (python) S 22333 22333 21550 0 -1 4202560 1072 0 0 0 152 138 0 0 15 0 2 0 627247334 426409984 5893 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/22359/statm: 104104 5893 407 364 0 40001 0
[pid=22361] ppid=22359 vsize=120756 CPUtime=781.09 cores=0-7
/proc/22361/stat : 22361 (march_hi) R 22359 22361 22361 0 -1 4202496 23130 0 0 0 78104 5 0 0 25 0 1 0 627247334 123654144 22866 33554432000 4194304 4955518 140736865705696 18446744073709551615 4227935 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/22361/statm: 30189 22866 104 186 0 30002 0
[pid=22359/tid=22391] ppid=22333 vsize=416416 CPUtime=0 cores=0-7
/proc/22359/task/22391/stat : 22391 (python) S 22333 22333 21550 0 -1 4202560 76 0 0 0 0 0 0 0 15 0 2 0 627305007 426409984 5893 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 514 18446604450707657152 0 0 -1 6 0 0 0
[pid=22367] ppid=22333 vsize=426672 CPUtime=2.34 cores=0-7
/proc/22367/stat : 22367 (python) S 22333 22333 21550 0 -1 4202560 1039 0 0 0 125 109 0 0 15 0 2 0 627257955 436912128 6023 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/22367/statm: 106668 6023 400 364 0 42562 0
[pid=22369] ppid=22367 vsize=120756 CPUtime=679.9 cores=0-7
/proc/22369/stat : 22369 (march_hi) T 22367 22369 22369 0 -1 4202496 20581 0 0 0 67985 5 0 0 25 0 1 0 627257956 123654144 20319 33554432000 4194304 4955518 140736568821184 18446744073709551615 4224557 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/22369/statm: 30189 20319 104 186 0 30002 0
[pid=22367/tid=22394] ppid=22333 vsize=426672 CPUtime=0 cores=0-7
/proc/22367/task/22394/stat : 22394 (python) S 22333 22333 21550 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 2 0 627308477 436912128 6023 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 514 18446604448249554752 0 0 -1 0 0 0 0
[pid=22374] ppid=22333 vsize=436928 CPUtime=2.23 cores=0-7
/proc/22374/stat : 22374 (python) S 22333 22333 21550 0 -1 4202560 843 0 0 0 118 105 0 0 18 0 1 0 627264552 447414272 5900 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 18034805445293474050 0 0 17 1 0 0 0
/proc/22374/statm: 109232 5900 371 364 0 45123 0
[pid=22376] ppid=22374 vsize=182448 CPUtime=529.1 cores=0-7
/proc/22376/stat : 22376 (kcnfs-2006) R 22374 22376 22376 0 -1 4202496 591 0 0 0 52910 0 0 0 25 0 1 0 627264553 186826752 330 33554432000 134512640 135163436 4294499408 18446744073709551615 134569431 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/22376/statm: 45612 330 77 159 0 45452 0
[pid=22401] ppid=22333 vsize=447184 CPUtime=0.53 cores=0-7
/proc/22401/stat : 22401 (python) S 22333 22333 21550 0 -1 4202560 857 0 0 0 26 27 0 0 18 0 1 0 627332738 457916416 5958 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 18034805445293474052 0 0 17 1 0 0 0
/proc/22401/statm: 111796 5958 371 364 0 47684 0
[pid=22403] ppid=22401 vsize=182452 CPUtime=165.38 cores=0-7
/proc/22403/stat : 22403 (kcnfs-2006) R 22401 22403 22403 0 -1 4202496 592 0 0 0 16538 0 0 0 25 0 1 0 627332738 186830848 329 33554432000 134512640 135163436 4290361616 18446744073709551615 134675111 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/22403/statm: 45613 329 77 159 0 45453 0
[pid=22406] ppid=22333 vsize=457440 CPUtime=0.37 cores=0-7
/proc/22406/stat : 22406 (python) S 22333 22333 21550 0 -1 4202560 864 0 0 0 21 16 0 0 18 0 1 0 627339634 468418560 5943 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 18034805445293474051 0 0 17 2 0 0 0
/proc/22406/statm: 114360 5943 371 364 0 50245 0
[pid=22408] ppid=22406 vsize=182448 CPUtime=75.53 cores=0-7
/proc/22408/stat : 22408 (kcnfs-2006) R 22406 22408 22408 0 -1 4202496 596 0 0 0 7553 0 0 0 25 0 1 0 627339634 186826752 330 33554432000 134512640 135163436 4292647824 18446744073709551615 134666481 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/22408/statm: 45612 330 77 159 0 45452 0
[pid=22409] ppid=22333 vsize=467696 CPUtime=0.34 cores=0-7
/proc/22409/stat : 22409 (python) S 22333 22333 21550 0 -1 4202560 866 0 0 0 17 17 0 0 18 0 1 0 627340512 478920704 5997 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 18034805445293474050 0 0 17 6 0 0 0
/proc/22409/statm: 116924 5997 371 364 0 52806 0
[pid=22411] ppid=22409 vsize=182444 CPUtime=70.34 cores=0-7
/proc/22411/stat : 22411 (kcnfs-2006) R 22409 22411 22411 0 -1 4202496 593 0 0 0 7034 0 0 0 25 0 1 0 627340512 186822656 327 33554432000 134512640 135163436 4289442848 18446744073709551615 134585747 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/22411/statm: 45611 327 77 159 0 45451 0
[pid=22413] ppid=22333 vsize=477952 CPUtime=0.28 cores=0-7
/proc/22413/stat : 22413 (python) S 22333 22333 21550 0 -1 4202560 889 0 0 0 16 12 0 0 15 0 1 0 627344260 489422848 5981 33554432000 4194304 5683644 140735916659040 18446744073709551615 215988612678 0 0 16781312 514 255961913194676482 0 0 17 3 0 0 0
/proc/22413/statm: 119488 5981 371 364 0 55367 0
[pid=22415] ppid=22413 vsize=17812 CPUtime=76.01 cores=0-7
/proc/22415/stat : 22415 (march_hi) R 22413 22415 22415 0 -1 4202496 3346 0 0 0 7601 0 0 0 25 0 1 0 627344267 18239488 3078 33554432000 4194304 4955518 140734894543424 18446744073709551615 4209688 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/22415/statm: 4453 3078 104 186 0 4266 0
[pid=22333/tid=22340] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22340/stat : 22340 (python) S 22331 22333 21550 0 -1 4202560 27 938 0 0 0 0 0 0 20 0 15 0 627247307 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 0 0 0 0
[pid=22333/tid=22343] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22343/stat : 22343 (python) S 22331 22333 21550 0 -1 4202560 28 938 0 0 0 0 0 0 18 0 15 0 627247311 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 5 0 0 0
[pid=22333/tid=22346] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22346/stat : 22346 (python) S 22331 22333 21550 0 -1 4202560 84 938 0 0 0 0 0 0 18 0 15 0 627247314 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 0 0 0 0
[pid=22333/tid=22349] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22349/stat : 22349 (python) S 22331 22333 21550 0 -1 4202560 45 938 0 0 0 0 0 0 18 0 15 0 627247318 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 7 0 0 0
[pid=22333/tid=22352] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22352/stat : 22352 (python) S 22331 22333 21550 0 -1 4202560 33 938 0 0 0 0 0 0 24 0 15 0 627247322 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22355] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22355/stat : 22355 (python) S 22331 22333 21550 0 -1 4202560 51 938 0 0 0 0 0 0 18 0 15 0 627247326 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22357] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22357/stat : 22357 (python) S 22331 22333 21550 0 -1 4202560 36 938 0 0 0 0 0 0 18 0 15 0 627247330 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22360] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22360/stat : 22360 (python) S 22331 22333 21550 0 -1 4202560 82 938 0 0 0 0 0 0 18 0 15 0 627247334 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22368] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22368/stat : 22368 (python) S 22331 22333 21550 0 -1 4202560 42 938 0 0 0 0 0 0 18 0 15 0 627257955 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 3 0 0 0
[pid=22333/tid=22375] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22375/stat : 22375 (python) S 22331 22333 21550 0 -1 4202560 35 938 0 0 0 0 0 0 19 0 15 0 627264553 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22402] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22402/stat : 22402 (python) S 22331 22333 21550 0 -1 4202560 57 938 0 0 0 0 0 0 19 0 15 0 627332738 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 3 0 0 0
[pid=22333/tid=22407] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22407/stat : 22407 (python) S 22331 22333 21550 0 -1 4202560 32 938 0 0 0 0 0 0 20 0 15 0 627339634 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22410] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22410/stat : 22410 (python) S 22331 22333 21550 0 -1 4202560 33 938 0 0 0 0 0 0 20 0 15 0 627340512 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 6 0 0 0
[pid=22333/tid=22414] ppid=22331 vsize=488196 CPUtime=0 cores=0-7
/proc/22333/task/22414/stat : 22414 (python) S 22331 22333 21550 0 -1 4202560 36 938 0 0 0 0 0 0 20 0 15 0 627344261 499912704 7574 33554432000 4194304 5683644 140735916659040 18446744073709551615 216000416177 0 0 16781312 2 18446604448249555648 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6571.73
Current children cumulated vsize (KiB) 9668792

Child status: 0
Real time (s): 1067.4
CPU time (s): 6572.44
CPU user time (s): 6560.72
CPU system time (s): 11.7222
CPU usage (%): 615.742
Max. virtual memory (cumulated for all children) (KiB): 9789552

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6560.72
system time used= 11.7222
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 210318
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15534
involuntary context switches= 62559

runsolver used 6.05708 second user time and 14.2618 second system time

The end

Launcher Data 

Begin job on node117 at 2011-05-02 23:02:44
IDJOB=3321968
IDBENCH=82746
IDSOLVER=1712
FILE ID=node117/3321968-1304370164
RUNJOBID= node117-1304366467-21564
PBS_JOBID= 13181754
Free space on /tmp= 72644 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v500-c2130-S1514125851-037.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321968-1304370164/watcher-3321968-1304370164 -o /tmp/evaluation-result-3321968-1304370164/solver-3321968-1304370164 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321968-1304370164.cnf -seed 1935221403 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7ce6e28d94f25a5004daf47b6c05c693
RANDOM SEED=1935221403

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      22128024 kB
Buffers:       1024400 kB
Cached:        4534400 kB
SwapCached:        160 kB
Active:        5234672 kB
Inactive:      5078672 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      22128024 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           31980 kB
Writeback:           0 kB
AnonPages:     4754716 kB
Mapped:          26476 kB
Slab:           410968 kB
PageTables:      30812 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 70962488 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72612 MiB
End job on node117 at 2011-05-02 23:20:32