Trace number 3317424

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 1870.67 470.121

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S384085843-009.UNKNOWN.cnf
MD5SUM420ae9a699afd6f172f364b156d160ff
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark363.335
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data 

0.39/0.66	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.39/0.67	c INFO: solving HOME/instance-3317424-1304269593.cnf
0.39/0.67	c INFO: computing task features
0.47/0.70	c INFO: computed variable-clause graph statistics
0.47/0.70	c INFO: computed clause balance statistics
0.57/0.89	c INFO: computed variable balance statistics
0.67/0.96	c INFO: computed small-clause counts
0.67/0.96	c INFO: computed Horn-clause counts
0.67/0.97	c INFO: computed variable graph statistics
0.67/0.97	c INFO: collected features for HOME/instance-3317424-1304269593.cnf in 0.30 s
0.67/1.00	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.53)
0.77/1.02	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.09)
0.77/1.05	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.04)
0.77/1.08	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.03)
396.57/100.28	c INFO: running adaptg2wsat2009++@0 for 97 with 4700 remaining (b = 0.03)
400.60/101.22	c INFO: running march_hi@0 for 485 with 4699 remaining (b = 0.11)
400.60/101.27	c INFO: running gnovelty+2@0 for 97 with 4699 remaining (b = 0.02)
400.84/101.31	c INFO: running march_hi@0 for 485 with 4699 remaining (b = 0.09)
796.85/200.50	c INFO: running FH@0 for 97 with 4600 remaining (b = 0.02)
800.83/201.52	c INFO: running adaptg2wsat2009++@0 for 97 with 4599 remaining (b = 0.01)
1183.97/297.74	c INFO: running adaptg2wsat2009++@98 for 97 with 4502 remaining (b = 0.01)
1191.92/299.73	c INFO: running march_hi@0 for 485 with 4500 remaining (b = 0.08)
1567.02/393.96	c INFO: running march_hi@0 for 485 with 4406 remaining (b = 0.07)
1870.04/470.10	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317424-1304269593/watcher-3317424-1304269593 -o /tmp/evaluation-result-3317424-1304269593/solver-3317424-1304269593 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317424-1304269593.cnf -seed 2026662428 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.22 8.18 7.43 5/280 10803
/proc/meminfo: memFree=29388312/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=15752 CPUtime=0 cores=1,3,5,7
/proc/10803/stat : 10803 (python) R 10801 10803 9843 0 -1 4202496 839 0 0 0 0 0 0 0 25 0 1 0 519375562 16130048 723 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039651173 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10803/statm: 3938 723 334 364 0 425 0

[startup+0.0332019 s]
/proc/loadavg: 8.22 8.18 7.43 5/280 10803
/proc/meminfo: memFree=29388312/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=16812 CPUtime=0.01 cores=1,3,5,7
/proc/10803/stat : 10803 (python) R 10801 10803 9843 0 -1 4202496 1213 0 0 0 1 0 0 0 25 0 1 0 519375562 17215488 1072 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039653376 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10803/statm: 4203 1072 417 364 0 690 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16812

[startup+0.100189 s]
/proc/loadavg: 8.22 8.18 7.43 5/280 10803
/proc/meminfo: memFree=29388312/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=89768 CPUtime=0.07 cores=1,3,5,7
/proc/10803/stat : 10803 (python) R 10801 10803 9843 0 -1 4202496 2667 0 0 0 5 2 0 0 17 0 1 0 519375562 91922432 2383 33554432000 4194304 5683644 140736523957696 18446744073709551615 212043109355 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10803/statm: 22442 2388 750 364 0 1622 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 89768

[startup+0.300174 s]
/proc/loadavg: 8.22 8.18 7.43 5/280 10803
/proc/meminfo: memFree=29388312/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=135748 CPUtime=0.19 cores=1,3,5,7
/proc/10803/stat : 10803 (python) R 10801 10803 9843 0 -1 4202496 5968 936 1 0 14 5 0 0 17 0 1 0 519375562 139005952 4151 33554432000 4194304 5683644 140736523957696 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10803/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.701082 s]
/proc/loadavg: 8.22 8.18 7.43 5/280 10803
/proc/meminfo: memFree=29388312/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=279616 CPUtime=0.47 cores=1,3,5,7
/proc/10803/stat : 10803 (python) R 10801 10803 9843 0 -1 4202496 9566 936 1 0 34 13 0 0 15 0 1 0 519375562 286326784 7246 33554432000 4194304 5683644 140736523957696 18446744073709551615 47599917363702 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10803/statm: 69904 7246 1761 364 0 5828 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 279616

[startup+1.5009 s]
/proc/loadavg: 7.96 8.12 7.41 6/281 10809
/proc/meminfo: memFree=29364356/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=320244 CPUtime=0.84 cores=1,3,5,7
/proc/10803/stat : 10803 (python) S 10801 10803 9843 0 -1 4202496 12742 936 1 0 71 13 0 0 20 0 5 0 519375562 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/10803/statm: 80061 7260 1883 364 0 15970 0
[pid=10803/tid=10810] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10810/stat : 10810 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 5 0 519375663 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.84
Current children cumulated vsize (KiB) 320244

[startup+3.10062 s]
/proc/loadavg: 7.96 8.12 7.41 9/293 10820
/proc/meminfo: memFree=29346156/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=320244 CPUtime=0.84 cores=1,3,5,7
/proc/10803/stat : 10803 (python) S 10801 10803 9843 0 -1 4202496 12742 936 1 0 71 13 0 0 20 0 5 0 519375562 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/10803/statm: 80061 7260 1883 364 0 15970 0
[pid=10809] ppid=10803 vsize=278700 CPUtime=0 cores=1,3,5,7
/proc/10809/stat : 10809 (python) S 10803 10803 9843 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 519375663 285388800 5614 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675407 0 0 16781312 514 10071650484659126535 0 0 17 1 0 0 0
/proc/10809/statm: 69675 5614 354 364 0 5593 0
[pid=10811] ppid=10809 vsize=1017932 CPUtime=2.09 cores=1,3,5,7
/proc/10811/stat : 10811 (gnovelty+2) R 10809 10811 10811 0 -1 4202496 510 0 0 0 209 0 0 0 25 0 1 0 519375663 1042362368 248 33554432000 134512640 135663704 4287997520 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10811/statm: 254483 248 113 282 0 254199 0
[pid=10812] ppid=10803 vsize=289352 CPUtime=0 cores=1,3,5,7
/proc/10812/stat : 10812 (python) S 10803 10803 9843 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 519375665 296296448 5696 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 12736203115120787717 0 0 17 5 0 0 0
/proc/10812/statm: 72338 5696 348 364 0 8253 0
[pid=10814] ppid=10812 vsize=1017932 CPUtime=2.06 cores=1,3,5,7
/proc/10814/stat : 10814 (gnovelty+2) R 10812 10814 10814 0 -1 4202496 513 0 0 0 206 0 0 0 25 0 1 0 519375666 1042362368 248 33554432000 134512640 135663704 4286817712 18446744073709551615 134546746 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10814/statm: 254483 248 113 282 0 254199 0
[pid=10815] ppid=10803 vsize=299136 CPUtime=0 cores=1,3,5,7
/proc/10815/stat : 10815 (python) S 10803 10803 9843 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 519375668 306315264 5597 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 1405500495400763654 0 0 17 7 0 0 0
/proc/10815/statm: 74784 5597 348 364 0 10696 0
[pid=10817] ppid=10815 vsize=416788 CPUtime=2.03 cores=1,3,5,7
/proc/10817/stat : 10817 (adaptg2wsat2009) R 10815 10817 10817 0 -1 4202496 630 0 0 0 203 0 0 0 25 0 1 0 519375668 426790912 364 33554432000 134512640 135107411 4291225328 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/10817/statm: 104197 364 59 146 0 103073 0
[pid=10818] ppid=10803 vsize=310000 CPUtime=0 cores=1,3,5,7
/proc/10818/stat : 10818 (python) S 10803 10803 9843 0 -1 4202560 747 0 0 0 0 0 0 0 18 0 1 0 519375671 317440000 5721 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 5483282908833612038 0 0 17 5 0 0 0
/proc/10818/statm: 77500 5721 348 364 0 13409 0
[pid=10820] ppid=10818 vsize=416788 CPUtime=2 cores=1,3,5,7
/proc/10820/stat : 10820 (adaptg2wsat2009) R 10818 10820 10820 0 -1 4202496 628 0 0 0 200 0 0 0 25 0 1 0 519375671 426790912 363 33554432000 134512640 135107411 4293457408 18446744073709551615 134531808 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10820/statm: 104197 363 59 146 0 103073 0
[pid=10803/tid=10810] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10810/stat : 10810 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 5 0 519375663 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 1 0 0 0
[pid=10803/tid=10813] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10813/stat : 10813 (python) S 10801 10803 9843 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 5 0 519375665 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10816] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10816/stat : 10816 (python) S 10801 10803 9843 0 -1 4202560 23 936 0 0 0 0 0 0 22 0 5 0 519375668 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10819] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10819/stat : 10819 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 5 0 519375671 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 9.02
Current children cumulated vsize (KiB) 4366872

[startup+6.30104 s]
/proc/loadavg: 7.96 8.12 7.41 9/293 10820
/proc/meminfo: memFree=29343236/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=320244 CPUtime=0.84 cores=1,3,5,7
/proc/10803/stat : 10803 (python) S 10801 10803 9843 0 -1 4202496 12742 936 1 0 71 13 0 0 20 0 5 0 519375562 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/10803/statm: 80061 7260 1883 364 0 15970 0
[pid=10809] ppid=10803 vsize=278700 CPUtime=0 cores=1,3,5,7
/proc/10809/stat : 10809 (python) S 10803 10803 9843 0 -1 4202560 898 0 0 0 0 0 0 0 18 0 1 0 519375663 285388800 5637 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675407 0 0 16781312 514 10071650484659126535 0 0 17 1 0 0 0
/proc/10809/statm: 69675 5637 377 364 0 5593 0
[pid=10811] ppid=10809 vsize=1017932 CPUtime=5.29 cores=1,3,5,7
/proc/10811/stat : 10811 (gnovelty+2) R 10809 10811 10811 0 -1 4202496 510 0 0 0 529 0 0 0 25 0 1 0 519375663 1042362368 248 33554432000 134512640 135663704 4287997520 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10811/statm: 254483 248 113 282 0 254199 0
[pid=10812] ppid=10803 vsize=289352 CPUtime=0 cores=1,3,5,7
/proc/10812/stat : 10812 (python) S 10803 10803 9843 0 -1 4202560 896 0 0 0 0 0 0 0 18 0 1 0 519375665 296296448 5718 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 12736203115120787717 0 0 17 5 0 0 0
/proc/10812/statm: 72338 5718 370 364 0 8253 0
[pid=10814] ppid=10812 vsize=1017932 CPUtime=5.25 cores=1,3,5,7
/proc/10814/stat : 10814 (gnovelty+2) R 10812 10814 10814 0 -1 4202496 513 0 0 0 525 0 0 0 25 0 1 0 519375666 1042362368 248 33554432000 134512640 135663704 4286817712 18446744073709551615 134525229 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10814/statm: 254483 248 113 282 0 254199 0
[pid=10815] ppid=10803 vsize=299136 CPUtime=0 cores=1,3,5,7
/proc/10815/stat : 10815 (python) S 10803 10803 9843 0 -1 4202560 911 0 0 0 0 0 0 0 18 0 1 0 519375668 306315264 5620 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 1405500495400763654 0 0 17 7 0 0 0
/proc/10815/statm: 74784 5620 371 364 0 10696 0
[pid=10817] ppid=10815 vsize=416788 CPUtime=5.21 cores=1,3,5,7
/proc/10817/stat : 10817 (adaptg2wsat2009) R 10815 10817 10817 0 -1 4202496 630 0 0 0 521 0 0 0 25 0 1 0 519375668 426790912 364 33554432000 134512640 135107411 4291225328 18446744073709551615 134531843 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/10817/statm: 104197 364 59 146 0 103073 0
[pid=10818] ppid=10803 vsize=310000 CPUtime=0 cores=1,3,5,7
/proc/10818/stat : 10818 (python) S 10803 10803 9843 0 -1 4202560 915 0 0 0 0 0 0 0 18 0 1 0 519375671 317440000 5744 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 5483282908833612038 0 0 17 5 0 0 0
/proc/10818/statm: 77500 5744 371 364 0 13409 0
[pid=10820] ppid=10818 vsize=416788 CPUtime=5.16 cores=1,3,5,7
/proc/10820/stat : 10820 (adaptg2wsat2009) R 10818 10820 10820 0 -1 4202496 628 0 0 0 516 0 0 0 25 0 1 0 519375671 426790912 363 33554432000 134512640 135107411 4293457408 18446744073709551615 134532224 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10820/statm: 104197 363 59 146 0 103073 0
[pid=10803/tid=10810] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10810/stat : 10810 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 5 0 519375663 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 1 0 0 0
[pid=10803/tid=10813] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10813/stat : 10813 (python) S 10801 10803 9843 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 5 0 519375665 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10816] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10816/stat : 10816 (python) S 10801 10803 9843 0 -1 4202560 23 936 0 0 0 0 0 0 22 0 5 0 519375668 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10819] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10819/stat : 10819 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 5 0 519375671 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 21.75
Current children cumulated vsize (KiB) 4366872

[startup+12.7009 s]
/proc/loadavg: 7.97 8.12 7.42 10/293 10821
/proc/meminfo: memFree=29340500/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=320244 CPUtime=0.84 cores=1,3,5,7
/proc/10803/stat : 10803 (python) S 10801 10803 9843 0 -1 4202496 12742 936 1 0 71 13 0 0 20 0 5 0 519375562 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/10803/statm: 80061 7260 1883 364 0 15970 0
[pid=10809] ppid=10803 vsize=278700 CPUtime=0.02 cores=1,3,5,7
/proc/10809/stat : 10809 (python) S 10803 10803 9843 0 -1 4202560 903 0 0 0 1 1 0 0 18 0 1 0 519375663 285388800 5637 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675407 0 0 16781312 514 14023435183445737735 0 0 17 1 0 0 0
/proc/10809/statm: 69675 5637 377 364 0 5593 0
[pid=10811] ppid=10809 vsize=1017932 CPUtime=11.69 cores=1,3,5,7
/proc/10811/stat : 10811 (gnovelty+2) R 10809 10811 10811 0 -1 4202496 510 0 0 0 1169 0 0 0 25 0 1 0 519375663 1042362368 248 33554432000 134512640 135663704 4287997520 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10811/statm: 254483 248 113 282 0 254199 0
[pid=10812] ppid=10803 vsize=289352 CPUtime=0.01 cores=1,3,5,7
/proc/10812/stat : 10812 (python) S 10803 10803 9843 0 -1 4202560 900 0 0 0 1 0 0 0 18 0 1 0 519375665 296296448 5718 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 14023435183445737733 0 0 17 5 0 0 0
/proc/10812/statm: 72338 5718 370 364 0 8253 0
[pid=10814] ppid=10812 vsize=1017932 CPUtime=11.64 cores=1,3,5,7
/proc/10814/stat : 10814 (gnovelty+2) R 10812 10814 10814 0 -1 4202496 513 0 0 0 1164 0 0 0 25 0 1 0 519375666 1042362368 248 33554432000 134512640 135663704 4286817712 18446744073709551615 134525243 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10814/statm: 254483 248 113 282 0 254199 0
[pid=10815] ppid=10803 vsize=299136 CPUtime=0.02 cores=1,3,5,7
/proc/10815/stat : 10815 (python) S 10803 10803 9843 0 -1 4202560 911 0 0 0 1 1 0 0 18 0 1 0 519375668 306315264 5620 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 14023435183445737734 0 0 17 7 0 0 0
/proc/10815/statm: 74784 5620 371 364 0 10696 0
[pid=10817] ppid=10815 vsize=416788 CPUtime=11.59 cores=1,3,5,7
/proc/10817/stat : 10817 (adaptg2wsat2009) R 10815 10817 10817 0 -1 4202496 630 0 0 0 1159 0 0 0 25 0 1 0 519375668 426790912 364 33554432000 134512640 135107411 4291225328 18446744073709551615 134531792 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/10817/statm: 104197 364 59 146 0 103073 0
[pid=10818] ppid=10803 vsize=310000 CPUtime=0.02 cores=1,3,5,7
/proc/10818/stat : 10818 (python) S 10803 10803 9843 0 -1 4202560 921 0 0 0 1 1 0 0 18 0 1 0 519375671 317440000 5744 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 14023435183445737734 0 0 17 5 0 0 0
/proc/10818/statm: 77500 5744 371 364 0 13409 0
[pid=10820] ppid=10818 vsize=416788 CPUtime=11.5 cores=1,3,5,7
/proc/10820/stat : 10820 (adaptg2wsat2009) R 10818 10820 10820 0 -1 4202496 628 0 0 0 1150 0 0 0 25 0 1 0 519375671 426790912 363 33554432000 134512640 135107411 4293457408 18446744073709551615 134532242 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10820/statm: 104197 363 59 146 0 103073 0
[pid=10803/tid=10810] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10810/stat : 10810 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 5 0 519375663 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 1 0 0 0
[pid=10803/tid=10813] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10813/stat : 10813 (python) S 10801 10803 9843 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 5 0 519375665 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10816] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10816/stat : 10816 (python) S 10801 10803 9843 0 -1 4202560 23 936 0 0 0 0 0 0 22 0 5 0 519375668 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10819] ppid=10801 vsize=320244 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10819/stat : 10819 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 5 0 519375671 327929856 7260 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 47.33
Current children cumulated vsize (KiB) 4366872

[startup+25.5006 s]
/proc/loadavg: 7.97 8.11 7.43 9/296 10824

################
# More data... #
################

/proc/10842/statm: 983 793 106 186 0 796 0
[pid=10847] ppid=10803 vsize=361556 CPUtime=0.19 cores=1,3,5,7
/proc/10847/stat : 10847 (python) S 10803 10803 9843 0 -1 4202560 1127 0 0 0 9 10 0 0 19 0 2 0 519395613 370233344 5863 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/10847/statm: 90389 5863 400 364 0 26283 0
[pid=10849] ppid=10847 vsize=246936 CPUtime=97.1 cores=1,3,5,7
/proc/10849/stat : 10849 (FH) T 10847 10849 10849 0 -1 4202496 593 0 0 0 9710 0 0 0 25 0 1 0 519395613 252862464 327 33554432000 134512640 134936988 4288191872 18446744073709551615 134553311 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/10849/statm: 61734 327 41 104 0 61238 0
[pid=10847/tid=10854] ppid=10803 vsize=361556 CPUtime=0 cores=1,3,5,7
/proc/10847/task/10854/stat : 10854 (python) S 10803 10803 9843 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 519405533 370233344 5863 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 514 18446604466974946304 0 0 -1 5 0 0 0
[pid=10855] ppid=10803 vsize=371812 CPUtime=0.36 cores=1,3,5,7
/proc/10855/stat : 10855 (python) S 10803 10803 9843 0 -1 4202560 1020 0 0 0 19 17 0 0 15 0 1 0 519405536 380735488 5863 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 6203198317602504965 0 0 17 5 0 0 0
/proc/10855/statm: 92953 5863 371 364 0 28844 0
[pid=10857] ppid=10855 vsize=3080 CPUtime=167.67 cores=1,3,5,7
/proc/10857/stat : 10857 (march_hi) R 10855 10857 10857 0 -1 4202496 1460 0 0 0 16767 0 0 0 25 0 1 0 519405537 3153920 562 33554432000 4194304 4955518 140737309490416 18446744073709551615 4224615 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/10857/statm: 770 562 106 186 0 583 0
[pid=10905] ppid=10803 vsize=382068 CPUtime=0.16 cores=1,3,5,7
/proc/10905/stat : 10905 (python) S 10803 10803 9843 0 -1 4202560 989 0 0 0 9 7 0 0 15 0 1 0 519414959 391237632 5867 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 5545980635262189830 0 0 17 7 0 0 0
/proc/10905/statm: 95517 5867 371 364 0 31405 0
[pid=10907] ppid=10905 vsize=2620 CPUtime=73.85 cores=1,3,5,7
/proc/10907/stat : 10907 (march_hi) R 10905 10907 10907 0 -1 4202496 1304 0 0 0 7385 0 0 0 25 0 1 0 519414960 2682880 449 33554432000 4194304 4955518 140736660309136 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10907/statm: 655 449 106 186 0 468 0
[pid=10803/tid=10810] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10810/stat : 10810 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 12 0 519375663 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 1 0 0 0
[pid=10803/tid=10813] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10813/stat : 10813 (python) S 10801 10803 9843 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 12 0 519375665 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10816] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10816/stat : 10816 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 12 0 519375668 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10819] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10819/stat : 10819 (python) S 10801 10803 9843 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 12 0 519375671 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10829] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10829/stat : 10829 (python) S 10801 10803 9843 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 12 0 519385592 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10834] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10834/stat : 10834 (python) S 10801 10803 9843 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 12 0 519385685 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 1 0 0 0
[pid=10803/tid=10838] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10838/stat : 10838 (python) S 10801 10803 9843 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 12 0 519385690 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10841] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10841/stat : 10841 (python) S 10801 10803 9843 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 12 0 519385694 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10848] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10848/stat : 10848 (python) S 10801 10803 9843 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 12 0 519395613 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10856] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10856/stat : 10856 (python) S 10801 10803 9843 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 12 0 519405537 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10906] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10906/stat : 10906 (python) S 10801 10803 9843 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 12 0 519414960 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1868.06
Current children cumulated vsize (KiB) 8602888

[startup+469.902 s]
/proc/loadavg: 8.10 8.09 7.66 10/314 10917
/proc/meminfo: memFree=29496968/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=392312 CPUtime=1.16 cores=1,3,5,7
/proc/10803/stat : 10803 (python) S 10801 10803 9843 0 -1 4202496 19013 936 1 0 101 15 0 0 19 0 12 0 519375562 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/10803/statm: 98078 7398 1898 364 0 33966 0
[pid=10809] ppid=10803 vsize=288944 CPUtime=0.18 cores=1,3,5,7
/proc/10809/stat : 10809 (python) S 10803 10803 9843 0 -1 4202560 1091 0 0 0 10 8 0 0 19 0 2 0 519375663 295878656 5675 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/10809/statm: 72236 5675 410 364 0 8154 0
[pid=10811] ppid=10809 vsize=1017932 CPUtime=100.17 cores=1,3,5,7
/proc/10811/stat : 10811 (gnovelty+2) T 10809 10811 10811 0 -1 4202496 510 0 0 0 10017 0 0 0 25 0 1 0 519375663 1042362368 248 33554432000 134512640 135663704 4287997520 18446744073709551615 134525286 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/10811/statm: 254483 248 113 282 0 254199 0
[pid=10809/tid=10831] ppid=10803 vsize=288944 CPUtime=0 cores=1,3,5,7
/proc/10809/task/10831/stat : 10831 (python) S 10803 10803 9843 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519385681 295878656 5675 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 514 18446604459552649408 0 0 -1 1 0 0 0
[pid=10812] ppid=10803 vsize=289352 CPUtime=0.18 cores=1,3,5,7
/proc/10812/stat : 10812 (python) S 10803 10803 9843 0 -1 4202560 1078 0 0 0 11 7 0 0 19 0 2 0 519375665 296296448 5749 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10812/statm: 72338 5749 400 364 0 8253 0
[pid=10814] ppid=10812 vsize=1017932 CPUtime=99.99 cores=1,3,5,7
/proc/10814/stat : 10814 (gnovelty+2) T 10812 10814 10814 0 -1 4202496 513 0 0 0 9999 0 0 0 25 0 1 0 519375666 1042362368 248 33554432000 134512640 135663704 4286817712 18446744073709551615 134524882 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/10814/statm: 254483 248 113 282 0 254199 0
[pid=10812/tid=10832] ppid=10803 vsize=289352 CPUtime=0 cores=1,3,5,7
/proc/10812/task/10832/stat : 10832 (python) S 10803 10803 9843 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 519385684 296296448 5749 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 514 18446604468762973504 0 0 -1 5 0 0 0
[pid=10815] ppid=10803 vsize=299136 CPUtime=0.38 cores=1,3,5,7
/proc/10815/stat : 10815 (python) S 10803 10803 9843 0 -1 4202560 1128 0 0 0 23 15 0 0 18 0 2 0 519375668 306315264 5650 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/10815/statm: 74784 5650 400 364 0 10696 0
[pid=10817] ppid=10815 vsize=416788 CPUtime=195.03 cores=1,3,5,7
/proc/10817/stat : 10817 (adaptg2wsat2009) T 10815 10817 10817 0 -1 4202496 630 0 0 0 19503 0 0 0 25 0 1 0 519375668 426790912 364 33554432000 134512640 135107411 4291225328 18446744073709551615 134532302 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/10817/statm: 104197 364 59 146 0 103073 0
[pid=10815/tid=10827] ppid=10803 vsize=299136 CPUtime=0 cores=1,3,5,7
/proc/10815/task/10827/stat : 10827 (python) S 10803 10803 9843 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 519385589 306315264 5650 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 514 18446604457534904128 0 0 -1 7 0 0 0
[pid=10818] ppid=10803 vsize=310000 CPUtime=0.38 cores=1,3,5,7
/proc/10818/stat : 10818 (python) S 10803 10803 9843 0 -1 4202560 1140 0 0 0 21 17 0 0 18 0 2 0 519375671 317440000 5774 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/10818/statm: 77500 5774 400 364 0 13409 0
[pid=10820] ppid=10818 vsize=416788 CPUtime=195.29 cores=1,3,5,7
/proc/10820/stat : 10820 (adaptg2wsat2009) T 10818 10820 10820 0 -1 4202496 628 0 0 0 19529 0 0 0 25 0 1 0 519375671 426790912 363 33554432000 134512640 135107411 4293457408 18446744073709551615 134532326 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/10820/statm: 104197 363 59 146 0 103073 0
[pid=10818/tid=10836] ppid=10803 vsize=310000 CPUtime=0 cores=1,3,5,7
/proc/10818/task/10836/stat : 10836 (python) S 10803 10803 9843 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 519385689 317440000 5774 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 514 18446604467074271424 0 0 -1 7 0 0 0
[pid=10828] ppid=10803 vsize=320256 CPUtime=0.19 cores=1,3,5,7
/proc/10828/stat : 10828 (python) S 10803 10803 9843 0 -1 4202560 1115 0 0 0 10 9 0 0 19 0 2 0 519385591 327942144 5778 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10828/statm: 80064 5778 400 364 0 15970 0
[pid=10830] ppid=10828 vsize=416788 CPUtime=99.33 cores=1,3,5,7
/proc/10830/stat : 10830 (adaptg2wsat2009) T 10828 10830 10830 0 -1 4202496 631 0 0 0 9933 0 0 0 25 0 1 0 519385592 426790912 364 33554432000 134512640 135107411 4292412768 18446744073709551615 134531808 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/10830/statm: 104197 364 59 146 0 103073 0
[pid=10828/tid=10846] ppid=10803 vsize=320256 CPUtime=0 cores=1,3,5,7
/proc/10828/task/10846/stat : 10846 (python) S 10803 10803 9843 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 519395609 327942144 5778 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 514 18446604461858596672 0 0 -1 5 0 0 0
[pid=10833] ppid=10803 vsize=330060 CPUtime=0.79 cores=1,3,5,7
/proc/10833/stat : 10833 (python) S 10803 10803 9843 0 -1 4202560 1037 0 0 0 43 36 0 0 15 0 1 0 519385685 337981440 5661 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 14380332264070283526 0 0 17 1 0 0 0
/proc/10833/statm: 82515 5661 372 364 0 18418 0
[pid=10835] ppid=10833 vsize=4696 CPUtime=368.67 cores=1,3,5,7
/proc/10835/stat : 10835 (march_hi) R 10833 10835 10835 0 -1 4202496 1694 0 0 0 36866 1 0 0 25 0 1 0 519385685 4808704 800 33554432000 4194304 4955518 140733320044320 18446744073709551615 4285604 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10835/statm: 1174 800 106 186 0 987 0
[pid=10837] ppid=10803 vsize=340856 CPUtime=0.18 cores=1,3,5,7
/proc/10837/stat : 10837 (python) S 10803 10803 9843 0 -1 4202560 1125 0 0 0 10 8 0 0 19 0 2 0 519385690 349036544 5808 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/10837/statm: 85214 5808 400 364 0 21114 0
[pid=10839] ppid=10837 vsize=1017932 CPUtime=99.83 cores=1,3,5,7
/proc/10839/stat : 10839 (gnovelty+2) T 10837 10839 10839 0 -1 4202496 515 0 0 0 9983 0 0 0 25 0 1 0 519385690 1042362368 247 33554432000 134512640 135663704 4293960928 18446744073709551615 134525276 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/10839/statm: 254483 247 113 282 0 254199 0
[pid=10837/tid=10850] ppid=10803 vsize=340856 CPUtime=0 cores=1,3,5,7
/proc/10837/task/10850/stat : 10850 (python) S 10803 10803 9843 0 -1 4202560 52 0 0 0 0 0 0 0 19 0 2 0 519395711 349036544 5808 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 514 18446604459359955776 0 0 -1 5 0 0 0
[pid=10840] ppid=10803 vsize=351112 CPUtime=0.79 cores=1,3,5,7
/proc/10840/stat : 10840 (python) S 10803 10803 9843 0 -1 4202560 1056 0 0 0 42 37 0 0 15 0 1 0 519385694 359538688 5811 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 7783205322809639176 0 0 17 1 0 0 0
/proc/10840/statm: 87778 5811 377 364 0 23675 0
[pid=10842] ppid=10840 vsize=3932 CPUtime=366.99 cores=1,3,5,7
/proc/10842/stat : 10842 (march_hi) R 10840 10842 10842 0 -1 4202496 1695 0 0 0 36699 0 0 0 25 0 1 0 519385694 4026368 794 33554432000 4194304 4955518 140736909569200 18446744073709551615 4224512 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10842/statm: 983 794 106 186 0 796 0
[pid=10847] ppid=10803 vsize=361556 CPUtime=0.19 cores=1,3,5,7
/proc/10847/stat : 10847 (python) S 10803 10803 9843 0 -1 4202560 1127 0 0 0 9 10 0 0 19 0 2 0 519395613 370233344 5863 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051482059 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/10847/statm: 90389 5863 400 364 0 26283 0
[pid=10849] ppid=10847 vsize=246936 CPUtime=97.1 cores=1,3,5,7
/proc/10849/stat : 10849 (FH) T 10847 10849 10849 0 -1 4202496 593 0 0 0 9710 0 0 0 25 0 1 0 519395613 252862464 327 33554432000 134512640 134936988 4288191872 18446744073709551615 134553311 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/10849/statm: 61734 327 41 104 0 61238 0
[pid=10847/tid=10854] ppid=10803 vsize=361556 CPUtime=0 cores=1,3,5,7
/proc/10847/task/10854/stat : 10854 (python) S 10803 10803 9843 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 519405533 370233344 5863 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 514 18446604466974946304 0 0 -1 5 0 0 0
[pid=10855] ppid=10803 vsize=371812 CPUtime=0.36 cores=1,3,5,7
/proc/10855/stat : 10855 (python) S 10803 10803 9843 0 -1 4202560 1020 0 0 0 19 17 0 0 15 0 1 0 519405536 380735488 5863 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 6203198317602504965 0 0 17 5 0 0 0
/proc/10855/statm: 92953 5863 371 364 0 28844 0
[pid=10857] ppid=10855 vsize=3080 CPUtime=168.07 cores=1,3,5,7
/proc/10857/stat : 10857 (march_hi) R 10855 10857 10857 0 -1 4202496 1461 0 0 0 16807 0 0 0 25 0 1 0 519405537 3153920 563 33554432000 4194304 4955518 140737309490416 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/10857/statm: 770 563 106 186 0 583 0
[pid=10905] ppid=10803 vsize=382068 CPUtime=0.16 cores=1,3,5,7
/proc/10905/stat : 10905 (python) S 10803 10803 9843 0 -1 4202560 989 0 0 0 9 7 0 0 15 0 1 0 519414959 391237632 5867 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039675462 0 0 16781312 514 5545980635262189830 0 0 17 7 0 0 0
/proc/10905/statm: 95517 5867 371 364 0 31405 0
[pid=10907] ppid=10905 vsize=2620 CPUtime=74.24 cores=1,3,5,7
/proc/10907/stat : 10907 (march_hi) R 10905 10907 10907 0 -1 4202496 1304 0 0 0 7424 0 0 0 25 0 1 0 519414960 2682880 449 33554432000 4194304 4955518 140736660309136 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10907/statm: 655 449 106 186 0 468 0
[pid=10803/tid=10810] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10810/stat : 10810 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 12 0 519375663 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 1 0 0 0
[pid=10803/tid=10813] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10813/stat : 10813 (python) S 10801 10803 9843 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 12 0 519375665 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10816] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10816/stat : 10816 (python) S 10801 10803 9843 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 12 0 519375668 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10819] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10819/stat : 10819 (python) S 10801 10803 9843 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 12 0 519375671 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10829] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10829/stat : 10829 (python) S 10801 10803 9843 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 12 0 519385592 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10834] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10834/stat : 10834 (python) S 10801 10803 9843 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 12 0 519385685 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 1 0 0 0
[pid=10803/tid=10838] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10838/stat : 10838 (python) S 10801 10803 9843 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 12 0 519385690 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 5 0 0 0
[pid=10803/tid=10841] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10841/stat : 10841 (python) S 10801 10803 9843 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 12 0 519385694 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10848] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10848/stat : 10848 (python) S 10801 10803 9843 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 12 0 519395613 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10856] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10856/stat : 10856 (python) S 10801 10803 9843 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 12 0 519405537 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
[pid=10803/tid=10906] ppid=10801 vsize=392312 CPUtime=0 cores=1,3,5,7
/proc/10803/task/10906/stat : 10906 (python) S 10801 10803 9843 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 12 0 519414960 401727488 7398 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1869.65
Current children cumulated vsize (KiB) 8602888

[startup+470.102 s]
/proc/loadavg: 8.10 8.09 7.66 10/314 10917
/proc/meminfo: memFree=29496968/32951124 swapFree=67106388/67111528
[pid=10803] ppid=10801 vsize=320484 CPUtime=1500.95 cores=1,3,5,7
/proc/10803/stat : 10803 (python) R 10801 10803 9843 0 -1 4202496 19419 20653 1 0 101 15 149836 143 17 0 2 0 519375562 328175616 7351 33554432000 4194304 5683644 140736523957696 18446744073709551615 212039314229 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/10803/statm: 80121 7351 1879 364 0 16039 0
[pid=10833] ppid=10803 vsize=0 CPUtime=369.66 cores=1,3,5,7
/proc/10833/stat : 10833 (python) Z 10803 10803 9843 0 -1 4202588 1256 1695 0 0 44 36 36885 1 15 0 1 0 519385685 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 1 0 0 0
/proc/10833/statm: 0 0 0 0 0 0 0
[pid=10803/tid=10834] ppid=10801 vsize=320484 CPUtime=1499.79 cores=1,3,5,7
/proc/10803/task/10834/stat : 10834 (python) S 10801 10803 9843 0 -1 4202560 23 20653 0 0 0 0 149836 143 20 0 2 0 519385685 328175616 7351 33554432000 4194304 5683644 140736523957696 18446744073709551615 212051478961 0 0 16781312 2 18446604459552652096 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1870.61
Current children cumulated vsize (KiB) 320484

Child status: 0
Real time (s): 470.121
CPU time (s): 1870.67
CPU user time (s): 1868.69
CPU system time (s): 1.9777
CPU usage (%): 397.911
Max. virtual memory (cumulated for all children) (KiB): 8602888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1868.69
system time used= 1.9777
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 47055
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6627
involuntary context switches= 16680

runsolver used 1.9667 second user time and 4.46732 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-01 19:06:33
IDJOB=3317424
IDBENCH=82889
IDSOLVER=1705
FILE ID=node146/3317424-1304269593
RUNJOBID= node146-1304267279-9862
PBS_JOBID= 13173933
Free space on /tmp= 73300 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S384085843-009.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317424-1304269593/watcher-3317424-1304269593 -o /tmp/evaluation-result-3317424-1304269593/solver-3317424-1304269593 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317424-1304269593.cnf -seed 2026662428 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 420ae9a699afd6f172f364b156d160ff
RANDOM SEED=2026662428

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29388592 kB
Buffers:        465920 kB
Cached:        1319424 kB
SwapCached:        888 kB
Active:        1642396 kB
Inactive:      1520632 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29388592 kB
SwapTotal:    67111528 kB
SwapFree:     67106388 kB
Dirty:           31876 kB
Writeback:           0 kB
AnonPages:     1376344 kB
Mapped:          26084 kB
Slab:           317800 kB
PageTables:      21344 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 39095116 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73268 MiB
End job on node146 at 2011-05-01 19:14:23