Trace number 3378159

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 2382.76 600.637

General information on the benchmark

Namerandom/large/
unif-k7-r85-v200-c17000-S283489555-036-UNKNOWN.cnf
MD5SUMdd0dfae1a7fca71616878d93d3870a71
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark656.835
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses17000
Sum of the clauses size119000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517000

Solver Data 

0.29/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.29/0.47	c INFO: solving HOME/instance-3378159-1305463266.cnf
0.29/0.47	c INFO: computing task features
0.38/0.58	c INFO: computed variable-clause graph statistics
0.38/0.58	c INFO: computed clause balance statistics
1.08/1.20	c INFO: computed variable balance statistics
1.28/1.44	c INFO: computed small-clause counts
1.28/1.44	c INFO: computed Horn-clause counts
1.28/1.46	c INFO: computed variable graph statistics
1.28/1.46	c INFO: collected features for HOME/instance-3378159-1305463266.cnf in 0.99 s
1.28/1.47	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.35)
1.28/1.48	c INFO: running gnovelty+2@0 for 97 with 1198 remaining (b = 0.12)
1.37/2.08	c INFO: running adaptg2wsat2009++@0 for 97 with 1198 remaining (b = 0.08)
1.37/2.08	c INFO: running adaptg2wsat2009++@0 for 97 with 1198 remaining (b = 0.06)
401.03/101.83	c INFO: running adaptg2wsat2009++@0 for 97 with 1098 remaining (b = 0.05)
401.37/101.91	c INFO: running gnovelty+2@0 for 97 with 1098 remaining (b = 0.04)
401.37/101.93	c INFO: running FH@0 for 97 with 1098 remaining (b = 0.03)
401.37/101.95	c INFO: running adaptg2wsat2009++@0 for 97 with 1098 remaining (b = 0.03)
797.27/201.33	c INFO: running adaptg2wsat2009++@0 for 97 with 999 remaining (b = 0.02)
799.63/202.18	c INFO: running FH@0 for 97 with 998 remaining (b = 0.02)
801.19/202.31	c INFO: running hybridGM3@0 for 194 with 998 remaining (b = 0.04)
801.19/202.32	c INFO: running gnovelty+2@0 for 97 with 998 remaining (b = 0.02)
1195.45/301.56	c INFO: running hybridGM3@0 for 194 with 898 remaining (b = 0.03)
1195.80/301.69	c INFO: running adaptg2wsat2009++@0 for 97 with 898 remaining (b = 0.02)
1196.13/301.73	c INFO: running hybridGM3@0 for 194 with 898 remaining (b = 0.03)
1594.81/402.09	c INFO: running FH@0 for 97 with 798 remaining (b = 0.01)
1603.17/404.10	c INFO: running hybridGM3@100 for 97 with 796 remaining (b = 0.01)
1977.06/498.30	c INFO: running hybridGM3@99 for 97 with 702 remaining (b = 0.01)
1981.84/499.45	c INFO: running hybridGM3@296 for 97 with 701 remaining (b = 0.01)
1993.70/502.46	c INFO: running adaptg2wsat2009++@0 for 97 with 698 remaining (b = 0.01)
1997.66/503.49	c INFO: running hybridGM3@99 for 97 with 696 remaining (b = 0.01)
2375.95/598.84	c INFO: running hybridGM3@0 for 194 with 601 remaining (b = 0.02)
2379.12/599.67	c INFO: running TNM@0 for 600 with 600 remaining (b = 0.06)
2379.77/599.83	c INFO: running adaptg2wsat2009++@100 for 97 with 600 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378159-1305463266/watcher-3378159-1305463266 -o /tmp/evaluation-result-3378159-1305463266/solver-3378159-1305463266 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378159-1305463266.cnf -seed 1299012451 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.30 7.23 5.62 5/456 26225
/proc/meminfo: memFree=15990128/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=16240 CPUtime=0 cores=0,2,4,6
/proc/26225/stat : 26225 (python) R 26223 26225 25950 0 -1 4202496 997 0 0 0 0 0 0 0 25 0 1 0 657924377 16629760 870 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905391813 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/26225/statm: 4060 870 368 364 0 547 0

[startup+0.079794 s]
/proc/loadavg: 7.30 7.23 5.62 5/456 26225
/proc/meminfo: memFree=15990128/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=85620 CPUtime=0.05 cores=0,2,4,6
/proc/26225/stat : 26225 (python) R 26223 26225 25950 0 -1 4202496 2628 0 0 0 4 1 0 0 25 0 1 0 657924377 87674880 2348 33554432000 4194304 5683644 140735654440544 18446744073709551615 5009139 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/26225/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85620

[startup+0.100796 s]
/proc/loadavg: 7.30 7.23 5.62 5/456 26225
/proc/meminfo: memFree=15990128/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=104228 CPUtime=0.06 cores=0,2,4,6
/proc/26225/stat : 26225 (python) S 26223 26225 25950 0 -1 4202496 3071 0 0 0 5 1 0 0 25 0 1 0 657924377 106729472 2752 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905729024 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/26225/statm: 26057 2752 847 364 0 1805 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104228

[startup+0.300751 s]
/proc/loadavg: 7.30 7.23 5.62 5/456 26225
/proc/meminfo: memFree=15990128/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=172860 CPUtime=0.21 cores=0,2,4,6
/proc/26225/stat : 26225 (python) S 26223 26225 25950 0 -1 4202496 6747 931 1 0 16 5 0 0 17 0 1 0 657924377 177008640 4814 33554432000 4194304 5683644 140735654440544 18446744073709551615 218900807303 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/26225/statm: 45608 4814 1338 364 0 3454 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 172860

[startup+0.70068 s]
/proc/loadavg: 7.30 7.23 5.62 5/456 26225
/proc/meminfo: memFree=15990128/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=282588 CPUtime=0.58 cores=0,2,4,6
/proc/26225/stat : 26225 (python) R 26223 26225 25950 0 -1 4202496 11328 931 1 0 50 8 0 0 17 0 1 0 657924377 289370112 8059 33554432000 4194304 5683644 140735654440544 18446744073709551615 47704129540683 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/26225/statm: 70647 8059 1826 364 0 6571 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 282588

[startup+1.5005 s]
/proc/loadavg: 7.30 7.23 5.62 6/457 26230
/proc/meminfo: memFree=15963088/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=310136 CPUtime=1.37 cores=0,2,4,6
/proc/26225/stat : 26225 (python) R 26223 26225 25950 0 -1 4202496 13886 931 1 0 128 9 0 0 20 0 4 0 657924377 317579264 7303 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905551253 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26225/statm: 77534 7303 1880 364 0 13443 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 310136

[startup+3.1012 s]
/proc/loadavg: 7.30 7.23 5.62 9/469 26242
/proc/meminfo: memFree=15941436/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=320380 CPUtime=1.37 cores=0,2,4,6
/proc/26225/stat : 26225 (python) S 26223 26225 25950 0 -1 4202496 14099 931 1 0 128 9 0 0 22 0 5 0 657924377 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26225/statm: 80095 7310 1883 364 0 16004 0
[pid=26231] ppid=26225 vsize=279232 CPUtime=0 cores=0,2,4,6
/proc/26231/stat : 26231 (python) S 26225 26225 25950 0 -1 4202560 722 0 0 0 0 0 0 0 18 0 1 0 657924524 285933568 5715 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751055 0 0 16781312 514 10530180368546365697 0 0 17 0 0 0 0
/proc/26231/statm: 69808 5715 354 364 0 5726 0
[pid=26233] ppid=26231 vsize=1018616 CPUtime=1.62 cores=0,2,4,6
/proc/26233/stat : 26233 (gnovelty+2) R 26231 26233 26233 0 -1 4202496 764 0 0 0 162 0 0 0 25 0 1 0 657924524 1043062784 501 33554432000 134512640 135663704 4293744672 18446744073709551615 134524925 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26233/statm: 254654 501 113 282 0 254370 0
[pid=26234] ppid=26225 vsize=289624 CPUtime=0 cores=0,2,4,6
/proc/26234/stat : 26234 (python) S 26225 26225 25950 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 657924525 296574976 5763 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 10530176520255668481 0 0 17 4 0 0 0
/proc/26234/statm: 72406 5763 348 364 0 8321 0
[pid=26236] ppid=26234 vsize=1018616 CPUtime=1.61 cores=0,2,4,6
/proc/26236/stat : 26236 (gnovelty+2) R 26234 26236 26236 0 -1 4202496 762 0 0 0 161 0 0 0 25 0 1 0 657924525 1043062784 500 33554432000 134512640 135663704 4287729056 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26236/statm: 254654 500 113 282 0 254370 0
[pid=26237] ppid=26225 vsize=299880 CPUtime=0 cores=0,2,4,6
/proc/26237/stat : 26237 (python) S 26225 26225 25950 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 657924526 307077120 5767 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 4267204631693623295 0 0 17 0 0 0 0
/proc/26237/statm: 74970 5767 348 364 0 10882 0
[pid=26239] ppid=26237 vsize=418500 CPUtime=1.6 cores=0,2,4,6
/proc/26239/stat : 26239 (adaptg2wsat2009) R 26237 26239 26239 0 -1 4202496 1073 0 0 0 160 0 0 0 25 0 1 0 657924526 428544000 808 33554432000 134512640 135107411 4287430160 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26239/statm: 104625 808 49 146 0 103501 0
[pid=26240] ppid=26225 vsize=310136 CPUtime=0 cores=0,2,4,6
/proc/26240/stat : 26240 (python) S 26225 26225 25950 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 657924527 317579264 5771 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 13928203187124174847 0 0 17 4 0 0 0
/proc/26240/statm: 77534 5771 348 364 0 13443 0
[pid=26242] ppid=26240 vsize=418500 CPUtime=1.57 cores=0,2,4,6
/proc/26242/stat : 26242 (adaptg2wsat2009) R 26240 26242 26242 0 -1 4202496 1068 0 0 0 157 0 0 0 25 0 1 0 657924527 428544000 808 33554432000 134512640 135107411 4288513984 18446744073709551615 134523455 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/26242/statm: 104625 808 49 146 0 103501 0
[pid=26225/tid=26232] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26232/stat : 26232 (python) S 26223 26225 25950 0 -1 4202560 24 931 0 0 0 0 0 0 21 0 5 0 657924524 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26235] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26235/stat : 26235 (python) S 26223 26225 25950 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 5 0 657924525 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26238] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26238/stat : 26238 (python) S 26223 26225 25950 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 5 0 657924526 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26241] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26241/stat : 26241 (python) S 26223 26225 25950 0 -1 4202560 29 931 0 0 0 0 0 0 22 0 5 0 657924527 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7.77
Current children cumulated vsize (KiB) 4373484

[startup+6.30063 s]
/proc/loadavg: 7.36 7.24 5.64 9/469 26242
/proc/meminfo: memFree=15939576/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=320380 CPUtime=1.37 cores=0,2,4,6
/proc/26225/stat : 26225 (python) S 26223 26225 25950 0 -1 4202496 14099 931 1 0 128 9 0 0 22 0 5 0 657924377 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26225/statm: 80095 7310 1883 364 0 16004 0
[pid=26231] ppid=26225 vsize=279232 CPUtime=0.01 cores=0,2,4,6
/proc/26231/stat : 26231 (python) S 26225 26225 25950 0 -1 4202560 877 0 0 0 1 0 0 0 18 0 1 0 657924524 285933568 5738 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751055 0 0 16781312 514 10530180368546365697 0 0 17 0 0 0 0
/proc/26231/statm: 69808 5738 377 364 0 5726 0
[pid=26233] ppid=26231 vsize=1018616 CPUtime=4.78 cores=0,2,4,6
/proc/26233/stat : 26233 (gnovelty+2) R 26231 26233 26233 0 -1 4202496 764 0 0 0 478 0 0 0 25 0 1 0 657924524 1043062784 501 33554432000 134512640 135663704 4293744672 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26233/statm: 254654 501 113 282 0 254370 0
[pid=26234] ppid=26225 vsize=289624 CPUtime=0.01 cores=0,2,4,6
/proc/26234/stat : 26234 (python) S 26225 26225 25950 0 -1 4202560 897 0 0 0 0 1 0 0 18 0 1 0 657924525 296574976 5786 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 10530176520255668481 0 0 17 4 0 0 0
/proc/26234/statm: 72406 5786 371 364 0 8321 0
[pid=26236] ppid=26234 vsize=1018616 CPUtime=4.76 cores=0,2,4,6
/proc/26236/stat : 26236 (gnovelty+2) R 26234 26236 26236 0 -1 4202496 762 0 0 0 476 0 0 0 25 0 1 0 657924525 1043062784 500 33554432000 134512640 135663704 4287729056 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26236/statm: 254654 500 113 282 0 254370 0
[pid=26237] ppid=26225 vsize=299880 CPUtime=0.01 cores=0,2,4,6
/proc/26237/stat : 26237 (python) S 26225 26225 25950 0 -1 4202560 902 0 0 0 0 1 0 0 18 0 1 0 657924526 307077120 5790 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 4267204631693590788 0 0 17 0 0 0 0
/proc/26237/statm: 74970 5790 371 364 0 10882 0
[pid=26239] ppid=26237 vsize=418636 CPUtime=4.8 cores=0,2,4,6
/proc/26239/stat : 26239 (adaptg2wsat2009) R 26237 26239 26239 0 -1 4202496 1220 0 0 0 480 0 0 0 25 0 1 0 657924526 428683264 955 33554432000 134512640 135107411 4287430160 18446744073709551615 134531435 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26239/statm: 104659 955 59 146 0 103535 0
[pid=26240] ppid=26225 vsize=310136 CPUtime=0.01 cores=0,2,4,6
/proc/26240/stat : 26240 (python) S 26225 26225 25950 0 -1 4202560 902 0 0 0 0 1 0 0 18 0 1 0 657924527 317579264 5794 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 13928203187124142337 0 0 17 4 0 0 0
/proc/26240/statm: 77534 5794 371 364 0 13443 0
[pid=26242] ppid=26240 vsize=418636 CPUtime=4.73 cores=0,2,4,6
/proc/26242/stat : 26242 (adaptg2wsat2009) R 26240 26242 26242 0 -1 4202496 1216 0 0 0 473 0 0 0 25 0 1 0 657924527 428683264 956 33554432000 134512640 135107411 4288513984 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/26242/statm: 104659 956 59 146 0 103535 0
[pid=26225/tid=26232] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26232/stat : 26232 (python) S 26223 26225 25950 0 -1 4202560 24 931 0 0 0 0 0 0 21 0 5 0 657924524 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26235] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26235/stat : 26235 (python) S 26223 26225 25950 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 5 0 657924525 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26238] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26238/stat : 26238 (python) S 26223 26225 25950 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 5 0 657924526 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26241] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26241/stat : 26241 (python) S 26223 26225 25950 0 -1 4202560 29 931 0 0 0 0 0 0 22 0 5 0 657924527 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 20.48
Current children cumulated vsize (KiB) 4373756

[startup+12.7005 s]
/proc/loadavg: 7.41 7.25 5.65 9/469 26242
/proc/meminfo: memFree=15936804/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=320380 CPUtime=1.37 cores=0,2,4,6
/proc/26225/stat : 26225 (python) S 26223 26225 25950 0 -1 4202496 14099 931 1 0 128 9 0 0 22 0 5 0 657924377 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26225/statm: 80095 7310 1883 364 0 16004 0
[pid=26231] ppid=26225 vsize=279232 CPUtime=0.03 cores=0,2,4,6
/proc/26231/stat : 26231 (python) S 26225 26225 25950 0 -1 4202560 881 0 0 0 2 1 0 0 18 0 1 0 657924524 285933568 5738 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751055 0 0 16781312 514 443411049249472769 0 0 17 0 0 0 0
/proc/26231/statm: 69808 5738 377 364 0 5726 0
[pid=26233] ppid=26231 vsize=1018616 CPUtime=11.14 cores=0,2,4,6
/proc/26233/stat : 26233 (gnovelty+2) R 26231 26233 26233 0 -1 4202496 764 0 0 0 1114 0 0 0 25 0 1 0 657924524 1043062784 501 33554432000 134512640 135663704 4293744672 18446744073709551615 134524503 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26233/statm: 254654 501 113 282 0 254370 0
[pid=26234] ppid=26225 vsize=289624 CPUtime=0.03 cores=0,2,4,6
/proc/26234/stat : 26234 (python) S 26225 26225 25950 0 -1 4202560 902 0 0 0 1 2 0 0 18 0 1 0 657924525 296574976 5786 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 443411049249472769 0 0 17 4 0 0 0
/proc/26234/statm: 72406 5786 371 364 0 8321 0
[pid=26236] ppid=26234 vsize=1018616 CPUtime=11.12 cores=0,2,4,6
/proc/26236/stat : 26236 (gnovelty+2) R 26234 26236 26236 0 -1 4202496 762 0 0 0 1112 0 0 0 25 0 1 0 657924525 1043062784 500 33554432000 134512640 135663704 4287729056 18446744073709551615 134525684 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26236/statm: 254654 500 113 282 0 254370 0
[pid=26237] ppid=26225 vsize=299880 CPUtime=0.04 cores=0,2,4,6
/proc/26237/stat : 26237 (python) S 26225 26225 25950 0 -1 4202560 905 0 0 0 2 2 0 0 18 0 1 0 657924526 307077120 5790 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 443411049249472772 0 0 17 0 0 0 0
/proc/26237/statm: 74970 5790 371 364 0 10882 0
[pid=26239] ppid=26237 vsize=418636 CPUtime=11.2 cores=0,2,4,6
/proc/26239/stat : 26239 (adaptg2wsat2009) R 26237 26239 26239 0 -1 4202496 1220 0 0 0 1120 0 0 0 25 0 1 0 657924526 428683264 955 33554432000 134512640 135107411 4287430160 18446744073709551615 134539389 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26239/statm: 104659 955 59 146 0 103535 0
[pid=26240] ppid=26225 vsize=310136 CPUtime=0.03 cores=0,2,4,6
/proc/26240/stat : 26240 (python) S 26225 26225 25950 0 -1 4202560 904 0 0 0 1 2 0 0 18 0 1 0 657924527 317579264 5794 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 443411049249472769 0 0 17 4 0 0 0
/proc/26240/statm: 77534 5794 371 364 0 13443 0
[pid=26242] ppid=26240 vsize=418636 CPUtime=11.03 cores=0,2,4,6
/proc/26242/stat : 26242 (adaptg2wsat2009) R 26240 26242 26242 0 -1 4202496 1216 0 0 0 1103 0 0 0 25 0 1 0 657924527 428683264 956 33554432000 134512640 135107411 4288513984 18446744073709551615 134532135 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/26242/statm: 104659 956 59 146 0 103535 0
[pid=26225/tid=26232] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26232/stat : 26232 (python) S 26223 26225 25950 0 -1 4202560 24 931 0 0 0 0 0 0 21 0 5 0 657924524 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26235] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26235/stat : 26235 (python) S 26223 26225 25950 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 5 0 657924525 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26238] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26238/stat : 26238 (python) S 26223 26225 25950 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 5 0 657924526 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26241] ppid=26223 vsize=320380 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26241/stat : 26241 (python) S 26223 26225 25950 0 -1 4202560 29 931 0 0 0 0 0 0 22 0 5 0 657924527 328069120 7310 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 45.99
Current children cumulated vsize (KiB) 4373756

[startup+25.5012 s]
/proc/loadavg: 7.54 7.29 5.69 9/469 26242
/proc/meminfo: memFree=15937552/32951124 swapFree=65581060/67111528
[pid=26225] ppid=26223 vsize=320380 CPUtime=1.37 cores=0,2,4,6

################
# More data... #
################

[pid=26237/tid=26289] ppid=26225 vsize=299880 CPUtime=0 cores=0,2,4,6
/proc/26237/task/26289/stat : 26289 (python) S 26225 26225 25950 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 657934559 307077120 5820 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604453906229248 0 0 -1 0 0 0 0
[pid=26240] ppid=26225 vsize=310136 CPUtime=0.34 cores=0,2,4,6
/proc/26240/stat : 26240 (python) S 26225 26225 25950 0 -1 4202560 1088 0 0 0 17 17 0 0 18 0 2 0 657924527 317579264 5824 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/26240/statm: 77534 5824 400 364 0 13443 0
[pid=26242] ppid=26240 vsize=418636 CPUtime=99.59 cores=0,2,4,6
/proc/26242/stat : 26242 (adaptg2wsat2009) R 26240 26242 26242 0 -1 4202496 1216 0 0 0 9959 0 0 0 18 0 1 0 657924527 428683264 956 33554432000 134512640 135107411 4288513984 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/26242/statm: 104659 956 59 146 0 103535 0
[pid=26240/tid=26293] ppid=26225 vsize=310136 CPUtime=0 cores=0,2,4,6
/proc/26240/task/26293/stat : 26293 (python) S 26225 26225 25950 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 657934568 317579264 5824 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604447565671168 0 0 -1 4 0 0 0
[pid=26290] ppid=26225 vsize=320524 CPUtime=0.35 cores=0,2,4,6
/proc/26290/stat : 26290 (python) S 26225 26225 25950 0 -1 4202560 1092 0 0 0 19 16 0 0 19 0 2 0 657934560 328216576 5845 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/26290/statm: 80131 5845 400 364 0 16037 0
[pid=26292] ppid=26290 vsize=418636 CPUtime=99.96 cores=0,2,4,6
/proc/26292/stat : 26292 (adaptg2wsat2009) T 26290 26292 26292 0 -1 4202496 1218 0 0 0 9996 0 0 0 25 0 1 0 657934560 428683264 956 33554432000 134512640 135107411 4293743888 18446744073709551615 134531928 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/26292/statm: 104659 956 59 146 0 103535 0
[pid=26290/tid=26356] ppid=26225 vsize=320524 CPUtime=0 cores=0,2,4,6
/proc/26290/task/26356/stat : 26356 (python) S 26225 26225 25950 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657944595 328216576 5845 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604452883773504 0 0 -1 4 0 0 0
[pid=26294] ppid=26225 vsize=331320 CPUtime=0.33 cores=0,2,4,6
/proc/26294/stat : 26294 (python) S 26225 26225 25950 0 -1 4202560 1090 0 0 0 19 14 0 0 19 0 2 0 657934569 339271680 5984 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26294/statm: 82830 5984 399 364 0 18733 0
[pid=26297] ppid=26294 vsize=1018616 CPUtime=100 cores=0,2,4,6
/proc/26297/stat : 26297 (gnovelty+2) T 26294 26297 26297 0 -1 4202496 761 0 0 0 10000 0 0 0 25 0 1 0 657934569 1043062784 500 33554432000 134512640 135663704 4294001696 18446744073709551615 134545631 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26297/statm: 254654 500 113 282 0 254370 0
[pid=26294/tid=26361] ppid=26225 vsize=331320 CPUtime=0 cores=0,2,4,6
/proc/26294/task/26361/stat : 26361 (python) S 26225 26225 25950 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657944607 339271680 5984 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604452883772608 0 0 -1 2 0 0 0
[pid=26298] ppid=26225 vsize=341576 CPUtime=0.34 cores=0,2,4,6
/proc/26298/stat : 26298 (python) S 26225 26225 25950 0 -1 4202560 1094 0 0 0 17 17 0 0 18 0 2 0 657934570 349773824 5988 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26298/statm: 85394 5988 399 364 0 21294 0
[pid=26300] ppid=26298 vsize=248648 CPUtime=100.02 cores=0,2,4,6
/proc/26300/stat : 26300 (FH) T 26298 26300 26300 0 -1 4202496 1119 0 0 0 10001 1 0 0 25 0 1 0 657934570 254615552 857 33554432000 134512640 134936988 4290482544 18446744073709551615 134545007 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/26300/statm: 62162 857 41 104 0 61666 0
[pid=26298/tid=26360] ppid=26225 vsize=341576 CPUtime=0 cores=0,2,4,6
/proc/26298/task/26360/stat : 26360 (python) S 26225 26225 25950 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657944607 349773824 5988 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604447565669376 0 0 -1 0 0 0 0
[pid=26302] ppid=26225 vsize=351832 CPUtime=0.34 cores=0,2,4,6
/proc/26302/stat : 26302 (python) S 26225 26225 25950 0 -1 4202560 1125 0 0 0 18 16 0 0 19 0 2 0 657934572 360275968 5998 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/26302/statm: 87958 5998 406 364 0 23855 0
[pid=26304] ppid=26302 vsize=418636 CPUtime=97.27 cores=0,2,4,6
/proc/26304/stat : 26304 (adaptg2wsat2009) T 26302 26304 26304 0 -1 4202496 1224 0 0 0 9727 0 0 0 25 0 1 0 657934572 428683264 956 33554432000 134512640 135107411 4290004624 18446744073709551615 134532288 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/26304/statm: 104659 956 59 146 0 103535 0
[pid=26302/tid=26352] ppid=26225 vsize=351832 CPUtime=0 cores=0,2,4,6
/proc/26302/task/26352/stat : 26352 (python) S 26225 26225 25950 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657944509 360275968 5998 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604453402139520 0 0 -1 6 0 0 0
[pid=26353] ppid=26225 vsize=362088 CPUtime=0.35 cores=0,2,4,6
/proc/26353/stat : 26353 (python) S 26225 26225 25950 0 -1 4202560 1139 0 0 0 19 16 0 0 19 0 2 0 657944510 370778112 6002 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/26353/statm: 90522 6002 406 364 0 26416 0
[pid=26355] ppid=26353 vsize=418636 CPUtime=99.96 cores=0,2,4,6
/proc/26355/stat : 26355 (adaptg2wsat2009) T 26353 26355 26355 0 -1 4202496 1220 0 0 0 9996 0 0 0 25 0 1 0 657944511 428683264 955 33554432000 134512640 135107411 4287401376 18446744073709551615 134532128 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/26355/statm: 104659 955 59 146 0 103535 0
[pid=26353/tid=26379] ppid=26225 vsize=362088 CPUtime=0 cores=0,2,4,6
/proc/26353/task/26379/stat : 26379 (python) S 26225 26225 25950 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657954545 370778112 6002 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604449063426048 0 0 -1 4 0 0 0
[pid=26357] ppid=26225 vsize=372344 CPUtime=0.36 cores=0,2,4,6
/proc/26357/stat : 26357 (python) S 26225 26225 25950 0 -1 4202560 1120 0 0 0 18 18 0 0 19 0 2 0 657944596 381280256 6000 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26357/statm: 93086 6000 400 364 0 28977 0
[pid=26359] ppid=26357 vsize=248656 CPUtime=99.29 cores=0,2,4,6
/proc/26359/stat : 26359 (FH) T 26357 26359 26359 0 -1 4202496 1121 0 0 0 9929 0 0 0 25 0 1 0 657944596 254623744 857 33554432000 134512640 134936988 4288268192 18446744073709551615 134554216 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26359/statm: 62164 857 41 104 0 61668 0
[pid=26357/tid=26375] ppid=26225 vsize=372344 CPUtime=0 cores=0,2,4,6
/proc/26357/task/26375/stat : 26375 (python) S 26225 26225 25950 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657954532 381280256 6000 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604449063424256 0 0 -1 0 0 0 0
[pid=26362] ppid=26225 vsize=382600 CPUtime=1.42 cores=0,2,4,6
/proc/26362/stat : 26362 (python) S 26225 26225 25950 0 -1 4202560 1173 0 0 0 75 67 0 0 18 0 2 0 657944608 391782400 6004 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26362/statm: 95650 6004 400 364 0 31538 0
[pid=26364] ppid=26362 vsize=268428 CPUtime=393.62 cores=0,2,4,6
/proc/26364/stat : 26364 (hybridGM3) R 26362 26364 26364 0 -1 4202496 5161 0 0 0 39361 1 0 0 25 0 1 0 657944609 274870272 4897 33554432000 134512640 135204385 4289738096 18446744073709551615 134538041 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26364/statm: 67107 4897 63 169 0 66937 0
[pid=26362/tid=26439] ppid=26225 vsize=382600 CPUtime=0 cores=0,2,4,6
/proc/26362/task/26439/stat : 26439 (python) S 26225 26225 25950 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 657964786 391782400 6004 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604447847656448 0 0 -1 0 0 0 0
[pid=26365] ppid=26225 vsize=392856 CPUtime=0.34 cores=0,2,4,6
/proc/26365/stat : 26365 (python) S 26225 26225 25950 0 -1 4202560 1132 0 0 0 16 18 0 0 19 0 2 0 657944610 402284544 6008 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26365/statm: 98214 6008 400 364 0 34099 0
[pid=26367] ppid=26365 vsize=1018616 CPUtime=98.71 cores=0,2,4,6
/proc/26367/stat : 26367 (gnovelty+2) T 26365 26367 26367 0 -1 4202496 767 0 0 0 9871 0 0 0 25 0 1 0 657944610 1043062784 501 33554432000 134512640 135663704 4292114336 18446744073709551615 134524988 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26367/statm: 254654 501 113 282 0 254370 0
[pid=26365/tid=26382] ppid=26225 vsize=392856 CPUtime=0 cores=0,2,4,6
/proc/26365/task/26382/stat : 26382 (python) S 26225 26225 25950 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657954549 402284544 6008 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604447847654656 0 0 -1 2 0 0 0
[pid=26376] ppid=26225 vsize=403112 CPUtime=1.07 cores=0,2,4,6
/proc/26376/stat : 26376 (python) S 26225 26225 25950 0 -1 4202560 1176 0 0 0 55 52 0 0 18 0 2 0 657954533 412786688 6012 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26376/statm: 100778 6012 400 364 0 36660 0
[pid=26378] ppid=26376 vsize=268424 CPUtime=296.99 cores=0,2,4,6
/proc/26378/stat : 26378 (hybridGM3) T 26376 26378 26378 0 -1 4202496 5165 0 0 0 29696 3 0 0 25 0 1 0 657954534 274866176 4897 33554432000 134512640 135204385 4292732928 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26378/statm: 67106 4897 63 169 0 66936 0
[pid=26376/tid=26459] ppid=26225 vsize=403112 CPUtime=0 cores=0,2,4,6
/proc/26376/task/26459/stat : 26459 (python) S 26225 26225 25950 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 657974206 412786688 6012 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604452181890112 0 0 -1 0 0 0 0
[pid=26380] ppid=26225 vsize=413368 CPUtime=0.36 cores=0,2,4,6
/proc/26380/stat : 26380 (python) S 26225 26225 25950 0 -1 4202560 1153 0 0 0 19 17 0 0 19 0 2 0 657954546 423288832 6016 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26380/statm: 103342 6016 400 364 0 39221 0
[pid=26384] ppid=26380 vsize=418636 CPUtime=99.99 cores=0,2,4,6
/proc/26384/stat : 26384 (adaptg2wsat2009) T 26380 26384 26384 0 -1 4202496 1225 0 0 0 9998 1 0 0 25 0 1 0 657954550 428683264 955 33554432000 134512640 135107411 4291736672 18446744073709551615 134531600 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26384/statm: 104659 955 59 146 0 103535 0
[pid=26380/tid=26435] ppid=26225 vsize=413368 CPUtime=0 cores=0,2,4,6
/proc/26380/task/26435/stat : 26435 (python) S 26225 26225 25950 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657964585 423288832 6016 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604452181889216 0 0 -1 2 0 0 0
[pid=26383] ppid=26225 vsize=423624 CPUtime=1.08 cores=0,2,4,6
/proc/26383/stat : 26383 (python) S 26225 26225 25950 0 -1 4202560 1241 0 0 0 56 52 0 0 18 0 2 0 657954550 433790976 6028 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26383/statm: 105906 6028 407 364 0 41782 0
[pid=26386] ppid=26383 vsize=268420 CPUtime=291.09 cores=0,2,4,6
/proc/26386/stat : 26386 (hybridGM3) T 26383 26386 26386 0 -1 4202496 5172 0 0 0 29108 1 0 0 25 0 1 0 657954551 274862080 4895 33554432000 134512640 135204385 4288938208 18446744073709551615 134538427 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26386/statm: 67105 4895 63 169 0 66935 0
[pid=26383/tid=26461] ppid=26225 vsize=423624 CPUtime=0 cores=0,2,4,6
/proc/26383/task/26461/stat : 26461 (python) S 26225 26225 25950 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 657974726 433790976 6028 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604451824357632 0 0 -1 6 0 0 0
[pid=26436] ppid=26225 vsize=433880 CPUtime=0.36 cores=0,2,4,6
/proc/26436/stat : 26436 (python) S 26225 26225 25950 0 -1 4202560 1196 0 0 0 16 20 0 0 19 0 2 0 657964586 444293120 6033 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/26436/statm: 108470 6033 408 364 0 44343 0
[pid=26438] ppid=26436 vsize=248652 CPUtime=99.98 cores=0,2,4,6
/proc/26438/stat : 26438 (FH) T 26436 26438 26438 0 -1 4202496 1132 0 0 0 9998 0 0 0 25 0 1 0 657964587 254619648 857 33554432000 134512640 134936988 4293154912 18446744073709551615 134544944 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/26438/statm: 62163 857 41 104 0 61667 0
[pid=26436/tid=26460] ppid=26225 vsize=433880 CPUtime=0 cores=0,2,4,6
/proc/26436/task/26460/stat : 26460 (python) S 26225 26225 25950 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657974622 444293120 6033 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 514 18446604444804468928 0 0 -1 4 0 0 0
[pid=26481] ppid=26225 vsize=444564 CPUtime=0 cores=0,2,4,6
/proc/26481/stat : 26481 (python) S 26225 26225 25950 0 -1 4202560 861 0 0 0 0 0 0 0 18 0 1 0 657984262 455233536 6090 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 13201230562972369154 0 0 17 2 0 0 0
/proc/26481/statm: 111141 6090 356 364 0 47011 0
[pid=26483] ppid=26481 vsize=268420 CPUtime=1.63 cores=0,2,4,6
/proc/26483/stat : 26483 (hybridGM3) R 26481 26483 26483 0 -1 4202496 5174 0 0 0 162 1 0 0 25 0 1 0 657984262 274862080 4895 33554432000 134512640 135204385 4291369904 18446744073709551615 134538282 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26483/statm: 67105 4895 63 169 0 66935 0
[pid=26484] ppid=26225 vsize=454820 CPUtime=0 cores=0,2,4,6
/proc/26484/stat : 26484 (python) S 26225 26225 25950 0 -1 4202560 818 0 0 0 0 0 0 0 19 0 1 0 657984344 465735680 6108 33554432000 4194304 5683644 140735654440544 18446744073709551615 218905751110 0 0 16781312 514 13201234411263098879 0 0 17 2 0 0 0
/proc/26484/statm: 113705 6108 346 364 0 49572 0
[pid=26486] ppid=26484 vsize=453032 CPUtime=0.85 cores=0,2,4,6
/proc/26486/stat : 26486 (TNM) R 26484 26486 26486 0 -1 4202496 957 0 0 0 85 0 0 0 23 0 1 0 657984345 463904768 685 33554432000 134512640 135008748 4289368320 18446744073709551615 134523398 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26486/statm: 113258 685 45 122 0 112158 0
[pid=26225/tid=26232] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26232/stat : 26232 (python) S 26223 26225 25950 0 -1 4202560 24 931 0 0 0 0 0 0 21 0 19 0 657924524 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26235] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26235/stat : 26235 (python) S 26223 26225 25950 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 19 0 657924525 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26238] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26238/stat : 26238 (python) S 26223 26225 25950 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 19 0 657924526 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26241] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26241/stat : 26241 (python) S 26223 26225 25950 0 -1 4202560 34 931 0 0 0 0 0 0 18 0 19 0 657924527 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 4 0 0 0
[pid=26225/tid=26291] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26291/stat : 26291 (python) S 26223 26225 25950 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 19 0 657934560 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 4 0 0 0
[pid=26225/tid=26296] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26296/stat : 26296 (python) S 26223 26225 25950 0 -1 4202560 22 931 0 0 0 0 0 0 21 0 19 0 657934569 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26299] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26299/stat : 26299 (python) S 26223 26225 25950 0 -1 4202560 28 931 0 0 0 0 0 0 23 0 19 0 657934570 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 0 0 0 0
[pid=26225/tid=26303] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26303/stat : 26303 (python) S 26223 26225 25950 0 -1 4202560 27 931 0 0 0 0 0 0 24 0 19 0 657934572 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 6 0 0 0
[pid=26225/tid=26354] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26354/stat : 26354 (python) S 26223 26225 25950 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 19 0 657944510 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 6 0 0 0
[pid=26225/tid=26358] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26358/stat : 26358 (python) S 26223 26225 25950 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 19 0 657944596 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 6 0 0 0
[pid=26225/tid=26363] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26363/stat : 26363 (python) S 26223 26225 25950 0 -1 4202560 25 931 0 0 0 0 0 0 18 0 19 0 657944608 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 6 0 0 0
[pid=26225/tid=26366] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26366/stat : 26366 (python) S 26223 26225 25950 0 -1 4202560 26 931 0 0 0 0 0 0 22 0 19 0 657944610 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26377] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26377/stat : 26377 (python) S 26223 26225 25950 0 -1 4202560 32 931 0 0 0 0 0 0 18 0 19 0 657954534 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26381] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26381/stat : 26381 (python) S 26223 26225 25950 0 -1 4202560 41 931 0 0 0 0 0 0 20 0 19 0 657954546 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26385] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26385/stat : 26385 (python) S 26223 26225 25950 0 -1 4202560 14 931 0 0 0 0 0 0 18 0 19 0 657954551 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26437] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26437/stat : 26437 (python) S 26223 26225 25950 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 19 0 657964587 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26482] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26482/stat : 26482 (python) S 26223 26225 25950 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 19 0 657984262 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
[pid=26225/tid=26485] ppid=26223 vsize=465064 CPUtime=0 cores=0,2,4,6
/proc/26225/task/26485/stat : 26485 (python) S 26223 26225 25950 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 19 0 657984345 476225536 7678 33554432000 4194304 5683644 140735654440544 18446744073709551615 218917554609 0 0 16781312 2 18446604443858776512 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2382.76
Current children cumulated vsize (KiB) 15941648

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26225 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=526767
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=136979
# CPU time returned by wait4() is 1.66375
# while last known CPU time is 2382.76
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 600.637
CPU time (s): 2382.76
CPU user time (s): 2378.49
CPU system time (s): 4.27
CPU usage (%): 396.706
Max. virtual memory (cumulated for all children) (KiB): 15941648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.52677
system time used= 0.136979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28507
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1193
involuntary context switches= 55

runsolver used 4.52431 second user time and 9.89449 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-15 14:41:06
IDJOB=3378159
IDBENCH=82568
IDSOLVER=1859
FILE ID=node137/3378159-1305463266
RUNJOBID= node137-1305462758-25968
PBS_JOBID= 13324972
Free space on /tmp= 73700 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v200-c17000-S283489555-036-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378159-1305463266/watcher-3378159-1305463266 -o /tmp/evaluation-result-3378159-1305463266/solver-3378159-1305463266 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378159-1305463266.cnf -seed 1299012451 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dd0dfae1a7fca71616878d93d3870a71
RANDOM SEED=1299012451

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15990408 kB
Buffers:        309460 kB
Cached:        4069812 kB
SwapCached:      36320 kB
Active:        6759232 kB
Inactive:      9937260 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15990408 kB
SwapTotal:    67111528 kB
SwapFree:     65581060 kB
Dirty:           65692 kB
Writeback:          24 kB
AnonPages:    12290380 kB
Mapped:          34344 kB
Slab:           135880 kB
PageTables:      60596 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 123047300 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73668 MiB
End job on node137 at 2011-05-15 14:51:09