Trace number 3317083

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 2783.45 715.019

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1000-c20000-S72635791-098-UNKNOWN.cnf
MD5SUM93976db0d99d3daab756f06103f77642
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark22.9885
Satisfiable
(Un)Satisfiability was proved
Number of variables1000
Number of clauses20000
Sum of the clauses size100000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 520000
Number of clauses of size over 50

Solver Data 

0.55/14.78	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.55/14.78	c INFO: solving HOME/instance-3317083-1304267287.cnf
0.55/14.78	c INFO: computing task features
0.58/14.89	c INFO: computed variable-clause graph statistics
0.58/14.89	c INFO: computed clause balance statistics
1.19/15.47	c INFO: computed variable balance statistics
1.48/15.79	c INFO: computed small-clause counts
1.48/15.79	c INFO: computed Horn-clause counts
1.58/15.81	c INFO: computed variable graph statistics
1.58/15.81	c INFO: collected features for HOME/instance-3317083-1304267287.cnf in 1.03 s
1.58/15.88	c INFO: running gnovelty+2@0 for 97 with 4798 remaining (b = 0.39)
1.65/15.91	c INFO: running gnovelty+2@0 for 97 with 4798 remaining (b = 0.14)
1.65/15.94	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.09)
1.65/15.97	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.08)
397.73/115.12	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.06)
397.73/115.16	c INFO: running gnovelty+2@0 for 97 with 4699 remaining (b = 0.05)
401.30/116.07	c INFO: running FH@0 for 97 with 4698 remaining (b = 0.04)
401.66/116.10	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.04)
792.94/214.35	c INFO: running gnovelty+2@0 for 97 with 4600 remaining (b = 0.03)
796.53/215.24	c INFO: running gnovelty+2@0 for 97 with 4599 remaining (b = 0.03)
796.53/215.28	c INFO: running gnovelty+2@100 for 97 with 4599 remaining (b = 0.03)
796.92/215.39	c INFO: running adaptg2wsat2009++@0 for 97 with 4599 remaining (b = 0.03)
1180.17/311.50	c INFO: running FH@0 for 97 with 4503 remaining (b = 0.03)
1183.36/312.40	c INFO: running gnovelty+2@0 for 97 with 4502 remaining (b = 0.02)
1196.09/315.55	c INFO: running adaptg2wsat2009++@0 for 97 with 4499 remaining (b = 0.02)
1199.66/316.45	c INFO: running hybridGM3@0 for 194 with 4498 remaining (b = 0.04)
1574.93/410.68	c INFO: running FH@0 for 97 with 4404 remaining (b = 0.02)
1582.87/412.63	c INFO: running hybridGM3@0 for 194 with 4402 remaining (b = 0.03)
1595.20/415.74	c INFO: running hybridGM3@0 for 194 with 4399 remaining (b = 0.03)
1973.18/510.87	c INFO: running TNM@0 for 1552 with 4303 remaining (b = 0.20)
1981.10/512.82	c INFO: running hybridGM3@99 for 97 with 4301 remaining (b = 0.01)
2375.73/612.11	c INFO: running hybridGM3@97 for 97 with 4202 remaining (b = 0.01)
2383.28/614.04	c INFO: running hybridGM3@99 for 97 with 4200 remaining (b = 0.01)
2383.28/614.08	c INFO: running hybridGM3@295 for 97 with 4200 remaining (b = 0.01)
2752.83/707.29	c INFO: running adaptg2wsat2009++@0 for 97 with 4107 remaining (b = 0.01)
2760.77/709.27	c INFO: running adaptg2wsat2009++@98 for 97 with 4105 remaining (b = 0.01)
2780.61/714.23	c INFO: running iPAWS@0 for 97 with 4100 remaining (b = 0.01)
2783.45/714.98	c INFO: running hybridGM3@295 for 97 with 4099 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317083-1304267287/watcher-3317083-1304267287 -o /tmp/evaluation-result-3317083-1304267287/solver-3317083-1304267287 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317083-1304267287.cnf -seed 1878399543 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/174 15777
/proc/meminfo: memFree=24689192/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=1840 CPUtime=0 cores=0,2,4,6
/proc/15777/stat : 15777 (python) D 15774 15777 15742 0 -1 4194304 46 0 0 0 0 0 0 0 20 0 1 0 616959867 1884160 1 33554432000 0 0 140734494013081 18446744073709551615 5055495 0 0 4096 0 18446744071562234166 0 0 17 2 0 0 0
/proc/15777/statm: 460 1 0 0 0 36 0

[startup+0.073262 s]
/proc/loadavg: 0.00 0.00 0.00 2/174 15777
/proc/meminfo: memFree=24689192/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=15080 CPUtime=0 cores=0,2,4,6
/proc/15777/stat : 15777 (python) S 15774 15777 15742 0 -1 4202496 642 0 7 0 0 0 0 0 17 0 1 0 616959867 15441920 545 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988588389 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 2
/proc/15777/statm: 3770 545 312 364 0 257 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15080

[startup+0.10027 s]
/proc/loadavg: 0.00 0.00 0.00 2/174 15777
/proc/meminfo: memFree=24689192/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/15777/stat : 15777 (python) S 15774 15777 15742 0 -1 4202496 717 0 7 0 0 0 0 0 17 0 1 0 616959867 15548416 615 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988590592 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 3
/proc/15777/statm: 3796 615 321 364 0 283 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15184

[startup+0.300281 s]
/proc/loadavg: 0.00 0.00 0.00 2/174 15777
/proc/meminfo: memFree=24689192/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=15912 CPUtime=0.01 cores=0,2,4,6
/proc/15777/stat : 15777 (python) S 15774 15777 15742 0 -1 4202496 952 0 7 0 0 1 0 0 16 0 1 0 616959867 16293888 835 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988588468 0 2147483391 16781312 2 18446744071699945619 0 0 17 6 0 0 4
/proc/15777/statm: 3978 835 357 364 0 465 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 15912

[startup+0.70021 s]
/proc/loadavg: 0.00 0.00 0.00 2/174 15777
/proc/meminfo: memFree=24689192/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=21104 CPUtime=0.05 cores=0,2,4,6
/proc/15777/stat : 15777 (python) D 15774 15777 15742 0 -1 4202496 1306 0 9 0 3 2 0 0 16 0 1 0 616959867 21610496 1166 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988588389 0 0 16781312 2 0 0 0 17 6 0 0 6
/proc/15777/statm: 5276 1166 428 364 0 723 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 21104

[startup+1.50107 s]
/proc/loadavg: 0.00 0.00 0.00 1/178 15781
/proc/meminfo: memFree=24677392/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=38904 CPUtime=0.06 cores=0,2,4,6
/proc/15777/stat : 15777 (python) R 15774 15777 15742 0 -1 4202496 1649 0 15 0 4 2 0 0 16 0 1 0 616959867 39837696 1491 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988590592 0 0 16781312 2 0 0 0 17 6 0 0 8
/proc/15777/statm: 9726 1491 455 364 0 1026 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 38904

[startup+3.10073 s]
/proc/loadavg: 0.00 0.00 0.00 2/178 15781
/proc/meminfo: memFree=24672096/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=94212 CPUtime=0.1 cores=0,2,4,6
/proc/15777/stat : 15777 (python) S 15774 15777 15742 0 -1 4202496 2755 0 24 0 6 4 0 0 16 0 1 0 616959867 96473088 2484 33554432000 4194304 5683644 140734494007952 18446744073709551615 215983668804 0 2147483391 16781312 2 18446744071699945619 0 0 17 6 0 0 18
/proc/15777/statm: 23553 2484 765 364 0 1685 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 94212
heavy processes:

[startup+6.30017 s]
/proc/loadavg: 0.08 0.02 0.01 1/178 15781
/proc/meminfo: memFree=24660280/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=113076 CPUtime=0.16 cores=0,2,4,6
/proc/15777/stat : 15777 (python) S 15774 15777 15742 0 -1 4202496 3484 0 36 0 9 7 0 0 16 0 1 0 616959867 115789824 3168 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988590592 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 48
/proc/15777/statm: 28269 3168 884 364 0 2291 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 113076
heavy processes:

[startup+12.701 s]
/proc/loadavg: 0.15 0.03 0.01 1/178 15789
/proc/meminfo: memFree=24634472/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=210652 CPUtime=0.38 cores=0,2,4,6
/proc/15777/stat : 15777 (python) S 15774 15777 15742 0 -1 4202496 7235 926 84 8 24 14 0 0 15 0 1 0 616959867 215707648 5337 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988590592 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 105
/proc/15777/statm: 52663 5337 1508 364 0 4043 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 210652
heavy processes:

[startup+25.5008 s]
/proc/loadavg: 0.76 0.16 0.05 10/202 15814
/proc/meminfo: memFree=24413788/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=322380 CPUtime=1.72 cores=0,2,4,6
/proc/15777/stat : 15777 (python) S 15774 15777 15742 0 -1 4202496 14256 926 115 8 149 23 0 0 24 0 5 0 616959867 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 126
/proc/15777/statm: 80595 7794 1883 364 0 16504 0
[pid=15791] ppid=15777 vsize=281232 CPUtime=0 cores=0,2,4,6
/proc/15791/stat : 15791 (python) S 15777 15777 15742 0 -1 4202560 887 0 0 0 0 0 0 0 15 0 1 0 616961456 287981568 6238 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612623 0 0 16781312 514 4267930309367922946 0 0 17 0 0 0 0
/proc/15791/statm: 70308 6238 377 364 0 6226 0
[pid=15793] ppid=15791 vsize=1018676 CPUtime=9.6 cores=0,2,4,6
/proc/15793/stat : 15793 (gnovelty+2) R 15791 15793 15793 0 -1 4202496 773 0 0 0 960 0 0 0 25 0 1 0 616961457 1043124224 509 33554432000 134512640 135663704 4287639200 18446744073709551615 134525224 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/15793/statm: 254669 509 113 282 0 254385 0
[pid=15794] ppid=15777 vsize=291488 CPUtime=0 cores=0,2,4,6
/proc/15794/stat : 15794 (python) S 15777 15777 15742 0 -1 4202560 897 0 0 0 0 0 0 0 18 0 1 0 616961459 298483712 6244 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 4302639967311462658 0 0 17 2 0 0 0
/proc/15794/statm: 72872 6244 371 364 0 8787 0
[pid=15796] ppid=15794 vsize=1018676 CPUtime=9.57 cores=0,2,4,6
/proc/15796/stat : 15796 (gnovelty+2) R 15794 15796 15796 0 -1 4202496 772 0 0 0 957 0 0 0 25 0 1 0 616961459 1043124224 508 33554432000 134512640 135663704 4288237040 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15796/statm: 254669 508 113 282 0 254385 0
[pid=15797] ppid=15777 vsize=301880 CPUtime=0 cores=0,2,4,6
/proc/15797/stat : 15797 (python) S 15777 15777 15742 0 -1 4202560 897 0 0 0 0 0 0 0 18 0 1 0 616961462 309125120 6274 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 4372862751320539394 0 0 17 6 0 0 0
/proc/15797/statm: 75470 6274 371 364 0 11382 0
[pid=15799] ppid=15797 vsize=419584 CPUtime=9.48 cores=0,2,4,6
/proc/15799/stat : 15799 (adaptg2wsat2009) R 15797 15799 15799 0 -1 4202496 1467 0 0 0 948 0 0 0 25 0 1 0 616961462 429654016 1204 33554432000 134512640 135107411 4286589792 18446744073709551615 134531942 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15799/statm: 104896 1204 59 146 0 103772 0
[pid=15800] ppid=15777 vsize=312136 CPUtime=0 cores=0,2,4,6
/proc/15800/stat : 15800 (python) S 15777 15777 15742 0 -1 4202560 923 0 0 0 0 0 0 0 18 0 1 0 616961465 319627264 6278 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 6003680387870458115 0 0 17 2 0 0 0
/proc/15800/statm: 78034 6278 371 364 0 13943 0
[pid=15802] ppid=15800 vsize=419584 CPUtime=9.5 cores=0,2,4,6
/proc/15802/stat : 15802 (adaptg2wsat2009) R 15800 15802 15802 0 -1 4202496 1467 0 0 0 950 0 0 0 25 0 1 0 616961465 429654016 1204 33554432000 134512640 135107411 4293262768 18446744073709551615 134539462 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15802/statm: 104896 1204 59 146 0 103772 0
[pid=15777/tid=15792] ppid=15774 vsize=322380 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15792/stat : 15792 (python) S 15774 15777 15742 0 -1 4202560 23 926 0 8 0 0 0 0 18 0 5 0 616961456 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 4 0 0 0
[pid=15777/tid=15795] ppid=15774 vsize=322380 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15795/stat : 15795 (python) S 15774 15777 15742 0 -1 4202560 24 926 0 8 0 0 0 0 20 0 5 0 616961459 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 2 0 0 0
[pid=15777/tid=15798] ppid=15774 vsize=322380 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15798/stat : 15798 (python) S 15774 15777 15742 0 -1 4202560 21 926 0 8 0 0 0 0 22 0 5 0 616961462 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 2 0 0 0
[pid=15777/tid=15801] ppid=15774 vsize=322380 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15801/stat : 15801 (python) S 15774 15777 15742 0 -1 4202560 28 926 0 8 0 0 0 0 24 0 5 0 616961465 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39.87
Current children cumulated vsize (KiB) 4385636

[startup+51.1013 s]
/proc/loadavg: 3.61 0.91 0.30 10/202 15814
/proc/meminfo: memFree=24412696/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=322380 CPUtime=1.72 cores=0,2,4,6
/proc/15777/stat : 15777 (python) S 15774 15777 15742 0 -1 4202496 14256 926 115 8 149 23 0 0 24 0 5 0 616959867 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 126
/proc/15777/statm: 80595 7794 1883 364 0 16504 0
[pid=15791] ppid=15777 vsize=281232 CPUtime=0.04 cores=0,2,4,6
/proc/15791/stat : 15791 (python) S 15777 15777 15742 0 -1 4202560 901 0 0 0 2 2 0 0 15 0 1 0 616961456 287981568 6238 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612623 0 0 16781312 514 13105422139089977602 0 0 17 0 0 0 0
/proc/15791/statm: 70308 6238 377 364 0 6226 0
[pid=15793] ppid=15791 vsize=1018676 CPUtime=35.2 cores=0,2,4,6
/proc/15793/stat : 15793 (gnovelty+2) R 15791 15793 15793 0 -1 4202496 773 0 0 0 3520 0 0 0 25 0 1 0 616961457 1043124224 509 33554432000 134512640 135663704 4287639200 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/15793/statm: 254669 509 113 282 0 254385 0
[pid=15794] ppid=15777 vsize=291488 CPUtime=0.04 cores=0,2,4,6
/proc/15794/stat : 15794 (python) S 15777 15777 15742 0 -1 4202560 910 0 0 0 3 1 0 0 18 0 1 0 616961459 298483712 6244 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 13105422139089977602 0 0 17 2 0 0 0
/proc/15794/statm: 72872 6244 371 364 0 8787 0
[pid=15796] ppid=15794 vsize=1018676 CPUtime=35.13 cores=0,2,4,6
/proc/15796/stat : 15796 (gnovelty+2) R 15794 15796 15796 0 -1 4202496 772 0 0 0 3513 0 0 0 25 0 1 0 616961459 1043124224 508 33554432000 134512640 135663704 4288237040 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15796/statm: 254669 508 113 282 0 254385 0
[pid=15797] ppid=15777 vsize=301880 CPUtime=0.03 cores=0,2,4,6
/proc/15797/stat : 15797 (python) S 15777 15777 15742 0 -1 4202560 909 0 0 0 2 1 0 0 18 0 1 0 616961462 309125120 6274 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 13105422139089977602 0 0 17 6 0 0 0
/proc/15797/statm: 75470 6274 371 364 0 11382 0
[pid=15799] ppid=15797 vsize=419584 CPUtime=34.9 cores=0,2,4,6
/proc/15799/stat : 15799 (adaptg2wsat2009) R 15797 15799 15799 0 -1 4202496 1467 0 0 0 3490 0 0 0 25 0 1 0 616961462 429654016 1204 33554432000 134512640 135107411 4286589792 18446744073709551615 134531905 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15799/statm: 104896 1204 59 146 0 103772 0
[pid=15800] ppid=15777 vsize=312136 CPUtime=0.04 cores=0,2,4,6
/proc/15800/stat : 15800 (python) S 15777 15777 15742 0 -1 4202560 939 0 0 0 2 2 0 0 18 0 1 0 616961465 319627264 6278 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 13105422139089977603 0 0 17 2 0 0 0
/proc/15800/statm: 78034 6278 371 364 0 13943 0
[pid=15802] ppid=15800 vsize=419584 CPUtime=35.01 cores=0,2,4,6
/proc/15802/stat : 15802 (adaptg2wsat2009) R 15800 15802 15802 0 -1 4202496 1467 0 0 0 3501 0 0 0 25 0 1 0 616961465 429654016 1204 33554432000 134512640 135107411 4293262768 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15802/statm: 104896 1204 59 146 0 103772 0
[pid=15777/tid=15792] ppid=15774 vsize=322380 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15792/stat : 15792 (python) S 15774 15777 15742 0 -1 4202560 23 926 0 8 0 0 0 0 18 0 5 0 616961456 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 4 0 0 0
[pid=15777/tid=15795] ppid=15774 vsize=322380 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15795/stat : 15795 (python) S 15774 15777 15742 0 -1 4202560 24 926 0 8 0 0 0 0 20 0 5 0 616961459 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 2 0 0 0
[pid=15777/tid=15798] ppid=15774 vsize=322380 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15798/stat : 15798 (python) S 15774 15777 15742 0 -1 4202560 21 926 0 8 0 0 0 0 22 0 5 0 616961462 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 2 0 0 0
[pid=15777/tid=15801] ppid=15774 vsize=322380 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15801/stat : 15801 (python) S 15774 15777 15742 0 -1 4202560 28 926 0 8 0 0 0 0 24 0 5 0 616961465 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 142.11
Current children cumulated vsize (KiB) 4385636

[startup+102.307 s]
/proc/loadavg: 6.20 2.03 0.71 10/202 15816
/proc/meminfo: memFree=24412784/32950940 swapFree=67111364/67111528
[pid=15777] ppid=15774 vsize=322380 CPUtime=1.72 cores=0,2,4,6
/proc/15777/stat : 15777 (python) S 15774 15777 15742 0 -1 4202496 14256 926 115 8 149 23 0 0 24 0 5 0 616959867 330117120 7794 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 126
/proc/15777/statm: 80595 7794 1883 364 0 16504 0
[pid=15791] ppid=15777 vsize=281232 CPUtime=0.1 cores=0,2,4,6
/proc/15791/stat : 15791 (python) S 15777 15777 15742 0 -1 4202560 917 0 0 0 5 5 0 0 15 0 1 0 616961456 287981568 6238 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612623 0 0 16781312 514 13105422139089977602 0 0 17 0 0 0 0
/proc/15791/statm: 70308 6238 377 364 0 6226 0
[pid=15793] ppid=15791 vsize=1018676 CPUtime=86.41 cores=0,2,4,6
/proc/15793/stat : 15793 (gnovelty+2) R 15791 15793 15793 0 -1 4202496 773 0 0 0 8641 0 0 0 25 0 1 0 616961457 1043124224 509 33554432000 134512640 135663704 4287639200 18446744073709551615 134545534 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/15793/statm: 254669 509 113 282 0 254385 0
[pid=15794] ppid=15777 vsize=291488 CPUtime=0.1 cores=0,2,4,6
/proc/15794/stat : 15794 (python) S 15777 15777 15742 0 -1 4202560 927 0 0 0 7 3 0 0 18 0 1 0 616961459 298483712 6244 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 13105422139089977602 0 0 17 2 0 0 0
/proc/15794/statm: 72872 6244 371 364 0 8787 0

################
# More data... #
################

[pid=15797/tid=15817] ppid=15777 vsize=301880 CPUtime=0 cores=0,2,4,6
/proc/15797/task/15817/stat : 15817 (python) S 15777 15777 15742 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 616971376 309125120 6304 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453930829696 0 0 -1 6 0 0 0
[pid=15800] ppid=15777 vsize=312136 CPUtime=0.13 cores=0,2,4,6
/proc/15800/stat : 15800 (python) S 15777 15777 15742 0 -1 4202560 1123 0 0 0 7 6 0 0 18 0 2 0 616961465 319627264 6308 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/15800/statm: 78034 6308 400 364 0 13943 0
[pid=15802] ppid=15800 vsize=419584 CPUtime=104.31 cores=0,2,4,6
/proc/15802/stat : 15802 (adaptg2wsat2009) R 15800 15802 15802 0 -1 4202496 1467 0 0 0 10431 0 0 0 25 0 1 0 616961465 429654016 1204 33554432000 134512640 135107411 4293262768 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15802/statm: 104896 1204 59 146 0 103772 0
[pid=15800/tid=15818] ppid=15777 vsize=312136 CPUtime=0 cores=0,2,4,6
/proc/15800/task/15818/stat : 15818 (python) S 15777 15777 15742 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 616971380 319627264 6308 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604445720599424 0 0 -1 6 0 0 0
[pid=15819] ppid=15777 vsize=322864 CPUtime=0.12 cores=0,2,4,6
/proc/15819/stat : 15819 (python) S 15777 15777 15742 0 -1 4202560 1127 0 0 0 7 5 0 0 19 0 2 0 616971380 330612736 6430 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/15819/statm: 80716 6430 399 364 0 16622 0
[pid=15821] ppid=15819 vsize=419584 CPUtime=99.96 cores=0,2,4,6
/proc/15821/stat : 15821 (adaptg2wsat2009) T 15819 15821 15821 0 -1 4202496 1470 0 0 0 9996 0 0 0 25 0 1 0 616971381 429654016 1206 33554432000 134512640 135107411 4289577296 18446744073709551615 134531613 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/15821/statm: 104896 1206 59 146 0 103772 0
[pid=15819/tid=15845] ppid=15777 vsize=322864 CPUtime=0 cores=0,2,4,6
/proc/15819/task/15845/stat : 15845 (python) S 15777 15777 15742 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 616981393 330612736 6430 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453906256832 0 0 -1 2 0 0 0
[pid=15822] ppid=15777 vsize=333120 CPUtime=0.26 cores=0,2,4,6
/proc/15822/stat : 15822 (python) S 15777 15777 15742 0 -1 4202560 1171 0 0 0 15 11 0 0 18 0 2 0 616971384 341114880 6434 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/15822/statm: 83280 6434 400 364 0 19183 0
[pid=15824] ppid=15822 vsize=1018676 CPUtime=199.93 cores=0,2,4,6
/proc/15824/stat : 15824 (gnovelty+2) T 15822 15824 15824 0 -1 4202496 776 0 0 0 19993 0 0 0 25 0 1 0 616971384 1043124224 510 33554432000 134512640 135663704 4290442336 18446744073709551615 134525218 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/15824/statm: 254669 510 113 282 0 254385 0
[pid=15822/tid=15840] ppid=15777 vsize=333120 CPUtime=0 cores=0,2,4,6
/proc/15822/task/15840/stat : 15840 (python) S 15777 15777 15742 0 -1 4202560 50 0 0 0 0 0 0 0 18 0 2 0 616981299 341114880 6434 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453921113280 0 0 -1 6 0 0 0
[pid=15827] ppid=15777 vsize=343376 CPUtime=0.13 cores=0,2,4,6
/proc/15827/stat : 15827 (python) S 15777 15777 15742 0 -1 4202560 1193 0 0 0 7 6 0 0 19 0 2 0 616971475 351617024 6453 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/15827/statm: 85844 6453 414 364 0 21744 0
[pid=15829] ppid=15827 vsize=249480 CPUtime=99.12 cores=0,2,4,6
/proc/15829/stat : 15829 (FH) T 15827 15829 15829 0 -1 4202496 1399 0 0 0 9912 0 0 0 25 0 1 0 616971475 255467520 1135 33554432000 134512640 134936988 4292561072 18446744073709551615 134554097 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/15829/statm: 62370 1135 41 104 0 61874 0
[pid=15827/tid=15844] ppid=15777 vsize=343376 CPUtime=0 cores=0,2,4,6
/proc/15827/task/15844/stat : 15844 (python) S 15777 15777 15742 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 616981388 351617024 6453 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453985338304 0 0 -1 6 0 0 0
[pid=15830] ppid=15777 vsize=353632 CPUtime=0.12 cores=0,2,4,6
/proc/15830/stat : 15830 (python) S 15777 15777 15742 0 -1 4202560 1186 0 0 0 7 5 0 0 19 0 2 0 616971478 362119168 6448 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/15830/statm: 88408 6448 406 364 0 24305 0
[pid=15832] ppid=15830 vsize=419584 CPUtime=97.46 cores=0,2,4,6
/proc/15832/stat : 15832 (adaptg2wsat2009) T 15830 15832 15832 0 -1 4202496 1477 0 0 0 9746 0 0 0 25 0 1 0 616971479 429654016 1204 33554432000 134512640 135107411 4293978672 18446744073709551615 134531582 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/15832/statm: 104896 1204 59 146 0 103772 0
[pid=15830/tid=15846] ppid=15777 vsize=353632 CPUtime=0 cores=0,2,4,6
/proc/15830/task/15846/stat : 15846 (python) S 15777 15777 15742 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 616981402 362119168 6448 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604450415487936 0 0 -1 0 0 0 0
[pid=15847] ppid=15777 vsize=364152 CPUtime=0.13 cores=0,2,4,6
/proc/15847/stat : 15847 (python) S 15777 15777 15742 0 -1 4202560 1154 0 0 0 9 4 0 0 19 0 2 0 616981406 372891648 6512 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/15847/statm: 91038 6512 399 364 0 26932 0
[pid=15849] ppid=15847 vsize=419584 CPUtime=99.86 cores=0,2,4,6
/proc/15849/stat : 15849 (adaptg2wsat2009) T 15847 15849 15849 0 -1 4202496 1478 0 0 0 9986 0 0 0 25 0 1 0 616981407 429654016 1205 33554432000 134512640 135107411 4294513840 18446744073709551615 134532371 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/15849/statm: 104896 1205 59 146 0 103772 0
[pid=15847/tid=15943] ppid=15777 vsize=364152 CPUtime=0 cores=0,2,4,6
/proc/15847/task/15943/stat : 15943 (python) S 15777 15777 15742 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 616991419 372891648 6512 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453932861504 0 0 -1 6 0 0 0
[pid=15936] ppid=15777 vsize=374408 CPUtime=0.14 cores=0,2,4,6
/proc/15936/stat : 15936 (python) S 15777 15777 15742 0 -1 4202560 1156 0 0 0 8 6 0 0 19 0 2 0 616991018 383393792 6515 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/15936/statm: 93602 6515 399 364 0 29493 0
[pid=15938] ppid=15936 vsize=249476 CPUtime=99.06 cores=0,2,4,6
/proc/15938/stat : 15938 (FH) T 15936 15938 15938 0 -1 4202496 1406 0 0 0 9906 0 0 0 25 0 1 0 616991019 255463424 1134 33554432000 134512640 134936988 4286959008 18446744073709551615 134545312 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/15938/statm: 62369 1134 41 104 0 61873 0
[pid=15936/tid=15956] ppid=15777 vsize=374408 CPUtime=0 cores=0,2,4,6
/proc/15936/task/15956/stat : 15956 (python) S 15777 15777 15742 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 617000931 383393792 6515 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453930827904 0 0 -1 6 0 0 0
[pid=15939] ppid=15777 vsize=384664 CPUtime=0.14 cores=0,2,4,6
/proc/15939/stat : 15939 (python) S 15777 15777 15742 0 -1 4202560 1156 0 0 0 7 7 0 0 19 0 2 0 616991108 393895936 6520 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/15939/statm: 96166 6520 400 364 0 32054 0
[pid=15941] ppid=15939 vsize=1018676 CPUtime=98.52 cores=0,2,4,6
/proc/15941/stat : 15941 (gnovelty+2) T 15939 15941 15941 0 -1 4202496 777 0 0 0 9852 0 0 0 25 0 1 0 616991108 1043124224 509 33554432000 134512640 135663704 4287927424 18446744073709551615 134545583 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/15941/statm: 254669 509 113 282 0 254385 0
[pid=15939/tid=15960] ppid=15777 vsize=384664 CPUtime=0 cores=0,2,4,6
/proc/15939/task/15960/stat : 15960 (python) S 15777 15777 15742 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 617001127 393895936 6520 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604440278877312 0 0 -1 6 0 0 0
[pid=15944] ppid=15777 vsize=394920 CPUtime=0.14 cores=0,2,4,6
/proc/15944/stat : 15944 (python) S 15777 15777 15742 0 -1 4202560 1158 0 0 0 8 6 0 0 19 0 2 0 616991423 404398080 6524 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/15944/statm: 98730 6524 400 364 0 34615 0
[pid=15946] ppid=15944 vsize=419584 CPUtime=99.7 cores=0,2,4,6
/proc/15946/stat : 15946 (adaptg2wsat2009) T 15944 15946 15946 0 -1 4202496 1479 0 0 0 9969 1 0 0 25 0 1 0 616991424 429654016 1204 33554432000 134512640 135107411 4287945472 18446744073709551615 134532336 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/15946/statm: 104896 1204 59 146 0 103772 0
[pid=15944/tid=15964] ppid=15777 vsize=394920 CPUtime=0 cores=0,2,4,6
/proc/15944/task/15964/stat : 15964 (python) S 15777 15777 15742 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 617001437 404398080 6524 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604440278879104 0 0 -1 4 0 0 0
[pid=15947] ppid=15777 vsize=405176 CPUtime=0.61 cores=0,2,4,6
/proc/15947/stat : 15947 (python) S 15777 15777 15742 0 -1 4202560 1187 0 0 0 31 30 0 0 18 0 2 0 616991513 414900224 6528 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/15947/statm: 101294 6528 400 364 0 37176 0
[pid=15949] ppid=15947 vsize=268424 CPUtime=392.13 cores=0,2,4,6
/proc/15949/stat : 15949 (hybridGM3) T 15947 15949 15949 0 -1 4202496 5445 0 0 0 39211 2 0 0 25 0 1 0 616991514 274866176 5174 33554432000 134512640 135204385 4291796384 18446744073709551615 134537724 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/15949/statm: 67106 5174 63 169 0 66936 0
[pid=15947/tid=15978] ppid=15777 vsize=405176 CPUtime=0 cores=0,2,4,6
/proc/15947/task/15978/stat : 15978 (python) S 15777 15777 15742 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 617011145 414900224 6528 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453917978816 0 0 -1 4 0 0 0
[pid=15957] ppid=15777 vsize=415432 CPUtime=0.14 cores=0,2,4,6
/proc/15957/stat : 15957 (python) S 15777 15777 15742 0 -1 4202560 1183 0 0 0 8 6 0 0 19 0 2 0 617000936 425402368 6532 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/15957/statm: 103858 6532 400 364 0 39737 0
[pid=15959] ppid=15957 vsize=249476 CPUtime=97.67 cores=0,2,4,6
/proc/15959/stat : 15959 (FH) T 15957 15959 15959 0 -1 4202496 1413 0 0 0 9767 0 0 0 25 0 1 0 617000936 255463424 1135 33554432000 134512640 134936988 4292269504 18446744073709551615 134554839 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/15959/statm: 62369 1135 41 104 0 61873 0
[pid=15957/tid=15974] ppid=15777 vsize=415432 CPUtime=0 cores=0,2,4,6
/proc/15957/task/15974/stat : 15974 (python) S 15777 15777 15742 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 617010950 425402368 6532 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453930830592 0 0 -1 6 0 0 0
[pid=15961] ppid=15777 vsize=425688 CPUtime=0.47 cores=0,2,4,6
/proc/15961/stat : 15961 (python) S 15777 15777 15742 0 -1 4202560 1246 0 0 0 26 21 0 0 18 0 2 0 617001131 435904512 6553 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/15961/statm: 106422 6553 408 364 0 42298 0
[pid=15963] ppid=15961 vsize=268420 CPUtime=294.9 cores=0,2,4,6
/proc/15963/stat : 15963 (hybridGM3) T 15961 15963 15963 0 -1 4202496 5452 0 0 0 29487 3 0 0 25 0 1 0 617001132 274862080 5174 33554432000 134512640 135204385 4294296144 18446744073709551615 134549153 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/15963/statm: 67105 5174 63 169 0 66935 0
[pid=15961/tid=15995] ppid=15777 vsize=425688 CPUtime=0 cores=0,2,4,6
/proc/15961/task/15995/stat : 15995 (python) S 15777 15777 15742 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 617021267 435904512 6553 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453917980608 0 0 -1 6 0 0 0
[pid=15965] ppid=15777 vsize=435944 CPUtime=0.44 cores=0,2,4,6
/proc/15965/stat : 15965 (python) S 15777 15777 15742 0 -1 4202560 1236 0 0 0 24 20 0 0 18 0 2 0 617001442 446406656 6557 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/15965/statm: 108986 6557 408 364 0 44859 0
[pid=15967] ppid=15965 vsize=268420 CPUtime=291.1 cores=0,2,4,6
/proc/15967/stat : 15967 (hybridGM3) T 15965 15967 15967 0 -1 4202496 5448 0 0 0 29109 1 0 0 25 0 1 0 617001443 274862080 5174 33554432000 134512640 135204385 4290522080 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/15967/statm: 67105 5174 63 169 0 66935 0
[pid=15965/tid=15994] ppid=15777 vsize=435944 CPUtime=0 cores=0,2,4,6
/proc/15965/task/15994/stat : 15994 (python) S 15777 15777 15742 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 617021074 446406656 6557 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 514 18446604453599655104 0 0 -1 0 0 0 0
[pid=15975] ppid=15777 vsize=446200 CPUtime=0.3 cores=0,2,4,6
/proc/15975/stat : 15975 (python) S 15777 15777 15742 0 -1 4202560 1060 0 0 0 18 12 0 0 18 0 1 0 617010955 456908800 6540 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 13105422139089977602 0 0 17 2 0 0 0
/proc/15975/statm: 111550 6540 373 364 0 47420 0
[pid=15977] ppid=15975 vsize=457948 CPUtime=203.69 cores=0,2,4,6
/proc/15977/stat : 15977 (TNM) R 15975 15977 15977 0 -1 4202496 1391 0 0 0 20369 0 0 0 25 0 1 0 617010955 468938752 1114 33554432000 134512640 135008748 4287012064 18446744073709551615 134527054 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15977/statm: 114487 1114 46 122 0 113387 0
[pid=16006] ppid=15777 vsize=456612 CPUtime=0 cores=0,2,4,6
/proc/16006/stat : 16006 (python) S 15777 15777 15742 0 -1 4202560 830 0 0 0 0 0 0 0 19 0 1 0 617031291 467570688 6532 33554432000 4194304 5683644 140734494007952 18446744073709551615 215988612678 0 0 16781312 514 4279027130471284735 0 0 17 4 0 0 0
/proc/16006/statm: 114153 6532 346 364 0 50020 0
[pid=16008] ppid=16006 vsize=335996 CPUtime=0.67 cores=0,2,4,6
/proc/16008/stat : 16008 (iPAWS) R 16006 16008 16008 0 -1 4202496 1606 0 0 0 67 0 0 0 22 0 1 0 617031291 344059904 1331 33554432000 134512640 135114423 4294612320 18446744073709551615 134516919 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/16008/statm: 83999 1331 59 147 0 83851 0
[pid=15777/tid=15792] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15792/stat : 15792 (python) S 15774 15777 15742 0 -1 4202560 26 926 0 8 0 0 0 0 18 0 19 0 616961456 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 4 0 0 0
[pid=15777/tid=15795] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15795/stat : 15795 (python) S 15774 15777 15742 0 -1 4202560 28 926 0 8 0 0 0 0 18 0 19 0 616961459 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 2 0 0 0
[pid=15777/tid=15798] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15798/stat : 15798 (python) S 15774 15777 15742 0 -1 4202560 24 926 0 8 0 0 0 0 18 0 19 0 616961462 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 2 0 0 0
[pid=15777/tid=15801] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15801/stat : 15801 (python) S 15774 15777 15742 0 -1 4202560 33 926 0 8 0 0 0 0 18 0 19 0 616961465 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 2 0 0 0
[pid=15777/tid=15820] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15820/stat : 15820 (python) S 15774 15777 15742 0 -1 4202560 28 926 0 8 0 0 0 0 20 0 19 0 616971380 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 6 0 0 0
[pid=15777/tid=15823] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15823/stat : 15823 (python) S 15774 15777 15742 0 -1 4202560 36 926 0 8 0 0 0 0 18 0 19 0 616971384 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 6 0 0 0
[pid=15777/tid=15828] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15828/stat : 15828 (python) S 15774 15777 15742 0 -1 4202560 23 926 0 8 0 0 0 0 20 0 19 0 616971475 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 6 0 0 0
[pid=15777/tid=15831] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15831/stat : 15831 (python) S 15774 15777 15742 0 -1 4202560 28 926 0 8 0 0 0 0 22 0 19 0 616971479 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 4 0 0 0
[pid=15777/tid=15848] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15848/stat : 15848 (python) S 15774 15777 15742 0 -1 4202560 31 926 0 8 0 0 0 0 20 0 19 0 616981407 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 0 0 0 0
[pid=15777/tid=15937] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15937/stat : 15937 (python) S 15774 15777 15742 0 -1 4202560 26 926 0 8 0 0 0 0 20 0 19 0 616991018 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 0 0 0 0
[pid=15777/tid=15940] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15940/stat : 15940 (python) S 15774 15777 15742 0 -1 4202560 28 926 0 8 0 0 0 0 20 0 19 0 616991108 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 0 0 0 0
[pid=15777/tid=15945] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15945/stat : 15945 (python) S 15774 15777 15742 0 -1 4202560 28 926 0 8 0 0 0 0 20 0 19 0 616991424 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 0 0 0 0
[pid=15777/tid=15948] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15948/stat : 15948 (python) S 15774 15777 15742 0 -1 4202560 31 926 0 8 0 0 0 0 18 0 19 0 616991513 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 0 0 0 0
[pid=15777/tid=15958] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15958/stat : 15958 (python) S 15774 15777 15742 0 -1 4202560 32 926 0 8 0 0 0 0 20 0 19 0 617000936 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 0 0 0 0
[pid=15777/tid=15962] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15962/stat : 15962 (python) S 15774 15777 15742 0 -1 4202560 30 926 0 8 0 0 0 0 18 0 19 0 617001132 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 0 0 0 0
[pid=15777/tid=15966] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15966/stat : 15966 (python) S 15774 15777 15742 0 -1 4202560 34 926 0 8 0 0 0 0 18 0 19 0 617001443 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 0 0 0 0
[pid=15777/tid=15976] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/15976/stat : 15976 (python) S 15774 15777 15742 0 -1 4202560 29 926 0 8 0 0 0 0 20 0 19 0 617010955 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 0 0 0 0
[pid=15777/tid=16007] ppid=15774 vsize=466856 CPUtime=0 cores=0,2,4,6
/proc/15777/task/16007/stat : 16007 (python) S 15774 15777 15742 0 -1 4202560 30 926 0 8 0 0 0 0 20 0 19 0 617031291 478060544 8102 33554432000 4194304 5683644 140734494007952 18446744073709551615 216000416177 0 0 16781312 2 18446604453932862400 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2783.45
Current children cumulated vsize (KiB) 16059872

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15777 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=494620
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=284956
# CPU time returned by wait4() is 2.77958
# while last known CPU time is 2783.45
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 715.019
CPU time (s): 2783.45
CPU user time (s): 2781.3
CPU system time (s): 2.15
CPU usage (%): 389.283
Max. virtual memory (cumulated for all children) (KiB): 16059872

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.49462
system time used= 0.284956
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29612
page faults= 123
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23429
involuntary context switches= 123

runsolver used 4.08038 second user time and 8.91664 second system time

The end

Launcher Data 

Begin job on node117 at 2011-05-01 18:28:07
IDJOB=3317083
IDBENCH=82548
IDSOLVER=1705
FILE ID=node117/3317083-1304267287
RUNJOBID= node117-1304267285-15760
PBS_JOBID= 13173962
Free space on /tmp= 72640 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k5-r20-v1000-c20000-S72635791-098-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317083-1304267287/watcher-3317083-1304267287 -o /tmp/evaluation-result-3317083-1304267287/solver-3317083-1304267287 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317083-1304267287.cnf -seed 1878399543 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 93976db0d99d3daab756f06103f77642
RANDOM SEED=1878399543

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      24689612 kB
Buffers:       1903148 kB
Cached:        5728668 kB
SwapCached:        160 kB
Active:        1207396 kB
Inactive:      6488404 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      24689612 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           66836 kB
Writeback:           0 kB
AnonPages:       63816 kB
Mapped:          14548 kB
Slab:           502656 kB
PageTables:       4612 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   188856 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72576 MiB
End job on node117 at 2011-05-01 18:40:08