Trace number 3317202

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 2381.51 599.518

General information on the benchmark

Namerandom/large/
unif-k7-r85-v250-c21250-S1274193329-021-UNKNOWN.cnf
MD5SUM3c4691c1028b5642345f341166405cb7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables250
Number of clauses21250
Sum of the clauses size148750
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521250

Solver Data 

0.32/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.67	c INFO: solving HOME/instance-3317202-1304268127.cnf
0.32/0.67	c INFO: computing task features
0.49/0.81	c INFO: computed variable-clause graph statistics
0.49/0.81	c INFO: computed clause balance statistics
1.19/1.55	c INFO: computed variable balance statistics
1.49/1.84	c INFO: computed small-clause counts
1.49/1.84	c INFO: computed Horn-clause counts
1.49/1.86	c INFO: computed variable graph statistics
1.49/1.86	c INFO: collected features for HOME/instance-3317202-1304268127.cnf in 1.20 s
1.49/1.89	c INFO: running gnovelty+2@0 for 97 with 4798 remaining (b = 0.36)
1.59/1.92	c INFO: running gnovelty+2@0 for 97 with 4798 remaining (b = 0.13)
1.59/1.95	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.08)
1.59/1.98	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.07)
401.58/102.10	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.05)
401.58/102.13	c INFO: running gnovelty+2@0 for 97 with 4698 remaining (b = 0.04)
401.58/102.17	c INFO: running FH@0 for 97 with 4698 remaining (b = 0.03)
401.90/102.21	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.03)
797.06/201.36	c INFO: running adaptg2wsat2009++@0 for 97 with 4599 remaining (b = 0.02)
799.77/202.29	c INFO: running FH@0 for 97 with 4598 remaining (b = 0.02)
801.35/202.42	c INFO: running hybridGM3@0 for 194 with 4598 remaining (b = 0.04)
801.35/202.46	c INFO: running gnovelty+2@0 for 97 with 4598 remaining (b = 0.02)
1196.02/301.56	c INFO: running hybridGM3@0 for 194 with 4499 remaining (b = 0.03)
1199.61/302.49	c INFO: running hybridGM3@0 for 194 with 4498 remaining (b = 0.03)
1200.59/302.70	c INFO: running TNM@0 for 1552 with 4498 remaining (b = 0.20)
1575.51/396.84	c INFO: running hybridGM3@100 for 97 with 4403 remaining (b = 0.01)
1974.56/497.04	c INFO: running adaptg2wsat2009++@0 for 97 with 4303 remaining (b = 0.01)
1982.14/498.90	c INFO: running hybridGM3@100 for 97 with 4301 remaining (b = 0.01)
2002.01/503.97	c INFO: running hybridGM3@98 for 97 with 4296 remaining (b = 0.01)
2372.76/597.25	c INFO: running FH@0 for 97 with 4203 remaining (b = 0.01)
2380.28/599.17	c INFO: running hybridGM3@0 for 194 with 4201 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317202-1304268127/watcher-3317202-1304268127 -o /tmp/evaluation-result-3317202-1304268127/solver-3317202-1304268127 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317202-1304268127.cnf -seed 529580218 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.47 7.79 4.83 6/223 28804
/proc/meminfo: memFree=29437424/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/28804/stat : 28804 (python) S 28802 28804 28463 0 -1 4202496 733 0 0 0 0 0 0 0 25 0 1 0 538410917 15548416 622 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516832256 0 2147483391 16781312 2 18446744071699453118 0 0 17 2 0 0 0
/proc/28804/statm: 3796 622 322 364 0 283 0

[startup+0.0688291 s]
/proc/loadavg: 8.47 7.79 4.83 6/223 28804
/proc/meminfo: memFree=29437424/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=36508 CPUtime=0.03 cores=0,2,4,6
/proc/28804/stat : 28804 (python) R 28802 28804 28463 0 -1 4202496 1567 0 0 0 3 0 0 0 25 0 1 0 538410917 37384192 1402 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516495045 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28804/statm: 9127 1402 452 364 0 944 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 36508

[startup+0.100805 s]
/proc/loadavg: 8.47 7.79 4.83 6/223 28804
/proc/meminfo: memFree=29437424/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=89768 CPUtime=0.04 cores=0,2,4,6
/proc/28804/stat : 28804 (python) R 28802 28804 28463 0 -1 4202496 2640 0 0 0 4 0 0 0 25 0 1 0 538410917 91922432 2356 33554432000 4194304 5683644 140734974844512 18446744073709551615 246511884848 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28804/statm: 22442 2359 721 364 0 1622 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 89768

[startup+0.300782 s]
/proc/loadavg: 8.47 7.79 4.83 6/223 28804
/proc/meminfo: memFree=29437424/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=135752 CPUtime=0.17 cores=0,2,4,6
/proc/28804/stat : 28804 (python) S 28802 28804 28463 0 -1 4202496 5964 934 1 0 14 3 0 0 17 0 1 0 538410917 139010048 4152 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516830213 0 2147483391 16781312 2 18446744071699453118 0 0 17 2 0 0 0
/proc/28804/statm: 33938 4152 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135752

[startup+0.700705 s]
/proc/loadavg: 8.47 7.79 4.83 6/223 28804
/proc/meminfo: memFree=29437424/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=279756 CPUtime=0.39 cores=0,2,4,6
/proc/28804/stat : 28804 (python) R 28802 28804 28463 0 -1 4202496 9714 934 1 0 32 7 0 0 16 0 1 0 538410917 286470144 7281 33554432000 4194304 5683644 140734974844512 18446744073709551615 4531714 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28804/statm: 69939 7281 1761 364 0 5863 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 279756

[startup+1.50056 s]
/proc/loadavg: 8.47 7.79 4.83 6/224 28809
/proc/meminfo: memFree=29410008/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=283916 CPUtime=1.19 cores=0,2,4,6
/proc/28804/stat : 28804 (python) R 28802 28804 28463 0 -1 4202496 11842 934 1 0 112 7 0 0 17 0 1 0 538410917 290729984 8364 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516493739 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28804/statm: 70979 8364 1826 364 0 6903 0
Current children cumulated CPU time (s) 1.19
Current children cumulated vsize (KiB) 283916

[startup+3.10123 s]
/proc/loadavg: 8.19 7.74 4.83 9/236 28821
/proc/meminfo: memFree=29374192/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=321108 CPUtime=1.68 cores=0,2,4,6
/proc/28804/stat : 28804 (python) S 28802 28804 28463 0 -1 4202496 14707 934 1 0 159 9 0 0 22 0 5 0 538410917 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28804/statm: 80277 7476 1883 364 0 16186 0
[pid=28810] ppid=28804 vsize=279940 CPUtime=0 cores=0,2,4,6
/proc/28810/stat : 28810 (python) S 28804 28804 28463 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 538411107 286658560 5773 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854287 0 0 16781312 514 4020988793862455554 0 0 17 0 0 0 0
/proc/28810/statm: 69985 5773 355 364 0 5903 0
[pid=28812] ppid=28810 vsize=1018820 CPUtime=1.19 cores=0,2,4,6
/proc/28812/stat : 28812 (gnovelty+2) R 28810 28812 28812 0 -1 4202496 855 0 0 0 119 0 0 0 22 0 1 0 538411107 1043271680 596 33554432000 134512640 135663704 4293820096 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/28812/statm: 254705 596 113 282 0 254421 0
[pid=28813] ppid=28804 vsize=290836 CPUtime=0 cores=0,2,4,6
/proc/28813/stat : 28813 (python) S 28804 28804 28463 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 538411110 297816064 5796 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 4020981097281061121 0 0 17 0 0 0 0
/proc/28813/statm: 72709 5796 349 364 0 8624 0
[pid=28815] ppid=28813 vsize=1018820 CPUtime=1.16 cores=0,2,4,6
/proc/28815/stat : 28815 (gnovelty+2) R 28813 28815 28815 0 -1 4202496 858 0 0 0 116 0 0 0 25 0 1 0 538411110 1043271680 596 33554432000 134512640 135663704 4287592224 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/28815/statm: 254705 596 113 282 0 254421 0
[pid=28816] ppid=28804 vsize=300608 CPUtime=0 cores=0,2,4,6
/proc/28816/stat : 28816 (python) S 28804 28804 28463 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 538411112 307822592 5933 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 774645253603852287 0 0 17 2 0 0 0
/proc/28816/statm: 75152 5933 347 364 0 11064 0
[pid=28818] ppid=28816 vsize=419160 CPUtime=1.14 cores=0,2,4,6
/proc/28818/stat : 28818 (adaptg2wsat2009) R 28816 28818 28818 0 -1 4202496 1255 0 0 0 114 0 0 0 25 0 1 0 538411113 429219840 990 33554432000 134512640 135107411 4288929616 18446744073709551615 134523298 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/28818/statm: 104790 990 49 146 0 103666 0
[pid=28819] ppid=28804 vsize=310864 CPUtime=0 cores=0,2,4,6
/proc/28819/stat : 28819 (python) S 28804 28804 28463 0 -1 4202560 747 0 0 0 0 0 0 0 18 0 1 0 538411115 318324736 5936 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 4017399713031520255 0 0 17 0 0 0 0
/proc/28819/statm: 77716 5936 347 364 0 13625 0
[pid=28821] ppid=28819 vsize=419160 CPUtime=1.11 cores=0,2,4,6
/proc/28821/stat : 28821 (adaptg2wsat2009) R 28819 28821 28821 0 -1 4202496 1257 0 0 0 111 0 0 0 25 0 1 0 538411116 429219840 991 33554432000 134512640 135107411 4288377504 18446744073709551615 134523314 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/28821/statm: 104790 991 49 146 0 103666 0
[pid=28804/tid=28811] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28811/stat : 28811 (python) S 28802 28804 28463 0 -1 4202560 26 934 0 0 0 0 0 0 19 0 5 0 538411107 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28814] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28814/stat : 28814 (python) S 28802 28804 28463 0 -1 4202560 22 934 0 0 0 0 0 0 21 0 5 0 538411110 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28817] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28817/stat : 28817 (python) S 28802 28804 28463 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 5 0 538411113 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28820] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28820/stat : 28820 (python) S 28802 28804 28463 0 -1 4202560 23 934 0 0 0 0 0 0 22 0 5 0 538411116 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 4379316

[startup+6.30065 s]
/proc/loadavg: 8.19 7.74 4.83 9/236 28821
/proc/meminfo: memFree=29375308/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=321108 CPUtime=1.68 cores=0,2,4,6
/proc/28804/stat : 28804 (python) S 28802 28804 28463 0 -1 4202496 14707 934 1 0 159 9 0 0 22 0 5 0 538410917 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28804/statm: 80277 7476 1883 364 0 16186 0
[pid=28810] ppid=28804 vsize=279940 CPUtime=0 cores=0,2,4,6
/proc/28810/stat : 28810 (python) S 28804 28804 28463 0 -1 4202560 894 0 0 0 0 0 0 0 18 0 1 0 538411107 286658560 5796 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854287 0 0 16781312 514 4020988793862455554 0 0 17 0 0 0 0
/proc/28810/statm: 69985 5796 378 364 0 5903 0
[pid=28812] ppid=28810 vsize=1018820 CPUtime=4.38 cores=0,2,4,6
/proc/28812/stat : 28812 (gnovelty+2) R 28810 28812 28812 0 -1 4202496 855 0 0 0 438 0 0 0 25 0 1 0 538411107 1043271680 596 33554432000 134512640 135663704 4293820096 18446744073709551615 134525258 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/28812/statm: 254705 596 113 282 0 254421 0
[pid=28813] ppid=28804 vsize=290836 CPUtime=0 cores=0,2,4,6
/proc/28813/stat : 28813 (python) S 28804 28804 28463 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 538411110 297816064 5819 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 4020981097281061121 0 0 17 0 0 0 0
/proc/28813/statm: 72709 5819 372 364 0 8624 0
[pid=28815] ppid=28813 vsize=1018820 CPUtime=4.34 cores=0,2,4,6
/proc/28815/stat : 28815 (gnovelty+2) R 28813 28815 28815 0 -1 4202496 858 0 0 0 434 0 0 0 25 0 1 0 538411110 1043271680 596 33554432000 134512640 135663704 4287592224 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/28815/statm: 254705 596 113 282 0 254421 0
[pid=28816] ppid=28804 vsize=300608 CPUtime=0 cores=0,2,4,6
/proc/28816/stat : 28816 (python) S 28804 28804 28463 0 -1 4202560 897 0 0 0 0 0 0 0 18 0 1 0 538411112 307822592 5956 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 774645253603819780 0 0 17 2 0 0 0
/proc/28816/statm: 75152 5956 370 364 0 11064 0
[pid=28818] ppid=28816 vsize=419428 CPUtime=4.33 cores=0,2,4,6
/proc/28818/stat : 28818 (adaptg2wsat2009) R 28816 28818 28818 0 -1 4202496 1440 0 0 0 433 0 0 0 25 0 1 0 538411113 429494272 1175 33554432000 134512640 135107411 4288929616 18446744073709551615 134547589 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/28818/statm: 104857 1175 59 146 0 103733 0
[pid=28819] ppid=28804 vsize=310864 CPUtime=0 cores=0,2,4,6
/proc/28819/stat : 28819 (python) S 28804 28804 28463 0 -1 4202560 909 0 0 0 0 0 0 0 18 0 1 0 538411115 318324736 5958 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 4017399713031520255 0 0 17 0 0 0 0
/proc/28819/statm: 77716 5958 369 364 0 13625 0
[pid=28821] ppid=28819 vsize=419428 CPUtime=4.28 cores=0,2,4,6
/proc/28821/stat : 28821 (adaptg2wsat2009) R 28819 28821 28821 0 -1 4202496 1442 0 0 0 428 0 0 0 25 0 1 0 538411116 429494272 1176 33554432000 134512640 135107411 4288377504 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/28821/statm: 104857 1176 59 146 0 103733 0
[pid=28804/tid=28811] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28811/stat : 28811 (python) S 28802 28804 28463 0 -1 4202560 26 934 0 0 0 0 0 0 19 0 5 0 538411107 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28814] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28814/stat : 28814 (python) S 28802 28804 28463 0 -1 4202560 22 934 0 0 0 0 0 0 21 0 5 0 538411110 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28817] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28817/stat : 28817 (python) S 28802 28804 28463 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 5 0 538411113 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28820] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28820/stat : 28820 (python) S 28802 28804 28463 0 -1 4202560 23 934 0 0 0 0 0 0 22 0 5 0 538411116 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 19.01
Current children cumulated vsize (KiB) 4379852

[startup+12.7015 s]
/proc/loadavg: 8.24 7.77 4.87 9/239 28824
/proc/meminfo: memFree=29355792/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=321108 CPUtime=1.68 cores=0,2,4,6
/proc/28804/stat : 28804 (python) S 28802 28804 28463 0 -1 4202496 14707 934 1 0 159 9 0 0 22 0 5 0 538410917 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28804/statm: 80277 7476 1883 364 0 16186 0
[pid=28810] ppid=28804 vsize=279940 CPUtime=0 cores=0,2,4,6
/proc/28810/stat : 28810 (python) S 28804 28804 28463 0 -1 4202560 898 0 0 0 0 0 0 0 18 0 1 0 538411107 286658560 5796 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854287 0 0 16781312 514 4673891988280410370 0 0 17 0 0 0 0
/proc/28810/statm: 69985 5796 378 364 0 5903 0
[pid=28812] ppid=28810 vsize=1018820 CPUtime=10.77 cores=0,2,4,6
/proc/28812/stat : 28812 (gnovelty+2) R 28810 28812 28812 0 -1 4202496 855 0 0 0 1077 0 0 0 25 0 1 0 538411107 1043271680 596 33554432000 134512640 135663704 4293820096 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/28812/statm: 254705 596 113 282 0 254421 0
[pid=28813] ppid=28804 vsize=290836 CPUtime=0.01 cores=0,2,4,6
/proc/28813/stat : 28813 (python) S 28804 28804 28463 0 -1 4202560 905 0 0 0 0 1 0 0 18 0 1 0 538411110 297816064 5819 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 4673891988280410369 0 0 17 0 0 0 0
/proc/28813/statm: 72709 5819 372 364 0 8624 0
[pid=28815] ppid=28813 vsize=1018820 CPUtime=10.7 cores=0,2,4,6
/proc/28815/stat : 28815 (gnovelty+2) R 28813 28815 28815 0 -1 4202496 858 0 0 0 1070 0 0 0 25 0 1 0 538411110 1043271680 596 33554432000 134512640 135663704 4287592224 18446744073709551615 134524534 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/28815/statm: 254705 596 113 282 0 254421 0
[pid=28816] ppid=28804 vsize=300608 CPUtime=0.01 cores=0,2,4,6
/proc/28816/stat : 28816 (python) S 28804 28804 28463 0 -1 4202560 899 0 0 0 1 0 0 0 18 0 1 0 538411112 307822592 5956 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 4673891988280410372 0 0 17 2 0 0 0
/proc/28816/statm: 75152 5956 370 364 0 11064 0
[pid=28818] ppid=28816 vsize=419428 CPUtime=10.73 cores=0,2,4,6
/proc/28818/stat : 28818 (adaptg2wsat2009) R 28816 28818 28818 0 -1 4202496 1440 0 0 0 1073 0 0 0 25 0 1 0 538411113 429494272 1175 33554432000 134512640 135107411 4288929616 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/28818/statm: 104857 1175 59 146 0 103733 0
[pid=28819] ppid=28804 vsize=310864 CPUtime=0.01 cores=0,2,4,6
/proc/28819/stat : 28819 (python) S 28804 28804 28463 0 -1 4202560 915 0 0 0 1 0 0 0 18 0 1 0 538411115 318324736 5959 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 4017399713031487747 0 0 17 0 0 0 0
/proc/28819/statm: 77716 5959 370 364 0 13625 0
[pid=28821] ppid=28819 vsize=419428 CPUtime=10.65 cores=0,2,4,6
/proc/28821/stat : 28821 (adaptg2wsat2009) R 28819 28821 28821 0 -1 4202496 1442 0 0 0 1065 0 0 0 25 0 1 0 538411116 429494272 1176 33554432000 134512640 135107411 4288377504 18446744073709551615 134531830 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/28821/statm: 104857 1176 59 146 0 103733 0
[pid=28804/tid=28811] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28811/stat : 28811 (python) S 28802 28804 28463 0 -1 4202560 26 934 0 0 0 0 0 0 19 0 5 0 538411107 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28814] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28814/stat : 28814 (python) S 28802 28804 28463 0 -1 4202560 22 934 0 0 0 0 0 0 21 0 5 0 538411110 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28817] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28817/stat : 28817 (python) S 28802 28804 28463 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 5 0 538411113 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28820] ppid=28802 vsize=321108 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28820/stat : 28820 (python) S 28802 28804 28463 0 -1 4202560 23 934 0 0 0 0 0 0 22 0 5 0 538411116 328814592 7476 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 44.56
Current children cumulated vsize (KiB) 4379852

[startup+25.5012 s]
/proc/loadavg: 8.20 7.77 4.90 9/243 28828
/proc/meminfo: memFree=29324136/32951124 swapFree=67102756/67111528
[pid=28804] ppid=28802 vsize=321108 CPUtime=1.68 cores=0,2,4,6

################
# More data... #
################

/proc/28819/stat : 28819 (python) S 28804 28804 28463 0 -1 4202560 1104 0 0 0 8 7 0 0 19 0 2 0 538411115 318324736 5989 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28819/statm: 77716 5989 399 364 0 13625 0
[pid=28821] ppid=28819 vsize=419428 CPUtime=99.69 cores=0,2,4,6
/proc/28821/stat : 28821 (adaptg2wsat2009) T 28819 28821 28821 0 -1 4202496 1442 0 0 0 9969 0 0 0 25 0 1 0 538411116 429494272 1176 33554432000 134512640 135107411 4288377504 18446744073709551615 134532135 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/28821/statm: 104857 1176 59 146 0 103733 0
[pid=28819/tid=28840] ppid=28804 vsize=310864 CPUtime=0 cores=0,2,4,6
/proc/28819/task/28840/stat : 28840 (python) S 28804 28804 28463 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538421132 318324736 5989 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604453848067008 0 0 -1 0 0 0 0
[pid=28833] ppid=28804 vsize=321120 CPUtime=0.14 cores=0,2,4,6
/proc/28833/stat : 28833 (python) S 28804 28804 28463 0 -1 4202560 1126 0 0 0 8 6 0 0 19 0 2 0 538421127 328826880 5994 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28833/statm: 80280 5994 399 364 0 16186 0
[pid=28836] ppid=28833 vsize=419428 CPUtime=99.97 cores=0,2,4,6
/proc/28836/stat : 28836 (adaptg2wsat2009) T 28833 28836 28836 0 -1 4202496 1445 0 0 0 9997 0 0 0 25 0 1 0 538421129 429494272 1177 33554432000 134512640 135107411 4289437952 18446744073709551615 134532416 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/28836/statm: 104857 1177 59 146 0 103733 0
[pid=28833/tid=28859] ppid=28804 vsize=321120 CPUtime=0 cores=0,2,4,6
/proc/28833/task/28859/stat : 28859 (python) S 28804 28804 28463 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538431142 328826880 5994 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604453846827136 0 0 -1 0 0 0 0
[pid=28837] ppid=28804 vsize=331376 CPUtime=0.14 cores=0,2,4,6
/proc/28837/stat : 28837 (python) S 28804 28804 28463 0 -1 4202560 1126 0 0 0 7 7 0 0 19 0 2 0 538421131 339329024 5998 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/28837/statm: 82844 5998 399 364 0 18747 0
[pid=28839] ppid=28837 vsize=1018820 CPUtime=100.24 cores=0,2,4,6
/proc/28839/stat : 28839 (gnovelty+2) T 28837 28839 28839 0 -1 4202496 859 0 0 0 10024 0 0 0 25 0 1 0 538421131 1043271680 595 33554432000 134512640 135663704 4289294064 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/28839/statm: 254705 595 113 282 0 254421 0
[pid=28837/tid=28864] ppid=28804 vsize=331376 CPUtime=0 cores=0,2,4,6
/proc/28837/task/28864/stat : 28864 (python) S 28804 28804 28463 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538431155 339329024 5998 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604450394717120 0 0 -1 2 0 0 0
[pid=28841] ppid=28804 vsize=342248 CPUtime=0.14 cores=0,2,4,6
/proc/28841/stat : 28841 (python) S 28804 28804 28463 0 -1 4202560 1184 0 0 0 8 6 0 0 19 0 2 0 538421134 350461952 6009 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/28841/statm: 85562 6009 406 364 0 21462 0
[pid=28843] ppid=28841 vsize=249192 CPUtime=99 cores=0,2,4,6
/proc/28843/stat : 28843 (FH) T 28841 28843 28843 0 -1 4202496 1325 0 0 0 9900 0 0 0 25 0 1 0 538421134 255172608 1059 33554432000 134512640 134936988 4290573648 18446744073709551615 134553238 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/28843/statm: 62298 1059 41 104 0 61802 0
[pid=28841/tid=28855] ppid=28804 vsize=342248 CPUtime=0 cores=0,2,4,6
/proc/28841/task/28855/stat : 28855 (python) S 28804 28804 28463 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538431050 350461952 6009 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604448798088000 0 0 -1 6 0 0 0
[pid=28844] ppid=28804 vsize=352020 CPUtime=0.14 cores=0,2,4,6
/proc/28844/stat : 28844 (python) S 28804 28804 28463 0 -1 4202560 1157 0 0 0 7 7 0 0 19 0 2 0 538421139 360468480 6045 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/28844/statm: 88005 6045 405 364 0 23902 0
[pid=28846] ppid=28844 vsize=419428 CPUtime=98.61 cores=0,2,4,6
/proc/28846/stat : 28846 (adaptg2wsat2009) T 28844 28846 28846 0 -1 4202496 1448 0 0 0 9858 3 0 0 25 0 1 0 538421139 429494272 1177 33554432000 134512640 135107411 4293165952 18446744073709551615 134531535 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/28846/statm: 104857 1177 59 146 0 103733 0
[pid=28844/tid=28863] ppid=28804 vsize=352020 CPUtime=0 cores=0,2,4,6
/proc/28844/task/28863/stat : 28863 (python) S 28804 28804 28463 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538431155 360468480 6045 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604448798085312 0 0 -1 6 0 0 0
[pid=28856] ppid=28804 vsize=362444 CPUtime=0.16 cores=0,2,4,6
/proc/28856/stat : 28856 (python) S 28804 28804 28463 0 -1 4202560 1148 0 0 0 8 8 0 0 19 0 2 0 538431053 371142656 6044 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/28856/statm: 90611 6044 400 364 0 26505 0
[pid=28858] ppid=28856 vsize=419428 CPUtime=99.81 cores=0,2,4,6
/proc/28858/stat : 28858 (adaptg2wsat2009) T 28856 28858 28858 0 -1 4202496 1444 0 0 0 9981 0 0 0 25 0 1 0 538431054 429494272 1175 33554432000 134512640 135107411 4287576944 18446744073709551615 134532371 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/28858/statm: 104857 1175 59 146 0 103733 0
[pid=28856/tid=28878] ppid=28804 vsize=362444 CPUtime=0 cores=0,2,4,6
/proc/28856/task/28878/stat : 28878 (python) S 28804 28804 28463 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 538441069 371142656 6044 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604453863887936 0 0 -1 4 0 0 0
[pid=28860] ppid=28804 vsize=372816 CPUtime=0.16 cores=0,2,4,6
/proc/28860/stat : 28860 (python) S 28804 28804 28463 0 -1 4202560 1164 0 0 0 8 8 0 0 19 0 2 0 538431146 381763584 6048 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/28860/statm: 93204 6048 400 364 0 29095 0
[pid=28862] ppid=28860 vsize=249192 CPUtime=98.16 cores=0,2,4,6
/proc/28862/stat : 28862 (FH) T 28860 28862 28862 0 -1 4202496 1330 0 0 0 9816 0 0 0 25 0 1 0 538431147 255172608 1059 33554432000 134512640 134936988 4288225024 18446744073709551615 134552375 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/28862/statm: 62298 1059 41 104 0 61802 0
[pid=28860/tid=28882] ppid=28804 vsize=372816 CPUtime=0 cores=0,2,4,6
/proc/28860/task/28882/stat : 28882 (python) S 28804 28804 28463 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538441162 381763584 6048 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604453831750784 0 0 -1 6 0 0 0
[pid=28865] ppid=28804 vsize=383016 CPUtime=0.49 cores=0,2,4,6
/proc/28865/stat : 28865 (python) S 28804 28804 28463 0 -1 4202560 1206 0 0 0 25 24 0 0 18 0 2 0 538431159 392208384 6052 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/28865/statm: 95754 6052 400 364 0 31642 0
[pid=28867] ppid=28865 vsize=268428 CPUtime=294.03 cores=0,2,4,6
/proc/28867/stat : 28867 (hybridGM3) T 28865 28867 28867 0 -1 4202496 5279 0 0 0 29403 0 0 0 25 0 1 0 538431159 274870272 5010 33554432000 134512640 135204385 4294847152 18446744073709551615 134538295 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/28867/statm: 67107 5010 63 169 0 66937 0
[pid=28865/tid=28897] ppid=28804 vsize=383016 CPUtime=0 cores=0,2,4,6
/proc/28865/task/28897/stat : 28897 (python) S 28804 28804 28463 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538450596 392208384 6052 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604453861979392 0 0 -1 6 0 0 0
[pid=28868] ppid=28804 vsize=393400 CPUtime=0.16 cores=0,2,4,6
/proc/28868/stat : 28868 (python) S 28804 28804 28463 0 -1 4202560 1171 0 0 0 8 8 0 0 19 0 2 0 538431163 402841600 6056 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/28868/statm: 98350 6056 400 364 0 34235 0
[pid=28870] ppid=28868 vsize=1018820 CPUtime=100.17 cores=0,2,4,6
/proc/28870/stat : 28870 (gnovelty+2) T 28868 28870 28870 0 -1 4202496 867 0 0 0 10017 0 0 0 25 0 1 0 538431164 1043271680 596 33554432000 134512640 135663704 4288200592 18446744073709551615 134525222 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/28870/statm: 254705 596 113 282 0 254421 0
[pid=28868/tid=28886] ppid=28804 vsize=393400 CPUtime=0 cores=0,2,4,6
/proc/28868/task/28886/stat : 28886 (python) S 28804 28804 28463 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538441183 402841600 6056 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604448798086208 0 0 -1 2 0 0 0
[pid=28879] ppid=28804 vsize=403488 CPUtime=0.49 cores=0,2,4,6
/proc/28879/stat : 28879 (python) S 28804 28804 28463 0 -1 4202560 1197 0 0 0 26 23 0 0 18 0 2 0 538441073 413171712 6060 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/28879/statm: 100872 6060 400 364 0 36754 0
[pid=28881] ppid=28879 vsize=268420 CPUtime=293 cores=0,2,4,6
/proc/28881/stat : 28881 (hybridGM3) T 28879 28881 28881 0 -1 4202496 5277 0 0 0 29297 3 0 0 25 0 1 0 538441074 274862080 5009 33554432000 134512640 135204385 4293393136 18446744073709551615 134537935 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/28881/statm: 67105 5009 63 169 0 66935 0
[pid=28879/tid=28916] ppid=28804 vsize=403488 CPUtime=0 cores=0,2,4,6
/proc/28879/task/28916/stat : 28916 (python) S 28804 28804 28463 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 538461310 413171712 6060 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604453872511168 0 0 -1 2 0 0 0
[pid=28883] ppid=28804 vsize=414032 CPUtime=0.48 cores=0,2,4,6
/proc/28883/stat : 28883 (python) S 28804 28804 28463 0 -1 4202560 1202 0 0 0 25 23 0 0 18 0 2 0 538441167 423968768 6064 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/28883/statm: 103508 6064 400 364 0 39387 0
[pid=28885] ppid=28883 vsize=268424 CPUtime=293.86 cores=0,2,4,6
/proc/28885/stat : 28885 (hybridGM3) R 28883 28885 28885 0 -1 4202496 5281 0 0 0 29385 1 0 0 25 0 1 0 538441167 274866176 5010 33554432000 134512640 135204385 4294722640 18446744073709551615 134538034 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/28885/statm: 67106 5010 63 169 0 66936 0
[pid=28883/tid=28914] ppid=28804 vsize=414032 CPUtime=0 cores=0,2,4,6
/proc/28883/task/28914/stat : 28914 (python) S 28804 28804 28463 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538460803 423968768 6064 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604453872510272 0 0 -1 2 0 0 0
[pid=28887] ppid=28804 vsize=424588 CPUtime=0.48 cores=0,2,4,6
/proc/28887/stat : 28887 (python) S 28804 28804 28463 0 -1 4202560 1077 0 0 0 25 23 0 0 18 0 1 0 538441187 434778112 6047 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 4673891988280410370 0 0 17 2 0 0 0
/proc/28887/statm: 106147 6047 380 364 0 42023 0
[pid=28889] ppid=28887 vsize=457664 CPUtime=296.7 cores=0,2,4,6
/proc/28889/stat : 28889 (TNM) R 28887 28889 28889 0 -1 4202496 1315 0 0 0 29670 0 0 0 25 0 1 0 538441188 468647936 1037 33554432000 134512640 135008748 4289695760 18446744073709551615 134527118 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/28889/statm: 114416 1037 46 122 0 113316 0
[pid=28908] ppid=28804 vsize=434732 CPUtime=0.17 cores=0,2,4,6
/proc/28908/stat : 28908 (python) S 28804 28804 28463 0 -1 4202560 1221 0 0 0 9 8 0 0 19 0 2 0 538460622 445165568 6153 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/28908/statm: 108683 6153 408 364 0 44556 0
[pid=28910] ppid=28908 vsize=419428 CPUtime=100.12 cores=0,2,4,6
/proc/28910/stat : 28910 (adaptg2wsat2009) T 28908 28910 28910 0 -1 4202496 1455 0 0 0 10012 0 0 0 25 0 1 0 538460622 429494272 1176 33554432000 134512640 135107411 4289975952 18446744073709551615 134531239 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/28910/statm: 104857 1176 59 146 0 103733 0
[pid=28908/tid=28969] ppid=28804 vsize=434732 CPUtime=0 cores=0,2,4,6
/proc/28908/task/28969/stat : 28969 (python) S 28804 28804 28463 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 538470638 445165568 6153 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 514 18446604453856955264 0 0 -1 0 0 0 0
[pid=28970] ppid=28804 vsize=445168 CPUtime=0 cores=0,2,4,6
/proc/28970/stat : 28970 (python) S 28804 28804 28463 0 -1 4202560 853 0 0 0 0 0 0 0 18 0 1 0 538470642 455852032 6153 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 7632115107845079297 0 0 17 2 0 0 0
/proc/28970/statm: 111292 6153 351 364 0 47162 0
[pid=28972] ppid=28970 vsize=247428 CPUtime=2.14 cores=0,2,4,6
/proc/28972/stat : 28972 (FH) R 28970 28972 28972 0 -1 4202496 1102 0 0 0 214 0 0 0 25 0 1 0 538470643 253366272 832 33554432000 134512640 134936988 4287580752 18446744073709551615 134523479 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/28972/statm: 61857 832 37 104 0 61361 0
[pid=28973] ppid=28804 vsize=455596 CPUtime=0 cores=0,2,4,6
/proc/28973/stat : 28973 (python) S 28804 28804 28463 0 -1 4202560 855 0 0 0 0 0 0 0 19 0 1 0 538470834 466530304 6156 33554432000 4194304 5683644 140734974844512 18446744073709551615 246516854342 0 0 16781312 514 7632111259554414591 0 0 17 2 0 0 0
/proc/28973/statm: 113899 6156 350 364 0 49766 0
[pid=28975] ppid=28973 vsize=268420 CPUtime=0.21 cores=0,2,4,6
/proc/28975/stat : 28975 (hybridGM3) R 28973 28975 28975 0 -1 4202496 5285 0 0 0 21 0 0 0 21 0 1 0 538470834 274862080 5008 33554432000 134512640 135204385 4293061872 18446744073709551615 134545709 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/28975/statm: 67105 5008 63 169 0 66935 0
[pid=28804/tid=28811] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28811/stat : 28811 (python) S 28802 28804 28463 0 -1 4202560 26 934 0 0 0 0 0 0 19 0 19 0 538411107 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28814] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28814/stat : 28814 (python) S 28802 28804 28463 0 -1 4202560 22 934 0 0 0 0 0 0 21 0 19 0 538411110 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28817] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28817/stat : 28817 (python) S 28802 28804 28463 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 19 0 538411113 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28820] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28820/stat : 28820 (python) S 28802 28804 28463 0 -1 4202560 23 934 0 0 0 0 0 0 22 0 19 0 538411116 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28834] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28834/stat : 28834 (python) S 28802 28804 28463 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 19 0 538421127 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 0 0 0 0
[pid=28804/tid=28838] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28838/stat : 28838 (python) S 28802 28804 28463 0 -1 4202560 24 934 0 0 0 0 0 0 22 0 19 0 538421131 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 4 0 0 0
[pid=28804/tid=28842] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28842/stat : 28842 (python) S 28802 28804 28463 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 19 0 538421134 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 6 0 0 0
[pid=28804/tid=28845] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28845/stat : 28845 (python) S 28802 28804 28463 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 19 0 538421139 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 6 0 0 0
[pid=28804/tid=28857] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28857/stat : 28857 (python) S 28802 28804 28463 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 538431053 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 6 0 0 0
[pid=28804/tid=28861] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28861/stat : 28861 (python) S 28802 28804 28463 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 538431147 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 6 0 0 0
[pid=28804/tid=28866] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28866/stat : 28866 (python) S 28802 28804 28463 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 19 0 538431159 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 6 0 0 0
[pid=28804/tid=28869] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28869/stat : 28869 (python) S 28802 28804 28463 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 19 0 538431164 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28880] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28880/stat : 28880 (python) S 28802 28804 28463 0 -1 4202560 36 934 0 0 0 0 0 0 18 0 19 0 538441073 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28884] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28884/stat : 28884 (python) S 28802 28804 28463 0 -1 4202560 34 934 0 0 0 0 0 0 18 0 19 0 538441167 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28888] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28888/stat : 28888 (python) S 28802 28804 28463 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 19 0 538441188 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28909] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28909/stat : 28909 (python) S 28802 28804 28463 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 538460622 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28971] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28971/stat : 28971 (python) S 28802 28804 28463 0 -1 4202560 32 934 0 0 0 0 0 0 20 0 19 0 538470643 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
[pid=28804/tid=28974] ppid=28802 vsize=465332 CPUtime=0 cores=0,2,4,6
/proc/28804/task/28974/stat : 28974 (python) S 28802 28804 28463 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 19 0 538470834 476499968 7721 33554432000 4194304 5683644 140734974844512 18446744073709551615 246528657841 0 0 16781312 2 18446604453832289216 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2381.51
Current children cumulated vsize (KiB) 15962884

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28804 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=295651
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=135979
# CPU time returned by wait4() is 2.43163
# while last known CPU time is 2381.51
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 599.518
CPU time (s): 2381.51
CPU user time (s): 2379.54
CPU system time (s): 1.97
CPU usage (%): 397.237
Max. virtual memory (cumulated for all children) (KiB): 15962884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.29565
system time used= 0.135979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29666
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2974
involuntary context switches= 69

runsolver used 3.36049 second user time and 6.18606 second system time

The end

Launcher Data 

Begin job on node134 at 2011-05-01 18:42:07
IDJOB=3317202
IDBENCH=82667
IDSOLVER=1705
FILE ID=node134/3317202-1304268127
RUNJOBID= node134-1304267281-28481
PBS_JOBID= 13173945
Free space on /tmp= 72496 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v250-c21250-S1274193329-021-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317202-1304268127/watcher-3317202-1304268127 -o /tmp/evaluation-result-3317202-1304268127/solver-3317202-1304268127 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317202-1304268127.cnf -seed 529580218 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3c4691c1028b5642345f341166405cb7
RANDOM SEED=529580218

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29437712 kB
Buffers:       1060128 kB
Cached:        1645840 kB
SwapCached:       4712 kB
Active:         695172 kB
Inactive:      2403968 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29437712 kB
SwapTotal:    67111528 kB
SwapFree:     67102756 kB
Dirty:           32348 kB
Writeback:         116 kB
AnonPages:      390588 kB
Mapped:          21084 kB
Slab:           341644 kB
PageTables:      13336 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  4623628 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72456 MiB
End job on node134 at 2011-05-01 18:52:09