Trace number 3317184

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 1988.96 502.32

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S1158419275-045-UNKNOWN.cnf
MD5SUMba96eb51c814e4238dd0a7b33e8bab2d
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.30/1.77	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.30/1.77	c INFO: solving HOME/instance-3317184-1304268015.cnf
0.30/1.77	c INFO: computing task features
0.48/1.94	c INFO: computed variable-clause graph statistics
0.48/1.94	c INFO: computed clause balance statistics
1.39/2.84	c INFO: computed variable balance statistics
1.69/3.20	c INFO: computed small-clause counts
1.69/3.20	c INFO: computed Horn-clause counts
1.79/3.23	c INFO: computed variable graph statistics
1.79/3.23	c INFO: collected features for HOME/instance-3317184-1304268015.cnf in 1.46 s
1.79/3.26	c INFO: running gnovelty+2@0 for 97 with 4798 remaining (b = 0.37)
1.79/3.29	c INFO: running gnovelty+2@0 for 97 with 4798 remaining (b = 0.13)
1.88/3.32	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.08)
1.88/3.35	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.07)
401.56/103.48	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.05)
401.96/103.52	c INFO: running gnovelty+2@0 for 97 with 4698 remaining (b = 0.04)
401.96/103.55	c INFO: running FH@0 for 97 with 4698 remaining (b = 0.03)
401.96/103.59	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.03)
800.68/203.66	c INFO: running adaptg2wsat2009++@0 for 97 with 4598 remaining (b = 0.02)
801.06/203.73	c INFO: running FH@0 for 97 with 4598 remaining (b = 0.02)
801.06/203.79	c INFO: running hybridGM3@0 for 194 with 4598 remaining (b = 0.04)
801.25/203.83	c INFO: running gnovelty+2@0 for 97 with 4597 remaining (b = 0.02)
1199.66/303.87	c INFO: running hybridGM3@0 for 194 with 4497 remaining (b = 0.03)
1200.04/303.94	c INFO: running adaptg2wsat2009++@0 for 97 with 4497 remaining (b = 0.01)
1200.47/304.15	c INFO: running hybridGM3@0 for 194 with 4497 remaining (b = 0.03)
1583.53/400.21	c INFO: running hybridGM3@99 for 97 with 4401 remaining (b = 0.01)
1599.06/404.14	c INFO: running hybridGM3@0 for 194 with 4397 remaining (b = 0.02)
1980.96/500.29	c INFO: running hybridGM3@98 for 97 with 4301 remaining (b = 0.01)
1982.17/500.59	c INFO: running TNM@0 for 1552 with 4301 remaining (b = 0.19)
1985.75/501.42	c INFO: running FH@0 for 97 with 4300 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317184-1304268015/watcher-3317184-1304268015 -o /tmp/evaluation-result-3317184-1304268015/solver-3317184-1304268015 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317184-1304268015.cnf -seed 914171939 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.45 7.28 4.31 7/218 20430
/proc/meminfo: memFree=23876272/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=15752 CPUtime=0 cores=0,2,4,6
/proc/20430/stat : 20430 (python) R 20428 20430 20058 0 -1 4202496 840 0 0 0 0 0 0 0 25 0 1 0 538399267 16130048 723 33554432000 4194304 5683644 140734940125312 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/20430/statm: 3938 723 334 364 0 425 0

[startup+0.069703 s]
/proc/loadavg: 7.45 7.28 4.31 7/218 20430
/proc/meminfo: memFree=23876272/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=54536 CPUtime=0.05 cores=0,2,4,6
/proc/20430/stat : 20430 (python) R 20428 20430 20058 0 -1 4202496 2056 0 0 0 4 1 0 0 25 0 1 0 538399267 55844864 1813 33554432000 4194304 5683644 140734940125312 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/20430/statm: 13634 1814 492 364 0 1284 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 54536

[startup+0.100714 s]
/proc/loadavg: 7.45 7.28 4.31 7/218 20430
/proc/meminfo: memFree=23876272/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=104228 CPUtime=0.07 cores=0,2,4,6
/proc/20430/stat : 20430 (python) R 20428 20430 20058 0 -1 4202496 3087 0 0 0 5 2 0 0 17 0 1 0 538399267 106729472 2767 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687336133 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/20430/statm: 26057 2767 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104228

[startup+0.913558 s]
/proc/loadavg: 7.45 7.28 4.31 7/218 20430
/proc/meminfo: memFree=23876272/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=124236 CPUtime=0.1 cores=0,2,4,6
/proc/20430/stat : 20430 (python) S 20428 20430 20058 0 -1 4202496 4313 0 1 0 7 3 0 0 17 0 1 0 538399267 127217664 3880 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687675136 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 73
/proc/20430/statm: 31059 3880 997 364 0 2870 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 124236

[startup+1.00054 s]
/proc/loadavg: 7.45 7.28 4.31 7/218 20430
/proc/meminfo: memFree=23876272/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=124236 CPUtime=0.1 cores=0,2,4,6
/proc/20430/stat : 20430 (python) S 20428 20430 20058 0 -1 4202496 4313 0 1 0 7 3 0 0 17 0 1 0 538399267 127217664 3880 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687675136 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 73
/proc/20430/statm: 31059 3880 997 364 0 2870 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 124236

[startup+1.50042 s]
/proc/loadavg: 7.45 7.28 4.31 7/218 20430
/proc/meminfo: memFree=23876272/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=128868 CPUtime=0.14 cores=0,2,4,6
/proc/20430/stat : 20430 (python) R 20428 20430 20058 0 -1 4202496 5554 933 1 0 10 4 0 0 19 0 1 0 538399267 131960832 4019 33554432000 4194304 5683644 140734940125312 18446744073709551615 5213839 0 0 16781312 2 0 0 0 17 2 0 0 73
/proc/20430/statm: 32217 4019 1011 364 0 2996 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 128868

[startup+3.10016 s]
/proc/loadavg: 7.45 7.28 4.31 7/219 20435
/proc/meminfo: memFree=23774448/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=285676 CPUtime=1.69 cores=0,2,4,6
/proc/20430/stat : 20430 (python) R 20428 20430 20058 0 -1 4202496 12378 933 1 0 159 10 0 0 20 0 1 0 538399267 292532224 8805 33554432000 4194304 5683644 140734940125312 18446744073709551615 4300016 0 0 16781312 2 0 0 0 17 2 0 0 73
/proc/20430/statm: 71419 8805 1827 364 0 7343 0
Current children cumulated CPU time (s) 1.69
Current children cumulated vsize (KiB) 285676
heavy processes:

[startup+6.30053 s]
/proc/loadavg: 7.57 7.30 4.33 10/231 20447
/proc/meminfo: memFree=23750304/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=321356 CPUtime=1.93 cores=0,2,4,6
/proc/20430/stat : 20430 (python) S 20428 20430 20058 0 -1 4202496 15196 933 1 0 183 10 0 0 24 0 5 0 538399267 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 73
/proc/20430/statm: 80339 7538 1883 364 0 16248 0
[pid=20436] ppid=20430 vsize=280692 CPUtime=0 cores=0,2,4,6
/proc/20436/stat : 20436 (python) S 20430 20430 20058 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 538399594 287428608 5961 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695375 0 0 16781312 514 4353402220142625025 0 0 17 2 0 0 0
/proc/20436/statm: 70173 5961 355 364 0 6091 0
[pid=20438] ppid=20436 vsize=1019708 CPUtime=3.03 cores=0,2,4,6
/proc/20438/stat : 20438 (gnovelty+2) R 20436 20438 20438 0 -1 4202496 952 0 0 0 303 0 0 0 25 0 1 0 538399594 1044180992 689 33554432000 134512640 135663704 4291760640 18446744073709551615 134524507 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/20438/statm: 254927 689 113 282 0 254643 0
[pid=20439] ppid=20430 vsize=291556 CPUtime=0 cores=0,2,4,6
/proc/20439/stat : 20439 (python) S 20430 20430 20058 0 -1 4202560 746 0 0 0 0 0 0 0 18 0 1 0 538399597 298553344 5976 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 4255488235788009731 0 0 17 2 0 0 0
/proc/20439/statm: 72889 5976 349 364 0 8804 0
[pid=20441] ppid=20439 vsize=1019708 CPUtime=3 cores=0,2,4,6
/proc/20441/stat : 20441 (gnovelty+2) R 20439 20441 20441 0 -1 4202496 953 0 0 0 300 0 0 0 25 0 1 0 538399597 1044180992 689 33554432000 134512640 135663704 4293454800 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/20441/statm: 254927 689 113 282 0 254643 0
[pid=20442] ppid=20430 vsize=301340 CPUtime=0 cores=0,2,4,6
/proc/20442/stat : 20442 (python) S 20430 20430 20058 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 538399600 308572160 5980 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 3107143723209687299 0 0 17 6 0 0 0
/proc/20442/statm: 75335 5980 349 364 0 11247 0
[pid=20444] ppid=20442 vsize=419820 CPUtime=2.94 cores=0,2,4,6
/proc/20444/stat : 20444 (adaptg2wsat2009) R 20442 20444 20444 0 -1 4202496 1441 0 0 0 294 0 0 0 25 0 1 0 538399600 429895680 1174 33554432000 134512640 135107411 4289450736 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/20444/statm: 104955 1174 49 146 0 103831 0
[pid=20445] ppid=20430 vsize=311664 CPUtime=0 cores=0,2,4,6
/proc/20445/stat : 20445 (python) S 20430 20430 20058 0 -1 4202560 748 0 0 0 0 0 0 0 18 0 1 0 538399603 319143936 6001 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 3107136026628292867 0 0 17 2 0 0 0
/proc/20445/statm: 77916 6001 349 364 0 13825 0
[pid=20447] ppid=20445 vsize=419820 CPUtime=2.93 cores=0,2,4,6
/proc/20447/stat : 20447 (adaptg2wsat2009) R 20445 20447 20447 0 -1 4202496 1435 0 0 0 293 0 0 0 25 0 1 0 538399603 429895680 1172 33554432000 134512640 135107411 4294441248 18446744073709551615 134523304 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/20447/statm: 104955 1172 49 146 0 103831 0
[pid=20430/tid=20437] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20437/stat : 20437 (python) S 20428 20430 20058 0 -1 4202560 26 933 0 0 0 0 0 0 23 0 5 0 538399594 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20440] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20440/stat : 20440 (python) S 20428 20430 20058 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 538399597 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
[pid=20430/tid=20443] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20443/stat : 20443 (python) S 20428 20430 20058 0 -1 4202560 24 933 0 0 0 0 0 0 22 0 5 0 538399600 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
[pid=20430/tid=20446] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20446/stat : 20446 (python) S 20428 20430 20058 0 -1 4202560 25 933 0 0 0 0 0 0 24 0 5 0 538399603 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13.83
Current children cumulated vsize (KiB) 4385664

[startup+12.7014 s]
/proc/loadavg: 7.77 7.35 4.36 10/231 20448
/proc/meminfo: memFree=23747332/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=321356 CPUtime=1.93 cores=0,2,4,6
/proc/20430/stat : 20430 (python) S 20428 20430 20058 0 -1 4202496 15196 933 1 0 183 10 0 0 24 0 5 0 538399267 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 73
/proc/20430/statm: 80339 7538 1883 364 0 16248 0
[pid=20436] ppid=20430 vsize=280692 CPUtime=0 cores=0,2,4,6
/proc/20436/stat : 20436 (python) S 20430 20430 20058 0 -1 4202560 897 0 0 0 0 0 0 0 18 0 1 0 538399594 287428608 5984 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695375 0 0 16781312 514 4353402220142625025 0 0 17 2 0 0 0
/proc/20436/statm: 70173 5984 378 364 0 6091 0
[pid=20438] ppid=20436 vsize=1019708 CPUtime=9.43 cores=0,2,4,6
/proc/20438/stat : 20438 (gnovelty+2) R 20436 20438 20438 0 -1 4202496 952 0 0 0 943 0 0 0 25 0 1 0 538399594 1044180992 689 33554432000 134512640 135663704 4291760640 18446744073709551615 134544422 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/20438/statm: 254927 689 113 282 0 254643 0
[pid=20439] ppid=20430 vsize=291556 CPUtime=0 cores=0,2,4,6
/proc/20439/stat : 20439 (python) S 20430 20430 20058 0 -1 4202560 896 0 0 0 0 0 0 0 18 0 1 0 538399597 298553344 5999 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 4255488235788009731 0 0 17 2 0 0 0
/proc/20439/statm: 72889 5999 372 364 0 8804 0
[pid=20441] ppid=20439 vsize=1019708 CPUtime=9.4 cores=0,2,4,6
/proc/20441/stat : 20441 (gnovelty+2) R 20439 20441 20441 0 -1 4202496 953 0 0 0 940 0 0 0 25 0 1 0 538399597 1044180992 689 33554432000 134512640 135663704 4293454800 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/20441/statm: 254927 689 113 282 0 254643 0
[pid=20442] ppid=20430 vsize=301340 CPUtime=0 cores=0,2,4,6
/proc/20442/stat : 20442 (python) S 20430 20430 20058 0 -1 4202560 900 0 0 0 0 0 0 0 18 0 1 0 538399600 308572160 6003 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 3107143723209687299 0 0 17 6 0 0 0
/proc/20442/statm: 75335 6003 372 364 0 11247 0
[pid=20444] ppid=20442 vsize=420220 CPUtime=9.29 cores=0,2,4,6
/proc/20444/stat : 20444 (adaptg2wsat2009) R 20442 20444 20444 0 -1 4202496 1668 0 0 0 929 0 0 0 25 0 1 0 538399600 430305280 1401 33554432000 134512640 135107411 4289450736 18446744073709551615 134532313 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/20444/statm: 105055 1401 59 146 0 103931 0
[pid=20445] ppid=20430 vsize=311664 CPUtime=0 cores=0,2,4,6
/proc/20445/stat : 20445 (python) S 20430 20430 20058 0 -1 4202560 916 0 0 0 0 0 0 0 18 0 1 0 538399603 319143936 6023 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 3107136026628292867 0 0 17 2 0 0 0
/proc/20445/statm: 77916 6023 371 364 0 13825 0
[pid=20447] ppid=20445 vsize=420220 CPUtime=9.31 cores=0,2,4,6
/proc/20447/stat : 20447 (adaptg2wsat2009) R 20445 20447 20447 0 -1 4202496 1662 0 0 0 931 0 0 0 25 0 1 0 538399603 430305280 1399 33554432000 134512640 135107411 4294441248 18446744073709551615 134531435 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/20447/statm: 105055 1399 59 146 0 103931 0
[pid=20430/tid=20437] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20437/stat : 20437 (python) S 20428 20430 20058 0 -1 4202560 26 933 0 0 0 0 0 0 23 0 5 0 538399594 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20440] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20440/stat : 20440 (python) S 20428 20430 20058 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 538399597 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
[pid=20430/tid=20443] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20443/stat : 20443 (python) S 20428 20430 20058 0 -1 4202560 24 933 0 0 0 0 0 0 22 0 5 0 538399600 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
[pid=20430/tid=20446] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20446/stat : 20446 (python) S 20428 20430 20058 0 -1 4202560 25 933 0 0 0 0 0 0 24 0 5 0 538399603 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39.36
Current children cumulated vsize (KiB) 4386464

[startup+25.501 s]
/proc/loadavg: 8.04 7.43 4.43 10/231 20448
/proc/meminfo: memFree=23747492/32951124 swapFree=67111524/67111528
[pid=20430] ppid=20428 vsize=321356 CPUtime=1.93 cores=0,2,4,6
/proc/20430/stat : 20430 (python) S 20428 20430 20058 0 -1 4202496 15196 933 1 0 183 10 0 0 24 0 5 0 538399267 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 73
/proc/20430/statm: 80339 7538 1883 364 0 16248 0
[pid=20436] ppid=20430 vsize=280692 CPUtime=0.03 cores=0,2,4,6
/proc/20436/stat : 20436 (python) S 20430 20430 20058 0 -1 4202560 904 0 0 0 1 2 0 0 18 0 1 0 538399594 287428608 5984 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695375 0 0 16781312 514 6876996630994714881 0 0 17 2 0 0 0
/proc/20436/statm: 70173 5984 378 364 0 6091 0
[pid=20438] ppid=20436 vsize=1019708 CPUtime=22.23 cores=0,2,4,6
/proc/20438/stat : 20438 (gnovelty+2) R 20436 20438 20438 0 -1 4202496 952 0 0 0 2223 0 0 0 25 0 1 0 538399594 1044180992 689 33554432000 134512640 135663704 4291760640 18446744073709551615 134524551 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/20438/statm: 254927 689 113 282 0 254643 0
[pid=20439] ppid=20430 vsize=291556 CPUtime=0.03 cores=0,2,4,6
/proc/20439/stat : 20439 (python) S 20430 20430 20058 0 -1 4202560 904 0 0 0 2 1 0 0 18 0 1 0 538399597 298553344 5999 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 6876996630994714883 0 0 17 2 0 0 0
/proc/20439/statm: 72889 5999 372 364 0 8804 0
[pid=20441] ppid=20439 vsize=1019708 CPUtime=22.2 cores=0,2,4,6
/proc/20441/stat : 20441 (gnovelty+2) R 20439 20441 20441 0 -1 4202496 953 0 0 0 2220 0 0 0 25 0 1 0 538399597 1044180992 689 33554432000 134512640 135663704 4293454800 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/20441/statm: 254927 689 113 282 0 254643 0
[pid=20442] ppid=20430 vsize=301340 CPUtime=0.03 cores=0,2,4,6
/proc/20442/stat : 20442 (python) S 20430 20430 20058 0 -1 4202560 909 0 0 0 1 2 0 0 18 0 1 0 538399600 308572160 6003 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 6876996630994714883 0 0 17 6 0 0 0
/proc/20442/statm: 75335 6003 372 364 0 11247 0
[pid=20444] ppid=20442 vsize=420220 CPUtime=21.98 cores=0,2,4,6
/proc/20444/stat : 20444 (adaptg2wsat2009) R 20442 20444 20444 0 -1 4202496 1668 0 0 0 2198 0 0 0 25 0 1 0 538399600 430305280 1401 33554432000 134512640 135107411 4289450736 18446744073709551615 134532088 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/20444/statm: 105055 1401 59 146 0 103931 0
[pid=20445] ppid=20430 vsize=311664 CPUtime=0.02 cores=0,2,4,6
/proc/20445/stat : 20445 (python) S 20430 20430 20058 0 -1 4202560 926 0 0 0 1 1 0 0 18 0 1 0 538399603 319143936 6024 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 6876996630994714883 0 0 17 2 0 0 0
/proc/20445/statm: 77916 6024 372 364 0 13825 0
[pid=20447] ppid=20445 vsize=420220 CPUtime=22.03 cores=0,2,4,6
/proc/20447/stat : 20447 (adaptg2wsat2009) R 20445 20447 20447 0 -1 4202496 1662 0 0 0 2203 0 0 0 25 0 1 0 538399603 430305280 1399 33554432000 134512640 135107411 4294441248 18446744073709551615 134532288 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/20447/statm: 105055 1399 59 146 0 103931 0
[pid=20430/tid=20437] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20437/stat : 20437 (python) S 20428 20430 20058 0 -1 4202560 26 933 0 0 0 0 0 0 23 0 5 0 538399594 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20440] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20440/stat : 20440 (python) S 20428 20430 20058 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 538399597 329068544 7538 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
[pid=20430/tid=20443] ppid=20428 vsize=321356 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

/proc/20444/stat : 20444 (adaptg2wsat2009) T 20442 20444 20444 0 -1 4202496 1668 0 0 0 9935 0 0 0 25 0 1 0 538399600 430305280 1401 33554432000 134512640 135107411 4289450736 18446744073709551615 134532408 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/20444/statm: 105055 1401 59 146 0 103931 0
[pid=20442/tid=20456] ppid=20430 vsize=301340 CPUtime=0 cores=0,2,4,6
/proc/20442/task/20456/stat : 20456 (python) S 20430 20430 20058 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538409616 308572160 6032 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604453636131520 0 0 -1 6 0 0 0
[pid=20445] ppid=20430 vsize=311664 CPUtime=0.14 cores=0,2,4,6
/proc/20445/stat : 20445 (python) S 20430 20430 20058 0 -1 4202560 1105 0 0 0 7 7 0 0 19 0 2 0 538399603 319143936 6053 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/20445/statm: 77916 6053 400 364 0 13825 0
[pid=20447] ppid=20445 vsize=420220 CPUtime=99.71 cores=0,2,4,6
/proc/20447/stat : 20447 (adaptg2wsat2009) T 20445 20447 20447 0 -1 4202496 1662 0 0 0 9971 0 0 0 25 0 1 0 538399603 430305280 1399 33554432000 134512640 135107411 4294441248 18446744073709551615 134531584 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/20447/statm: 105055 1399 59 146 0 103931 0
[pid=20445/tid=20459] ppid=20430 vsize=311664 CPUtime=0 cores=0,2,4,6
/proc/20445/task/20459/stat : 20459 (python) S 20430 20430 20058 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538409619 319143936 6053 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604453636129728 0 0 -1 2 0 0 0
[pid=20454] ppid=20430 vsize=322072 CPUtime=0.15 cores=0,2,4,6
/proc/20454/stat : 20454 (python) S 20430 20430 20058 0 -1 4202560 1114 0 0 0 8 7 0 0 19 0 2 0 538409616 329801728 6074 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/20454/statm: 80518 6074 400 364 0 16424 0
[pid=20458] ppid=20454 vsize=420220 CPUtime=99.97 cores=0,2,4,6
/proc/20458/stat : 20458 (adaptg2wsat2009) T 20454 20458 20458 0 -1 4202496 1669 0 0 0 9997 0 0 0 25 0 1 0 538409617 430305280 1400 33554432000 134512640 135107411 4293448384 18446744073709551615 134532128 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/20458/statm: 105055 1400 59 146 0 103931 0
[pid=20454/tid=20473] ppid=20430 vsize=322072 CPUtime=0 cores=0,2,4,6
/proc/20454/task/20473/stat : 20473 (python) S 20430 20430 20058 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538419630 329801728 6074 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604453883791488 0 0 -1 0 0 0 0
[pid=20460] ppid=20430 vsize=332140 CPUtime=0.14 cores=0,2,4,6
/proc/20460/stat : 20460 (python) S 20430 20430 20058 0 -1 4202560 1115 0 0 0 7 7 0 0 19 0 2 0 538409620 340111360 6116 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/20460/statm: 83035 6116 400 364 0 18938 0
[pid=20462] ppid=20460 vsize=1019708 CPUtime=100.19 cores=0,2,4,6
/proc/20462/stat : 20462 (gnovelty+2) T 20460 20462 20462 0 -1 4202496 952 0 0 0 10019 0 0 0 25 0 1 0 538409620 1044180992 689 33554432000 134512640 135663704 4294263984 18446744073709551615 134524498 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/20462/statm: 254927 689 113 282 0 254643 0
[pid=20460/tid=20478] ppid=20430 vsize=332140 CPUtime=0 cores=0,2,4,6
/proc/20460/task/20478/stat : 20478 (python) S 20430 20430 20058 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 538419640 340111360 6116 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604453632266368 0 0 -1 6 0 0 0
[pid=20463] ppid=20430 vsize=343004 CPUtime=0.15 cores=0,2,4,6
/proc/20463/stat : 20463 (python) S 20430 20430 20058 0 -1 4202560 1168 0 0 0 8 7 0 0 19 0 2 0 538409623 351236096 6126 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/20463/statm: 85751 6126 406 364 0 21651 0
[pid=20465] ppid=20463 vsize=249868 CPUtime=98.44 cores=0,2,4,6
/proc/20465/stat : 20465 (FH) T 20463 20465 20465 0 -1 4202496 1529 0 0 0 9843 1 0 0 25 0 1 0 538409623 255864832 1263 33554432000 134512640 134936988 4294143536 18446744073709551615 134552472 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/20465/statm: 62467 1263 41 104 0 61971 0
[pid=20463/tid=20477] ppid=20430 vsize=343004 CPUtime=0 cores=0,2,4,6
/proc/20463/task/20477/stat : 20477 (python) S 20430 20430 20058 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538419637 351236096 6126 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604450897374208 0 0 -1 4 0 0 0
[pid=20466] ppid=20430 vsize=352928 CPUtime=0.15 cores=0,2,4,6
/proc/20466/stat : 20466 (python) S 20430 20430 20058 0 -1 4202560 1141 0 0 0 7 8 0 0 19 0 2 0 538409627 361398272 6234 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/20466/statm: 88232 6234 406 364 0 24129 0
[pid=20468] ppid=20466 vsize=420220 CPUtime=99.86 cores=0,2,4,6
/proc/20468/stat : 20468 (adaptg2wsat2009) T 20466 20468 20468 0 -1 4202496 1668 0 0 0 9986 0 0 0 25 0 1 0 538409627 430305280 1399 33554432000 134512640 135107411 4292501232 18446744073709551615 134532135 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/20468/statm: 105055 1399 59 146 0 103931 0
[pid=20466/tid=20482] ppid=20430 vsize=352928 CPUtime=0 cores=0,2,4,6
/proc/20466/task/20482/stat : 20482 (python) S 20430 20430 20058 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538419643 361398272 6234 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604450897372416 0 0 -1 4 0 0 0
[pid=20474] ppid=20430 vsize=363032 CPUtime=0.16 cores=0,2,4,6
/proc/20474/stat : 20474 (python) S 20430 20430 20058 0 -1 4202560 1142 0 0 0 9 7 0 0 19 0 2 0 538419634 371744768 6231 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/20474/statm: 90758 6231 399 364 0 26652 0
[pid=20476] ppid=20474 vsize=420220 CPUtime=100.13 cores=0,2,4,6
/proc/20476/stat : 20476 (adaptg2wsat2009) T 20474 20476 20476 0 -1 4202496 1671 0 0 0 10013 0 0 0 25 0 1 0 538419635 430305280 1400 33554432000 134512640 135107411 4290145904 18446744073709551615 134532242 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/20476/statm: 105055 1400 59 146 0 103931 0
[pid=20474/tid=20495] ppid=20430 vsize=363032 CPUtime=0 cores=0,2,4,6
/proc/20474/task/20495/stat : 20495 (python) S 20430 20430 20058 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538429650 371744768 6231 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604453942916928 0 0 -1 4 0 0 0
[pid=20479] ppid=20430 vsize=373500 CPUtime=0.16 cores=0,2,4,6
/proc/20479/stat : 20479 (python) S 20430 20430 20058 0 -1 4202560 1145 0 0 0 7 9 0 0 19 0 2 0 538419641 382464000 6236 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/20479/statm: 93375 6236 400 364 0 29266 0
[pid=20481] ppid=20479 vsize=249872 CPUtime=98.47 cores=0,2,4,6
/proc/20481/stat : 20481 (FH) T 20479 20481 20481 0 -1 4202496 1534 0 0 0 9847 0 0 0 25 0 1 0 538419642 255868928 1263 33554432000 134512640 134936988 4292184512 18446744073709551615 134553311 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/20481/statm: 62468 1263 41 104 0 61972 0
[pid=20479/tid=20499] ppid=20430 vsize=373500 CPUtime=0 cores=0,2,4,6
/proc/20479/task/20499/stat : 20499 (python) S 20430 20430 20058 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538429657 382464000 6236 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604453948739968 0 0 -1 4 0 0 0
[pid=20483] ppid=20430 vsize=383756 CPUtime=0.51 cores=0,2,4,6
/proc/20483/stat : 20483 (python) S 20430 20430 20058 0 -1 4202560 1180 0 0 0 28 23 0 0 18 0 2 0 538419647 392966144 6240 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/20483/statm: 95939 6240 400 364 0 31827 0
[pid=20485] ppid=20483 vsize=268420 CPUtime=294.21 cores=0,2,4,6
/proc/20485/stat : 20485 (hybridGM3) T 20483 20485 20485 0 -1 4202496 5394 0 0 0 29419 2 0 0 25 0 1 0 538419647 274862080 5125 33554432000 134512640 135204385 4289219872 18446744073709551615 134538264 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/20485/statm: 67105 5125 63 169 0 66935 0
[pid=20483/tid=20516] ppid=20430 vsize=383756 CPUtime=0 cores=0,2,4,6
/proc/20483/task/20516/stat : 20516 (python) S 20430 20430 20058 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538439284 392966144 6240 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604449043935488 0 0 -1 4 0 0 0
[pid=20486] ppid=20430 vsize=393800 CPUtime=0.17 cores=0,2,4,6
/proc/20486/stat : 20486 (python) S 20430 20430 20058 0 -1 4202560 1156 0 0 0 9 8 0 0 19 0 2 0 538419651 403251200 6243 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/20486/statm: 98450 6243 399 364 0 34335 0
[pid=20488] ppid=20486 vsize=1019708 CPUtime=100.09 cores=0,2,4,6
/proc/20488/stat : 20488 (gnovelty+2) T 20486 20488 20488 0 -1 4202496 962 0 0 0 10008 1 0 0 25 0 1 0 538419651 1044180992 690 33554432000 134512640 135663704 4291736368 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/20488/statm: 254927 690 113 282 0 254643 0
[pid=20486/tid=20503] ppid=20430 vsize=393800 CPUtime=0 cores=0,2,4,6
/proc/20486/task/20503/stat : 20503 (python) S 20430 20430 20058 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 538429679 403251200 6243 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604453928037312 0 0 -1 0 0 0 0
[pid=20496] ppid=20430 vsize=404712 CPUtime=0.33 cores=0,2,4,6
/proc/20496/stat : 20496 (python) S 20430 20430 20058 0 -1 4202560 1172 0 0 0 17 16 0 0 18 0 2 0 538429654 414425088 6248 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/20496/statm: 101178 6248 400 364 0 37060 0
[pid=20498] ppid=20496 vsize=268424 CPUtime=196.17 cores=0,2,4,6
/proc/20498/stat : 20498 (hybridGM3) R 20496 20498 20498 0 -1 4202496 5395 0 0 0 19617 0 0 0 25 0 1 0 538429655 274866176 5126 33554432000 134512640 135204385 4292451136 18446744073709551615 134537939 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/20498/statm: 67106 5126 63 169 0 66936 0
[pid=20496/tid=20528] ppid=20430 vsize=404712 CPUtime=0 cores=0,2,4,6
/proc/20496/task/20528/stat : 20528 (python) S 20430 20430 20058 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538449292 414425088 6248 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604453985321024 0 0 -1 6 0 0 0
[pid=20500] ppid=20430 vsize=414484 CPUtime=0.16 cores=0,2,4,6
/proc/20500/stat : 20500 (python) S 20430 20430 20058 0 -1 4202560 1153 0 0 0 10 6 0 0 19 0 2 0 538429662 424431616 6294 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/20500/statm: 103621 6294 399 364 0 39500 0
[pid=20502] ppid=20500 vsize=420220 CPUtime=99.82 cores=0,2,4,6
/proc/20502/stat : 20502 (adaptg2wsat2009) T 20500 20502 20502 0 -1 4202496 1675 0 0 0 9981 1 0 0 25 0 1 0 538429662 430305280 1401 33554432000 134512640 135107411 4289647008 18446744073709551615 134531709 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/20502/statm: 105055 1401 59 146 0 103931 0
[pid=20500/tid=20517] ppid=20430 vsize=414484 CPUtime=0 cores=0,2,4,6
/proc/20500/task/20517/stat : 20517 (python) S 20430 20430 20058 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538439677 424431616 6294 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604453985322816 0 0 -1 6 0 0 0
[pid=20504] ppid=20430 vsize=425304 CPUtime=0.34 cores=0,2,4,6
/proc/20504/stat : 20504 (python) S 20430 20430 20058 0 -1 4202560 1224 0 0 0 18 16 0 0 19 0 2 0 538429683 435511296 6308 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/20504/statm: 106326 6308 408 364 0 42202 0
[pid=20506] ppid=20504 vsize=268424 CPUtime=196.37 cores=0,2,4,6
/proc/20506/stat : 20506 (hybridGM3) T 20504 20506 20506 0 -1 4202496 5404 0 0 0 19637 0 0 0 25 0 1 0 538429684 274866176 5127 33554432000 134512640 135204385 4291519488 18446744073709551615 134538494 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/20506/statm: 67106 5127 63 169 0 66936 0
[pid=20504/tid=20529] ppid=20430 vsize=425304 CPUtime=0 cores=0,2,4,6
/proc/20504/task/20529/stat : 20529 (python) S 20430 20430 20058 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538449322 435511296 6308 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 514 18446604449798534144 0 0 -1 2 0 0 0
[pid=20518] ppid=20430 vsize=435256 CPUtime=0.15 cores=0,2,4,6
/proc/20518/stat : 20518 (python) S 20430 20430 20058 0 -1 4202560 1070 0 0 0 9 6 0 0 18 0 1 0 538439682 445702144 6303 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 6876996630994714883 0 0 17 0 0 0 0
/proc/20518/statm: 108814 6303 380 364 0 44687 0
[pid=20520] ppid=20518 vsize=268428 CPUtime=97.66 cores=0,2,4,6
/proc/20520/stat : 20520 (hybridGM3) R 20518 20520 20520 0 -1 4202496 5402 0 0 0 9765 1 0 0 25 0 1 0 538439683 274870272 5127 33554432000 134512640 135204385 4294358752 18446744073709551615 134538041 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/20520/statm: 67107 5127 63 169 0 66937 0
[pid=20530] ppid=20430 vsize=446096 CPUtime=0 cores=0,2,4,6
/proc/20530/stat : 20530 (python) S 20430 20430 20058 0 -1 4202560 837 0 0 0 0 0 0 0 18 0 1 0 538449327 456802304 6278 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 17761497920126844927 0 0 17 0 0 0 0
/proc/20530/statm: 111524 6278 351 364 0 47394 0
[pid=20532] ppid=20530 vsize=454088 CPUtime=1.61 cores=0,2,4,6
/proc/20532/stat : 20532 (TNM) R 20530 20532 20532 0 -1 4202496 1268 0 0 0 161 0 0 0 25 0 1 0 538449327 464986112 995 33554432000 134512640 135008748 4286919728 18446744073709551615 134523384 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/20532/statm: 113522 995 45 122 0 112422 0
[pid=20533] ppid=20430 vsize=456204 CPUtime=0 cores=0,2,4,6
/proc/20533/stat : 20533 (python) S 20430 20430 20058 0 -1 4202560 817 0 0 0 0 0 0 0 19 0 1 0 538449410 467152896 6284 33554432000 4194304 5683644 140734940125312 18446744073709551615 212687695430 0 0 16781312 514 4460454795391533055 0 0 17 0 0 0 0
/proc/20533/statm: 114051 6284 347 364 0 49918 0
[pid=20535] ppid=20533 vsize=247956 CPUtime=0.78 cores=0,2,4,6
/proc/20535/stat : 20535 (FH) R 20533 20535 20535 0 -1 4202496 1258 0 0 0 78 0 0 0 22 0 1 0 538449411 253906944 986 33554432000 134512640 134936988 4294067232 18446744073709551615 134523434 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/20535/statm: 61989 986 37 104 0 61493 0
[pid=20430/tid=20437] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20437/stat : 20437 (python) S 20428 20430 20058 0 -1 4202560 26 933 0 0 0 0 0 0 23 0 19 0 538399594 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20440] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20440/stat : 20440 (python) S 20428 20430 20058 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 19 0 538399597 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
[pid=20430/tid=20443] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20443/stat : 20443 (python) S 20428 20430 20058 0 -1 4202560 24 933 0 0 0 0 0 0 22 0 19 0 538399600 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
[pid=20430/tid=20446] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20446/stat : 20446 (python) S 20428 20430 20058 0 -1 4202560 25 933 0 0 0 0 0 0 24 0 19 0 538399603 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 2 0 0 0
[pid=20430/tid=20455] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20455/stat : 20455 (python) S 20428 20430 20058 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 19 0 538409616 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20461] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20461/stat : 20461 (python) S 20428 20430 20058 0 -1 4202560 26 933 0 0 0 0 0 0 22 0 19 0 538409620 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 6 0 0 0
[pid=20430/tid=20464] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20464/stat : 20464 (python) S 20428 20430 20058 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 19 0 538409623 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 4 0 0 0
[pid=20430/tid=20467] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20467/stat : 20467 (python) S 20428 20430 20058 0 -1 4202560 26 933 0 0 0 0 0 0 22 0 19 0 538409627 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 4 0 0 0
[pid=20430/tid=20475] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20475/stat : 20475 (python) S 20428 20430 20058 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 19 0 538419634 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 4 0 0 0
[pid=20430/tid=20480] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20480/stat : 20480 (python) S 20428 20430 20058 0 -1 4202560 24 933 0 0 0 0 0 0 21 0 19 0 538419641 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 4 0 0 0
[pid=20430/tid=20484] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20484/stat : 20484 (python) S 20428 20430 20058 0 -1 4202560 27 933 0 0 0 0 0 0 18 0 19 0 538419647 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 4 0 0 0
[pid=20430/tid=20487] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20487/stat : 20487 (python) S 20428 20430 20058 0 -1 4202560 28 933 0 0 0 0 0 0 25 0 19 0 538419651 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20497] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20497/stat : 20497 (python) S 20428 20430 20058 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 19 0 538429655 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20501] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20501/stat : 20501 (python) S 20428 20430 20058 0 -1 4202560 29 933 0 0 0 0 0 0 21 0 19 0 538429662 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20505] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20505/stat : 20505 (python) S 20428 20430 20058 0 -1 4202560 28 933 0 0 0 0 0 0 21 0 19 0 538429684 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20519] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20519/stat : 20519 (python) S 20428 20430 20058 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 19 0 538439683 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20531] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20531/stat : 20531 (python) S 20428 20430 20058 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 19 0 538449327 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
[pid=20430/tid=20534] ppid=20428 vsize=465752 CPUtime=0 cores=0,2,4,6
/proc/20430/task/20534/stat : 20534 (python) S 20428 20430 20058 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 19 0 538449411 476930048 7852 33554432000 4194304 5683644 140734940125312 18446744073709551615 212699498929 0 0 16781312 2 18446604449798535936 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1988.96
Current children cumulated vsize (KiB) 15983168

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20430 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=509618
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=159975
# CPU time returned by wait4() is 2.66959
# while last known CPU time is 1988.96
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 502.32
CPU time (s): 1988.96
CPU user time (s): 1987.27
CPU system time (s): 1.69
CPU usage (%): 395.955
Max. virtual memory (cumulated for all children) (KiB): 15983168

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.50962
system time used= 0.159975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30201
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1251
involuntary context switches= 63

runsolver used 3.45247 second user time and 4.68629 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-01 18:40:15
IDJOB=3317184
IDBENCH=82649
IDSOLVER=1705
FILE ID=node139/3317184-1304268015
RUNJOBID= node139-1304267280-20076
PBS_JOBID= 13173940
Free space on /tmp= 73004 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S1158419275-045-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317184-1304268015/watcher-3317184-1304268015 -o /tmp/evaluation-result-3317184-1304268015/solver-3317184-1304268015 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317184-1304268015.cnf -seed 914171939 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ba96eb51c814e4238dd0a7b33e8bab2d
RANDOM SEED=914171939

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23876676 kB
Buffers:       2074048 kB
Cached:        6126500 kB
SwapCached:          4 kB
Active:        1710960 kB
Inactive:      6828412 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23876676 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           66180 kB
Writeback:           0 kB
AnonPages:      338224 kB
Mapped:          22880 kB
Slab:           463808 kB
PageTables:      11980 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 16889956 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72972 MiB
End job on node139 at 2011-05-01 18:48:40