Trace number 3317637

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (TO) 4075.7 1300.1

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v70-c6230-S560963242-048.UNKNOWN.cnf
MD5SUM3be09135963d2d9a560d20860022864d
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables70
Number of clauses6230
Sum of the clauses size43610
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 56230

Solver Data 

0.32/0.64	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.64	c INFO: solving HOME/instance-3317637-1304270669.cnf
0.32/0.64	c INFO: computing task features
0.32/0.68	c INFO: computed variable-clause graph statistics
0.32/0.68	c INFO: computed clause balance statistics
0.50/0.89	c INFO: computed variable balance statistics
0.60/0.98	c INFO: computed small-clause counts
0.60/0.98	c INFO: computed Horn-clause counts
0.60/0.99	c INFO: computed variable graph statistics
0.60/0.99	c INFO: collected features for HOME/instance-3317637-1304270669.cnf in 0.35 s
0.70/1.01	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.52)
0.70/1.05	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.10)
0.70/1.07	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.05)
0.93/1.11	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.04)
300.42/101.25	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.03)
300.87/101.40	c INFO: running gnovelty+2@0 for 97 with 4699 remaining (b = 0.02)
441.59/148.43	c INFO: running FH@0 for 97 with 4652 remaining (b = 0.02)
462.18/155.30	c INFO: running march_hi@0 for 388 with 4645 remaining (b = 0.07)
668.65/224.51	c INFO: running adaptg2wsat2009++@0 for 97 with 4576 remaining (b = 0.02)
758.44/254.66	c INFO: running march_hi@0 for 485 with 4546 remaining (b = 0.08)
809.52/271.76	c INFO: running adaptg2wsat2009++@0 for 97 with 4528 remaining (b = 0.01)
1021.39/342.75	c INFO: running adaptg2wsat2009++@99 for 97 with 4457 remaining (b = 0.01)
1204.26/404.03	c INFO: running FH@0 for 97 with 4396 remaining (b = 0.01)
1416.12/475.03	c INFO: running march_hi@0 for 485 with 4325 remaining (b = 0.07)
1802.33/600.55	c INFO: running hybridGM3@0 for 194 with 4200 remaining (b = 0.03)
2156.79/705.39	c INFO: running march_hi@97 for 291 with 4095 remaining (b = 0.05)
2449.65/789.43	c INFO: running march_hi@97 for 291 with 4011 remaining (b = 0.05)
2517.94/809.04	c INFO: running gnovelty+2@0 for 97 with 3991 remaining (b = 0.01)
2972.86/939.55	c INFO: running march_hi@0 for 485 with 3861 remaining (b = 0.06)
3220.23/1021.92	c INFO: running march_hi@99 for 291 with 3778 remaining (b = 0.04)
3402.66/1074.34	c INFO: running march_hi@587 for 1552 with 3726 remaining (b = 0.18)
3566.06/1129.14	c INFO: running march_hi@291 for 97 with 3671 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317637-1304270669/watcher-3317637-1304270669 -o /tmp/evaluation-result-3317637-1304270669/solver-3317637-1304270669 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317637-1304270669.cnf -seed 1262470772 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.82 10.01 9.18 7/253 8397
/proc/meminfo: memFree=28671528/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=15784 CPUtime=0 cores=0,2,4,6
/proc/8397/stat : 8397 (python) R 8395 8397 7090 0 -1 4202496 832 0 0 0 0 0 0 0 25 0 1 0 617297516 16162816 716 33554432000 4194304 5683644 140735313664176 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8397/statm: 3946 720 334 364 0 433 0

[startup+0.102058 s]
/proc/loadavg: 9.82 10.01 9.18 7/253 8397
/proc/meminfo: memFree=28671528/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=93964 CPUtime=0.05 cores=0,2,4,6
/proc/8397/stat : 8397 (python) S 8395 8397 7090 0 -1 4202496 2694 0 0 0 4 1 0 0 25 0 1 0 617297516 96219136 2407 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020393984 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/8397/statm: 23491 2407 764 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93964

[startup+0.202547 s]
/proc/loadavg: 9.82 10.01 9.18 7/253 8397
/proc/meminfo: memFree=28671528/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=126304 CPUtime=0.11 cores=0,2,4,6
/proc/8397/stat : 8397 (python) S 8395 8397 7090 0 -1 4202496 4566 468 1 0 8 3 0 0 18 0 1 0 617297516 129335296 3895 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020395776 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/8397/statm: 31576 3895 1001 364 0 2871 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 126304

[startup+0.301011 s]
/proc/loadavg: 9.82 10.01 9.18 7/253 8397
/proc/meminfo: memFree=28671528/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=135752 CPUtime=0.17 cores=0,2,4,6
/proc/8397/stat : 8397 (python) S 8395 8397 7090 0 -1 4202496 5965 935 1 0 13 4 0 0 17 0 1 0 617297516 139010048 4151 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020391941 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/8397/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135752

[startup+0.700937 s]
/proc/loadavg: 9.82 10.01 9.18 7/253 8397
/proc/meminfo: memFree=28671528/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=279752 CPUtime=0.4 cores=0,2,4,6
/proc/8397/stat : 8397 (python) R 8395 8397 7090 0 -1 4202496 10028 935 1 0 33 7 0 0 16 0 1 0 617297516 286466048 7322 33554432000 4194304 5683644 140735313664176 18446744073709551615 47476074285873 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/8397/statm: 69938 7322 1826 364 0 5862 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 279752

[startup+1.50079 s]
/proc/loadavg: 9.82 10.01 9.18 11/262 8410
/proc/meminfo: memFree=28635728/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=320136 CPUtime=0.81 cores=0,2,4,6
/proc/8397/stat : 8397 (python) S 8395 8397 7090 0 -1 4202496 12968 935 1 0 73 8 0 0 25 0 5 0 617297516 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8397/statm: 80034 7248 1883 364 0 15943 0
[pid=8403] ppid=8397 vsize=278752 CPUtime=0 cores=0,2,4,6
/proc/8403/stat : 8403 (python) S 8397 8397 7090 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 617297618 285442048 5626 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416015 0 0 16781312 514 4370949326210334719 0 0 17 6 0 0 0
/proc/8403/statm: 69688 5626 354 364 0 5606 0
[pid=8405] ppid=8403 vsize=1018076 CPUtime=0.29 cores=0,2,4,6
/proc/8405/stat : 8405 (gnovelty+2) R 8403 8405 8405 0 -1 4202496 532 0 0 0 29 0 0 0 20 0 1 0 617297619 1042509824 267 33554432000 134512640 135663704 4289368464 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8405/statm: 254519 267 113 282 0 254235 0
[pid=8406] ppid=8397 vsize=289380 CPUtime=0 cores=0,2,4,6
/proc/8406/stat : 8406 (python) S 8397 8397 7090 0 -1 4202560 746 0 0 0 0 0 0 0 20 0 1 0 617297621 296325120 5701 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 6156263739625570303 0 0 17 0 0 0 0
/proc/8406/statm: 72345 5701 348 364 0 8260 0
[pid=8408] ppid=8406 vsize=1018076 CPUtime=0.44 cores=0,2,4,6
/proc/8408/stat : 8408 (gnovelty+2) R 8406 8408 8408 0 -1 4202496 530 0 0 0 44 0 0 0 23 0 1 0 617297622 1042509824 267 33554432000 134512640 135663704 4289440512 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8408/statm: 254519 267 113 282 0 254235 0
[pid=8409] ppid=8397 vsize=299636 CPUtime=0 cores=0,2,4,6
/proc/8409/stat : 8409 (python) S 8397 8397 7090 0 -1 4202560 722 0 0 0 0 0 0 0 22 0 1 0 617297624 306827264 5701 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 2583228631597711359 0 0 17 6 0 0 0
/proc/8409/statm: 74909 5701 344 364 0 10821 0
[pid=8397/tid=8404] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8404/stat : 8404 (python) S 8395 8397 7090 0 -1 4202560 26 935 0 0 0 0 0 0 19 0 5 0 617297619 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 0 0 0 0
[pid=8397/tid=8407] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8407/stat : 8407 (python) S 8395 8397 7090 0 -1 4202560 21 935 0 0 0 0 0 0 21 0 5 0 617297622 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 0 0 0 0
[pid=8397/tid=8410] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8410/stat : 8410 (python) S 8395 8397 7090 0 -1 4202560 20 935 0 0 0 0 0 0 23 0 5 0 617297624 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1.54
Current children cumulated vsize (KiB) 3224056

[startup+3.1015 s]
/proc/loadavg: 9.82 10.01 9.18 11/266 8414
/proc/meminfo: memFree=28628748/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=320136 CPUtime=0.81 cores=0,2,4,6
/proc/8397/stat : 8397 (python) S 8395 8397 7090 0 -1 4202496 12968 935 1 0 73 8 0 0 25 0 5 0 617297516 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8397/statm: 80034 7248 1883 364 0 15943 0
[pid=8403] ppid=8397 vsize=278752 CPUtime=0 cores=0,2,4,6
/proc/8403/stat : 8403 (python) S 8397 8397 7090 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 617297618 285442048 5626 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416015 0 0 16781312 514 4370949326210302212 0 0 17 6 0 0 0
/proc/8403/statm: 69688 5626 354 364 0 5606 0
[pid=8405] ppid=8403 vsize=1018076 CPUtime=1.09 cores=0,2,4,6
/proc/8405/stat : 8405 (gnovelty+2) R 8403 8405 8405 0 -1 4202496 532 0 0 0 109 0 0 0 22 0 1 0 617297619 1042509824 267 33554432000 134512640 135663704 4289368464 18446744073709551615 134524553 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8405/statm: 254519 267 113 282 0 254235 0
[pid=8406] ppid=8397 vsize=289380 CPUtime=0 cores=0,2,4,6
/proc/8406/stat : 8406 (python) S 8397 8397 7090 0 -1 4202560 746 0 0 0 0 0 0 0 18 0 1 0 617297621 296325120 5701 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 6156263739625537793 0 0 17 0 0 0 0
/proc/8406/statm: 72345 5701 348 364 0 8260 0
[pid=8408] ppid=8406 vsize=1018076 CPUtime=2.04 cores=0,2,4,6
/proc/8408/stat : 8408 (gnovelty+2) R 8406 8408 8408 0 -1 4202496 530 0 0 0 204 0 0 0 25 0 1 0 617297622 1042509824 267 33554432000 134512640 135663704 4289440512 18446744073709551615 134525715 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8408/statm: 254519 267 113 282 0 254235 0
[pid=8409] ppid=8397 vsize=299636 CPUtime=0 cores=0,2,4,6
/proc/8409/stat : 8409 (python) S 8397 8397 7090 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 617297624 306827264 5705 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 2583228631597711359 0 0 17 6 0 0 0
/proc/8409/statm: 74909 5705 348 364 0 10821 0
[pid=8411] ppid=8409 vsize=416920 CPUtime=1.96 cores=0,2,4,6
/proc/8411/stat : 8411 (adaptg2wsat2009) R 8409 8411 8411 0 -1 4202496 670 0 0 0 196 0 0 0 25 0 1 0 617297627 426926080 405 33554432000 134512640 135107411 4291688608 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8411/statm: 104230 405 59 146 0 103106 0
[pid=8412] ppid=8397 vsize=309892 CPUtime=0 cores=0,2,4,6
/proc/8412/stat : 8412 (python) S 8397 8397 7090 0 -1 4202560 758 0 0 0 0 0 0 0 18 0 1 0 617297628 317329408 5709 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 2583220935016316927 0 0 17 6 0 0 0
/proc/8412/statm: 77473 5709 348 364 0 13382 0
[pid=8414] ppid=8412 vsize=416920 CPUtime=0.97 cores=0,2,4,6
/proc/8414/stat : 8414 (adaptg2wsat2009) R 8412 8414 8414 0 -1 4202496 671 0 0 0 97 0 0 0 25 0 1 0 617297629 426926080 406 33554432000 134512640 135107411 4288619936 18446744073709551615 134532264 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8414/statm: 104230 406 59 146 0 103106 0
[pid=8397/tid=8404] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8404/stat : 8404 (python) S 8395 8397 7090 0 -1 4202560 26 935 0 0 0 0 0 0 19 0 5 0 617297619 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 0 0 0 0
[pid=8397/tid=8407] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8407/stat : 8407 (python) S 8395 8397 7090 0 -1 4202560 21 935 0 0 0 0 0 0 21 0 5 0 617297622 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 0 0 0 0
[pid=8397/tid=8410] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8410/stat : 8410 (python) S 8395 8397 7090 0 -1 4202560 20 935 0 0 0 0 0 0 23 0 5 0 617297624 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8413] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8413/stat : 8413 (python) S 8395 8397 7090 0 -1 4202560 24 935 0 0 0 0 0 0 25 0 5 0 617297629 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.87
Current children cumulated vsize (KiB) 4367788

[startup+6.30091 s]
/proc/loadavg: 9.84 10.01 9.18 11/266 8414
/proc/meminfo: memFree=28624412/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=320136 CPUtime=0.81 cores=0,2,4,6
/proc/8397/stat : 8397 (python) S 8395 8397 7090 0 -1 4202496 12968 935 1 0 73 8 0 0 25 0 5 0 617297516 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8397/statm: 80034 7248 1883 364 0 15943 0
[pid=8403] ppid=8397 vsize=278752 CPUtime=0 cores=0,2,4,6
/proc/8403/stat : 8403 (python) S 8397 8397 7090 0 -1 4202560 912 0 0 0 0 0 0 0 18 0 1 0 617297618 285442048 5649 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416015 0 0 16781312 514 4370949326210302212 0 0 17 6 0 0 0
/proc/8403/statm: 69688 5649 377 364 0 5606 0
[pid=8405] ppid=8403 vsize=1018076 CPUtime=2.69 cores=0,2,4,6
/proc/8405/stat : 8405 (gnovelty+2) R 8403 8405 8405 0 -1 4202496 532 0 0 0 269 0 0 0 25 0 1 0 617297619 1042509824 267 33554432000 134512640 135663704 4289368464 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8405/statm: 254519 267 113 282 0 254235 0
[pid=8406] ppid=8397 vsize=289380 CPUtime=0 cores=0,2,4,6
/proc/8406/stat : 8406 (python) S 8397 8397 7090 0 -1 4202560 914 0 0 0 0 0 0 0 18 0 1 0 617297621 296325120 5724 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 6156263739625537793 0 0 17 0 0 0 0
/proc/8406/statm: 72345 5724 371 364 0 8260 0
[pid=8408] ppid=8406 vsize=1018076 CPUtime=5.23 cores=0,2,4,6
/proc/8408/stat : 8408 (gnovelty+2) R 8406 8408 8408 0 -1 4202496 530 0 0 0 523 0 0 0 25 0 1 0 617297622 1042509824 267 33554432000 134512640 135663704 4289440512 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8408/statm: 254519 267 113 282 0 254235 0
[pid=8409] ppid=8397 vsize=299636 CPUtime=0 cores=0,2,4,6
/proc/8409/stat : 8409 (python) S 8397 8397 7090 0 -1 4202560 896 0 0 0 0 0 0 0 18 0 1 0 617297624 306827264 5728 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 2583228631597678850 0 0 17 6 0 0 0
/proc/8409/statm: 74909 5728 371 364 0 10821 0
[pid=8411] ppid=8409 vsize=416920 CPUtime=5.11 cores=0,2,4,6
/proc/8411/stat : 8411 (adaptg2wsat2009) R 8409 8411 8411 0 -1 4202496 670 0 0 0 511 0 0 0 25 0 1 0 617297627 426926080 405 33554432000 134512640 135107411 4291688608 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8411/statm: 104230 405 59 146 0 103106 0
[pid=8412] ppid=8397 vsize=309892 CPUtime=0 cores=0,2,4,6
/proc/8412/stat : 8412 (python) S 8397 8397 7090 0 -1 4202560 919 0 0 0 0 0 0 0 18 0 1 0 617297628 317329408 5732 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 2583220935016284418 0 0 17 6 0 0 0
/proc/8412/statm: 77473 5732 371 364 0 13382 0
[pid=8414] ppid=8412 vsize=416920 CPUtime=2.57 cores=0,2,4,6
/proc/8414/stat : 8414 (adaptg2wsat2009) R 8412 8414 8414 0 -1 4202496 671 0 0 0 257 0 0 0 25 0 1 0 617297629 426926080 406 33554432000 134512640 135107411 4288619936 18446744073709551615 134531848 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8414/statm: 104230 406 59 146 0 103106 0
[pid=8397/tid=8404] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8404/stat : 8404 (python) S 8395 8397 7090 0 -1 4202560 26 935 0 0 0 0 0 0 19 0 5 0 617297619 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 0 0 0 0
[pid=8397/tid=8407] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8407/stat : 8407 (python) S 8395 8397 7090 0 -1 4202560 21 935 0 0 0 0 0 0 21 0 5 0 617297622 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 0 0 0 0
[pid=8397/tid=8410] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8410/stat : 8410 (python) S 8395 8397 7090 0 -1 4202560 20 935 0 0 0 0 0 0 23 0 5 0 617297624 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8413] ppid=8395 vsize=320136 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8413/stat : 8413 (python) S 8395 8397 7090 0 -1 4202560 24 935 0 0 0 0 0 0 25 0 5 0 617297629 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16.41
Current children cumulated vsize (KiB) 4367788

[startup+12.7007 s]
/proc/loadavg: 9.93 10.02 9.19 11/266 8414
/proc/meminfo: memFree=28620652/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=320136 CPUtime=0.81 cores=0,2,4,6
/proc/8397/stat : 8397 (python) S 8395 8397 7090 0 -1 4202496 12968 935 1 0 73 8 0 0 25 0 5 0 617297516 327819264 7248 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8397/statm: 80034 7248 1883 364 0 15943 0
[pid=8403] ppid=8397 vsize=278752 CPUtime=0.01 cores=0,2,4,6
/proc/8403/stat : 8403 (python) S 8397 8397 7090 0 -1 4202560 914 0 0 0 0 1 0 0 18 0 1 0 617297618 285442048 5649 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416015 0 0 16781312 514 17066214866060017924 0 0 17 6 0 0 0
/proc/8403/statm: 69688 5649 377 364 0 5606 0
[pid=8405] ppid=8403 vsize=1018076 CPUtime=5.89 cores=0,2,4,6
/proc/8405/stat : 8405 (gnovelty+2) R 8403 8405 8405 0 -1 4202496 532 0 0 0 589 0 0 0 25 0 1 0 617297619 1042509824 267 33554432000 134512640 135663704 4289368464 18446744073709551615 134546746 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8405/statm: 254519 267 113 282 0 254235 0
[pid=8406] ppid=8397 vsize=289380 CPUtime=0.01 cores=0,2,4,6
/proc/8406/stat : 8406 (python) S 8397 8397 7090 0 -1 4202560 917 0 0 0 1 0 0 0 18 0 1 0 617297621 296325120 5724 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 17066214866060017921 0 0 17 0 0 0 0
/proc/8406/statm: 72345 5724 371 364 0 8260 0
[pid=8408] ppid=8406 vsize=1018076 CPUtime=11.62 cores=0,2,4,6
/proc/8408/stat : 8408 (gnovelty+2) R 8406 8408 8408 0 -1 4202496 530 0 0 0 1162 0 0 0 25 0 1 0 617297622 1042509824 267 33554432000 134512640 135663704 4289440512 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8408/statm: 254519 267 113 282 0 254235 0
[pid=8409] ppid=8397 vsize=299636 CPUtime=0.01 cores=0,2,4,6
/proc/8409/stat : 8409 (python) S 8397 8397 7090 0 -1 4202560 899 0 0 0 0 1 0 0 18 0 1 0 617297624 306827264 5728 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 17066214866060017922 0 0 17 6 0 0 0
/proc/8409/statm: 74909 5728 371 364 0 10821 0
[pid=8411] ppid=8409 vsize=416920 CPUtime=11.43 cores=0,2,4,6
/proc/8411/stat : 8411 (adaptg2wsat2009) R 8409 8411 8411 0 -1 4202496 670 0 0 0 1143 0 0 0 25 0 1 0 617297627 426926080 405 33554432000 134512640 135107411 4291688608 18446744073709551615 134532242 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8411/statm: 104230 405 59 146 0 103106 0

################
# More data... #
################

[startup+1300 s]
/proc/loadavg: 6.20 7.47 8.70 7/290 8528
/proc/meminfo: memFree=28094260/32951124 swapFree=67111464/67111528
[pid=8397] ppid=8395 vsize=433704 CPUtime=1.47 cores=0,2,4,6
/proc/8397/stat : 8397 (python) S 8395 8397 7090 0 -1 4202496 24011 935 1 0 136 11 0 0 18 0 16 0 617297516 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8397/statm: 108426 7519 1906 364 0 44302 0
[pid=8403] ppid=8397 vsize=288996 CPUtime=0.25 cores=0,2,4,6
/proc/8403/stat : 8403 (python) S 8397 8397 7090 0 -1 4202560 1113 0 0 0 13 12 0 0 19 0 2 0 617297618 295931904 5687 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8403/statm: 72249 5687 410 364 0 8167 0
[pid=8405] ppid=8403 vsize=1018076 CPUtime=100.02 cores=0,2,4,6
/proc/8405/stat : 8405 (gnovelty+2) T 8403 8405 8405 0 -1 4202496 532 0 0 0 10002 0 0 0 25 0 1 0 617297619 1042509824 267 33554432000 134512640 135663704 4289368464 18446744073709551615 134545786 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8405/statm: 254519 267 113 282 0 254235 0
[pid=8403/tid=8432] ppid=8397 vsize=288996 CPUtime=0 cores=0,2,4,6
/proc/8403/task/8432/stat : 8432 (python) S 8397 8397 7090 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 617313044 295931904 5687 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604453930384192 0 0 -1 4 0 0 0
[pid=8406] ppid=8397 vsize=289380 CPUtime=0.16 cores=0,2,4,6
/proc/8406/stat : 8406 (python) S 8397 8397 7090 0 -1 4202560 1096 0 0 0 7 9 0 0 19 0 2 0 617297621 296325120 5754 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/8406/statm: 72345 5754 400 364 0 8260 0
[pid=8408] ppid=8406 vsize=1018076 CPUtime=99.99 cores=0,2,4,6
/proc/8408/stat : 8408 (gnovelty+2) T 8406 8408 8408 0 -1 4202496 530 0 0 0 9999 0 0 0 25 0 1 0 617297622 1042509824 267 33554432000 134512640 135663704 4289440512 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8408/statm: 254519 267 113 282 0 254235 0
[pid=8406/tid=8418] ppid=8397 vsize=289380 CPUtime=0 cores=0,2,4,6
/proc/8406/task/8418/stat : 8418 (python) S 8397 8397 7090 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 617307639 296325120 5754 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604441461158208 0 0 -1 0 0 0 0
[pid=8409] ppid=8397 vsize=299636 CPUtime=0.42 cores=0,2,4,6
/proc/8409/stat : 8409 (python) S 8397 8397 7090 0 -1 4202560 1123 0 0 0 21 21 0 0 18 0 2 0 617297624 306827264 5758 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8409/statm: 74909 5758 400 364 0 10821 0
[pid=8411] ppid=8409 vsize=416920 CPUtime=194.49 cores=0,2,4,6
/proc/8411/stat : 8411 (adaptg2wsat2009) T 8409 8411 8411 0 -1 4202496 670 0 0 0 19449 0 0 0 25 0 1 0 617297627 426926080 405 33554432000 134512640 135107411 4291688608 18446744073709551615 134531848 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8411/statm: 104230 405 59 146 0 103106 0
[pid=8409/tid=8422] ppid=8397 vsize=299636 CPUtime=0 cores=0,2,4,6
/proc/8409/task/8422/stat : 8422 (python) S 8397 8397 7090 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 617307647 306827264 5758 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604440629246144 0 0 -1 6 0 0 0
[pid=8412] ppid=8397 vsize=309892 CPUtime=0.51 cores=0,2,4,6
/proc/8412/stat : 8412 (python) S 8397 8397 7090 0 -1 4202560 1167 0 0 0 26 25 0 0 18 0 2 0 617297628 317329408 5762 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8412/statm: 77473 5762 400 364 0 13382 0
[pid=8414] ppid=8412 vsize=416920 CPUtime=195.28 cores=0,2,4,6
/proc/8414/stat : 8414 (adaptg2wsat2009) T 8412 8414 8414 0 -1 4202496 671 0 0 0 19528 0 0 0 25 0 1 0 617297629 426926080 406 33554432000 134512640 135107411 4288619936 18446744073709551615 134531720 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8414/statm: 104230 406 59 146 0 103106 0
[pid=8412/tid=8428] ppid=8397 vsize=309892 CPUtime=0 cores=0,2,4,6
/proc/8412/task/8428/stat : 8428 (python) S 8397 8397 7090 0 -1 4202560 50 0 0 0 0 0 0 0 18 0 2 0 617312357 317329408 5762 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604440629244352 0 0 -1 6 0 0 0
[pid=8419] ppid=8397 vsize=320148 CPUtime=0.23 cores=0,2,4,6
/proc/8419/stat : 8419 (python) S 8397 8397 7090 0 -1 4202560 1129 0 0 0 12 11 0 0 19 0 2 0 617307642 327831552 5775 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8419/statm: 80037 5775 400 364 0 15943 0
[pid=8421] ppid=8419 vsize=416920 CPUtime=97.92 cores=0,2,4,6
/proc/8421/stat : 8421 (adaptg2wsat2009) T 8419 8421 8421 0 -1 4202496 670 0 0 0 9791 1 0 0 25 0 1 0 617307642 426926080 406 33554432000 134512640 135107411 4286717904 18446744073709551615 134532235 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8421/statm: 104230 406 59 146 0 103106 0
[pid=8419/tid=8438] ppid=8397 vsize=320148 CPUtime=0 cores=0,2,4,6
/proc/8419/task/8438/stat : 8438 (python) S 8397 8397 7090 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 617319964 327831552 5775 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604440629245248 0 0 -1 6 0 0 0
[pid=8423] ppid=8397 vsize=330144 CPUtime=0.31 cores=0,2,4,6
/proc/8423/stat : 8423 (python) S 8397 8397 7090 0 -1 4202560 1146 0 0 0 14 17 0 0 19 0 2 0 617307657 338067456 5709 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8423/statm: 82536 5709 400 364 0 18439 0
[pid=8425] ppid=8423 vsize=1018076 CPUtime=97.61 cores=0,2,4,6
/proc/8425/stat : 8425 (gnovelty+2) T 8423 8425 8425 0 -1 4202496 535 0 0 0 9761 0 0 0 25 0 1 0 617307657 1042509824 268 33554432000 134512640 135663704 4289583312 18446744073709551615 134524540 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8425/statm: 254519 268 113 282 0 254235 0
[pid=8423/tid=8447] ppid=8397 vsize=330144 CPUtime=0 cores=0,2,4,6
/proc/8423/task/8447/stat : 8447 (python) S 8397 8397 7090 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 617324689 338067456 5709 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604445037777152 0 0 -1 0 0 0 0
[pid=8429] ppid=8397 vsize=340972 CPUtime=0.19 cores=0,2,4,6
/proc/8429/stat : 8429 (python) S 8397 8397 7090 0 -1 4202560 1190 0 0 0 10 9 0 0 19 0 2 0 617312360 349155328 5842 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8429/statm: 85243 5842 406 364 0 21143 0
[pid=8431] ppid=8429 vsize=247064 CPUtime=102.78 cores=0,2,4,6
/proc/8431/stat : 8431 (FH) T 8429 8431 8431 0 -1 4202496 630 0 0 0 10278 0 0 0 25 0 1 0 617312361 252993536 365 33554432000 134512640 134936988 4294643552 18446744073709551615 134547063 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8431/statm: 61766 365 41 104 0 61270 0
[pid=8429/tid=8443] ppid=8397 vsize=340972 CPUtime=0 cores=0,2,4,6
/proc/8429/task/8443/stat : 8443 (python) S 8397 8397 7090 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 617322980 349155328 5842 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604453907802240 0 0 -1 2 0 0 0
[pid=8433] ppid=8397 vsize=351228 CPUtime=2.24 cores=0,2,4,6
/proc/8433/stat : 8433 (python) S 8397 8397 7090 0 -1 4202560 1222 0 0 0 119 105 0 0 15 0 2 0 617313047 359657472 5869 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/8433/statm: 87807 5869 406 364 0 23704 0
[pid=8435] ppid=8433 vsize=92984 CPUtime=890.22 cores=0,2,4,6
/proc/8435/stat : 8435 (march_hi) R 8433 8435 8435 0 -1 4202496 22294 0 0 0 89013 9 0 0 25 0 1 0 617313047 95215616 21139 33554432000 4194304 4955518 140736762369104 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8435/statm: 23246 21139 106 186 0 23059 0
[pid=8433/tid=8476] ppid=8397 vsize=351228 CPUtime=0 cores=0,2,4,6
/proc/8433/task/8476/stat : 8476 (python) S 8397 8397 7090 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 617368052 359657472 5869 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604447685466176 0 0 -1 2 0 0 0
[pid=8439] ppid=8397 vsize=361484 CPUtime=0.21 cores=0,2,4,6
/proc/8439/stat : 8439 (python) S 8397 8397 7090 0 -1 4202560 1147 0 0 0 11 10 0 0 19 0 2 0 617319968 370159616 5867 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8439/statm: 90371 5867 400 364 0 26265 0
[pid=8441] ppid=8439 vsize=416920 CPUtime=100.95 cores=0,2,4,6
/proc/8441/stat : 8441 (adaptg2wsat2009) T 8439 8441 8441 0 -1 4202496 679 0 0 0 10095 0 0 0 25 0 1 0 617319968 426926080 407 33554432000 134512640 135107411 4294266560 18446744073709551615 134531935 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8441/statm: 104230 407 59 146 0 103106 0
[pid=8439/tid=8451] ppid=8397 vsize=361484 CPUtime=0 cores=0,2,4,6
/proc/8439/task/8451/stat : 8451 (python) S 8397 8397 7090 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 617331789 370159616 5867 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604446184581056 0 0 -1 4 0 0 0
[pid=8444] ppid=8397 vsize=371884 CPUtime=2.05 cores=0,2,4,6
/proc/8444/stat : 8444 (python) S 8397 8397 7090 0 -1 4202560 1200 0 0 0 111 94 0 0 15 0 2 0 617322983 380809216 5884 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/8444/statm: 92971 5884 400 364 0 28862 0
[pid=8446] ppid=8444 vsize=92984 CPUtime=862.89 cores=0,2,4,6
/proc/8446/stat : 8446 (march_hi) R 8444 8446 8446 0 -1 4202496 21559 0 0 0 86278 11 0 0 25 0 1 0 617322985 95215616 20405 33554432000 4194304 4955518 140733227058336 18446744073709551615 4297483 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8446/statm: 23246 20405 106 186 0 23059 0
[pid=8444/tid=8479] ppid=8397 vsize=371884 CPUtime=0 cores=0,2,4,6
/proc/8444/task/8479/stat : 8479 (python) S 8397 8397 7090 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 617376456 380809216 5884 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604443857797184 0 0 -1 0 0 0 0
[pid=8454] ppid=8397 vsize=382140 CPUtime=0.35 cores=0,2,4,6
/proc/8454/stat : 8454 (python) S 8397 8397 7090 0 -1 4202560 1174 0 0 0 18 17 0 0 19 0 2 0 617337920 391311360 5903 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8454/statm: 95535 5903 400 364 0 31423 0
[pid=8456] ppid=8454 vsize=247068 CPUtime=99.68 cores=0,2,4,6
/proc/8456/stat : 8456 (FH) T 8454 8456 8456 0 -1 4202496 638 0 0 0 9968 0 0 0 25 0 1 0 617337921 252997632 366 33554432000 134512640 134936988 4293768064 18446744073709551615 134553428 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8456/statm: 61767 366 41 104 0 61271 0
[pid=8454/tid=8469] ppid=8397 vsize=382140 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8469/stat : 8469 (python) S 8397 8397 7090 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 617357568 391311360 5903 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604453918492608 0 0 -1 4 0 0 0
[pid=8463] ppid=8397 vsize=392396 CPUtime=1.63 cores=0,2,4,6
/proc/8463/stat : 8463 (python) S 8397 8397 7090 0 -1 4202560 1217 0 0 0 82 81 0 0 16 0 2 0 617345019 401813504 5923 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8463/statm: 98099 5923 400 364 0 33984 0
[pid=8465] ppid=8463 vsize=92984 CPUtime=709.26 cores=0,2,4,6
/proc/8465/stat : 8465 (march_hi) R 8463 8465 8465 0 -1 4202496 18352 0 0 0 70919 7 0 0 25 0 1 0 617345020 95215616 17198 33554432000 4194304 4955518 140737289457104 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8465/statm: 23246 17198 106 186 0 23059 0
[pid=8463/tid=8520] ppid=8397 vsize=392396 CPUtime=0 cores=0,2,4,6
/proc/8463/task/8520/stat : 8520 (python) S 8397 8397 7090 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 617399704 401813504 5923 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604453921984768 0 0 -1 4 0 0 0
[pid=8470] ppid=8397 vsize=402652 CPUtime=0.38 cores=0,2,4,6
/proc/8470/stat : 8470 (python) S 8397 8397 7090 0 -1 4202560 1194 0 0 0 21 17 0 0 19 0 2 0 617357572 412315648 5927 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8470/statm: 100663 5927 400 364 0 36545 0
[pid=8472] ppid=8470 vsize=268428 CPUtime=194.3 cores=0,2,4,6
/proc/8472/stat : 8472 (hybridGM3) T 8470 8472 8472 0 -1 4202496 4903 0 0 0 19430 0 0 0 25 0 1 0 617357573 274870272 4630 33554432000 134512640 135204385 4289557840 18446744073709551615 134537376 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8472/statm: 67107 4630 64 169 0 66937 0
[pid=8470/tid=8480] ppid=8397 vsize=402652 CPUtime=0 cores=0,2,4,6
/proc/8470/task/8480/stat : 8480 (python) S 8397 8397 7090 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 617378417 412315648 5927 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604453913479104 0 0 -1 4 0 0 0
[pid=8481] ppid=8397 vsize=413204 CPUtime=0.23 cores=0,2,4,6
/proc/8481/stat : 8481 (python) S 8397 8397 7090 0 -1 4202560 1187 0 0 0 12 11 0 0 19 0 2 0 617378421 423120896 5974 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032222667 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8481/statm: 103301 5974 400 364 0 39180 0
[pid=8483] ppid=8481 vsize=1018076 CPUtime=97.49 cores=0,2,4,6
/proc/8483/stat : 8483 (gnovelty+2) T 8481 8483 8483 0 -1 4202496 537 0 0 0 9749 0 0 0 25 0 1 0 617378431 1042509824 266 33554432000 134512640 135663704 4293480288 18446744073709551615 134525136 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8483/statm: 254519 266 113 282 0 254235 0
[pid=8481/tid=8491] ppid=8397 vsize=413204 CPUtime=0 cores=0,2,4,6
/proc/8481/task/8491/stat : 8491 (python) S 8397 8397 7090 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 617391468 423120896 5974 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 514 18446604453495842624 0 0 -1 4 0 0 0
[pid=8492] ppid=8397 vsize=423460 CPUtime=0.72 cores=0,2,4,6
/proc/8492/stat : 8492 (python) S 8397 8397 7090 0 -1 4202560 1097 0 0 0 38 34 0 0 15 0 1 0 617391472 433623040 5955 33554432000 4194304 5683644 140735313664176 18446744073709551615 260020416070 0 0 16781312 514 17066214866060017924 0 0 17 6 0 0 0
/proc/8492/statm: 105865 5955 378 364 0 41741 0
[pid=8494] ppid=8492 vsize=29416 CPUtime=221.47 cores=0,2,4,6
/proc/8494/stat : 8494 (march_hi) R 8492 8494 8494 0 -1 4202496 7161 0 0 0 22144 3 0 0 25 0 1 0 617391472 30121984 6003 33554432000 4194304 4955518 140736307222320 18446744073709551615 4297490 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8494/statm: 7354 6003 106 186 0 7167 0
[pid=8397/tid=8404] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8404/stat : 8404 (python) S 8395 8397 7090 0 -1 4202560 26 935 0 0 0 0 0 0 19 0 16 0 617297619 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 0 0 0 0
[pid=8397/tid=8407] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8407/stat : 8407 (python) S 8395 8397 7090 0 -1 4202560 21 935 0 0 0 0 0 0 21 0 16 0 617297622 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 0 0 0 0
[pid=8397/tid=8410] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8410/stat : 8410 (python) S 8395 8397 7090 0 -1 4202560 23 935 0 0 0 0 0 0 18 0 16 0 617297624 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8413] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8413/stat : 8413 (python) S 8395 8397 7090 0 -1 4202560 29 935 0 0 0 0 0 0 18 0 16 0 617297629 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8420] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8420/stat : 8420 (python) S 8395 8397 7090 0 -1 4202560 26 935 0 0 0 0 0 0 20 0 16 0 617307642 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8424] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8424/stat : 8424 (python) S 8395 8397 7090 0 -1 4202560 25 935 0 0 0 0 0 0 21 0 16 0 617307657 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8430] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8430/stat : 8430 (python) S 8395 8397 7090 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 16 0 617312361 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8434] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8434/stat : 8434 (python) S 8395 8397 7090 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 16 0 617313047 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8440] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8440/stat : 8440 (python) S 8395 8397 7090 0 -1 4202560 29 935 0 0 0 0 0 0 20 0 16 0 617319968 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8445] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8445/stat : 8445 (python) S 8395 8397 7090 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 16 0 617322984 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8455] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8455/stat : 8455 (python) S 8395 8397 7090 0 -1 4202560 32 935 0 0 0 0 0 0 20 0 16 0 617337920 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8464] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8464/stat : 8464 (python) S 8395 8397 7090 0 -1 4202560 33 935 0 0 0 0 0 0 18 0 16 0 617345020 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8471] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8471/stat : 8471 (python) S 8395 8397 7090 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 16 0 617357572 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8482] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8482/stat : 8482 (python) S 8395 8397 7090 0 -1 4202560 35 935 0 0 0 0 0 0 19 0 16 0 617378421 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
[pid=8397/tid=8493] ppid=8395 vsize=433704 CPUtime=0 cores=0,2,4,6
/proc/8397/task/8493/stat : 8493 (python) S 8395 8397 7090 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 16 0 617391472 444112896 7519 33554432000 4194304 5683644 140735313664176 18446744073709551615 260032219569 0 0 16781312 2 18446604453907801344 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4075.7
Current children cumulated vsize (KiB) 12522232

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8397 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=385789
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=118981
# CPU time returned by wait4() is 1.50477
# while last known CPU time is 4075.7
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.1
CPU time (s): 4075.7
CPU user time (s): 4070.55
CPU system time (s): 5.15
CPU usage (%): 313.492
Max. virtual memory (cumulated for all children) (KiB): 12522236

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.38579
system time used= 0.118981
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 24958
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2921
involuntary context switches= 87

runsolver used 7.47286 second user time and 14.7638 second system time

The end

Launcher Data 

Begin job on node110 at 2011-05-01 19:24:29
IDJOB=3317637
IDBENCH=83102
IDSOLVER=1705
FILE ID=node110/3317637-1304270669
RUNJOBID= node110-1304267293-7108
PBS_JOBID= 13173968
Free space on /tmp= 73492 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k7-r89-v70-c6230-S560963242-048.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317637-1304270669/watcher-3317637-1304270669 -o /tmp/evaluation-result-3317637-1304270669/solver-3317637-1304270669 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317637-1304270669.cnf -seed 1262470772 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3be09135963d2d9a560d20860022864d
RANDOM SEED=1262470772

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28671560 kB
Buffers:       1033460 kB
Cached:        1206584 kB
SwapCached:         64 kB
Active:        2021444 kB
Inactive:      1823060 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28671560 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:           31844 kB
Writeback:           8 kB
AnonPages:     1604096 kB
Mapped:          26196 kB
Slab:           357032 kB
PageTables:      17472 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 28949376 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73488 MiB
End job on node110 at 2011-05-01 19:46:11