Trace number 3386651

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (TO) 5000.11 4979.73

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v80-c7120-S1494985128-003.UNKNOWN.cnf
MD5SUM6317a356b3e87abef9291d8243489542
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables80
Number of clauses7120
Sum of the clauses size49840
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 57120

Solver Data 

0.32/0.45	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.45	c INFO: solving HOME/instance-3386651-1305589857.cnf
0.32/0.45	c INFO: computing task features
0.41/0.50	c INFO: computed variable-clause graph statistics
0.41/0.50	c INFO: computed clause balance statistics
0.61/0.76	c INFO: computed variable balance statistics
0.71/0.86	c INFO: computed small-clause counts
0.71/0.86	c INFO: computed Horn-clause counts
0.71/0.86	c INFO: computed variable graph statistics
0.71/0.86	c INFO: collected features for HOME/instance-3386651-1305589857.cnf in 0.41 s
0.71/0.89	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.49)
101.60/101.37	c INFO: running gnovelty+2@0 for 97 with 4899 remaining (b = 0.11)
202.43/201.82	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.06)
305.35/304.32	c INFO: running adaptg2wsat2009++@0 for 97 with 4696 remaining (b = 0.04)
404.28/402.80	c INFO: running adaptg2wsat2009++@0 for 97 with 4597 remaining (b = 0.04)
504.07/502.28	c INFO: running gnovelty+2@0 for 97 with 4498 remaining (b = 0.03)
604.93/602.74	c INFO: running FH@0 for 97 with 4398 remaining (b = 0.02)
705.75/703.21	c INFO: running adaptg2wsat2009++@0 for 97 with 4297 remaining (b = 0.02)
806.45/803.68	c INFO: running adaptg2wsat2009++@0 for 97 with 4197 remaining (b = 0.02)
906.39/903.16	c INFO: running march_hi@0 for 388 with 4097 remaining (b = 0.05)
1301.30/1296.26	c INFO: running march_hi@393 for 97 with 3704 remaining (b = 0.02)
1398.43/1392.91	c INFO: running march_hi@489 for 194 with 3608 remaining (b = 0.04)
1589.41/1583.05	c INFO: running march_hi@679 for 97 with 3418 remaining (b = 0.01)
1691.41/1684.63	c INFO: running hybridGM3@0 for 194 with 3316 remaining (b = 0.03)
1892.12/1884.55	c INFO: running FH@0 for 97 with 3116 remaining (b = 0.01)
1993.04/1985.07	c INFO: running march_hi@0 for 388 with 3016 remaining (b = 0.05)
2385.01/2375.26	c INFO: running march_hi@390 for 97 with 2625 remaining (b = 0.02)
2484.14/2474.06	c INFO: running march_hi@488 for 194 with 2527 remaining (b = 0.03)
2678.20/2667.52	c INFO: running gnovelty+2@0 for 97 with 2333 remaining (b = 0.01)
2778.96/2767.97	c INFO: running hybridGM3@0 for 194 with 2233 remaining (b = 0.02)
2976.64/2964.89	c INFO: running march_hi@781 for 582 with 2036 remaining (b = 0.06)
3557.19/3543.16	c INFO: running march_hi@1359 for 776 with 1458 remaining (b = 0.10)
4340.01/4322.57	c INFO: running march_hi@2138 for 97 with 679 remaining (b = 0.02)
4435.84/4417.98	c INFO: running march_hi@2233 for 584 with 584 remaining (b = 0.07)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386651-1305589857/watcher-3386651-1305589857 -o /tmp/evaluation-result-3386651-1305589857/solver-3386651-1305589857 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386651-1305589857.cnf -seed 1058371754 -budget 5000 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.17 4.12 4.05 4/576 31694
/proc/meminfo: memFree=15283392/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=16400 CPUtime=0 cores=0,2,4,6
/proc/31694/stat : 31694 (python) R 31692 31694 31236 0 -1 4202496 1110 0 0 0 0 0 0 0 24 0 1 0 749216338 16793600 979 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284921701 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31694/statm: 4100 979 407 364 0 587 0

[startup+0.0830969 s]
/proc/loadavg: 4.17 4.12 4.05 4/576 31694
/proc/meminfo: memFree=15283392/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=93964 CPUtime=0.06 cores=0,2,4,6
/proc/31694/stat : 31694 (python) R 31692 31694 31236 0 -1 4202496 2692 0 0 0 4 2 0 0 18 0 1 0 749216338 96219136 2407 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284921701 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31694/statm: 23491 2407 764 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 93964

[startup+0.101092 s]
/proc/loadavg: 4.17 4.12 4.05 4/576 31694
/proc/meminfo: memFree=15283392/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=104616 CPUtime=0.07 cores=0,2,4,6
/proc/31694/stat : 31694 (python) R 31692 31694 31236 0 -1 4202496 3142 0 0 0 5 2 0 0 17 0 1 0 749216338 107126784 2821 33554432000 4194304 5683644 140733508979216 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31694/statm: 26154 2821 847 364 0 1902 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104616

[startup+0.301057 s]
/proc/loadavg: 4.17 4.12 4.05 4/576 31694
/proc/meminfo: memFree=15283392/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=198920 CPUtime=0.24 cores=0,2,4,6
/proc/31694/stat : 31694 (python) R 31692 31694 31236 0 -1 4202496 7027 936 1 0 18 6 0 0 17 0 1 0 749216338 203694080 5053 33554432000 4194304 5683644 140733508979216 18446744073709551615 4578752 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31694/statm: 49730 5053 1466 364 0 3757 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 198920

[startup+0.700991 s]
/proc/loadavg: 4.17 4.12 4.05 4/576 31694
/proc/meminfo: memFree=15283392/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=279952 CPUtime=0.61 cores=0,2,4,6
/proc/31694/stat : 31694 (python) R 31692 31694 31236 0 -1 4202496 9812 936 1 0 53 8 0 0 17 0 1 0 749216338 286670848 7372 33554432000 4194304 5683644 140733508979216 18446744073709551615 4510895 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31694/statm: 69988 7372 1826 364 0 5912 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 279952

[startup+1.50088 s]
/proc/loadavg: 4.17 4.12 4.05 5/580 31702
/proc/meminfo: memFree=15256824/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=290220 CPUtime=0.81 cores=0,2,4,6
/proc/31694/stat : 31694 (python) S 31692 31694 31236 0 -1 4202496 10108 936 1 0 73 8 0 0 20 0 2 0 749216338 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/31694/statm: 72555 7419 1869 364 0 8473 0
[pid=31700] ppid=31694 vsize=279976 CPUtime=0 cores=0,2,4,6
/proc/31700/stat : 31700 (python) S 31694 31694 31236 0 -1 4202560 744 0 0 0 0 0 0 0 19 0 1 0 749216428 286695424 5900 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284945935 0 0 16781312 514 10859700979733889023 0 0 17 6 0 0 0
/proc/31700/statm: 69994 5900 354 364 0 5912 0
[pid=31702] ppid=31700 vsize=1018084 CPUtime=0.59 cores=0,2,4,6
/proc/31702/stat : 31702 (gnovelty+2) R 31700 31702 31702 0 -1 4202496 553 0 0 0 59 0 0 0 22 0 1 0 749216428 1042518016 287 33554432000 134512640 135663704 4294296992 18446744073709551615 134525258 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31702/statm: 254521 287 113 282 0 254237 0
[pid=31694/tid=31701] ppid=31692 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31701/stat : 31701 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 2 0 749216428 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 1588280

[startup+3.10059 s]
/proc/loadavg: 4.17 4.12 4.05 5/580 31702
/proc/meminfo: memFree=15255956/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=290220 CPUtime=0.81 cores=0,2,4,6
/proc/31694/stat : 31694 (python) S 31692 31694 31236 0 -1 4202496 10108 936 1 0 73 8 0 0 20 0 2 0 749216338 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/31694/statm: 72555 7419 1869 364 0 8473 0
[pid=31700] ppid=31694 vsize=279976 CPUtime=0 cores=0,2,4,6
/proc/31700/stat : 31700 (python) S 31694 31694 31236 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 749216428 286695424 5900 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284945935 0 0 16781312 514 10859700979733856515 0 0 17 6 0 0 0
/proc/31700/statm: 69994 5900 354 364 0 5912 0
[pid=31702] ppid=31700 vsize=1018084 CPUtime=2.19 cores=0,2,4,6
/proc/31702/stat : 31702 (gnovelty+2) R 31700 31702 31702 0 -1 4202496 553 0 0 0 219 0 0 0 25 0 1 0 749216428 1042518016 287 33554432000 134512640 135663704 4294296992 18446744073709551615 134524553 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31702/statm: 254521 287 113 282 0 254237 0
[pid=31694/tid=31701] ppid=31692 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31701/stat : 31701 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 2 0 749216428 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 1588280

[startup+6.30108 s]
/proc/loadavg: 4.24 4.13 4.06 5/580 31702
/proc/meminfo: memFree=15255084/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=290220 CPUtime=0.81 cores=0,2,4,6
/proc/31694/stat : 31694 (python) S 31692 31694 31236 0 -1 4202496 10108 936 1 0 73 8 0 0 20 0 2 0 749216338 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/31694/statm: 72555 7419 1869 364 0 8473 0
[pid=31700] ppid=31694 vsize=279976 CPUtime=0.02 cores=0,2,4,6
/proc/31700/stat : 31700 (python) S 31694 31694 31236 0 -1 4202560 889 0 0 0 1 1 0 0 18 0 1 0 749216428 286695424 5923 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284945935 0 0 16781312 514 10859700979733856515 0 0 17 6 0 0 0
/proc/31700/statm: 69994 5923 377 364 0 5912 0
[pid=31702] ppid=31700 vsize=1018084 CPUtime=5.39 cores=0,2,4,6
/proc/31702/stat : 31702 (gnovelty+2) R 31700 31702 31702 0 -1 4202496 553 0 0 0 539 0 0 0 25 0 1 0 749216428 1042518016 287 33554432000 134512640 135663704 4294296992 18446744073709551615 134545682 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31702/statm: 254521 287 113 282 0 254237 0
[pid=31694/tid=31701] ppid=31692 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31701/stat : 31701 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 2 0 749216428 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 1588280

[startup+12.701 s]
/proc/loadavg: 4.22 4.13 4.06 5/580 31702
/proc/meminfo: memFree=15254500/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=290220 CPUtime=0.81 cores=0,2,4,6
/proc/31694/stat : 31694 (python) S 31692 31694 31236 0 -1 4202496 10108 936 1 0 73 8 0 0 20 0 2 0 749216338 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/31694/statm: 72555 7419 1869 364 0 8473 0
[pid=31700] ppid=31694 vsize=279976 CPUtime=0.04 cores=0,2,4,6
/proc/31700/stat : 31700 (python) S 31694 31694 31236 0 -1 4202560 895 0 0 0 2 2 0 0 18 0 1 0 749216428 286695424 5923 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284945935 0 0 16781312 514 7891977804827296003 0 0 17 6 0 0 0
/proc/31700/statm: 69994 5923 377 364 0 5912 0
[pid=31702] ppid=31700 vsize=1018084 CPUtime=11.79 cores=0,2,4,6
/proc/31702/stat : 31702 (gnovelty+2) R 31700 31702 31702 0 -1 4202496 553 0 0 0 1179 0 0 0 25 0 1 0 749216428 1042518016 287 33554432000 134512640 135663704 4294296992 18446744073709551615 134524546 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31702/statm: 254521 287 113 282 0 254237 0
[pid=31694/tid=31701] ppid=31692 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31701/stat : 31701 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 2 0 749216428 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.64
Current children cumulated vsize (KiB) 1588280

[startup+25.5009 s]
/proc/loadavg: 4.24 4.14 4.06 5/580 31702
/proc/meminfo: memFree=15255564/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=290220 CPUtime=0.81 cores=0,2,4,6
/proc/31694/stat : 31694 (python) S 31692 31694 31236 0 -1 4202496 10108 936 1 0 73 8 0 0 20 0 2 0 749216338 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/31694/statm: 72555 7419 1869 364 0 8473 0
[pid=31700] ppid=31694 vsize=279976 CPUtime=0.1 cores=0,2,4,6
/proc/31700/stat : 31700 (python) S 31694 31694 31236 0 -1 4202560 901 0 0 0 5 5 0 0 18 0 1 0 749216428 286695424 5923 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284945935 0 0 16781312 514 7891977804827296003 0 0 17 6 0 0 0
/proc/31700/statm: 69994 5923 377 364 0 5912 0
[pid=31702] ppid=31700 vsize=1018084 CPUtime=24.59 cores=0,2,4,6
/proc/31702/stat : 31702 (gnovelty+2) R 31700 31702 31702 0 -1 4202496 553 0 0 0 2459 0 0 0 25 0 1 0 749216428 1042518016 287 33554432000 134512640 135663704 4294296992 18446744073709551615 134525544 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31702/statm: 254521 287 113 282 0 254237 0
[pid=31694/tid=31701] ppid=31692 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31701/stat : 31701 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 2 0 749216428 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 1588280

[startup+51.1006 s]
/proc/loadavg: 4.15 4.12 4.06 5/580 31702
/proc/meminfo: memFree=15255072/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=290220 CPUtime=0.81 cores=0,2,4,6
/proc/31694/stat : 31694 (python) S 31692 31694 31236 0 -1 4202496 10108 936 1 0 73 8 0 0 20 0 2 0 749216338 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/31694/statm: 72555 7419 1869 364 0 8473 0
[pid=31700] ppid=31694 vsize=279976 CPUtime=0.19 cores=0,2,4,6
/proc/31700/stat : 31700 (python) S 31694 31694 31236 0 -1 4202560 911 0 0 0 10 9 0 0 18 0 1 0 749216428 286695424 5923 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284945935 0 0 16781312 514 7891977804827296003 0 0 17 6 0 0 0
/proc/31700/statm: 69994 5923 377 364 0 5912 0
[pid=31702] ppid=31700 vsize=1018084 CPUtime=50.19 cores=0,2,4,6
/proc/31702/stat : 31702 (gnovelty+2) R 31700 31702 31702 0 -1 4202496 553 0 0 0 5019 0 0 0 25 0 1 0 749216428 1042518016 287 33554432000 134512640 135663704 4294296992 18446744073709551615 134525243 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31702/statm: 254521 287 113 282 0 254237 0
[pid=31694/tid=31701] ppid=31692 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31701/stat : 31701 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 2 0 749216428 297185280 7419 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 51.19
Current children cumulated vsize (KiB) 1588280

[startup+102.321 s]
/proc/loadavg: 4.07 4.10 4.05 5/587 31711
/proc/meminfo: memFree=15215928/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=300476 CPUtime=0.84 cores=0,2,4,6
/proc/31694/stat : 31694 (python) S 31692 31694 31236 0 -1 4202496 11003 936 1 0 75 9 0 0 20 0 3 0 749216338 307687424 7434 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31694/statm: 75119 7434 1880 364 0 11034 0
[pid=31700] ppid=31694 vsize=290220 CPUtime=0.42 cores=0,2,4,6
/proc/31700/stat : 31700 (python) S 31694 31694 31236 0 -1 4202560 1087 0 0 0 23 19 0 0 19 0 2 0 749216428 297185280 5961 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31700/statm: 72555 5961 410 364 0 8473 0
[pid=31702] ppid=31700 vsize=1018084 CPUtime=100.43 cores=0,2,4,6
/proc/31702/stat : 31702 (gnovelty+2) T 31700 31702 31702 0 -1 4202496 553 0 0 0 10043 0 0 0 25 0 1 0 749216428 1042518016 287 33554432000 134512640 135663704 4294296992 18446744073709551615 134524894 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31702/statm: 254521 287 113 282 0 254237 0
[pid=31700/tid=31708] ppid=31694 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/31700/task/31708/stat : 31708 (python) S 31694 31694 31236 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749226472 297185280 5961 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604451146197120 0 0 -1 4 0 0 0
[pid=31709] ppid=31694 vsize=290232 CPUtime=0 cores=0,2,4,6
/proc/31709/stat : 31709 (python) S 31694 31694 31236 0 -1 4202560 744 0 0 0 0 0 0 0 19 0 1 0 749226475 297197568 5898 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284945990 0 0 16781312 514 5063190577063919615 0 0 17 4 0 0 0
/proc/31709/statm: 72558 5898 348 364 0 8473 0
[pid=31711] ppid=31709 vsize=1018084 CPUtime=0.94 cores=0,2,4,6
/proc/31711/stat : 31711 (gnovelty+2) R 31709 31711 31711 0 -1 4202496 552 0 0 0 94 0 0 0 23 0 1 0 749226475 1042518016 287 33554432000 134512640 135663704 4286568672 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31711/statm: 254521 287 113 282 0 254237 0
[pid=31694/tid=31701] ppid=31692 vsize=300476 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31701/stat : 31701 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 3 0 749216428 307687424 7434 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=31710] ppid=31692 vsize=300476 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31710/stat : 31710 (python) S 31692 31694 31236 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 3 0 749226475 307687424 7434 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 102.63
Current children cumulated vsize (KiB) 2917096

[startup+162.301 s]
/proc/loadavg: 4.02 4.08 4.05 5/587 31713
/proc/meminfo: memFree=15214160/32951124 swapFree=45193380/67111528
[pid=31694] ppid=31692 vsize=300476 CPUtime=0.84 cores=0,2,4,6
/proc/31694/stat : 31694 (python) S 31692 31694 31236 0 -1 4202496 11003 936 1 0 75 9 0 0 20 0 3 0 749216338 307687424 7434 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31694/statm: 75119 7434 1880 364 0 11034 0
[pid=31700] ppid=31694 vsize=290220 CPUtime=0.42 cores=0,2,4,6

################
# More data... #
################

/proc/31700/stat : 31700 (python) S 31694 31694 31236 0 -1 4202560 1087 0 0 0 23 19 0 0 19 0 2 0 749216428 297185280 5961 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31700/statm: 72555 5961 410 364 0 8473 0
[pid=31702] ppid=31700 vsize=1018084 CPUtime=100.43 cores=0,2,4,6
/proc/31702/stat : 31702 (gnovelty+2) T 31700 31702 31702 0 -1 4202496 553 0 0 0 10043 0 0 0 25 0 1 0 749216428 1042518016 287 33554432000 134512640 135663704 4294296992 18446744073709551615 134524894 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31702/statm: 254521 287 113 282 0 254237 0
[pid=31700/tid=31708] ppid=31694 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/31700/task/31708/stat : 31708 (python) S 31694 31694 31236 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749226472 297185280 5961 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604451146197120 0 0 -1 4 0 0 0
[pid=31709] ppid=31694 vsize=290232 CPUtime=0.42 cores=0,2,4,6
/proc/31709/stat : 31709 (python) S 31694 31694 31236 0 -1 4202560 1085 0 0 0 22 20 0 0 19 0 2 0 749226475 297197568 5951 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31709/statm: 72558 5951 400 364 0 8473 0
[pid=31711] ppid=31709 vsize=1018084 CPUtime=100.31 cores=0,2,4,6
/proc/31711/stat : 31711 (gnovelty+2) T 31709 31711 31711 0 -1 4202496 552 0 0 0 10031 0 0 0 25 0 1 0 749226475 1042518016 287 33554432000 134512640 135663704 4286568672 18446744073709551615 134524534 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31711/statm: 254521 287 113 282 0 254237 0
[pid=31709/tid=31714] ppid=31694 vsize=290232 CPUtime=0 cores=0,2,4,6
/proc/31709/task/31714/stat : 31714 (python) S 31694 31694 31236 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749236517 297197568 5951 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604445501624576 0 0 -1 6 0 0 0
[pid=31715] ppid=31694 vsize=300488 CPUtime=0.44 cores=0,2,4,6
/proc/31715/stat : 31715 (python) S 31694 31694 31236 0 -1 4202560 1083 0 0 0 23 21 0 0 19 0 2 0 749236520 307699712 5955 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31715/statm: 75122 5955 400 364 0 11034 0
[pid=31717] ppid=31715 vsize=417056 CPUtime=102.45 cores=0,2,4,6
/proc/31717/stat : 31717 (adaptg2wsat2009) T 31715 31717 31717 0 -1 4202496 716 0 0 0 10245 0 0 0 25 0 1 0 749236521 427065344 449 33554432000 134512640 135107411 4291226240 18446744073709551615 134531656 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31717/statm: 104264 449 59 146 0 103140 0
[pid=31715/tid=31726] ppid=31694 vsize=300488 CPUtime=0 cores=0,2,4,6
/proc/31715/task/31726/stat : 31726 (python) S 31694 31694 31236 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 749246767 307699712 5955 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604452506802368 0 0 -1 4 0 0 0
[pid=31727] ppid=31694 vsize=310744 CPUtime=0.43 cores=0,2,4,6
/proc/31727/stat : 31727 (python) S 31694 31694 31236 0 -1 4202560 1111 0 0 0 23 20 0 0 19 0 2 0 749246771 318201856 5959 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31727/statm: 77686 5959 400 364 0 13595 0
[pid=31729] ppid=31727 vsize=417056 CPUtime=98.44 cores=0,2,4,6
/proc/31729/stat : 31729 (adaptg2wsat2009) T 31727 31729 31729 0 -1 4202496 720 0 0 0 9844 0 0 0 25 0 1 0 749246771 427065344 450 33554432000 134512640 135107411 4292314416 18446744073709551615 134531239 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/31729/statm: 104264 450 59 146 0 103140 0
[pid=31727/tid=31732] ppid=31694 vsize=310744 CPUtime=0 cores=0,2,4,6
/proc/31727/task/31732/stat : 31732 (python) S 31694 31694 31236 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 749256615 318201856 5959 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604443254001920 0 0 -1 4 0 0 0
[pid=31733] ppid=31694 vsize=321000 CPUtime=0.44 cores=0,2,4,6
/proc/31733/stat : 31733 (python) S 31694 31694 31236 0 -1 4202560 1113 0 0 0 23 21 0 0 19 0 2 0 749256618 328704000 5963 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31733/statm: 80250 5963 400 364 0 16156 0
[pid=31735] ppid=31733 vsize=417056 CPUtime=99.43 cores=0,2,4,6
/proc/31735/stat : 31735 (adaptg2wsat2009) T 31733 31735 31735 0 -1 4202496 718 0 0 0 9943 0 0 0 25 0 1 0 749256619 427065344 450 33554432000 134512640 135107411 4289321328 18446744073709551615 134531511 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/31735/statm: 104264 450 59 146 0 103140 0
[pid=31733/tid=31742] ppid=31694 vsize=321000 CPUtime=0 cores=0,2,4,6
/proc/31733/task/31742/stat : 31742 (python) S 31694 31694 31236 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749266563 328704000 5963 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604448358613440 0 0 -1 6 0 0 0
[pid=31743] ppid=31694 vsize=331256 CPUtime=0.42 cores=0,2,4,6
/proc/31743/stat : 31743 (python) S 31694 31694 31236 0 -1 4202560 1129 0 0 0 22 20 0 0 19 0 2 0 749266566 339206144 5967 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31743/statm: 82814 5967 400 364 0 18717 0
[pid=31745] ppid=31743 vsize=1018084 CPUtime=100.32 cores=0,2,4,6
/proc/31745/stat : 31745 (gnovelty+2) T 31743 31745 31745 0 -1 4202496 554 0 0 0 10032 0 0 0 25 0 1 0 749266566 1042518016 287 33554432000 134512640 135663704 4287823808 18446744073709551615 134525699 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31745/statm: 254521 287 113 282 0 254237 0
[pid=31743/tid=31754] ppid=31694 vsize=331256 CPUtime=0 cores=0,2,4,6
/proc/31743/task/31754/stat : 31754 (python) S 31694 31694 31236 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749276609 339206144 5967 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604451486126400 0 0 -1 6 0 0 0
[pid=31755] ppid=31694 vsize=341512 CPUtime=0.43 cores=0,2,4,6
/proc/31755/stat : 31755 (python) S 31694 31694 31236 0 -1 4202560 1172 0 0 0 22 21 0 0 19 0 2 0 749276613 349708288 5977 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31755/statm: 85378 5977 406 364 0 21278 0
[pid=31757] ppid=31755 vsize=247232 CPUtime=100.33 cores=0,2,4,6
/proc/31757/stat : 31757 (FH) T 31755 31757 31757 0 -1 4202496 676 0 0 0 10033 0 0 0 25 0 1 0 749276613 253165568 406 33554432000 134512640 134936988 4286572368 18446744073709551615 134553270 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31757/statm: 61808 406 41 104 0 61312 0
[pid=31755/tid=31769] ppid=31694 vsize=341512 CPUtime=0 cores=0,2,4,6
/proc/31755/task/31769/stat : 31769 (python) S 31694 31694 31236 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 749286656 349708288 5977 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604452453078016 0 0 -1 6 0 0 0
[pid=31770] ppid=31694 vsize=351768 CPUtime=0.43 cores=0,2,4,6
/proc/31770/stat : 31770 (python) S 31694 31694 31236 0 -1 4202560 1169 0 0 0 24 19 0 0 19 0 2 0 749286660 360210432 5981 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31770/statm: 87942 5981 406 364 0 23839 0
[pid=31772] ppid=31770 vsize=417056 CPUtime=100.33 cores=0,2,4,6
/proc/31772/stat : 31772 (adaptg2wsat2009) T 31770 31772 31772 0 -1 4202496 729 0 0 0 10033 0 0 0 25 0 1 0 749286660 427065344 451 33554432000 134512640 135107411 4288156560 18446744073709551615 134547635 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31772/statm: 104264 451 59 146 0 103140 0
[pid=31770/tid=31779] ppid=31694 vsize=351768 CPUtime=0 cores=0,2,4,6
/proc/31770/task/31779/stat : 31779 (python) S 31694 31694 31236 0 -1 4202560 53 0 0 0 0 0 0 0 19 0 2 0 749296703 360210432 5981 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604451878008640 0 0 -1 4 0 0 0
[pid=31780] ppid=31694 vsize=362024 CPUtime=0.44 cores=0,2,4,6
/proc/31780/stat : 31780 (python) S 31694 31694 31236 0 -1 4202560 1132 0 0 0 21 23 0 0 19 0 2 0 749296706 370712576 5979 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31780/statm: 90506 5979 400 364 0 26400 0
[pid=31782] ppid=31780 vsize=417056 CPUtime=99.41 cores=0,2,4,6
/proc/31782/stat : 31782 (adaptg2wsat2009) T 31780 31782 31782 0 -1 4202496 722 0 0 0 9941 0 0 0 25 0 1 0 749296707 427065344 449 33554432000 134512640 135107411 4289285744 18446744073709551615 134531239 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31782/statm: 104264 449 59 146 0 103140 0
[pid=31780/tid=31791] ppid=31694 vsize=362024 CPUtime=0 cores=0,2,4,6
/proc/31780/task/31791/stat : 31791 (python) S 31694 31694 31236 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 749306651 370712576 5979 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604443783143488 0 0 -1 4 0 0 0
[pid=31792] ppid=31694 vsize=372280 CPUtime=12.46 cores=0,2,4,6
/proc/31792/stat : 31792 (python) S 31694 31694 31236 0 -1 4202560 1185 0 0 0 674 572 0 0 15 0 2 0 749306654 381214720 5983 33554432000 4194304 5683644 140733508979216 18446744073709551615 224284945990 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31792/statm: 93070 5983 400 364 0 28961 0
[pid=31794] ppid=31792 vsize=309548 CPUtime=2795.72 cores=0,2,4,6
/proc/31794/stat : 31794 (march_hi) R 31792 31794 31794 0 -1 4202496 69914 0 0 0 279554 18 0 0 25 0 1 0 749306655 316977152 68556 33554432000 4194304 4955518 140736287833136 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/31794/statm: 77387 68556 106 186 0 77200 0
[pid=31792/tid=31806] ppid=31694 vsize=372280 CPUtime=0 cores=0,2,4,6
/proc/31792/task/31806/stat : 31806 (python) S 31694 31694 31236 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 749345961 381214720 5983 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604451352695168 0 0 -1 4 0 0 0
[pid=31996] ppid=31694 vsize=382536 CPUtime=0.85 cores=0,2,4,6
/proc/31996/stat : 31996 (python) S 31694 31694 31236 0 -1 4202560 1159 0 0 0 47 38 0 0 19 0 2 0 749384802 391716864 5987 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31996/statm: 95634 5987 400 364 0 31522 0
[pid=31998] ppid=31996 vsize=268424 CPUtime=199.87 cores=0,2,4,6
/proc/31998/stat : 31998 (hybridGM3) T 31996 31998 31998 0 -1 4202496 4918 0 0 0 19987 0 0 0 25 0 1 0 749384802 274866176 4649 33554432000 134512640 135204385 4289563664 18446744073709551615 134537383 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/31998/statm: 67106 4649 64 169 0 66936 0
[pid=31996/tid=32009] ppid=31694 vsize=382536 CPUtime=0 cores=0,2,4,6
/proc/31996/task/32009/stat : 32009 (python) S 31694 31694 31236 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749404790 391716864 5987 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604451461928000 0 0 -1 2 0 0 0
[pid=32010] ppid=31694 vsize=392792 CPUtime=0.45 cores=0,2,4,6
/proc/32010/stat : 32010 (python) S 31694 31694 31236 0 -1 4202560 1140 0 0 0 24 21 0 0 19 0 2 0 749404793 402219008 5991 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32010/statm: 98198 5991 400 364 0 34083 0
[pid=32012] ppid=32010 vsize=247232 CPUtime=100.49 cores=0,2,4,6
/proc/32012/stat : 32012 (FH) T 32010 32012 32012 0 -1 4202496 677 0 0 0 10049 0 0 0 25 0 1 0 749404793 253165568 406 33554432000 134512640 134936988 4287136128 18446744073709551615 134554623 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/32012/statm: 61808 406 41 104 0 61312 0
[pid=32010/tid=32015] ppid=31694 vsize=392792 CPUtime=0 cores=0,2,4,6
/proc/32010/task/32015/stat : 32015 (python) S 31694 31694 31236 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 749414843 402219008 5991 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604440822761280 0 0 -1 6 0 0 0
[pid=32016] ppid=31694 vsize=403048 CPUtime=3 cores=0,2,4,6
/proc/32016/stat : 32016 (python) S 31694 31694 31236 0 -1 4202560 1181 0 0 0 162 138 0 0 15 0 2 0 749414846 412721152 5995 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32016/statm: 100762 5995 400 364 0 36644 0
[pid=32018] ppid=32016 vsize=93468 CPUtime=682.09 cores=0,2,4,6
/proc/32018/stat : 32018 (march_hi) T 32016 32018 32018 0 -1 4202496 19688 0 0 0 68206 3 0 0 25 0 1 0 749414846 95711232 18328 33554432000 4194304 4955518 140733387415040 18446744073709551615 4208693 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/32018/statm: 23367 18328 106 186 0 23180 0
[pid=32016/tid=32030] ppid=31694 vsize=403048 CPUtime=0 cores=0,2,4,6
/proc/32016/task/32030/stat : 32030 (python) S 31694 31694 31236 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 749453862 412721152 5995 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604440321914944 0 0 -1 6 0 0 0
[pid=32042] ppid=31694 vsize=413304 CPUtime=0.42 cores=0,2,4,6
/proc/32042/stat : 32042 (python) S 31694 31694 31236 0 -1 4202560 1144 0 0 0 22 20 0 0 19 0 2 0 749483090 423223296 6017 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32042/statm: 103326 6017 400 364 0 39205 0
[pid=32044] ppid=32042 vsize=1018084 CPUtime=100.28 cores=0,2,4,6
/proc/32044/stat : 32044 (gnovelty+2) T 32042 32044 32044 0 -1 4202496 558 0 0 0 10028 0 0 0 25 0 1 0 749483090 1042518016 287 33554432000 134512640 135663704 4289009040 18446744073709551615 134525276 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32044/statm: 254521 287 113 282 0 254237 0
[pid=32042/tid=32049] ppid=31694 vsize=413304 CPUtime=0 cores=0,2,4,6
/proc/32042/task/32049/stat : 32049 (python) S 31694 31694 31236 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 749493133 423223296 6017 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604451461928896 0 0 -1 4 0 0 0
[pid=32050] ppid=31694 vsize=423560 CPUtime=0.86 cores=0,2,4,6
/proc/32050/stat : 32050 (python) S 31694 31694 31236 0 -1 4202560 1219 0 0 0 46 40 0 0 19 0 2 0 749493135 433725440 6028 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32050/statm: 105890 6028 407 364 0 41766 0
[pid=32052] ppid=32050 vsize=268420 CPUtime=196.83 cores=0,2,4,6
/proc/32052/stat : 32052 (hybridGM3) T 32050 32052 32052 0 -1 4202496 4925 0 0 0 19683 0 0 0 25 0 1 0 749493135 274862080 4649 33554432000 134512640 135204385 4290266272 18446744073709551615 134536749 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/32052/statm: 67105 4649 64 169 0 66935 0
[pid=32050/tid=32061] ppid=31694 vsize=423560 CPUtime=0 cores=0,2,4,6
/proc/32050/task/32061/stat : 32061 (python) S 31694 31694 31236 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 749512825 433725440 6028 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 514 18446604440822759488 0 0 -1 6 0 0 0
[pid=31694/tid=31701] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31701/stat : 31701 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 16 0 749216428 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=31710] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31710/stat : 31710 (python) S 31692 31694 31236 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 16 0 749226475 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=31716] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31716/stat : 31716 (python) S 31692 31694 31236 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 16 0 749236521 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=31728] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31728/stat : 31728 (python) S 31692 31694 31236 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 16 0 749246771 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=31734] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31734/stat : 31734 (python) S 31692 31694 31236 0 -1 4202560 32 936 0 0 0 0 0 0 20 0 16 0 749256618 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 4 0 0 0
[pid=31694/tid=31744] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31744/stat : 31744 (python) S 31692 31694 31236 0 -1 4202560 32 936 0 0 0 0 0 0 20 0 16 0 749266566 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=31756] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31756/stat : 31756 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 16 0 749276613 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=31771] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31771/stat : 31771 (python) S 31692 31694 31236 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 16 0 749286660 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=31781] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31781/stat : 31781 (python) S 31692 31694 31236 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 16 0 749296707 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=31793] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31793/stat : 31793 (python) S 31692 31694 31236 0 -1 4202560 33 936 0 0 0 0 0 0 18 0 16 0 749306655 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 4 0 0 0
[pid=31694/tid=31997] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/31997/stat : 31997 (python) S 31692 31694 31236 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 16 0 749384802 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=32011] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/32011/stat : 32011 (python) S 31692 31694 31236 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 16 0 749404793 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 2 0 0 0
[pid=31694/tid=32017] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/32017/stat : 32017 (python) S 31692 31694 31236 0 -1 4202560 27 936 0 0 0 0 0 0 18 0 16 0 749414846 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 6 0 0 0
[pid=31694/tid=32043] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/32043/stat : 32043 (python) S 31692 31694 31236 0 -1 4202560 30 936 0 0 0 0 0 0 20 0 16 0 749483090 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 2 0 0 0
[pid=31694/tid=32051] ppid=31692 vsize=433804 CPUtime=0 cores=0,2,4,6
/proc/31694/task/32051/stat : 32051 (python) S 31692 31694 31236 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 16 0 749493135 444215296 7534 33554432000 4194304 5683644 140733508979216 18446744073709551615 224296749489 0 0 16781312 2 18446604446429848768 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5000.11
Current children cumulated vsize (KiB) 13312508

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31694 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=365792
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=121981
# CPU time returned by wait4() is 1.48777
# while last known CPU time is 5000.11
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4979.73
CPU time (s): 5000.11
CPU user time (s): 4989.66
CPU system time (s): 10.45
CPU usage (%): 100.409
Max. virtual memory (cumulated for all children) (KiB): 13312512

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.36579
system time used= 0.121981
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25572
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1075
involuntary context switches= 44

runsolver used 44.9832 second user time and 90.9162 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-17 01:50:57
IDJOB=3386651
IDBENCH=82716
IDSOLVER=1872
FILE ID=node118/3386651-1305589857
RUNJOBID= node118-1305586147-31254
PBS_JOBID= 13350360
Free space on /tmp= 73096 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v80-c7120-S1494985128-003.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386651-1305589857/watcher-3386651-1305589857 -o /tmp/evaluation-result-3386651-1305589857/solver-3386651-1305589857 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386651-1305589857.cnf -seed 1058371754 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6317a356b3e87abef9291d8243489542
RANDOM SEED=1058371754

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15283548 kB
Buffers:        323696 kB
Cached:        5030036 kB
SwapCached:      22068 kB
Active:       14564132 kB
Inactive:      2747032 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15283548 kB
SwapTotal:    67111528 kB
SwapFree:     45193380 kB
Dirty:           32168 kB
Writeback:           0 kB
AnonPages:    11947832 kB
Mapped:          34756 kB
Slab:           163680 kB
PageTables:     121612 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 176611788 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73064 MiB
End job on node118 at 2011-05-17 03:13:58