Trace number 3377781

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)UNSAT 855.19 854.741

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S1675230100-032.UNKNOWN.cnf
MD5SUMf9a60c414c65108f1df33ba3a81b8715
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark349.16
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data 

0.32/0.73	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.73	c INFO: solving HOME/instance-3377781-1305458023.cnf
0.32/0.73	c INFO: computing task features
0.32/0.73	c INFO: computed variable-clause graph statistics
0.32/0.73	c INFO: computed clause balance statistics
0.32/0.73	c INFO: computed variable balance statistics
0.61/0.78	c INFO: computed small-clause counts
0.61/0.78	c INFO: computed Horn-clause counts
0.61/0.78	c INFO: computed variable graph statistics
0.61/0.78	c INFO: collected features for HOME/instance-3377781-1305458023.cnf in 0.31 s
0.61/0.79	c INFO: running gnovelty+2@0 for 97 with 2399 remaining (b = 0.55)
99.25/99.10	c INFO: running gnovelty+2@0 for 97 with 2301 remaining (b = 0.09)
199.52/199.40	c INFO: running adaptg2wsat2009++@0 for 97 with 2201 remaining (b = 0.04)
299.72/299.69	c INFO: running adaptg2wsat2009++@0 for 97 with 2101 remaining (b = 0.03)
400.01/399.98	c INFO: running adaptg2wsat2009++@0 for 97 with 2001 remaining (b = 0.03)
500.27/500.29	c INFO: running march_hi@0 for 388 with 1901 remaining (b = 0.10)
855.01/854.72	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3377781-1305458023/watcher-3377781-1305458023 -o /tmp/evaluation-result-3377781-1305458023/solver-3377781-1305458023 -C 2400 -W 1300 -M 7680 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3377781-1305458023.cnf -seed 229177894 -budget 2400 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.31 2.74 3.30 5/403 29665
/proc/meminfo: memFree=21862480/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=11796 CPUtime=0 cores=5,7
/proc/29665/stat : 29665 (runsolver) R 29663 29665 27552 0 -1 4202560 41 0 0 0 0 0 0 0 25 0 1 0 657400058 12079104 50 33554432000 4194304 5432360 140736998532080 18446744073709551615 4881623 0 2147483391 4096 24578 0 0 0 17 7 0 0 0
/proc/29665/statm: 2949 50 30 303 0 2643 0

[startup+0.0802929 s]
/proc/loadavg: 1.31 2.74 3.30 5/403 29665
/proc/meminfo: memFree=21862480/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=50012 CPUtime=0.04 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 1968 0 0 0 3 1 0 0 25 0 1 0 657400058 51212288 1732 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/29665/statm: 12503 1732 480 364 0 1203 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 50012

[startup+0.100401 s]
/proc/loadavg: 1.31 2.74 3.30 5/403 29665
/proc/meminfo: memFree=21862480/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=93960 CPUtime=0.06 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 2695 0 0 0 4 2 0 0 17 0 1 0 657400058 96215040 2407 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/29665/statm: 23490 2407 764 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 93960

[startup+0.300326 s]
/proc/loadavg: 1.31 2.74 3.30 5/403 29665
/proc/meminfo: memFree=21862480/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=156688 CPUtime=0.21 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 6439 931 1 0 15 6 0 0 17 0 1 0 657400058 160448512 4539 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/29665/statm: 39172 4539 1257 364 0 3280 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 156688

[startup+0.735251 s]
/proc/loadavg: 1.31 2.74 3.30 5/403 29665
/proc/meminfo: memFree=21862480/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=279656 CPUtime=0.61 cores=5,7
/proc/29665/stat : 29665 (python) R 29663 29665 27552 0 -1 4202496 9717 931 1 0 53 8 0 0 17 0 1 0 657400058 286367744 7300 33554432000 4194304 5683644 140733354930880 18446744073709551615 212691083953 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29665/statm: 69914 7300 1827 364 0 5838 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 279656

[startup+1.50106 s]
/proc/loadavg: 1.31 2.74 3.30 5/407 29673
/proc/meminfo: memFree=21834300/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=289196 CPUtime=0.68 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 10014 931 1 0 59 9 0 0 20 0 2 0 657400058 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 72299 7204 1877 364 0 8217 0
[pid=29671] ppid=29665 vsize=278952 CPUtime=0 cores=5,7
/proc/29671/stat : 29671 (python) S 29665 29665 27552 0 -1 4202560 743 0 0 0 0 0 0 0 20 0 1 0 657400138 285646848 5677 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695375 0 0 16781312 514 15114134779575926783 0 0 17 7 0 0 0
/proc/29671/statm: 69738 5677 354 364 0 5656 0
[pid=29673] ppid=29671 vsize=1017932 CPUtime=0.69 cores=5,7
/proc/29673/stat : 29673 (gnovelty+2) R 29671 29673 29673 0 -1 4202496 514 0 0 0 69 0 0 0 24 0 1 0 657400138 1042362368 247 33554432000 134512640 135663704 4287654400 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29673/statm: 254483 247 113 282 0 254199 0
[pid=29665/tid=29672] ppid=29663 vsize=289196 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 2 0 657400138 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 1586080

[startup+3.10078 s]
/proc/loadavg: 1.31 2.74 3.30 5/407 29673
/proc/meminfo: memFree=21833472/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=289196 CPUtime=0.68 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 10014 931 1 0 59 9 0 0 20 0 2 0 657400058 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 72299 7204 1877 364 0 8217 0
[pid=29671] ppid=29665 vsize=278952 CPUtime=0 cores=5,7
/proc/29671/stat : 29671 (python) S 29665 29665 27552 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 657400138 285646848 5677 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695375 0 0 16781312 514 15114134779575894280 0 0 17 7 0 0 0
/proc/29671/statm: 69738 5677 354 364 0 5656 0
[pid=29673] ppid=29671 vsize=1017932 CPUtime=2.29 cores=5,7
/proc/29673/stat : 29673 (gnovelty+2) R 29671 29673 29673 0 -1 4202496 514 0 0 0 229 0 0 0 25 0 1 0 657400138 1042362368 247 33554432000 134512640 135663704 4287654400 18446744073709551615 134524711 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29673/statm: 254483 247 113 282 0 254199 0
[pid=29665/tid=29672] ppid=29663 vsize=289196 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 2 0 657400138 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 1586080

[startup+6.30119 s]
/proc/loadavg: 1.52 2.76 3.31 5/407 29673
/proc/meminfo: memFree=21834416/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=289196 CPUtime=0.68 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 10014 931 1 0 59 9 0 0 20 0 2 0 657400058 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 72299 7204 1877 364 0 8217 0
[pid=29671] ppid=29665 vsize=278952 CPUtime=0 cores=5,7
/proc/29671/stat : 29671 (python) S 29665 29665 27552 0 -1 4202560 989 0 0 0 0 0 0 0 18 0 1 0 657400138 285646848 5705 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695375 0 0 16781312 514 15114134779575894280 0 0 17 7 0 0 0
/proc/29671/statm: 69738 5705 382 364 0 5656 0
[pid=29673] ppid=29671 vsize=1017932 CPUtime=5.5 cores=5,7
/proc/29673/stat : 29673 (gnovelty+2) R 29671 29673 29673 0 -1 4202496 514 0 0 0 550 0 0 0 25 0 1 0 657400138 1042362368 247 33554432000 134512640 135663704 4287654400 18446744073709551615 134525347 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29673/statm: 254483 247 113 282 0 254199 0
[pid=29665/tid=29672] ppid=29663 vsize=289196 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 2 0 657400138 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 1586080

[startup+12.701 s]
/proc/loadavg: 1.72 2.78 3.31 5/407 29673
/proc/meminfo: memFree=21832376/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=289196 CPUtime=0.68 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 10014 931 1 0 59 9 0 0 20 0 2 0 657400058 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 72299 7204 1877 364 0 8217 0
[pid=29671] ppid=29665 vsize=278952 CPUtime=0.02 cores=5,7
/proc/29671/stat : 29671 (python) S 29665 29665 27552 0 -1 4202560 991 0 0 0 1 1 0 0 18 0 1 0 657400138 285646848 5705 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695375 0 0 16781312 514 15064435200438010120 0 0 17 7 0 0 0
/proc/29671/statm: 69738 5705 382 364 0 5656 0
[pid=29673] ppid=29671 vsize=1017932 CPUtime=11.9 cores=5,7
/proc/29673/stat : 29673 (gnovelty+2) R 29671 29673 29673 0 -1 4202496 514 0 0 0 1190 0 0 0 25 0 1 0 657400138 1042362368 247 33554432000 134512640 135663704 4287654400 18446744073709551615 134525120 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29673/statm: 254483 247 113 282 0 254199 0
[pid=29665/tid=29672] ppid=29663 vsize=289196 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 2 0 657400138 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.6
Current children cumulated vsize (KiB) 1586080

[startup+25.5007 s]
/proc/loadavg: 2.22 2.84 3.32 5/407 29673
/proc/meminfo: memFree=21832844/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=289196 CPUtime=0.68 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 10014 931 1 0 59 9 0 0 20 0 2 0 657400058 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 72299 7204 1877 364 0 8217 0
[pid=29671] ppid=29665 vsize=278952 CPUtime=0.06 cores=5,7
/proc/29671/stat : 29671 (python) S 29665 29665 27552 0 -1 4202560 998 0 0 0 3 3 0 0 18 0 1 0 657400138 285646848 5705 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695375 0 0 16781312 514 15064435200438010120 0 0 17 7 0 0 0
/proc/29671/statm: 69738 5705 382 364 0 5656 0
[pid=29673] ppid=29671 vsize=1017932 CPUtime=24.7 cores=5,7
/proc/29673/stat : 29673 (gnovelty+2) R 29671 29673 29673 0 -1 4202496 514 0 0 0 2470 0 0 0 25 0 1 0 657400138 1042362368 247 33554432000 134512640 135663704 4287654400 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29673/statm: 254483 247 113 282 0 254199 0
[pid=29665/tid=29672] ppid=29663 vsize=289196 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 2 0 657400138 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.44
Current children cumulated vsize (KiB) 1586080

[startup+51.114 s]
/proc/loadavg: 2.83 2.93 3.34 5/407 29674
/proc/meminfo: memFree=21832556/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=289196 CPUtime=0.68 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 10014 931 1 0 59 9 0 0 20 0 2 0 657400058 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 72299 7204 1877 364 0 8217 0
[pid=29671] ppid=29665 vsize=278952 CPUtime=0.13 cores=5,7
/proc/29671/stat : 29671 (python) S 29665 29665 27552 0 -1 4202560 1009 0 0 0 7 6 0 0 18 0 1 0 657400138 285646848 5705 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695375 0 0 16781312 514 15064435200438010120 0 0 17 7 0 0 0
/proc/29671/statm: 69738 5705 382 364 0 5656 0
[pid=29673] ppid=29671 vsize=1017932 CPUtime=50.31 cores=5,7
/proc/29673/stat : 29673 (gnovelty+2) R 29671 29673 29673 0 -1 4202496 514 0 0 0 5031 0 0 0 25 0 1 0 657400138 1042362368 247 33554432000 134512640 135663704 4287654400 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29673/statm: 254483 247 113 282 0 254199 0
[pid=29665/tid=29672] ppid=29663 vsize=289196 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 2 0 657400138 296136704 7204 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 51.12
Current children cumulated vsize (KiB) 1586080

[startup+102.301 s]
/proc/loadavg: 3.65 3.13 3.38 5/423 29694
/proc/meminfo: memFree=21814608/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=299452 CPUtime=0.69 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 10885 931 1 0 60 9 0 0 20 0 3 0 657400058 306638848 7211 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 74863 7211 1880 364 0 10778 0
[pid=29671] ppid=29665 vsize=289196 CPUtime=0.27 cores=5,7
/proc/29671/stat : 29671 (python) S 29665 29665 27552 0 -1 4202560 1171 0 0 0 15 12 0 0 19 0 2 0 657400138 296136704 5743 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29671/statm: 72299 5743 415 364 0 8217 0
[pid=29673] ppid=29671 vsize=1017932 CPUtime=98.29 cores=5,7
/proc/29673/stat : 29673 (gnovelty+2) T 29671 29673 29673 0 -1 4202496 514 0 0 0 9829 0 0 0 25 0 1 0 657400138 1042362368 247 33554432000 134512640 135663704 4287654400 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29673/statm: 254483 247 113 282 0 254199 0
[pid=29671/tid=29680] ppid=29665 vsize=289196 CPUtime=0 cores=5,7
/proc/29671/task/29680/stat : 29680 (python) S 29665 29665 27552 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657409967 296136704 5743 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604469316628864 0 0 -1 7 0 0 0
[pid=29681] ppid=29665 vsize=289208 CPUtime=0 cores=5,7
/proc/29681/stat : 29681 (python) S 29665 29665 27552 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 657409968 296148992 5675 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695430 0 0 16781312 514 16200067713626767621 0 0 17 5 0 0 0
/proc/29681/statm: 72302 5675 348 364 0 8217 0
[pid=29683] ppid=29681 vsize=1017932 CPUtime=3.17 cores=5,7
/proc/29683/stat : 29683 (gnovelty+2) R 29681 29683 29683 0 -1 4202496 512 0 0 0 317 0 0 0 25 0 1 0 657409969 1042362368 247 33554432000 134512640 135663704 4290235280 18446744073709551615 134524894 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29683/statm: 254483 247 113 282 0 254199 0
[pid=29665/tid=29672] ppid=29663 vsize=299452 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 3 0 657400138 306638848 7211 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29682] ppid=29663 vsize=299452 CPUtime=0 cores=5,7
/proc/29665/task/29682/stat : 29682 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 3 0 657409968 306638848 7211 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.42
Current children cumulated vsize (KiB) 2913720

[startup+162.301 s]
/proc/loadavg: 3.94 3.31 3.43 5/423 29697
/proc/meminfo: memFree=21810716/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=299452 CPUtime=0.69 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 10885 931 1 0 60 9 0 0 20 0 3 0 657400058 306638848 7211 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 74863 7211 1880 364 0 10778 0
[pid=29671] ppid=29665 vsize=289196 CPUtime=0.27 cores=5,7

################
# More data... #
################

[pid=29743] ppid=29665 vsize=309996 CPUtime=0.28 cores=5,7
/proc/29743/stat : 29743 (python) S 29665 29665 27552 0 -1 4202560 1091 0 0 0 13 15 0 0 19 0 2 0 657430027 317435904 5794 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29743/statm: 77499 5794 400 364 0 13408 0
[pid=29745] ppid=29743 vsize=416788 CPUtime=99.99 cores=5,7
/proc/29745/stat : 29745 (adaptg2wsat2009) T 29743 29745 29745 0 -1 4202496 624 0 0 0 9999 0 0 0 25 0 1 0 657430027 426790912 364 33554432000 134512640 135107411 4290351088 18446744073709551615 134531656 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29745/statm: 104197 364 59 146 0 103073 0
[pid=29743/tid=29764] ppid=29665 vsize=309996 CPUtime=0 cores=5,7
/proc/29743/task/29764/stat : 29764 (python) S 29665 29665 27552 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 657440055 317435904 5794 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604457984530496 0 0 -1 5 0 0 0
[pid=29765] ppid=29665 vsize=320252 CPUtime=0.3 cores=5,7
/proc/29765/stat : 29765 (python) S 29665 29665 27552 0 -1 4202560 1098 0 0 0 15 15 0 0 19 0 2 0 657440056 327938048 5800 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29765/statm: 80063 5800 400 364 0 15969 0
[pid=29768] ppid=29765 vsize=416788 CPUtime=99.95 cores=5,7
/proc/29768/stat : 29768 (adaptg2wsat2009) T 29765 29768 29768 0 -1 4202496 627 0 0 0 9995 0 0 0 25 0 1 0 657440057 426790912 364 33554432000 134512640 135107411 4293715872 18446744073709551615 134531674 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29768/statm: 104197 364 59 146 0 103073 0
[pid=29765/tid=29783] ppid=29665 vsize=320252 CPUtime=0 cores=5,7
/proc/29765/task/29783/stat : 29783 (python) S 29665 29665 27552 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657450085 327938048 5800 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604463485186240 0 0 -1 5 0 0 0
[pid=29784] ppid=29665 vsize=330792 CPUtime=1.17 cores=5,7
/proc/29784/stat : 29784 (python) S 29665 29665 27552 0 -1 4202560 1007 0 0 0 61 56 0 0 15 0 1 0 657450087 338731008 5822 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695430 0 0 16781312 514 5606903191577788679 0 0 17 5 0 0 0
/proc/29784/statm: 82698 5822 371 364 0 18601 0
[pid=29787] ppid=29784 vsize=4696 CPUtime=353.19 cores=5,7
/proc/29787/stat : 29787 (march_hi) R 29784 29787 29787 0 -1 4202496 1691 0 0 0 35319 0 0 0 25 0 1 0 657450087 4808704 799 33554432000 4194304 4955518 140737012451696 18446744073709551615 4206520 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29787/statm: 1174 799 106 186 0 987 0
[pid=29665/tid=29672] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 7 0 657400138 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29682] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29682/stat : 29682 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657409968 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29706] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29706/stat : 29706 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657419998 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29744] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29744/stat : 29744 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657430027 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29766] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29766/stat : 29766 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657440056 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29786] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29786/stat : 29786 (python) S 29663 29665 27552 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 7 0 657450087 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 854.71
Current children cumulated vsize (KiB) 5471144

[startup+854.601 s]
/proc/loadavg: 2.10 2.69 3.09 3/436 29832
/proc/meminfo: memFree=21873084/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=341036 CPUtime=0.75 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 14259 931 1 0 65 10 0 0 19 0 7 0 657400058 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 85259 7343 1888 364 0 21162 0
[pid=29671] ppid=29665 vsize=289196 CPUtime=0.27 cores=5,7
/proc/29671/stat : 29671 (python) S 29665 29665 27552 0 -1 4202560 1171 0 0 0 15 12 0 0 19 0 2 0 657400138 296136704 5743 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29671/statm: 72299 5743 415 364 0 8217 0
[pid=29673] ppid=29671 vsize=1017932 CPUtime=98.29 cores=5,7
/proc/29673/stat : 29673 (gnovelty+2) T 29671 29673 29673 0 -1 4202496 514 0 0 0 9829 0 0 0 25 0 1 0 657400138 1042362368 247 33554432000 134512640 135663704 4287654400 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29673/statm: 254483 247 113 282 0 254199 0
[pid=29671/tid=29680] ppid=29665 vsize=289196 CPUtime=0 cores=5,7
/proc/29671/task/29680/stat : 29680 (python) S 29665 29665 27552 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657409967 296136704 5743 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604469316628864 0 0 -1 7 0 0 0
[pid=29681] ppid=29665 vsize=289208 CPUtime=0.28 cores=5,7
/proc/29681/stat : 29681 (python) S 29665 29665 27552 0 -1 4202560 1082 0 0 0 12 16 0 0 19 0 2 0 657409968 296148992 5728 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29681/statm: 72302 5728 400 364 0 8217 0
[pid=29683] ppid=29681 vsize=1017932 CPUtime=99.98 cores=5,7
/proc/29683/stat : 29683 (gnovelty+2) T 29681 29683 29683 0 -1 4202496 512 0 0 0 9998 0 0 0 25 0 1 0 657409969 1042362368 247 33554432000 134512640 135663704 4290235280 18446744073709551615 134524931 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29683/statm: 254483 247 113 282 0 254199 0
[pid=29681/tid=29704] ppid=29665 vsize=289208 CPUtime=0 cores=5,7
/proc/29681/task/29704/stat : 29704 (python) S 29665 29665 27552 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657419997 296148992 5728 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604456684565440 0 0 -1 7 0 0 0
[pid=29705] ppid=29665 vsize=299740 CPUtime=0.28 cores=5,7
/proc/29705/stat : 29705 (python) S 29665 29665 27552 0 -1 4202560 1091 0 0 0 15 13 0 0 19 0 2 0 657419998 306933760 5769 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29705/statm: 74935 5769 400 364 0 10847 0
[pid=29707] ppid=29705 vsize=416788 CPUtime=99.98 cores=5,7
/proc/29707/stat : 29707 (adaptg2wsat2009) T 29705 29707 29707 0 -1 4202496 630 0 0 0 9998 0 0 0 25 0 1 0 657419998 426790912 364 33554432000 134512640 135107411 4289343936 18446744073709551615 134532091 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29707/statm: 104197 364 59 146 0 103073 0
[pid=29705/tid=29741] ppid=29665 vsize=299740 CPUtime=0 cores=5,7
/proc/29705/task/29741/stat : 29741 (python) S 29665 29665 27552 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 657430026 306933760 5769 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604467727399040 0 0 -1 5 0 0 0
[pid=29743] ppid=29665 vsize=309996 CPUtime=0.28 cores=5,7
/proc/29743/stat : 29743 (python) S 29665 29665 27552 0 -1 4202560 1091 0 0 0 13 15 0 0 19 0 2 0 657430027 317435904 5794 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29743/statm: 77499 5794 400 364 0 13408 0
[pid=29745] ppid=29743 vsize=416788 CPUtime=99.99 cores=5,7
/proc/29745/stat : 29745 (adaptg2wsat2009) T 29743 29745 29745 0 -1 4202496 624 0 0 0 9999 0 0 0 25 0 1 0 657430027 426790912 364 33554432000 134512640 135107411 4290351088 18446744073709551615 134531656 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29745/statm: 104197 364 59 146 0 103073 0
[pid=29743/tid=29764] ppid=29665 vsize=309996 CPUtime=0 cores=5,7
/proc/29743/task/29764/stat : 29764 (python) S 29665 29665 27552 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 657440055 317435904 5794 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604457984530496 0 0 -1 5 0 0 0
[pid=29765] ppid=29665 vsize=320252 CPUtime=0.3 cores=5,7
/proc/29765/stat : 29765 (python) S 29665 29665 27552 0 -1 4202560 1098 0 0 0 15 15 0 0 19 0 2 0 657440056 327938048 5800 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29765/statm: 80063 5800 400 364 0 15969 0
[pid=29768] ppid=29765 vsize=416788 CPUtime=99.95 cores=5,7
/proc/29768/stat : 29768 (adaptg2wsat2009) T 29765 29768 29768 0 -1 4202496 627 0 0 0 9995 0 0 0 25 0 1 0 657440057 426790912 364 33554432000 134512640 135107411 4293715872 18446744073709551615 134531674 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29768/statm: 104197 364 59 146 0 103073 0
[pid=29765/tid=29783] ppid=29665 vsize=320252 CPUtime=0 cores=5,7
/proc/29765/task/29783/stat : 29783 (python) S 29665 29665 27552 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657450085 327938048 5800 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604463485186240 0 0 -1 5 0 0 0
[pid=29784] ppid=29665 vsize=330792 CPUtime=1.17 cores=5,7
/proc/29784/stat : 29784 (python) S 29665 29665 27552 0 -1 4202560 1007 0 0 0 61 56 0 0 15 0 1 0 657450087 338731008 5822 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695430 0 0 16781312 514 5606903191577788679 0 0 17 5 0 0 0
/proc/29784/statm: 82698 5822 371 364 0 18601 0
[pid=29787] ppid=29784 vsize=4696 CPUtime=353.39 cores=5,7
/proc/29787/stat : 29787 (march_hi) R 29784 29787 29787 0 -1 4202496 1691 0 0 0 35339 0 0 0 25 0 1 0 657450087 4808704 799 33554432000 4194304 4955518 140737012451696 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29787/statm: 1174 799 106 186 0 987 0
[pid=29665/tid=29672] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 7 0 657400138 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29682] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29682/stat : 29682 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657409968 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29706] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29706/stat : 29706 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657419998 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29744] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29744/stat : 29744 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657430027 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29766] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29766/stat : 29766 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657440056 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29786] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29786/stat : 29786 (python) S 29663 29665 27552 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 7 0 657450087 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 854.91
Current children cumulated vsize (KiB) 5471144

[startup+854.701 s]
/proc/loadavg: 2.10 2.69 3.09 3/436 29832
/proc/meminfo: memFree=21873084/32951124 swapFree=67111348/67111528
[pid=29665] ppid=29663 vsize=341036 CPUtime=0.75 cores=5,7
/proc/29665/stat : 29665 (python) S 29663 29665 27552 0 -1 4202496 14259 931 1 0 65 10 0 0 19 0 7 0 657400058 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29665/statm: 85259 7343 1888 364 0 21162 0
[pid=29671] ppid=29665 vsize=289196 CPUtime=0.27 cores=5,7
/proc/29671/stat : 29671 (python) S 29665 29665 27552 0 -1 4202560 1171 0 0 0 15 12 0 0 19 0 2 0 657400138 296136704 5743 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29671/statm: 72299 5743 415 364 0 8217 0
[pid=29673] ppid=29671 vsize=1017932 CPUtime=98.29 cores=5,7
/proc/29673/stat : 29673 (gnovelty+2) T 29671 29673 29673 0 -1 4202496 514 0 0 0 9829 0 0 0 25 0 1 0 657400138 1042362368 247 33554432000 134512640 135663704 4287654400 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29673/statm: 254483 247 113 282 0 254199 0
[pid=29671/tid=29680] ppid=29665 vsize=289196 CPUtime=0 cores=5,7
/proc/29671/task/29680/stat : 29680 (python) S 29665 29665 27552 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657409967 296136704 5743 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604469316628864 0 0 -1 7 0 0 0
[pid=29681] ppid=29665 vsize=289208 CPUtime=0.28 cores=5,7
/proc/29681/stat : 29681 (python) S 29665 29665 27552 0 -1 4202560 1082 0 0 0 12 16 0 0 19 0 2 0 657409968 296148992 5728 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29681/statm: 72302 5728 400 364 0 8217 0
[pid=29683] ppid=29681 vsize=1017932 CPUtime=99.98 cores=5,7
/proc/29683/stat : 29683 (gnovelty+2) T 29681 29683 29683 0 -1 4202496 512 0 0 0 9998 0 0 0 25 0 1 0 657409969 1042362368 247 33554432000 134512640 135663704 4290235280 18446744073709551615 134524931 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29683/statm: 254483 247 113 282 0 254199 0
[pid=29681/tid=29704] ppid=29665 vsize=289208 CPUtime=0 cores=5,7
/proc/29681/task/29704/stat : 29704 (python) S 29665 29665 27552 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657419997 296148992 5728 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604456684565440 0 0 -1 7 0 0 0
[pid=29705] ppid=29665 vsize=299740 CPUtime=0.28 cores=5,7
/proc/29705/stat : 29705 (python) S 29665 29665 27552 0 -1 4202560 1091 0 0 0 15 13 0 0 19 0 2 0 657419998 306933760 5769 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29705/statm: 74935 5769 400 364 0 10847 0
[pid=29707] ppid=29705 vsize=416788 CPUtime=99.98 cores=5,7
/proc/29707/stat : 29707 (adaptg2wsat2009) T 29705 29707 29707 0 -1 4202496 630 0 0 0 9998 0 0 0 25 0 1 0 657419998 426790912 364 33554432000 134512640 135107411 4289343936 18446744073709551615 134532091 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29707/statm: 104197 364 59 146 0 103073 0
[pid=29705/tid=29741] ppid=29665 vsize=299740 CPUtime=0 cores=5,7
/proc/29705/task/29741/stat : 29741 (python) S 29665 29665 27552 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 657430026 306933760 5769 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604467727399040 0 0 -1 5 0 0 0
[pid=29743] ppid=29665 vsize=309996 CPUtime=0.28 cores=5,7
/proc/29743/stat : 29743 (python) S 29665 29665 27552 0 -1 4202560 1091 0 0 0 13 15 0 0 19 0 2 0 657430027 317435904 5794 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29743/statm: 77499 5794 400 364 0 13408 0
[pid=29745] ppid=29743 vsize=416788 CPUtime=99.99 cores=5,7
/proc/29745/stat : 29745 (adaptg2wsat2009) T 29743 29745 29745 0 -1 4202496 624 0 0 0 9999 0 0 0 25 0 1 0 657430027 426790912 364 33554432000 134512640 135107411 4290351088 18446744073709551615 134531656 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29745/statm: 104197 364 59 146 0 103073 0
[pid=29743/tid=29764] ppid=29665 vsize=309996 CPUtime=0 cores=5,7
/proc/29743/task/29764/stat : 29764 (python) S 29665 29665 27552 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 657440055 317435904 5794 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604457984530496 0 0 -1 5 0 0 0
[pid=29765] ppid=29665 vsize=320252 CPUtime=0.3 cores=5,7
/proc/29765/stat : 29765 (python) S 29665 29665 27552 0 -1 4202560 1098 0 0 0 15 15 0 0 19 0 2 0 657440056 327938048 5800 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29765/statm: 80063 5800 400 364 0 15969 0
[pid=29768] ppid=29765 vsize=416788 CPUtime=99.95 cores=5,7
/proc/29768/stat : 29768 (adaptg2wsat2009) T 29765 29768 29768 0 -1 4202496 627 0 0 0 9995 0 0 0 25 0 1 0 657440057 426790912 364 33554432000 134512640 135107411 4293715872 18446744073709551615 134531674 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29768/statm: 104197 364 59 146 0 103073 0
[pid=29765/tid=29783] ppid=29665 vsize=320252 CPUtime=0 cores=5,7
/proc/29765/task/29783/stat : 29783 (python) S 29665 29665 27552 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657450085 327938048 5800 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 514 18446604463485186240 0 0 -1 5 0 0 0
[pid=29784] ppid=29665 vsize=330792 CPUtime=1.17 cores=5,7
/proc/29784/stat : 29784 (python) S 29665 29665 27552 0 -1 4202560 1009 0 0 0 61 56 0 0 15 0 1 0 657450087 338731008 5822 33554432000 4194304 5683644 140733354930880 18446744073709551615 212687695430 0 0 16781312 514 5606903191577788679 0 0 17 5 0 0 0
/proc/29784/statm: 82698 5822 371 364 0 18601 0
[pid=29787] ppid=29784 vsize=4696 CPUtime=353.49 cores=5,7
/proc/29787/stat : 29787 (march_hi) R 29784 29787 29787 0 -1 4202496 1691 0 0 0 35349 0 0 0 25 0 1 0 657450087 4808704 799 33554432000 4194304 4955518 140737012451696 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29787/statm: 1174 799 106 186 0 987 0
[pid=29665/tid=29672] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29672/stat : 29672 (python) S 29663 29665 27552 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 7 0 657400138 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29682] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29682/stat : 29682 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657409968 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29706] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29706/stat : 29706 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657419998 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29744] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29744/stat : 29744 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657430027 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29766] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29766/stat : 29766 (python) S 29663 29665 27552 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 7 0 657440056 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
[pid=29665/tid=29786] ppid=29663 vsize=341036 CPUtime=0 cores=5,7
/proc/29665/task/29786/stat : 29786 (python) S 29663 29665 27552 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 7 0 657450087 349220864 7343 33554432000 4194304 5683644 140733354930880 18446744073709551615 212699498929 0 0 16781312 2 18446604467504414912 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 855.01
Current children cumulated vsize (KiB) 5471144

Child status: 0
Real time (s): 854.741
CPU time (s): 855.19
CPU user time (s): 853.749
CPU system time (s): 1.44078
CPU usage (%): 100.052
Max. virtual memory (cumulated for all children) (KiB): 5471144

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 853.749
system time used= 1.44078
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 31079
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2594
involuntary context switches= 3543

runsolver used 3.24551 second user time and 7.62584 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-15 13:13:43
IDJOB=3377781
IDBENCH=83090
IDSOLVER=1857
FILE ID=node139/3377781-1305458023
RUNJOBID= node139-1305458019-29405
PBS_JOBID= 13324881
Free space on /tmp= 73316 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S1675230100-032.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3377781-1305458023/watcher-3377781-1305458023 -o /tmp/evaluation-result-3377781-1305458023/solver-3377781-1305458023 -C 2400 -W 1300 -M 7680  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3377781-1305458023.cnf -seed 229177894 -budget 2400

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= f9a60c414c65108f1df33ba3a81b8715
RANDOM SEED=229177894

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21862636 kB
Buffers:        316492 kB
Cached:        3109848 kB
SwapCached:          0 kB
Active:        8695020 kB
Inactive:      2077180 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21862636 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:          127704 kB
Writeback:          40 kB
AnonPages:     7345616 kB
Mapped:          37108 kB
Slab:           207992 kB
PageTables:      43428 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 80497580 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73336 MiB
End job on node139 at 2011-05-15 13:27:58