Trace number 3322311

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 3219.9 508.219

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S2117313371-002.UNKNOWN.cnf
MD5SUM80ed5c7022fbd1c0bf0af45d87bcb3f8
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark373.874
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data 

0.31/0.45	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.45	c INFO: solving HOME/instance-3322311-1304380192.cnf
0.31/0.45	c INFO: computing task features
0.31/0.49	c INFO: computed variable-clause graph statistics
0.31/0.49	c INFO: computed clause balance statistics
0.51/0.67	c INFO: computed variable balance statistics
0.61/0.75	c INFO: computed small-clause counts
0.61/0.75	c INFO: computed Horn-clause counts
0.61/0.75	c INFO: computed variable graph statistics
0.61/0.75	c INFO: collected features for HOME/instance-3322311-1304380192.cnf in 0.30 s
0.61/0.79	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.55)
0.70/0.83	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.10)
0.70/0.86	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.05)
0.80/0.90	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.03)
0.80/0.94	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.03)
0.80/0.97	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.02)
1.54/1.01	c INFO: running FH@0 for 97 with 39999 remaining (b = 0.02)
1.54/1.05	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.01)
629.13/101.12	c INFO: running march_hi@0 for 2134 with 39899 remaining (b = 0.30)
629.67/101.25	c INFO: running march_hi@0 for 2134 with 39899 remaining (b = 0.28)
630.09/101.31	c INFO: running march_hi@0 for 388 with 39899 remaining (b = 0.11)
630.50/101.46	c INFO: running march_hi@0 for 388 with 39899 remaining (b = 0.09)
884.22/143.61	c INFO: running march_hi@0 for 485 with 39856 remaining (b = 0.09)
918.45/149.32	c INFO: running march_hi@0 for 485 with 39851 remaining (b = 0.07)
953.91/155.25	c INFO: running adaptg2wsat2009++@0 for 97 with 39845 remaining (b = 0.01)
1216.59/196.73	c INFO: running adaptg2wsat2009++@0 for 97 with 39803 remaining (b = 0.01)
1868.40/294.04	c INFO: running adaptg2wsat2009++@0 for 97 with 39706 remaining (b = 0.01)
2075.71/323.75	c INFO: running adaptg2wsat2009++@100 for 97 with 39676 remaining (b = 0.01)
2591.83/403.38	c INFO: running march_hi@0 for 388 with 39597 remaining (b = 0.05)
3219.08/508.19	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322311-1304380192/watcher-3322311-1304380192 -o /tmp/evaluation-result-3322311-1304380192/solver-3322311-1304380192 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322311-1304380192.cnf -seed 198129930 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.00 9.26 9.80 3/349 30594
/proc/meminfo: memFree=19711600/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=16240 CPUtime=0 cores=0-7
/proc/30594/stat : 30594 (python) R 30592 30594 28735 0 -1 4202496 998 0 0 0 0 0 0 0 22 0 1 0 549616937 16629760 870 33554432000 4194304 5683644 140734841254624 18446744073709551615 4865408 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/30594/statm: 4060 870 368 364 0 547 0

[startup+0.0747321 s]
/proc/loadavg: 7.00 9.26 9.80 3/349 30594
/proc/meminfo: memFree=19711600/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=84812 CPUtime=0.05 cores=0-7
/proc/30594/stat : 30594 (python) R 30592 30594 28735 0 -1 4202496 2432 0 0 0 4 1 0 0 23 0 1 0 549616937 86847488 2158 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905730816 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/30594/statm: 21203 2172 707 364 0 1420 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 84812

[startup+0.100726 s]
/proc/loadavg: 7.00 9.26 9.80 3/349 30594
/proc/meminfo: memFree=19711600/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=104616 CPUtime=0.07 cores=0-7
/proc/30594/stat : 30594 (python) R 30592 30594 28735 0 -1 4202496 3144 0 0 0 5 2 0 0 23 0 1 0 549616937 107126784 2822 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905398203 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/30594/statm: 26154 2822 847 364 0 1902 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104616

[startup+0.300691 s]
/proc/loadavg: 7.00 9.26 9.80 3/349 30594
/proc/meminfo: memFree=19711600/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=198916 CPUtime=0.22 cores=0-7
/proc/30594/stat : 30594 (python) R 30592 30594 28735 0 -1 4202496 7023 933 1 0 16 6 0 0 17 0 1 0 549616937 203689984 5053 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905390210 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/30594/statm: 49729 5053 1466 364 0 3756 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 198916

[startup+0.700614 s]
/proc/loadavg: 7.00 9.26 9.80 3/349 30594
/proc/meminfo: memFree=19711600/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=279556 CPUtime=0.61 cores=0-7
/proc/30594/stat : 30594 (python) R 30592 30594 28735 0 -1 4202496 9756 933 1 0 53 8 0 0 17 0 1 0 549616937 286265344 7275 33554432000 4194304 5683644 140734841254624 18446744073709551615 4941968 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/30594/statm: 69889 7275 1827 364 0 5813 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 279556

[startup+1.50143 s]
/proc/loadavg: 7.00 9.26 9.80 11/367 30616
/proc/meminfo: memFree=19661856/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=426808 CPUtime=0.96 cores=0-7
/proc/30594/stat : 30594 (python) S 30592 30594 28735 0 -1 4202496 15830 933 1 0 86 10 0 0 24 0 9 0 549616937 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/30594/statm: 106702 7534 1891 364 0 42599 0
[pid=30600] ppid=30594 vsize=278704 CPUtime=0 cores=0-7
/proc/30600/stat : 30600 (python) S 30594 30594 28735 0 -1 4202560 739 0 0 0 0 0 0 0 19 0 1 0 549617016 285392896 5615 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751055 0 0 16781312 514 4772197403069513727 0 0 17 1 0 0 0
/proc/30600/statm: 69676 5615 354 364 0 5594 0
[pid=30602] ppid=30600 vsize=1017932 CPUtime=0.5 cores=0-7
/proc/30602/stat : 30602 (gnovelty+2) R 30600 30602 30602 0 -1 4202496 512 0 0 0 50 0 0 0 22 0 1 0 549617017 1042362368 248 33554432000 134512640 135663704 4287526672 18446744073709551615 134524874 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/30602/statm: 254483 248 113 282 0 254199 0
[pid=30603] ppid=30594 vsize=289356 CPUtime=0 cores=0-7
/proc/30603/stat : 30603 (python) S 30594 30594 28735 0 -1 4202560 732 0 0 0 0 0 0 0 19 0 1 0 549617020 296300544 5697 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 4772205099650908159 0 0 17 1 0 0 0
/proc/30603/statm: 72339 5697 348 364 0 8254 0
[pid=30605] ppid=30603 vsize=1017932 CPUtime=0.66 cores=0-7
/proc/30605/stat : 30605 (gnovelty+2) R 30603 30605 30605 0 -1 4202496 511 0 0 0 66 0 0 0 22 0 1 0 549617020 1042362368 247 33554432000 134512640 135663704 4292300112 18446744073709551615 134524551 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30605/statm: 254483 247 113 282 0 254199 0
[pid=30606] ppid=30594 vsize=364820 CPUtime=0 cores=0-7
/proc/30606/stat : 30606 (python) S 30594 30594 28735 0 -1 4202560 720 0 0 0 0 0 0 0 19 0 1 0 549617024 373575680 5612 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 4631059967359582207 0 0 17 1 0 0 0
/proc/30606/statm: 91205 5612 344 364 0 27117 0
[pid=30608] ppid=30606 vsize=416652 CPUtime=0.61 cores=0-7
/proc/30608/stat : 30608 (adaptg2wsat2009) R 30606 30608 30608 0 -1 4202496 570 0 0 0 61 0 0 0 22 0 1 0 549617024 426651648 302 33554432000 134512640 135107411 4289730096 18446744073709551615 134523452 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/30608/statm: 104163 302 49 146 0 103039 0
[pid=30609] ppid=30594 vsize=375540 CPUtime=0 cores=0-7
/proc/30609/stat : 30609 (python) S 30594 30594 28735 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 549617027 384552960 5720 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 4261060560717611007 0 0 17 1 0 0 0
/proc/30609/statm: 93885 5720 344 364 0 29794 0
[pid=30611] ppid=30609 vsize=416652 CPUtime=0.57 cores=0-7
/proc/30611/stat : 30611 (adaptg2wsat2009) R 30609 30611 30611 0 -1 4202496 569 0 0 0 57 0 0 0 20 0 1 0 549617028 426651648 304 33554432000 134512640 135107411 4293890000 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/30611/statm: 104163 304 49 146 0 103039 0
[pid=30612] ppid=30594 vsize=385796 CPUtime=0 cores=0-7
/proc/30612/stat : 30612 (python) S 30594 30594 28735 0 -1 4202560 705 0 0 0 0 0 0 0 19 0 1 0 549617031 395055104 5895 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 4271848419053535231 0 0 17 1 0 0 0
/proc/30612/statm: 96449 5895 344 364 0 32355 0
[pid=30614] ppid=30612 vsize=416652 CPUtime=0.53 cores=0-7
/proc/30614/stat : 30614 (adaptg2wsat2009) R 30612 30614 30614 0 -1 4202496 558 0 0 0 53 0 0 0 22 0 1 0 549617033 426651648 303 33554432000 134512640 135107411 4291883312 18446744073709551615 134523455 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30614/statm: 104163 303 49 146 0 103039 0
[pid=30615] ppid=30594 vsize=396052 CPUtime=0 cores=0-7
/proc/30615/stat : 30615 (python) S 30594 30594 28735 0 -1 4202560 730 0 0 0 0 0 0 0 20 0 1 0 549617035 405557248 5876 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 10860096803919888383 0 0 17 6 0 0 0
/proc/30615/statm: 99013 5876 348 364 0 34916 0
[pid=30594/tid=30601] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30601/stat : 30601 (python) S 30592 30594 28735 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 9 0 549617016 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 0 0 0 0
[pid=30594/tid=30604] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30604/stat : 30604 (python) S 30592 30594 28735 0 -1 4202560 20 933 0 0 0 0 0 0 18 0 9 0 549617020 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 5 0 0 0
[pid=30594/tid=30607] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30607/stat : 30607 (python) S 30592 30594 28735 0 -1 4202560 21 933 0 0 0 0 0 0 19 0 9 0 549617024 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 0 0 0 0
[pid=30594/tid=30610] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30610/stat : 30610 (python) S 30592 30594 28735 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 9 0 549617027 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 7 0 0 0
[pid=30594/tid=30613] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30613/stat : 30613 (python) S 30592 30594 28735 0 -1 4202560 82 933 0 0 0 0 0 0 19 0 9 0 549617031 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30616] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30616/stat : 30616 (python) S 30592 30594 28735 0 -1 4202560 33 933 0 0 0 0 0 0 21 0 9 0 549617035 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.83
Current children cumulated vsize (KiB) 5802896

[startup+3.10115 s]
/proc/loadavg: 7.00 9.26 9.80 11/374 30623
/proc/meminfo: memFree=19649896/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=426808 CPUtime=0.96 cores=0-7
/proc/30594/stat : 30594 (python) S 30592 30594 28735 0 -1 4202496 15830 933 1 0 86 10 0 0 24 0 9 0 549616937 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/30594/statm: 106702 7534 1891 364 0 42599 0
[pid=30600] ppid=30594 vsize=278704 CPUtime=0 cores=0-7
/proc/30600/stat : 30600 (python) S 30594 30594 28735 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 549617016 285392896 5615 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751055 0 0 16781312 514 4772197403069481219 0 0 17 1 0 0 0
/proc/30600/statm: 69676 5615 354 364 0 5594 0
[pid=30602] ppid=30600 vsize=1017932 CPUtime=1.29 cores=0-7
/proc/30602/stat : 30602 (gnovelty+2) R 30600 30602 30602 0 -1 4202496 512 0 0 0 129 0 0 0 25 0 1 0 549617017 1042362368 248 33554432000 134512640 135663704 4287526672 18446744073709551615 134525107 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/30602/statm: 254483 248 113 282 0 254199 0
[pid=30603] ppid=30594 vsize=289356 CPUtime=0 cores=0-7
/proc/30603/stat : 30603 (python) S 30594 30594 28735 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 549617020 296300544 5697 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 4772205099650875652 0 0 17 1 0 0 0
/proc/30603/statm: 72339 5697 348 364 0 8254 0
[pid=30605] ppid=30603 vsize=1017932 CPUtime=2.26 cores=0-7
/proc/30605/stat : 30605 (gnovelty+2) R 30603 30605 30605 0 -1 4202496 511 0 0 0 226 0 0 0 25 0 1 0 549617020 1042362368 247 33554432000 134512640 135663704 4292300112 18446744073709551615 134524720 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30605/statm: 254483 247 113 282 0 254199 0
[pid=30606] ppid=30594 vsize=364820 CPUtime=0 cores=0-7
/proc/30606/stat : 30606 (python) S 30594 30594 28735 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 549617024 373575680 5616 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 4631059967359549698 0 0 17 1 0 0 0
/proc/30606/statm: 91205 5616 348 364 0 27117 0
[pid=30608] ppid=30606 vsize=416788 CPUtime=2.21 cores=0-7
/proc/30608/stat : 30608 (adaptg2wsat2009) R 30606 30608 30608 0 -1 4202496 631 0 0 0 221 0 0 0 25 0 1 0 549617024 426790912 363 33554432000 134512640 135107411 4289730096 18446744073709551615 134531942 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/30608/statm: 104197 363 59 146 0 103073 0
[pid=30609] ppid=30594 vsize=375540 CPUtime=0 cores=0-7
/proc/30609/stat : 30609 (python) S 30594 30594 28735 0 -1 4202560 754 0 0 0 0 0 0 0 18 0 1 0 549617027 384552960 5724 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 4261060560717578499 0 0 17 1 0 0 0
/proc/30609/statm: 93885 5724 348 364 0 29794 0
[pid=30611] ppid=30609 vsize=416788 CPUtime=2.16 cores=0-7
/proc/30611/stat : 30611 (adaptg2wsat2009) R 30609 30611 30611 0 -1 4202496 629 0 0 0 216 0 0 0 25 0 1 0 549617028 426790912 364 33554432000 134512640 135107411 4293890000 18446744073709551615 134539338 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/30611/statm: 104197 364 59 146 0 103073 0
[pid=30612] ppid=30594 vsize=385796 CPUtime=0 cores=0-7
/proc/30612/stat : 30612 (python) S 30594 30594 28735 0 -1 4202560 722 0 0 0 0 0 0 0 18 0 1 0 549617031 395055104 5899 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 4271848419053502721 0 0 17 1 0 0 0
/proc/30612/statm: 96449 5899 348 364 0 32355 0
[pid=30614] ppid=30612 vsize=416788 CPUtime=2.13 cores=0-7
/proc/30614/stat : 30614 (adaptg2wsat2009) R 30612 30614 30614 0 -1 4202496 618 0 0 0 213 0 0 0 25 0 1 0 549617033 426790912 363 33554432000 134512640 135107411 4291883312 18446744073709551615 134531768 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30614/statm: 104197 363 59 146 0 103073 0
[pid=30615] ppid=30594 vsize=396052 CPUtime=0 cores=0-7
/proc/30615/stat : 30615 (python) S 30594 30594 28735 0 -1 4202560 730 0 0 0 0 0 0 0 18 0 1 0 549617035 405557248 5876 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 10860096803919855874 0 0 17 6 0 0 0
/proc/30615/statm: 99013 5876 348 364 0 34916 0
[pid=30617] ppid=30615 vsize=1017932 CPUtime=2.04 cores=0-7
/proc/30617/stat : 30617 (gnovelty+2) R 30615 30617 30617 0 -1 4202496 504 0 0 0 204 0 0 0 25 0 1 0 549617037 1042362368 248 33554432000 134512640 135663704 4292282016 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30617/statm: 254483 248 113 282 0 254199 0
[pid=30618] ppid=30594 vsize=406308 CPUtime=0 cores=0-7
/proc/30618/stat : 30618 (python) S 30594 30594 28735 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 549617039 416059392 5846 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 3653880278167846911 0 0 17 1 0 0 0
/proc/30618/statm: 101577 5846 348 364 0 37477 0
[pid=30623] ppid=30618 vsize=246936 CPUtime=1.01 cores=0-7
/proc/30623/stat : 30623 (FH) R 30618 30623 30623 0 -1 4202496 585 0 0 0 101 0 0 0 25 0 1 0 549617047 252862464 326 33554432000 134512640 134936988 4288326800 18446744073709551615 134546502 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30623/statm: 61734 326 41 104 0 61238 0
[pid=30620] ppid=30594 vsize=416564 CPUtime=0 cores=0-7
/proc/30620/stat : 30620 (python) S 30594 30594 28735 0 -1 4202560 771 0 0 0 0 0 0 0 18 0 1 0 549617042 426561536 5993 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 15484334572212060159 0 0 17 6 0 0 0
/proc/30620/statm: 104141 5993 354 364 0 40038 0
[pid=30622] ppid=30620 vsize=416788 CPUtime=0.99 cores=0-7
/proc/30622/stat : 30622 (adaptg2wsat2009) R 30620 30622 30622 0 -1 4202496 625 0 0 0 99 0 0 0 25 0 1 0 549617043 426790912 362 33554432000 134512640 135107411 4287371520 18446744073709551615 134532358 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/30622/statm: 104197 362 59 146 0 103073 0
[pid=30594/tid=30601] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30601/stat : 30601 (python) S 30592 30594 28735 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 9 0 549617016 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 0 0 0 0
[pid=30594/tid=30604] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30604/stat : 30604 (python) S 30592 30594 28735 0 -1 4202560 20 933 0 0 0 0 0 0 18 0 9 0 549617020 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 5 0 0 0
[pid=30594/tid=30607] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30607/stat : 30607 (python) S 30592 30594 28735 0 -1 4202560 21 933 0 0 0 0 0 0 19 0 9 0 549617024 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 0 0 0 0
[pid=30594/tid=30610] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30610/stat : 30610 (python) S 30592 30594 28735 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 9 0 549617027 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 7 0 0 0
[pid=30594/tid=30613] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30613/stat : 30613 (python) S 30592 30594 28735 0 -1 4202560 82 933 0 0 0 0 0 0 19 0 9 0 549617031 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30616] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30616/stat : 30616 (python) S 30592 30594 28735 0 -1 4202560 33 933 0 0 0 0 0 0 21 0 9 0 549617035 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30619] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30619/stat : 30619 (python) S 30592 30594 28735 0 -1 4202560 32 933 0 0 0 0 0 0 22 0 9 0 549617039 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30621] ppid=30592 vsize=426808 CPUtime=0 cores=0-7
/proc/30594/task/30621/stat : 30621 (python) S 30592 30594 28735 0 -1 4202560 36 933 0 0 0 0 0 0 25 0 9 0 549617043 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 15.05
Current children cumulated vsize (KiB) 8307832

[startup+6.30157 s]
/proc/loadavg: 7.24 9.28 9.80 11/374 30623
/proc/meminfo: memFree=19648868/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=426808 CPUtime=0.96 cores=0-7
/proc/30594/stat : 30594 (python) S 30592 30594 28735 0 -1 4202496 15830 933 1 0 86 10 0 0 24 0 9 0 549616937 437051392 7534 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/30594/statm: 106702 7534 1891 364 0 42599 0
[pid=30600] ppid=30594 vsize=278704 CPUtime=0.01 cores=0-7
/proc/30600/stat : 30600 (python) S 30594 30594 28735 0 -1 4202560 898 0 0 0 1 0 0 0 18 0 1 0 549617016 285392896 5638 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751055 0 0 16781312 514 4772197403069481219 0 0 17 1 0 0 0
/proc/30600/statm: 69676 5638 377 364 0 5594 0

################
# More data... #
################

[pid=30594/tid=30629] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30629/stat : 30629 (python) S 30592 30594 28735 0 -1 4202560 40 933 0 0 0 0 0 0 19 0 16 0 549627049 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30633] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30633/stat : 30633 (python) S 30592 30594 28735 0 -1 4202560 31 933 0 0 0 0 0 0 21 0 16 0 549627063 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30636] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30636/stat : 30636 (python) S 30592 30594 28735 0 -1 4202560 34 933 0 0 0 0 0 0 22 0 16 0 549627069 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 4 0 0 0
[pid=30594/tid=30640] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30640/stat : 30640 (python) S 30592 30594 28735 0 -1 4202560 33 933 0 0 0 0 0 0 24 0 16 0 549627084 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 4 0 0 0
[pid=30594/tid=30646] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30646/stat : 30646 (python) S 30592 30594 28735 0 -1 4202560 34 933 0 0 0 0 0 0 19 0 16 0 549631299 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 3 0 0 0
[pid=30594/tid=30650] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30650/stat : 30650 (python) S 30592 30594 28735 0 -1 4202560 34 933 0 0 0 0 0 0 19 0 16 0 549631870 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 3 0 0 0
[pid=30594/tid=30661] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30661/stat : 30661 (python) S 30592 30594 28735 0 -1 4202560 41 933 0 0 0 0 0 0 19 0 16 0 549657275 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3217.82
Current children cumulated vsize (KiB) 11614752

[startup+508.102 s]
/proc/loadavg: 10.16 9.98 9.93 13/403 30665
/proc/meminfo: memFree=19606028/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=498600 CPUtime=1.53 cores=0-7
/proc/30594/stat : 30594 (python) S 30592 30594 28735 0 -1 4202496 23397 933 1 0 141 12 0 0 19 0 16 0 549616937 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/30594/statm: 124650 7577 1906 364 0 60526 0
[pid=30600] ppid=30594 vsize=288948 CPUtime=0.41 cores=0-7
/proc/30600/stat : 30600 (python) S 30594 30594 28735 0 -1 4202560 1104 0 0 0 20 21 0 0 19 0 2 0 549617016 295882752 5676 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/30600/statm: 72237 5676 410 364 0 8155 0
[pid=30602] ppid=30600 vsize=1017932 CPUtime=98.58 cores=0-7
/proc/30602/stat : 30602 (gnovelty+2) T 30600 30602 30602 0 -1 4202496 512 0 0 0 9858 0 0 0 25 0 1 0 549617017 1042362368 248 33554432000 134512640 135663704 4287526672 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/30602/statm: 254483 248 113 282 0 254199 0
[pid=30600/tid=30652] ppid=30594 vsize=288948 CPUtime=0 cores=0-7
/proc/30600/task/30652/stat : 30652 (python) S 30594 30594 28735 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 549632456 295882752 5676 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 514 18446604449728839744 0 0 -1 0 0 0 0
[pid=30603] ppid=30594 vsize=289356 CPUtime=0.25 cores=0-7
/proc/30603/stat : 30603 (python) S 30594 30594 28735 0 -1 4202560 1085 0 0 0 12 13 0 0 19 0 2 0 549617020 296300544 5750 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/30603/statm: 72339 5750 400 364 0 8254 0
[pid=30605] ppid=30603 vsize=1017932 CPUtime=100.24 cores=0-7
/proc/30605/stat : 30605 (gnovelty+2) T 30603 30605 30605 0 -1 4202496 511 0 0 0 10024 0 0 0 25 0 1 0 549617020 1042362368 247 33554432000 134512640 135663704 4292300112 18446744073709551615 134547022 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/30605/statm: 254483 247 113 282 0 254199 0
[pid=30603/tid=30626] ppid=30594 vsize=289356 CPUtime=0 cores=0-7
/proc/30603/task/30626/stat : 30626 (python) S 30594 30594 28735 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 549627045 296300544 5750 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 514 18446604449728841536 0 0 -1 1 0 0 0
[pid=30606] ppid=30594 vsize=364820 CPUtime=0.72 cores=0-7
/proc/30606/stat : 30606 (python) S 30594 30594 28735 0 -1 4202560 1159 0 0 0 37 35 0 0 18 0 2 0 549617024 373575680 5669 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/30606/statm: 91205 5669 400 364 0 27117 0
[pid=30608] ppid=30606 vsize=416788 CPUtime=197.57 cores=0-7
/proc/30608/stat : 30608 (adaptg2wsat2009) T 30606 30608 30608 0 -1 4202496 631 0 0 0 19757 0 0 0 25 0 1 0 549617024 426790912 363 33554432000 134512640 135107411 4289730096 18446744073709551615 134531239 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/30608/statm: 104197 363 59 146 0 103073 0
[pid=30606/tid=30627] ppid=30594 vsize=364820 CPUtime=0 cores=0-7
/proc/30606/task/30627/stat : 30627 (python) S 30594 30594 28735 0 -1 4202560 50 0 0 0 0 0 0 0 18 0 2 0 549627049 373575680 5669 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 514 18446604449695978624 0 0 -1 1 0 0 0
[pid=30609] ppid=30594 vsize=375540 CPUtime=0.69 cores=0-7
/proc/30609/stat : 30609 (python) S 30594 30594 28735 0 -1 4202560 1161 0 0 0 34 35 0 0 18 0 2 0 549617027 384552960 5777 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/30609/statm: 93885 5777 400 364 0 29794 0
[pid=30611] ppid=30609 vsize=416788 CPUtime=197.15 cores=0-7
/proc/30611/stat : 30611 (adaptg2wsat2009) T 30609 30611 30611 0 -1 4202496 629 0 0 0 19715 0 0 0 25 0 1 0 549617028 426790912 364 33554432000 134512640 135107411 4293890000 18446744073709551615 134531848 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/30611/statm: 104197 364 59 146 0 103073 0
[pid=30609/tid=30648] ppid=30594 vsize=375540 CPUtime=0 cores=0-7
/proc/30609/task/30648/stat : 30648 (python) S 30594 30594 28735 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 549631864 384552960 5777 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 514 18446604453904798720 0 0 -1 1 0 0 0
[pid=30612] ppid=30594 vsize=385796 CPUtime=0.52 cores=0-7
/proc/30612/stat : 30612 (python) S 30594 30594 28735 0 -1 4202560 1030 0 0 0 24 28 0 0 18 0 2 0 549617031 395055104 5952 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/30612/statm: 96449 5952 400 364 0 32355 0
[pid=30614] ppid=30612 vsize=416788 CPUtime=195.4 cores=0-7
/proc/30614/stat : 30614 (adaptg2wsat2009) T 30612 30614 30614 0 -1 4202496 618 0 0 0 19540 0 0 0 25 0 1 0 549617033 426790912 363 33554432000 134512640 135107411 4291883312 18446744073709551615 134531709 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/30614/statm: 104197 363 59 146 0 103073 0
[pid=30612/tid=30631] ppid=30594 vsize=385796 CPUtime=0 cores=0-7
/proc/30612/task/30631/stat : 30631 (python) S 30594 30594 28735 0 -1 4202560 115 0 0 0 0 0 0 0 18 0 2 0 549627057 395055104 5952 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 514 18446604453907310464 0 0 -1 1 0 0 0
[pid=30615] ppid=30594 vsize=396052 CPUtime=0.26 cores=0-7
/proc/30615/stat : 30615 (python) S 30594 30594 28735 0 -1 4202560 987 0 0 0 13 13 0 0 19 0 2 0 549617035 405557248 5929 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/30615/statm: 99013 5929 400 364 0 34916 0
[pid=30617] ppid=30615 vsize=1017932 CPUtime=99.62 cores=0-7
/proc/30617/stat : 30617 (gnovelty+2) T 30615 30617 30617 0 -1 4202496 504 0 0 0 9962 0 0 0 25 0 1 0 549617037 1042362368 248 33554432000 134512640 135663704 4292282016 18446744073709551615 134525678 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/30617/statm: 254483 248 113 282 0 254199 0
[pid=30615/tid=30638] ppid=30594 vsize=396052 CPUtime=0 cores=0-7
/proc/30615/task/30638/stat : 30638 (python) S 30594 30594 28735 0 -1 4202560 68 0 0 0 0 0 0 0 19 0 2 0 549627069 405557248 5929 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 514 18446604442556354688 0 0 -1 6 0 0 0
[pid=30618] ppid=30594 vsize=406308 CPUtime=0.38 cores=0-7
/proc/30618/stat : 30618 (python) S 30594 30594 28735 0 -1 4202560 1000 0 0 0 20 18 0 0 19 0 2 0 549617039 416059392 5899 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/30618/statm: 101577 5899 400 364 0 37477 0
[pid=30623] ppid=30618 vsize=246936 CPUtime=99.9 cores=0-7
/proc/30623/stat : 30623 (FH) T 30618 30623 30623 0 -1 4202496 585 0 0 0 9990 0 0 0 25 0 1 0 549617047 252862464 326 33554432000 134512640 134936988 4288326800 18446744073709551615 134553238 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/30623/statm: 61734 326 41 104 0 61238 0
[pid=30618/tid=30644] ppid=30594 vsize=406308 CPUtime=0 cores=0-7
/proc/30618/task/30644/stat : 30644 (python) S 30594 30594 28735 0 -1 4202560 69 0 0 0 0 0 0 0 19 0 2 0 549631293 416059392 5899 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 514 18446604445173493952 0 0 -1 2 0 0 0
[pid=30620] ppid=30594 vsize=416564 CPUtime=1.02 cores=0-7
/proc/30620/stat : 30620 (python) S 30594 30594 28735 0 -1 4202560 1044 0 0 0 55 47 0 0 18 0 2 0 549617042 426561536 6046 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/30620/statm: 104141 6046 406 364 0 40038 0
[pid=30622] ppid=30620 vsize=416788 CPUtime=190.41 cores=0-7
/proc/30622/stat : 30622 (adaptg2wsat2009) R 30620 30622 30622 0 -1 4202496 625 0 0 0 19041 0 0 0 25 0 1 0 549617043 426790912 362 33554432000 134512640 135107411 4287371520 18446744073709551615 134532318 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30622/statm: 104197 362 59 146 0 103073 0
[pid=30620/tid=30654] ppid=30594 vsize=416564 CPUtime=0 cores=0-7
/proc/30620/task/30654/stat : 30654 (python) S 30594 30594 28735 0 -1 4202560 76 0 0 0 0 0 0 0 19 0 2 0 549636605 426561536 6046 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 514 18446604447927986240 0 0 -1 1 0 0 0
[pid=30628] ppid=30594 vsize=426820 CPUtime=1.24 cores=0-7
/proc/30628/stat : 30628 (python) S 30594 30594 28735 0 -1 4202560 853 0 0 0 65 59 0 0 15 0 1 0 549627049 437063680 5913 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 16763330198933307651 0 0 17 1 0 0 0
/proc/30628/statm: 106705 5913 371 364 0 42599 0
[pid=30630] ppid=30628 vsize=3932 CPUtime=299.06 cores=0-7
/proc/30630/stat : 30630 (march_hi) R 30628 30630 30630 0 -1 4202496 1587 0 0 0 29906 0 0 0 25 0 1 0 549627051 4026368 692 33554432000 4194304 4955518 140733660416432 18446744073709551615 4224850 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30630/statm: 983 692 106 186 0 796 0
[pid=30632] ppid=30594 vsize=437076 CPUtime=3.75 cores=0-7
/proc/30632/stat : 30632 (python) R 30594 30594 28735 0 -1 4202560 869 0 0 0 283 92 0 0 18 0 1 0 549627063 447565824 6038 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/30632/statm: 109269 6038 372 364 0 45160 0
[pid=30634] ppid=30632 vsize=0 CPUtime=377.32 cores=0-7
/proc/30634/stat : 30634 (march_hi) R 30632 30634 30634 0 -1 4202500 1698 0 0 0 37731 1 0 0 25 0 1 0 549627065 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/30634/statm: 0 0 0 0 0 0 0
[pid=30635] ppid=30594 vsize=447332 CPUtime=1.26 cores=0-7
/proc/30635/stat : 30635 (python) S 30594 30594 28735 0 -1 4202560 870 0 0 0 67 59 0 0 15 0 1 0 549627069 458067968 5962 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 13335272850148262145 0 0 17 6 0 0 0
/proc/30635/statm: 111833 5962 371 364 0 47721 0
[pid=30637] ppid=30635 vsize=3932 CPUtime=371.17 cores=0-7
/proc/30637/stat : 30637 (march_hi) R 30635 30637 30637 0 -1 4202496 1682 0 0 0 37117 0 0 0 25 0 1 0 549627069 4026368 788 33554432000 4194304 4955518 140735003300640 18446744073709551615 4208676 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30637/statm: 983 788 106 186 0 796 0
[pid=30639] ppid=30594 vsize=457588 CPUtime=1.25 cores=0-7
/proc/30639/stat : 30639 (python) S 30594 30594 28735 0 -1 4202560 889 0 0 0 67 58 0 0 15 0 1 0 549627084 468570112 5990 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 16763330198933307651 0 0 17 0 0 0 0
/proc/30639/statm: 114397 5990 371 364 0 50282 0
[pid=30641] ppid=30639 vsize=3932 CPUtime=298.26 cores=0-7
/proc/30641/stat : 30641 (march_hi) R 30639 30641 30641 0 -1 4202496 1588 0 0 0 29825 1 0 0 25 0 1 0 549627094 4026368 691 33554432000 4194304 4955518 140735450923312 18446744073709551615 4297475 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30641/statm: 983 691 106 186 0 796 0
[pid=30645] ppid=30594 vsize=467844 CPUtime=1.11 cores=0-7
/proc/30645/stat : 30645 (python) S 30594 30594 28735 0 -1 4202560 886 0 0 0 58 53 0 0 15 0 1 0 549631299 479072256 5970 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 14746667548212691204 0 0 17 2 0 0 0
/proc/30645/statm: 116961 5970 371 364 0 52843 0
[pid=30647] ppid=30645 vsize=3932 CPUtime=350.65 cores=0-7
/proc/30647/stat : 30647 (march_hi) R 30645 30647 30647 0 -1 4202496 1653 0 0 0 35065 0 0 0 25 0 1 0 549631299 4026368 755 33554432000 4194304 4955518 140736841571968 18446744073709551615 4237786 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/30647/statm: 983 755 106 186 0 796 0
[pid=30649] ppid=30594 vsize=478100 CPUtime=1.08 cores=0-7
/proc/30649/stat : 30649 (python) S 30594 30594 28735 0 -1 4202560 893 0 0 0 54 54 0 0 15 0 1 0 549631870 489574400 6053 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 1221812509451714817 0 0 17 5 0 0 0
/proc/30649/statm: 119525 6053 371 364 0 55404 0
[pid=30651] ppid=30649 vsize=3420 CPUtime=275.68 cores=0-7
/proc/30651/stat : 30651 (march_hi) R 30649 30651 30651 0 -1 4202496 1564 0 0 0 27568 0 0 0 25 0 1 0 549631870 3502080 666 33554432000 4194304 4955518 140733720571328 18446744073709551615 4315128 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30651/statm: 855 666 106 186 0 668 0
[pid=30660] ppid=30594 vsize=488356 CPUtime=0.31 cores=0-7
/proc/30660/stat : 30660 (python) S 30594 30594 28735 0 -1 4202560 944 0 0 0 16 15 0 0 15 0 1 0 549657275 500076544 6047 33554432000 4194304 5683644 140734841254624 18446744073709551615 218905751110 0 0 16781312 514 9742702169273893123 0 0 17 1 0 0 0
/proc/30660/statm: 122089 6047 380 364 0 57965 0
[pid=30662] ppid=30660 vsize=2620 CPUtime=52.29 cores=0-7
/proc/30662/stat : 30662 (march_hi) R 30660 30662 30662 0 -1 4202496 1288 0 0 0 5229 0 0 0 25 0 1 0 549657276 2682880 432 33554432000 4194304 4955518 140735018786592 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30662/statm: 655 432 106 186 0 468 0
[pid=30594/tid=30601] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30601/stat : 30601 (python) S 30592 30594 28735 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 16 0 549617016 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 0 0 0 0
[pid=30594/tid=30604] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30604/stat : 30604 (python) S 30592 30594 28735 0 -1 4202560 20 933 0 0 0 0 0 0 18 0 16 0 549617020 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 5 0 0 0
[pid=30594/tid=30607] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30607/stat : 30607 (python) S 30592 30594 28735 0 -1 4202560 27 933 0 0 0 0 0 0 18 0 16 0 549617024 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 0 0 0 0
[pid=30594/tid=30610] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30610/stat : 30610 (python) S 30592 30594 28735 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 16 0 549617027 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 7 0 0 0
[pid=30594/tid=30613] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30613/stat : 30613 (python) S 30592 30594 28735 0 -1 4202560 88 933 0 0 0 0 0 0 18 0 16 0 549617031 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30616] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30616/stat : 30616 (python) S 30592 30594 28735 0 -1 4202560 33 933 0 0 0 0 0 0 21 0 16 0 549617035 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30619] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30619/stat : 30619 (python) S 30592 30594 28735 0 -1 4202560 32 933 0 0 0 0 0 0 22 0 16 0 549617039 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30621] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30621/stat : 30621 (python) S 30592 30594 28735 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 16 0 549617043 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30629] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30629/stat : 30629 (python) S 30592 30594 28735 0 -1 4202560 40 933 0 0 0 0 0 0 19 0 16 0 549627049 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30633] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30633/stat : 30633 (python) S 30592 30594 28735 0 -1 4202560 31 933 0 0 0 0 0 0 21 0 16 0 549627063 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 6 0 0 0
[pid=30594/tid=30636] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30636/stat : 30636 (python) S 30592 30594 28735 0 -1 4202560 34 933 0 0 0 0 0 0 22 0 16 0 549627069 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 4 0 0 0
[pid=30594/tid=30640] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30640/stat : 30640 (python) S 30592 30594 28735 0 -1 4202560 33 933 0 0 0 0 0 0 24 0 16 0 549627084 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 4 0 0 0
[pid=30594/tid=30646] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30646/stat : 30646 (python) S 30592 30594 28735 0 -1 4202560 34 933 0 0 0 0 0 0 19 0 16 0 549631299 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 3 0 0 0
[pid=30594/tid=30650] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30650/stat : 30650 (python) S 30592 30594 28735 0 -1 4202560 34 933 0 0 0 0 0 0 19 0 16 0 549631870 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 3 0 0 0
[pid=30594/tid=30661] ppid=30592 vsize=498600 CPUtime=0 cores=0-7
/proc/30594/task/30661/stat : 30661 (python) S 30592 30594 28735 0 -1 4202560 41 933 0 0 0 0 0 0 19 0 16 0 549657275 510566400 7577 33554432000 4194304 5683644 140734841254624 18446744073709551615 218917554609 0 0 16781312 2 18446604447627288960 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3219.08
Current children cumulated vsize (KiB) 11614752

[startup+508.215 s]
/proc/loadavg: 10.16 9.98 9.93 13/403 30665
/proc/meminfo: memFree=19606028/32951124 swapFree=67111356/67111528
[pid=30594] ppid=30592 vsize=375480 CPUtime=3219.87 cores=0-7
/proc/30594/stat : 30594 (python) R 30592 30594 28735 0 -1 4202496 27666 32199 1 0 143 12 321212 620 17 0 1 0 549616937 384491520 7440 33554432000 4194304 5683644 140734841254624 18446744073709551615 5296949 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/30594/statm: 93870 7440 1877 364 0 29794 0
Current children cumulated CPU time (s) 3219.87
Current children cumulated vsize (KiB) 375480

Child status: 0
Real time (s): 508.219
CPU time (s): 3219.9
CPU user time (s): 3213.56
CPU system time (s): 6.33304
CPU usage (%): 633.565
Max. virtual memory (cumulated for all children) (KiB): 11619448

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3213.56
system time used= 6.33304
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 60055
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7715
involuntary context switches= 29632

runsolver used 3.08653 second user time and 6.85696 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-03 01:49:52
IDJOB=3322311
IDBENCH=83089
IDSOLVER=1712
FILE ID=node137/3322311-1304380192
RUNJOBID= node137-1304366465-28749
PBS_JOBID= 13181736
Free space on /tmp= 73600 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S2117313371-002.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322311-1304380192/watcher-3322311-1304380192 -o /tmp/evaluation-result-3322311-1304380192/solver-3322311-1304380192 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322311-1304380192.cnf -seed 198129930 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 80ed5c7022fbd1c0bf0af45d87bcb3f8
RANDOM SEED=198129930

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19711756 kB
Buffers:        967892 kB
Cached:        2725368 kB
SwapCached:         48 kB
Active:        9625424 kB
Inactive:      3106092 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19711756 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           31828 kB
Writeback:           0 kB
AnonPages:     9037904 kB
Mapped:          29056 kB
Slab:           401448 kB
PageTables:      38576 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 76243804 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73568 MiB
End job on node137 at 2011-05-03 01:58:21