Trace number 3385692

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 53.1039 8.99573

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v350-c1491-S1404138730-025.UNKNOWN.cnf
MD5SUM2e059a7f69d15193cd88ec6d57d9e297
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark6.42702
Satisfiable
(Un)Satisfiability was proved
Number of variables350
Number of clauses1491
Sum of the clauses size4473
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31491
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.35/0.66	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.66	c INFO: solving HOME/instance-3385692-1305572261.cnf
0.35/0.66	c INFO: computing task features
0.35/0.67	c INFO: computed variable-clause graph statistics
0.35/0.67	c INFO: computed clause balance statistics
0.42/0.70	c INFO: computed variable balance statistics
0.42/0.72	c INFO: computed small-clause counts
0.42/0.72	c INFO: computed Horn-clause counts
0.42/0.72	c INFO: computed variable graph statistics
0.42/0.72	c INFO: collected features for HOME/instance-3385692-1305572261.cnf in 0.06 s
0.42/0.76	c INFO: running TNM@0 for 97 with 4999 remaining (b = 0.56)
0.42/0.79	c INFO: running march_hi@0 for 194 with 4999 remaining (b = 0.28)
0.52/0.82	c INFO: running march_hi@0 for 194 with 4999 remaining (b = 0.19)
0.52/0.85	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.27)
0.52/0.89	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.07)
0.61/0.92	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.26)
0.61/0.95	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.23)
0.61/0.99	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.20)
52.53/8.97	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385692-1305572261/watcher-3385692-1305572261 -o /tmp/evaluation-result-3385692-1305572261/solver-3385692-1305572261 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385692-1305572261.cnf -seed 1483233082 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.37 10.70 10.69 4/437 10992
/proc/meminfo: memFree=21490872/32951124 swapFree=67023148/67111528
[pid=10992] ppid=10990 vsize=15768 CPUtime=0 cores=0-7
/proc/10992/stat : 10992 (python) R 10990 10992 9715 0 -1 4202496 849 0 0 0 0 0 0 0 25 0 1 0 649641942 16146432 734 33554432000 4194304 5683644 140733717584144 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10992/statm: 3942 735 334 364 0 429 0

[startup+0.0876329 s]
/proc/loadavg: 10.37 10.70 10.69 4/437 10992
/proc/meminfo: memFree=21490872/32951124 swapFree=67023148/67111528
[pid=10992] ppid=10990 vsize=84528 CPUtime=0.05 cores=0-7
/proc/10992/stat : 10992 (python) R 10990 10992 9715 0 -1 4202496 2271 0 0 0 4 1 0 0 25 0 1 0 649641942 86556672 2017 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510357671 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10992/statm: 21132 2017 633 364 0 1336 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 84528

[startup+0.100626 s]
/proc/loadavg: 10.37 10.70 10.69 4/437 10992
/proc/meminfo: memFree=21490872/32951124 swapFree=67023148/67111528
[pid=10992] ppid=10990 vsize=93964 CPUtime=0.05 cores=0-7
/proc/10992/stat : 10992 (python) S 10990 10992 9715 0 -1 4202496 2693 0 0 0 4 1 0 0 17 0 1 0 649641942 96219136 2407 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510295552 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/10992/statm: 23491 2407 764 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93964

[startup+0.300615 s]
/proc/loadavg: 10.37 10.70 10.69 4/437 10992
/proc/meminfo: memFree=21490872/32951124 swapFree=67023148/67111528
[pid=10992] ppid=10990 vsize=135752 CPUtime=0.17 cores=0-7
/proc/10992/stat : 10992 (python) R 10990 10992 9715 0 -1 4202496 5962 937 1 0 13 4 0 0 17 0 1 0 649641942 139010048 4151 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510293509 0 2147483391 16781312 2 0 0 0 17 0 0 0 0
/proc/10992/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135752

[startup+0.700523 s]
/proc/loadavg: 10.37 10.70 10.69 4/437 10992
/proc/meminfo: memFree=21490872/32951124 swapFree=67023148/67111528
[pid=10992] ppid=10990 vsize=278260 CPUtime=0.42 cores=0-7
/proc/10992/stat : 10992 (python) R 10990 10992 9715 0 -1 4202496 9285 937 1 0 33 9 0 0 15 0 1 0 649641942 284938240 6955 33554432000 4194304 5683644 140733717584144 18446744073709551615 5003249 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/10992/statm: 69565 6955 1826 364 0 5489 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 278260

[startup+1.50134 s]
/proc/loadavg: 10.37 10.70 10.69 13/462 11021
/proc/meminfo: memFree=21431260/32951124 swapFree=67023148/67111528
[pid=10992] ppid=10990 vsize=361224 CPUtime=0.7 cores=0-7
/proc/10992/stat : 10992 (python) S 10990 10992 9715 0 -1 4202496 15718 937 1 0 59 11 0 0 25 0 9 0 649641942 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10992/statm: 90306 7278 1889 364 0 26203 0
[pid=10998] ppid=10992 vsize=278436 CPUtime=0 cores=0-7
/proc/10998/stat : 10998 (python) S 10992 10992 9715 0 -1 4202560 711 0 0 0 0 0 0 0 18 0 1 0 649642018 285118464 5536 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317583 0 0 16781312 514 8302791637143126015 0 0 17 4 0 0 0
/proc/10998/statm: 69609 5536 347 364 0 5527 0
[pid=11000] ppid=10998 vsize=454896 CPUtime=0.71 cores=0-7
/proc/11000/stat : 11000 (TNM) R 10998 11000 11000 0 -1 4202496 417 0 0 0 71 0 0 0 21 0 1 0 649642018 465813504 151 33554432000 134512640 135008748 4287988112 18446744073709551615 134529084 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/11000/statm: 113724 151 46 122 0 112624 0
[pid=11001] ppid=10992 vsize=289276 CPUtime=0 cores=0-7
/proc/11001/stat : 11001 (python) S 10992 10992 9715 0 -1 4202560 748 0 0 0 0 0 0 0 15 0 1 0 649642021 296218624 5676 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 7607432995946856707 0 0 17 4 0 0 0
/proc/11001/statm: 72319 5676 348 364 0 8234 0
[pid=11003] ppid=11001 vsize=1808 CPUtime=0.69 cores=0-7
/proc/11003/stat : 11003 (march_hi) R 11001 11003 11003 0 -1 4202496 550 0 0 0 69 0 0 0 22 0 1 0 649642021 1851392 284 33554432000 4194304 4955518 140734720809776 18446744073709551615 4238331 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/11003/statm: 452 284 104 186 0 265 0
[pid=11004] ppid=10992 vsize=299160 CPUtime=0 cores=0-7
/proc/11004/stat : 11004 (python) S 10992 10992 9715 0 -1 4202560 757 0 0 0 0 0 0 0 15 0 1 0 649642024 306339840 5584 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 7181614132741799935 0 0 17 1 0 0 0
/proc/11004/statm: 74790 5584 348 364 0 10702 0
[pid=11006] ppid=11004 vsize=1808 CPUtime=0.66 cores=0-7
/proc/11006/stat : 11006 (march_hi) R 11004 11006 11006 0 -1 4202496 546 0 0 0 66 0 0 0 22 0 1 0 649642025 1851392 285 33554432000 4194304 4955518 140733302201760 18446744073709551615 4209737 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/11006/statm: 452 285 104 186 0 265 0
[pid=11007] ppid=10992 vsize=309956 CPUtime=0 cores=0-7
/proc/11007/stat : 11007 (python) S 10992 10992 9715 0 -1 4202560 773 0 0 0 0 0 0 0 16 0 1 0 649642027 317394944 5709 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 15055867810129346820 0 0 17 0 0 0 0
/proc/11007/statm: 77489 5709 348 364 0 13398 0
[pid=11009] ppid=11007 vsize=1808 CPUtime=0.61 cores=0-7
/proc/11009/stat : 11009 (march_hi) R 11007 11009 11009 0 -1 4202496 549 0 0 0 61 0 0 0 25 0 1 0 649642028 1851392 284 33554432000 4194304 4955518 140735095716784 18446744073709551615 4227571 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/11009/statm: 452 284 104 186 0 265 0
[pid=11010] ppid=10992 vsize=320212 CPUtime=0 cores=0-7
/proc/11010/stat : 11010 (python) S 10992 10992 9715 0 -1 4202560 755 0 0 0 0 0 0 0 23 0 1 0 649642031 327897088 5713 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 14109571203538616319 0 0 17 2 0 0 0
/proc/11010/statm: 80053 5713 348 364 0 15959 0
[pid=11012] ppid=11010 vsize=1017800 CPUtime=0.29 cores=0-7
/proc/11012/stat : 11012 (gnovelty+2) R 11010 11012 11012 0 -1 4202496 426 0 0 0 29 0 0 0 25 0 1 0 649642033 1042227200 162 33554432000 134512640 135663704 4290305456 18446744073709551615 134545704 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/11012/statm: 254450 162 113 282 0 254166 0
[pid=11013] ppid=10992 vsize=330468 CPUtime=0 cores=0-7
/proc/11013/stat : 11013 (python) R 10992 10992 9715 0 -1 4202560 771 0 0 0 0 0 0 0 23 0 1 0 649642034 338399232 5717 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 0 0 0 17 4 0 0 0
/proc/11013/statm: 82617 5717 348 364 0 18520 0
[pid=11015] ppid=11013 vsize=1808 CPUtime=0.5 cores=0-7
/proc/11015/stat : 11015 (march_hi) R 11013 11015 11015 0 -1 4202496 549 0 0 0 50 0 0 0 25 0 1 0 649642036 1851392 284 33554432000 4194304 4955518 140737480722048 18446744073709551615 4227831 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/11015/statm: 452 284 104 186 0 265 0
[pid=11016] ppid=10992 vsize=340724 CPUtime=0 cores=0-7
/proc/11016/stat : 11016 (python) S 10992 10992 9715 0 -1 4202560 775 0 0 0 0 0 0 0 22 0 1 0 649642037 348901376 5729 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 14723045640401551620 0 0 17 2 0 0 0
/proc/11016/statm: 85181 5729 348 364 0 21081 0
[pid=11018] ppid=11016 vsize=1808 CPUtime=0.19 cores=0-7
/proc/11018/stat : 11018 (march_hi) R 11016 11018 11018 0 -1 4202496 538 0 0 0 19 0 0 0 25 0 1 0 649642040 1851392 271 33554432000 4194304 4955518 140735787242640 18446744073709551615 4267356 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/11018/statm: 452 271 104 186 0 265 0
[pid=11019] ppid=10992 vsize=350980 CPUtime=0 cores=0-7
/proc/11019/stat : 11019 (python) S 10992 10992 9715 0 -1 4202560 810 0 0 0 0 0 0 0 24 0 1 0 649642041 359403520 5739 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 13097501261618446595 0 0 17 2 0 0 0
/proc/11019/statm: 87745 5739 354 364 0 23642 0
[pid=11021] ppid=11019 vsize=1808 CPUtime=0.21 cores=0-7
/proc/11021/stat : 11021 (march_hi) R 11019 11021 11021 0 -1 4202496 545 0 0 0 21 0 0 0 25 0 1 0 649642041 1851392 272 33554432000 4194304 4955518 140733365613776 18446744073709551615 4224549 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/11021/statm: 452 272 104 186 0 265 0
[pid=10992/tid=10999] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/10999/stat : 10999 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 18 0 9 0 649642018 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11002] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11002/stat : 11002 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642021 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11005] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11005/stat : 11005 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642024 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11008] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11008/stat : 11008 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 22 0 9 0 649642028 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11011] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11011/stat : 11011 (python) S 10990 10992 9715 0 -1 4202560 23 937 0 0 0 0 0 0 24 0 9 0 649642031 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11014] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11014/stat : 11014 (python) S 10990 10992 9715 0 -1 4202560 24 937 0 0 0 0 0 0 25 0 9 0 649642034 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11017] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11017/stat : 11017 (python) S 10990 10992 9715 0 -1 4202560 26 937 0 0 0 0 0 0 25 0 9 0 649642038 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11020] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11020/stat : 11020 (python) S 10990 10992 9715 0 -1 4202560 31 937 0 0 0 0 0 0 25 0 9 0 649642041 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.56
Current children cumulated vsize (KiB) 4363980

[startup+3.10105 s]
/proc/loadavg: 10.37 10.70 10.69 12/462 11021
/proc/meminfo: memFree=21430020/32951124 swapFree=67023148/67111528
[pid=10992] ppid=10990 vsize=361224 CPUtime=0.7 cores=0-7
/proc/10992/stat : 10992 (python) S 10990 10992 9715 0 -1 4202496 15718 937 1 0 59 11 0 0 25 0 9 0 649641942 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10992/statm: 90306 7278 1889 364 0 26203 0
[pid=10998] ppid=10992 vsize=278436 CPUtime=0 cores=0-7
/proc/10998/stat : 10998 (python) S 10992 10992 9715 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 649642018 285118464 5543 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317583 0 0 16781312 514 8302791637143093505 0 0 17 4 0 0 0
/proc/10998/statm: 69609 5543 354 364 0 5527 0
[pid=11000] ppid=10998 vsize=454896 CPUtime=2.29 cores=0-7
/proc/11000/stat : 11000 (TNM) R 10998 11000 11000 0 -1 4202496 417 0 0 0 229 0 0 0 25 0 1 0 649642018 465813504 151 33554432000 134512640 135008748 4287988112 18446744073709551615 134527503 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/11000/statm: 113724 151 46 122 0 112624 0
[pid=11001] ppid=10992 vsize=289276 CPUtime=0 cores=0-7
/proc/11001/stat : 11001 (python) S 10992 10992 9715 0 -1 4202560 753 0 0 0 0 0 0 0 15 0 1 0 649642021 296218624 5676 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 7607432995946856707 0 0 17 4 0 0 0
/proc/11001/statm: 72319 5676 348 364 0 8234 0
[pid=11003] ppid=11001 vsize=1940 CPUtime=2.28 cores=0-7
/proc/11003/stat : 11003 (march_hi) R 11001 11003 11003 0 -1 4202496 577 0 0 0 228 0 0 0 25 0 1 0 649642021 1986560 311 33554432000 4194304 4955518 140734720809776 18446744073709551615 4209711 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/11003/statm: 485 311 104 186 0 298 0
[pid=11004] ppid=10992 vsize=299160 CPUtime=0 cores=0-7
/proc/11004/stat : 11004 (python) S 10992 10992 9715 0 -1 4202560 766 0 0 0 0 0 0 0 15 0 1 0 649642024 306339840 5584 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 8100366048911393027 0 0 17 1 0 0 0
/proc/11004/statm: 74790 5584 348 364 0 10702 0
[pid=11006] ppid=11004 vsize=1940 CPUtime=2.26 cores=0-7
/proc/11006/stat : 11006 (march_hi) R 11004 11006 11006 0 -1 4202496 573 0 0 0 226 0 0 0 25 0 1 0 649642025 1986560 312 33554432000 4194304 4955518 140733302201760 18446744073709551615 4210833 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/11006/statm: 485 312 104 186 0 298 0
[pid=11007] ppid=10992 vsize=309956 CPUtime=0 cores=0-7
/proc/11007/stat : 11007 (python) S 10992 10992 9715 0 -1 4202560 779 0 0 0 0 0 0 0 15 0 1 0 649642027 317394944 5709 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 15055867810129346820 0 0 17 0 0 0 0
/proc/11007/statm: 77489 5709 348 364 0 13398 0
[pid=11009] ppid=11007 vsize=1940 CPUtime=2.21 cores=0-7
/proc/11009/stat : 11009 (march_hi) R 11007 11009 11009 0 -1 4202496 575 0 0 0 221 0 0 0 25 0 1 0 649642028 1986560 310 33554432000 4194304 4955518 140735095716784 18446744073709551615 4238419 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/11009/statm: 485 310 104 186 0 298 0
[pid=11010] ppid=10992 vsize=320212 CPUtime=0 cores=0-7
/proc/11010/stat : 11010 (python) S 10992 10992 9715 0 -1 4202560 755 0 0 0 0 0 0 0 18 0 1 0 649642031 327897088 5713 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 14109571203538583811 0 0 17 2 0 0 0
/proc/11010/statm: 80053 5713 348 364 0 15959 0
[pid=11012] ppid=11010 vsize=1017800 CPUtime=1.09 cores=0-7
/proc/11012/stat : 11012 (gnovelty+2) R 11010 11012 11012 0 -1 4202496 426 0 0 0 109 0 0 0 25 0 1 0 649642033 1042227200 162 33554432000 134512640 135663704 4290305456 18446744073709551615 134545786 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/11012/statm: 254450 162 113 282 0 254166 0
[pid=11013] ppid=10992 vsize=330468 CPUtime=0 cores=0-7
/proc/11013/stat : 11013 (python) S 10992 10992 9715 0 -1 4202560 781 0 0 0 0 0 0 0 15 0 1 0 649642034 338399232 5717 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 15055876606222369025 0 0 17 4 0 0 0
/proc/11013/statm: 82617 5717 348 364 0 18520 0
[pid=11015] ppid=11013 vsize=1940 CPUtime=2.09 cores=0-7
/proc/11015/stat : 11015 (march_hi) R 11013 11015 11015 0 -1 4202496 576 0 0 0 209 0 0 0 25 0 1 0 649642036 1986560 311 33554432000 4194304 4955518 140737480722048 18446744073709551615 4224512 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/11015/statm: 485 311 104 186 0 298 0
[pid=11016] ppid=10992 vsize=340724 CPUtime=0 cores=0-7
/proc/11016/stat : 11016 (python) S 10992 10992 9715 0 -1 4202560 790 0 0 0 0 0 0 0 15 0 1 0 649642037 348901376 5729 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 14723045640401551620 0 0 17 2 0 0 0
/proc/11016/statm: 85181 5729 348 364 0 21081 0
[pid=11018] ppid=11016 vsize=1940 CPUtime=0.99 cores=0-7
/proc/11018/stat : 11018 (march_hi) R 11016 11018 11018 0 -1 4202496 560 0 0 0 99 0 0 0 25 0 1 0 649642040 1986560 293 33554432000 4194304 4955518 140735787242640 18446744073709551615 4224654 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/11018/statm: 485 293 104 186 0 298 0
[pid=11019] ppid=10992 vsize=350980 CPUtime=0 cores=0-7
/proc/11019/stat : 11019 (python) S 10992 10992 9715 0 -1 4202560 820 0 0 0 0 0 0 0 15 0 1 0 649642041 359403520 5739 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 13097501261618446595 0 0 17 2 0 0 0
/proc/11019/statm: 87745 5739 354 364 0 23642 0
[pid=11021] ppid=11019 vsize=1940 CPUtime=1.01 cores=0-7
/proc/11021/stat : 11021 (march_hi) R 11019 11021 11021 0 -1 4202496 566 0 0 0 101 0 0 0 25 0 1 0 649642041 1986560 293 33554432000 4194304 4955518 140733365613776 18446744073709551615 4210562 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/11021/statm: 485 293 104 186 0 298 0
[pid=10992/tid=10999] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/10999/stat : 10999 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 18 0 9 0 649642018 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11002] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11002/stat : 11002 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642021 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11005] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11005/stat : 11005 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642024 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11008] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11008/stat : 11008 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 22 0 9 0 649642028 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11011] ppid=10990 vsize=361224 CPUtime=0 cores=0-7

################
# More data... #
################

[pid=11019] ppid=10992 vsize=350980 CPUtime=0.02 cores=0-7
/proc/11019/stat : 11019 (python) S 10992 10992 9715 0 -1 4202560 986 0 0 0 1 1 0 0 15 0 1 0 649642041 359403520 5762 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 13097501261618446595 0 0 17 6 0 0 0
/proc/11019/statm: 87745 5762 377 364 0 23642 0
[pid=11021] ppid=11019 vsize=2076 CPUtime=3.41 cores=0-7
/proc/11021/stat : 11021 (march_hi) R 11019 11021 11021 0 -1 4202496 616 0 0 0 341 0 0 0 25 0 1 0 649642041 2125824 343 33554432000 4194304 4955518 140733365613776 18446744073709551615 4227892 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/11021/statm: 519 343 104 186 0 332 0
[pid=10992/tid=10999] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/10999/stat : 10999 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 18 0 9 0 649642018 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11002] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11002/stat : 11002 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642021 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11005] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11005/stat : 11005 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642024 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11008] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11008/stat : 11008 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 22 0 9 0 649642028 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11011] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11011/stat : 11011 (python) S 10990 10992 9715 0 -1 4202560 23 937 0 0 0 0 0 0 24 0 9 0 649642031 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11014] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11014/stat : 11014 (python) S 10990 10992 9715 0 -1 4202560 24 937 0 0 0 0 0 0 25 0 9 0 649642034 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11017] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11017/stat : 11017 (python) S 10990 10992 9715 0 -1 4202560 26 937 0 0 0 0 0 0 25 0 9 0 649642038 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11020] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11020/stat : 11020 (python) S 10990 10992 9715 0 -1 4202560 31 937 0 0 0 0 0 0 25 0 9 0 649642041 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 46.02
Current children cumulated vsize (KiB) 4357284

[startup+8.70105 s]
/proc/loadavg: 10.42 10.71 10.70 17/462 11022
/proc/meminfo: memFree=21430532/32951124 swapFree=67023148/67111528
[pid=10992] ppid=10990 vsize=361224 CPUtime=0.7 cores=0-7
/proc/10992/stat : 10992 (python) S 10990 10992 9715 0 -1 4202496 15718 937 1 0 59 11 0 0 25 0 9 0 649641942 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10992/statm: 90306 7278 1889 364 0 26203 0
[pid=10998] ppid=10992 vsize=278436 CPUtime=0.02 cores=0-7
/proc/10998/stat : 10998 (python) S 10992 10992 9715 0 -1 4202560 901 0 0 0 1 1 0 0 18 0 1 0 649642018 285118464 5566 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317583 0 0 16781312 514 8302791637143093505 0 0 17 6 0 0 0
/proc/10998/statm: 69609 5566 377 364 0 5527 0
[pid=11000] ppid=10998 vsize=454896 CPUtime=7.81 cores=0-7
/proc/11000/stat : 11000 (TNM) R 10998 11000 11000 0 -1 4202496 417 0 0 0 781 0 0 0 25 0 1 0 649642018 465813504 151 33554432000 134512640 135008748 4287988112 18446744073709551615 134527729 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/11000/statm: 113724 151 46 122 0 112624 0
[pid=11001] ppid=10992 vsize=289276 CPUtime=1.96 cores=0-7
/proc/11001/stat : 11001 (python) S 10992 10992 9715 0 -1 4202560 918 0 0 0 168 28 0 0 18 0 1 0 649642021 296218624 5699 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 4 0 0 0
/proc/11001/statm: 72319 5699 371 364 0 8234 0
[pid=11003] ppid=11001 vsize=0 CPUtime=5.92 cores=0-7
/proc/11003/stat : 11003 (march_hi) R 11001 11003 11003 0 -1 4202500 633 0 0 0 591 1 0 0 25 0 1 0 649642021 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/11003/statm: 0 0 0 0 0 0 0
[pid=11004] ppid=10992 vsize=299160 CPUtime=1.94 cores=0-7
/proc/11004/stat : 11004 (python) S 10992 10992 9715 0 -1 4202560 928 0 0 0 169 25 0 0 18 0 1 0 649642024 306339840 5607 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/11004/statm: 74790 5607 371 364 0 10702 0
[pid=11006] ppid=11004 vsize=0 CPUtime=5.93 cores=0-7
/proc/11006/stat : 11006 (march_hi) R 11004 11006 11006 0 -1 4202500 629 0 0 0 593 0 0 0 25 0 1 0 649642025 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/11006/statm: 0 0 0 0 0 0 0
[pid=11007] ppid=10992 vsize=309956 CPUtime=1.88 cores=0-7
/proc/11007/stat : 11007 (python) R 10992 10992 9715 0 -1 4202560 938 0 0 0 167 21 0 0 17 0 1 0 649642027 317394944 5732 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/11007/statm: 77489 5732 371 364 0 13398 0
[pid=11009] ppid=11007 vsize=0 CPUtime=5.93 cores=0-7
/proc/11009/stat : 11009 (march_hi) R 11007 11009 11009 0 -1 4202500 632 0 0 0 593 0 0 0 25 0 1 0 649642028 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/11009/statm: 0 0 0 0 0 0 0
[pid=11010] ppid=10992 vsize=320212 CPUtime=0.02 cores=0-7
/proc/11010/stat : 11010 (python) S 10992 10992 9715 0 -1 4202560 931 0 0 0 1 1 0 0 18 0 1 0 649642031 327897088 5736 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 14109571203538583811 0 0 17 5 0 0 0
/proc/11010/statm: 80053 5736 371 364 0 15959 0
[pid=11012] ppid=11010 vsize=1017800 CPUtime=3.9 cores=0-7
/proc/11012/stat : 11012 (gnovelty+2) R 11010 11012 11012 0 -1 4202496 426 0 0 0 390 0 0 0 25 0 1 0 649642033 1042227200 162 33554432000 134512640 135663704 4290305456 18446744073709551615 134525229 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/11012/statm: 254450 162 113 282 0 254166 0
[pid=11013] ppid=10992 vsize=330468 CPUtime=1.71 cores=0-7
/proc/11013/stat : 11013 (python) R 10992 10992 9715 0 -1 4202560 931 0 0 0 146 25 0 0 17 0 1 0 649642034 338399232 5740 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/11013/statm: 82617 5740 371 364 0 18520 0
[pid=11015] ppid=11013 vsize=0 CPUtime=5.92 cores=0-7
/proc/11015/stat : 11015 (march_hi) R 11013 11015 11015 0 -1 4202500 633 0 0 0 592 0 0 0 25 0 1 0 649642036 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/11015/statm: 0 0 0 0 0 0 0
[pid=11016] ppid=10992 vsize=340724 CPUtime=0.02 cores=0-7
/proc/11016/stat : 11016 (python) S 10992 10992 9715 0 -1 4202560 950 0 0 0 1 1 0 0 15 0 1 0 649642037 348901376 5752 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 14723045640401551620 0 0 17 5 0 0 0
/proc/11016/statm: 85181 5752 371 364 0 21081 0
[pid=11018] ppid=11016 vsize=2076 CPUtime=3.8 cores=0-7
/proc/11018/stat : 11018 (march_hi) R 11016 11018 11018 0 -1 4202496 613 0 0 0 380 0 0 0 25 0 1 0 649642040 2125824 346 33554432000 4194304 4955518 140735787242640 18446744073709551615 4224642 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/11018/statm: 519 346 104 186 0 332 0
[pid=11019] ppid=10992 vsize=350980 CPUtime=0.02 cores=0-7
/proc/11019/stat : 11019 (python) S 10992 10992 9715 0 -1 4202560 986 0 0 0 1 1 0 0 15 0 1 0 649642041 359403520 5762 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 13097501261618446595 0 0 17 6 0 0 0
/proc/11019/statm: 87745 5762 377 364 0 23642 0
[pid=11021] ppid=11019 vsize=2076 CPUtime=3.81 cores=0-7
/proc/11021/stat : 11021 (march_hi) R 11019 11021 11021 0 -1 4202496 619 0 0 0 381 0 0 0 25 0 1 0 649642041 2125824 346 33554432000 4194304 4955518 140733365613776 18446744073709551615 4227756 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/11021/statm: 519 346 104 186 0 332 0
[pid=10992/tid=10999] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/10999/stat : 10999 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 18 0 9 0 649642018 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11002] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11002/stat : 11002 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642021 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11005] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11005/stat : 11005 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642024 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11008] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11008/stat : 11008 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 22 0 9 0 649642028 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11011] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11011/stat : 11011 (python) S 10990 10992 9715 0 -1 4202560 23 937 0 0 0 0 0 0 24 0 9 0 649642031 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11014] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11014/stat : 11014 (python) S 10990 10992 9715 0 -1 4202560 24 937 0 0 0 0 0 0 25 0 9 0 649642034 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11017] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11017/stat : 11017 (python) S 10990 10992 9715 0 -1 4202560 26 937 0 0 0 0 0 0 25 0 9 0 649642038 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11020] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11020/stat : 11020 (python) S 10990 10992 9715 0 -1 4202560 31 937 0 0 0 0 0 0 25 0 9 0 649642041 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 51.29
Current children cumulated vsize (KiB) 4357284

[startup+8.90102 s]
/proc/loadavg: 10.42 10.71 10.70 17/462 11022
/proc/meminfo: memFree=21430532/32951124 swapFree=67023148/67111528
[pid=10992] ppid=10990 vsize=361224 CPUtime=0.7 cores=0-7
/proc/10992/stat : 10992 (python) S 10990 10992 9715 0 -1 4202496 15718 937 1 0 59 11 0 0 25 0 9 0 649641942 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10992/statm: 90306 7278 1889 364 0 26203 0
[pid=10998] ppid=10992 vsize=278436 CPUtime=0.02 cores=0-7
/proc/10998/stat : 10998 (python) S 10992 10992 9715 0 -1 4202560 901 0 0 0 1 1 0 0 18 0 1 0 649642018 285118464 5566 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317583 0 0 16781312 514 8302791637143093505 0 0 17 6 0 0 0
/proc/10998/statm: 69609 5566 377 364 0 5527 0
[pid=11000] ppid=10998 vsize=454896 CPUtime=8 cores=0-7
/proc/11000/stat : 11000 (TNM) R 10998 11000 11000 0 -1 4202496 417 0 0 0 800 0 0 0 25 0 1 0 649642018 465813504 151 33554432000 134512640 135008748 4287988112 18446744073709551615 134527553 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/11000/statm: 113724 151 46 122 0 112624 0
[pid=11001] ppid=10992 vsize=289276 CPUtime=2.15 cores=0-7
/proc/11001/stat : 11001 (python) R 10992 10992 9715 0 -1 4202560 918 0 0 0 184 31 0 0 18 0 1 0 649642021 296218624 5699 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 4 0 0 0
/proc/11001/statm: 72319 5699 371 364 0 8234 0
[pid=11003] ppid=11001 vsize=0 CPUtime=5.92 cores=0-7
/proc/11003/stat : 11003 (march_hi) R 11001 11003 11003 0 -1 4202500 633 0 0 0 591 1 0 0 25 0 1 0 649642021 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/11003/statm: 0 0 0 0 0 0 0
[pid=11004] ppid=10992 vsize=299160 CPUtime=2.13 cores=0-7
/proc/11004/stat : 11004 (python) R 10992 10992 9715 0 -1 4202560 928 0 0 0 186 27 0 0 18 0 1 0 649642024 306339840 5607 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/11004/statm: 74790 5607 371 364 0 10702 0
[pid=11006] ppid=11004 vsize=0 CPUtime=5.93 cores=0-7
/proc/11006/stat : 11006 (march_hi) R 11004 11006 11006 0 -1 4202500 629 0 0 0 593 0 0 0 25 0 1 0 649642025 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/11006/statm: 0 0 0 0 0 0 0
[pid=11007] ppid=10992 vsize=309956 CPUtime=2.08 cores=0-7
/proc/11007/stat : 11007 (python) R 10992 10992 9715 0 -1 4202560 938 0 0 0 184 24 0 0 18 0 1 0 649642027 317394944 5732 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/11007/statm: 77489 5732 371 364 0 13398 0
[pid=11009] ppid=11007 vsize=0 CPUtime=5.93 cores=0-7
/proc/11009/stat : 11009 (march_hi) R 11007 11009 11009 0 -1 4202500 632 0 0 0 593 0 0 0 25 0 1 0 649642028 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/11009/statm: 0 0 0 0 0 0 0
[pid=11010] ppid=10992 vsize=320212 CPUtime=0.02 cores=0-7
/proc/11010/stat : 11010 (python) S 10992 10992 9715 0 -1 4202560 931 0 0 0 1 1 0 0 18 0 1 0 649642031 327897088 5736 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 14109571203538583811 0 0 17 5 0 0 0
/proc/11010/statm: 80053 5736 371 364 0 15959 0
[pid=11012] ppid=11010 vsize=1017800 CPUtime=3.99 cores=0-7
/proc/11012/stat : 11012 (gnovelty+2) R 11010 11012 11012 0 -1 4202496 426 0 0 0 399 0 0 0 25 0 1 0 649642033 1042227200 162 33554432000 134512640 135663704 4290305456 18446744073709551615 134525224 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/11012/statm: 254450 162 113 282 0 254166 0
[pid=11013] ppid=10992 vsize=330468 CPUtime=1.9 cores=0-7
/proc/11013/stat : 11013 (python) R 10992 10992 9715 0 -1 4202560 931 0 0 0 162 28 0 0 17 0 1 0 649642034 338399232 5740 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/11013/statm: 82617 5740 371 364 0 18520 0
[pid=11015] ppid=11013 vsize=0 CPUtime=5.92 cores=0-7
/proc/11015/stat : 11015 (march_hi) R 11013 11015 11015 0 -1 4202500 633 0 0 0 592 0 0 0 25 0 1 0 649642036 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/11015/statm: 0 0 0 0 0 0 0
[pid=11016] ppid=10992 vsize=340724 CPUtime=0.02 cores=0-7
/proc/11016/stat : 11016 (python) S 10992 10992 9715 0 -1 4202560 950 0 0 0 1 1 0 0 15 0 1 0 649642037 348901376 5752 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 14723045640401551620 0 0 17 5 0 0 0
/proc/11016/statm: 85181 5752 371 364 0 21081 0
[pid=11018] ppid=11016 vsize=2076 CPUtime=3.89 cores=0-7
/proc/11018/stat : 11018 (march_hi) R 11016 11018 11018 0 -1 4202496 614 0 0 0 389 0 0 0 25 0 1 0 649642040 2125824 347 33554432000 4194304 4955518 140735787242640 18446744073709551615 4239032 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/11018/statm: 519 347 104 186 0 332 0
[pid=11019] ppid=10992 vsize=350980 CPUtime=0.02 cores=0-7
/proc/11019/stat : 11019 (python) S 10992 10992 9715 0 -1 4202560 986 0 0 0 1 1 0 0 15 0 1 0 649642041 359403520 5762 33554432000 4194304 5683644 140733717584144 18446744073709551615 233510317638 0 0 16781312 514 13097501261618446595 0 0 17 6 0 0 0
/proc/11019/statm: 87745 5762 377 364 0 23642 0
[pid=11021] ppid=11019 vsize=2076 CPUtime=3.91 cores=0-7
/proc/11021/stat : 11021 (march_hi) R 11019 11021 11021 0 -1 4202496 620 0 0 0 391 0 0 0 25 0 1 0 649642041 2125824 347 33554432000 4194304 4955518 140733365613776 18446744073709551615 4286726 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/11021/statm: 519 347 104 186 0 332 0
[pid=10992/tid=10999] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/10999/stat : 10999 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 18 0 9 0 649642018 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11002] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11002/stat : 11002 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642021 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11005] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11005/stat : 11005 (python) S 10990 10992 9715 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 9 0 649642024 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11008] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11008/stat : 11008 (python) S 10990 10992 9715 0 -1 4202560 25 937 0 0 0 0 0 0 22 0 9 0 649642028 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 0 0 0 0
[pid=10992/tid=11011] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11011/stat : 11011 (python) S 10990 10992 9715 0 -1 4202560 23 937 0 0 0 0 0 0 24 0 9 0 649642031 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11014] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11014/stat : 11014 (python) S 10990 10992 9715 0 -1 4202560 24 937 0 0 0 0 0 0 25 0 9 0 649642034 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11017] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11017/stat : 11017 (python) S 10990 10992 9715 0 -1 4202560 26 937 0 0 0 0 0 0 25 0 9 0 649642038 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
[pid=10992/tid=11020] ppid=10990 vsize=361224 CPUtime=0 cores=0-7
/proc/10992/task/11020/stat : 11020 (python) S 10990 10992 9715 0 -1 4202560 31 937 0 0 0 0 0 0 25 0 9 0 649642041 369893376 7278 33554432000 4194304 5683644 140733717584144 18446744073709551615 233522121137 0 0 16781312 2 18446604448034677056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 52.53
Current children cumulated vsize (KiB) 4357284

Child status: 0
Real time (s): 8.99573
CPU time (s): 53.1039
CPU user time (s): 51.7471
CPU system time (s): 1.35679
CPU usage (%): 590.324
Max. virtual memory (cumulated for all children) (KiB): 5055020

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 51.7471
system time used= 1.35679
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33920
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5328
involuntary context switches= 2617

runsolver used 0.045993 second user time and 0.103984 second system time

The end

Launcher Data 

Begin job on node145 at 2011-05-16 20:57:41
IDJOB=3385692
IDBENCH=82957
IDSOLVER=1870
FILE ID=node145/3385692-1305572261
RUNJOBID= node145-1305564961-9729
PBS_JOBID= 13350105
Free space on /tmp= 73632 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v350-c1491-S1404138730-025.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385692-1305572261/watcher-3385692-1305572261 -o /tmp/evaluation-result-3385692-1305572261/solver-3385692-1305572261 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385692-1305572261.cnf -seed 1483233082 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 2e059a7f69d15193cd88ec6d57d9e297
RANDOM SEED=1483233082

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21490780 kB
Buffers:        100688 kB
Cached:         953292 kB
SwapCached:       4796 kB
Active:        7651784 kB
Inactive:      3546492 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21490780 kB
SwapTotal:    67111528 kB
SwapFree:     67023148 kB
Dirty:           31944 kB
Writeback:           4 kB
AnonPages:    10139768 kB
Mapped:          33364 kB
Slab:           137784 kB
PageTables:      53040 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 118869828 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73600 MiB
End job on node145 at 2011-05-16 20:57:50