Trace number 3385783

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 377.352 70.3304

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v50-c4450-S1880985555-004.UNKNOWN.cnf
MD5SUMa1e34b50698b079e87a3cad9c76615ca
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark34.1038
Satisfiable
(Un)Satisfiability was proved
Number of variables50
Number of clauses4450
Sum of the clauses size31150
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 54450

Solver Data 

0.41/0.51	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.41/0.51	c INFO: solving HOME/instance-3385783-1305574624.cnf
0.41/0.51	c INFO: computing task features
0.41/0.54	c INFO: computed variable-clause graph statistics
0.41/0.54	c INFO: computed clause balance statistics
0.60/0.72	c INFO: computed variable balance statistics
0.60/0.79	c INFO: computed small-clause counts
0.60/0.79	c INFO: computed Horn-clause counts
0.60/0.80	c INFO: computed variable graph statistics
0.60/0.80	c INFO: collected features for HOME/instance-3385783-1305574624.cnf in 0.29 s
0.70/0.83	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.57)
0.70/0.86	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.09)
0.70/0.89	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.04)
0.80/0.93	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.03)
0.80/0.96	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.02)
0.80/0.99	c INFO: running FH@0 for 97 with 4999 remaining (b = 0.02)
1.28/1.03	c INFO: running march_hi@0 for 2134 with 4999 remaining (b = 0.38)
1.28/1.06	c INFO: running march_hi@0 for 2134 with 4999 remaining (b = 0.36)
376.65/70.30	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385783-1305574624/watcher-3385783-1305574624 -o /tmp/evaluation-result-3385783-1305574624/solver-3385783-1305574624 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385783-1305574624.cnf -seed 202123267 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.09 10.57 10.60 5/484 6960
/proc/meminfo: memFree=21308736/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=15780 CPUtime=0 cores=0-7
/proc/6960/stat : 6960 (python) R 6958 6960 5798 0 -1 4202496 889 0 0 0 0 0 0 0 22 0 1 0 669059479 16158720 772 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476355781 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6960/statm: 3945 773 343 364 0 432 0

[startup+0.0901721 s]
/proc/loadavg: 10.09 10.57 10.60 5/484 6960
/proc/meminfo: memFree=21308736/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=87708 CPUtime=0.07 cores=0-7
/proc/6960/stat : 6960 (python) R 6958 6960 5798 0 -1 4202496 2637 0 0 0 6 1 0 0 17 0 1 0 669059479 89812992 2354 33554432000 4194304 5683644 140736187049248 18446744073709551615 239471771271 0 2147483391 16781312 2 0 0 0 17 0 0 0 0
/proc/6960/statm: 22443 2354 717 364 0 1623 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 87708

[startup+0.10017 s]
/proc/loadavg: 10.09 10.57 10.60 5/484 6960
/proc/meminfo: memFree=21308736/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=99376 CPUtime=0.07 cores=0-7
/proc/6960/stat : 6960 (python) R 6958 6960 5798 0 -1 4202496 2869 0 0 0 6 1 0 0 17 0 1 0 669059479 101761024 2567 33554432000 4194304 5683644 140736187049248 18446744073709551615 4521616 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6960/statm: 24844 2567 818 364 0 1695 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 99376

[startup+0.300135 s]
/proc/loadavg: 10.09 10.57 10.60 5/484 6960
/proc/meminfo: memFree=21308736/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=135900 CPUtime=0.24 cores=0-7
/proc/6960/stat : 6960 (python) R 6958 6960 5798 0 -1 4202496 6033 935 1 0 19 5 0 0 17 0 1 0 669059479 139161600 4186 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476690789 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6960/statm: 33975 4186 1032 364 0 3161 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 135900

[startup+0.701057 s]
/proc/loadavg: 10.09 10.57 10.60 5/484 6960
/proc/meminfo: memFree=21308736/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=279220 CPUtime=0.6 cores=0-7
/proc/6960/stat : 6960 (python) R 6958 6960 5798 0 -1 4202496 9526 935 1 0 52 8 0 0 17 0 1 0 669059479 285921280 7198 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476343634 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6960/statm: 69805 7198 1826 364 0 5729 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 279220

[startup+1.50084 s]
/proc/loadavg: 9.68 10.48 10.57 12/501 6981
/proc/meminfo: memFree=21259728/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=361668 CPUtime=0.95 cores=0-7
/proc/6960/stat : 6960 (python) S 6958 6960 5798 0 -1 4202496 16096 935 1 0 85 10 0 0 25 0 9 0 669059479 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6960/statm: 90417 7383 1891 364 0 26314 0
[pid=6966] ppid=6960 vsize=279244 CPUtime=0 cores=0-7
/proc/6966/stat : 6966 (python) S 6960 6960 5798 0 -1 4202560 739 0 0 0 0 0 0 0 19 0 1 0 669059562 285945856 5726 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715023 0 0 16781312 514 7539483727106146303 0 0 17 3 0 0 0
/proc/6966/statm: 69811 5726 354 364 0 5729 0
[pid=6968] ppid=6966 vsize=1017932 CPUtime=0.64 cores=0-7
/proc/6968/stat : 6968 (gnovelty+2) R 6966 6968 6968 0 -1 4202496 493 0 0 0 64 0 0 0 22 0 1 0 669059563 1042362368 227 33554432000 134512640 135663704 4289689760 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6968/statm: 254483 227 113 282 0 254199 0
[pid=6969] ppid=6960 vsize=289888 CPUtime=0 cores=0-7
/proc/6969/stat : 6969 (python) S 6960 6960 5798 0 -1 4202560 744 0 0 0 0 0 0 0 19 0 1 0 669059566 296845312 5812 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 16506084339625230335 0 0 17 0 0 0 0
/proc/6969/statm: 72472 5812 348 364 0 8387 0
[pid=6971] ppid=6969 vsize=1017932 CPUtime=0.41 cores=0-7
/proc/6971/stat : 6971 (gnovelty+2) R 6969 6971 6971 0 -1 4202496 491 0 0 0 41 0 0 0 21 0 1 0 669059566 1042362368 226 33554432000 134512640 135663704 4293296656 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6971/statm: 254483 226 113 282 0 254199 0
[pid=6972] ppid=6960 vsize=300144 CPUtime=0 cores=0-7
/proc/6972/stat : 6972 (python) S 6960 6960 5798 0 -1 4202560 727 0 0 0 0 0 0 0 21 0 1 0 669059569 307347456 5812 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 4884298935713136639 0 0 17 2 0 0 0
/proc/6972/statm: 75036 5812 344 364 0 10948 0
[pid=6974] ppid=6972 vsize=416520 CPUtime=0.59 cores=0-7
/proc/6974/stat : 6974 (adaptg2wsat2009) R 6972 6974 6974 0 -1 4202496 531 0 0 0 59 0 0 0 25 0 1 0 669059569 426516480 265 33554432000 134512640 135107411 4291878080 18446744073709551615 134523314 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6974/statm: 104130 265 49 146 0 103006 0
[pid=6975] ppid=6960 vsize=310400 CPUtime=0 cores=0-7
/proc/6975/stat : 6975 (python) S 6960 6960 5798 0 -1 4202560 736 0 0 0 0 0 0 0 23 0 1 0 669059572 317849600 5816 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 8314595169345208319 0 0 17 0 0 0 0
/proc/6975/statm: 77600 5816 344 364 0 13509 0
[pid=6977] ppid=6975 vsize=416520 CPUtime=0.44 cores=0-7
/proc/6977/stat : 6977 (adaptg2wsat2009) R 6975 6977 6977 0 -1 4202496 533 0 0 0 44 0 0 0 25 0 1 0 669059575 426516480 265 33554432000 134512640 135107411 4292046368 18446744073709551615 134523296 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6977/statm: 104130 265 49 146 0 103006 0
[pid=6978] ppid=6960 vsize=320656 CPUtime=0 cores=0-7
/proc/6978/stat : 6978 (python) S 6960 6960 5798 0 -1 4202560 735 0 0 0 0 0 0 0 25 0 1 0 669059576 328351744 5820 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 15314749472156680191 0 0 17 0 0 0 0
/proc/6978/statm: 80164 5820 344 364 0 16070 0
[pid=6980] ppid=6978 vsize=416520 CPUtime=0.21 cores=0-7
/proc/6980/stat : 6980 (adaptg2wsat2009) R 6978 6980 6980 0 -1 4202496 533 0 0 0 21 0 0 0 25 0 1 0 669059578 426516480 265 33554432000 134512640 135107411 4293455152 18446744073709551615 134523426 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6980/statm: 104130 265 49 146 0 103006 0
[pid=6981] ppid=6960 vsize=330912 CPUtime=0 cores=0-7
/proc/6981/stat : 6981 (python) S 6960 6960 5798 0 -1 4202560 742 0 0 0 0 0 0 0 25 0 1 0 669059579 338853888 5824 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 4424288834297004031 0 0 17 0 0 0 0
/proc/6981/statm: 82728 5824 344 364 0 18631 0
[pid=6960/tid=6967] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6967/stat : 6967 (python) S 6958 6960 5798 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 9 0 669059563 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6970] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6970/stat : 6970 (python) S 6958 6960 5798 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 9 0 669059566 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6973] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6973/stat : 6973 (python) S 6958 6960 5798 0 -1 4202560 22 935 0 0 0 0 0 0 22 0 9 0 669059569 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6976] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6976/stat : 6976 (python) S 6958 6960 5798 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 9 0 669059572 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6979] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6979/stat : 6979 (python) S 6958 6960 5798 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 9 0 669059576 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6982] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6982/stat : 6982 (python) S 6958 6960 5798 0 -1 4202560 42 935 0 0 0 0 0 0 25 0 9 0 669059579 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.24
Current children cumulated vsize (KiB) 5478336

[startup+3.10154 s]
/proc/loadavg: 9.68 10.48 10.57 13/509 6989
/proc/meminfo: memFree=21244892/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=361668 CPUtime=0.95 cores=0-7
/proc/6960/stat : 6960 (python) S 6958 6960 5798 0 -1 4202496 16096 935 1 0 85 10 0 0 25 0 9 0 669059479 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6960/statm: 90417 7383 1891 364 0 26314 0
[pid=6966] ppid=6960 vsize=279244 CPUtime=0 cores=0-7
/proc/6966/stat : 6966 (python) S 6960 6960 5798 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 669059562 285945856 5726 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715023 0 0 16781312 514 7539483727106113793 0 0 17 3 0 0 0
/proc/6966/statm: 69811 5726 354 364 0 5729 0
[pid=6968] ppid=6966 vsize=1017932 CPUtime=2.22 cores=0-7
/proc/6968/stat : 6968 (gnovelty+2) R 6966 6968 6968 0 -1 4202496 493 0 0 0 222 0 0 0 25 0 1 0 669059563 1042362368 227 33554432000 134512640 135663704 4289689760 18446744073709551615 134524843 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6968/statm: 254483 227 113 282 0 254199 0
[pid=6969] ppid=6960 vsize=289888 CPUtime=0 cores=0-7
/proc/6969/stat : 6969 (python) S 6960 6960 5798 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 669059566 296845312 5812 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 16506084339625197827 0 0 17 0 0 0 0
/proc/6969/statm: 72472 5812 348 364 0 8387 0
[pid=6971] ppid=6969 vsize=1017932 CPUtime=1.21 cores=0-7
/proc/6971/stat : 6971 (gnovelty+2) R 6969 6971 6971 0 -1 4202496 491 0 0 0 121 0 0 0 25 0 1 0 669059566 1042362368 226 33554432000 134512640 135663704 4293296656 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6971/statm: 254483 226 113 282 0 254199 0
[pid=6972] ppid=6960 vsize=300144 CPUtime=0 cores=0-7
/proc/6972/stat : 6972 (python) S 6960 6960 5798 0 -1 4202560 745 0 0 0 0 0 0 0 18 0 1 0 669059569 307347456 5816 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 4884298935713104130 0 0 17 2 0 0 0
/proc/6972/statm: 75036 5816 348 364 0 10948 0
[pid=6974] ppid=6972 vsize=416524 CPUtime=2.19 cores=0-7
/proc/6974/stat : 6974 (adaptg2wsat2009) R 6972 6974 6974 0 -1 4202496 587 0 0 0 219 0 0 0 25 0 1 0 669059569 426520576 321 33554432000 134512640 135107411 4291878080 18446744073709551615 134532135 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6974/statm: 104131 321 59 146 0 103007 0
[pid=6975] ppid=6960 vsize=310400 CPUtime=0 cores=0-7
/proc/6975/stat : 6975 (python) S 6960 6960 5798 0 -1 4202560 755 0 0 0 0 0 0 0 18 0 1 0 669059572 317849600 5820 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 8314595169345175809 0 0 17 0 0 0 0
/proc/6975/statm: 77600 5820 348 364 0 13509 0
[pid=6977] ppid=6975 vsize=416524 CPUtime=2.04 cores=0-7
/proc/6977/stat : 6977 (adaptg2wsat2009) R 6975 6977 6977 0 -1 4202496 589 0 0 0 204 0 0 0 25 0 1 0 669059575 426520576 321 33554432000 134512640 135107411 4292046368 18446744073709551615 134532360 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6977/statm: 104131 321 59 146 0 103007 0
[pid=6978] ppid=6960 vsize=320656 CPUtime=0 cores=0-7
/proc/6978/stat : 6978 (python) S 6960 6960 5798 0 -1 4202560 753 0 0 0 0 0 0 0 18 0 1 0 669059576 328351744 5824 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 15314749472156680191 0 0 17 0 0 0 0
/proc/6978/statm: 80164 5824 348 364 0 16070 0
[pid=6980] ppid=6978 vsize=416524 CPUtime=1.01 cores=0-7
/proc/6980/stat : 6980 (adaptg2wsat2009) R 6978 6980 6980 0 -1 4202496 589 0 0 0 101 0 0 0 25 0 1 0 669059578 426520576 321 33554432000 134512640 135107411 4293455152 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6980/statm: 104131 321 59 146 0 103007 0
[pid=6981] ppid=6960 vsize=330912 CPUtime=0 cores=0-7
/proc/6981/stat : 6981 (python) S 6960 6960 5798 0 -1 4202560 763 0 0 0 0 0 0 0 18 0 1 0 669059579 338853888 5828 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 4424288834296971523 0 0 17 0 0 0 0
/proc/6981/statm: 82728 5828 348 364 0 18631 0
[pid=6985] ppid=6981 vsize=246808 CPUtime=1.01 cores=0-7
/proc/6985/stat : 6985 (FH) R 6981 6985 6985 0 -1 4202496 552 0 0 0 101 0 0 0 25 0 1 0 669059583 252731392 287 33554432000 134512640 134936988 4291647072 18446744073709551615 134553445 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6985/statm: 61702 287 41 104 0 61206 0
[pid=6983] ppid=6960 vsize=341168 CPUtime=0 cores=0-7
/proc/6983/stat : 6983 (python) S 6960 6960 5798 0 -1 4202560 776 0 0 0 0 0 0 0 15 0 1 0 669059582 349356032 5832 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 3879068230995640579 0 0 17 1 0 0 0
/proc/6983/statm: 85292 5832 348 364 0 21192 0
[pid=6989] ppid=6983 vsize=2264 CPUtime=0.95 cores=0-7
/proc/6989/stat : 6989 (march_hi) R 6983 6989 6989 0 -1 4202496 993 0 0 0 95 0 0 0 25 0 1 0 669059592 2318336 391 33554432000 4194304 4955518 140734968960096 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/6989/statm: 566 391 106 186 0 379 0
[pid=6986] ppid=6960 vsize=351424 CPUtime=0 cores=0-7
/proc/6986/stat : 6986 (python) S 6960 6960 5798 0 -1 4202560 822 0 0 0 0 0 0 0 15 0 1 0 669059586 359858176 5842 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 2514657863809335554 0 0 17 0 0 0 0
/proc/6986/statm: 87856 5842 354 364 0 23753 0
[pid=6988] ppid=6986 vsize=2264 CPUtime=0.98 cores=0-7
/proc/6988/stat : 6988 (march_hi) R 6986 6988 6988 0 -1 4202496 1000 0 0 0 98 0 0 0 25 0 1 0 669059586 2318336 392 33554432000 4194304 4955518 140737425892800 18446744073709551615 4208638 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/6988/statm: 566 392 106 186 0 379 0
[pid=6960/tid=6967] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6967/stat : 6967 (python) S 6958 6960 5798 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 9 0 669059563 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6970] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6970/stat : 6970 (python) S 6958 6960 5798 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 9 0 669059566 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6973] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6973/stat : 6973 (python) S 6958 6960 5798 0 -1 4202560 22 935 0 0 0 0 0 0 22 0 9 0 669059569 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6976] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6976/stat : 6976 (python) S 6958 6960 5798 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 9 0 669059572 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6979] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6979/stat : 6979 (python) S 6958 6960 5798 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 9 0 669059576 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6982] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6982/stat : 6982 (python) S 6958 6960 5798 0 -1 4202560 42 935 0 0 0 0 0 0 25 0 9 0 669059579 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6984] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6984/stat : 6984 (python) S 6958 6960 5798 0 -1 4202560 19 935 0 0 0 0 0 0 25 0 9 0 669059583 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6987] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6987/stat : 6987 (python) S 6958 6960 5798 0 -1 4202560 29 935 0 0 0 0 0 0 25 0 9 0 669059586 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 6422276

[startup+6.30092 s]
/proc/loadavg: 9.68 10.48 10.57 13/509 6989
/proc/meminfo: memFree=21242792/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=361668 CPUtime=0.95 cores=0-7
/proc/6960/stat : 6960 (python) S 6958 6960 5798 0 -1 4202496 16096 935 1 0 85 10 0 0 25 0 9 0 669059479 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6960/statm: 90417 7383 1891 364 0 26314 0
[pid=6966] ppid=6960 vsize=279244 CPUtime=0.02 cores=0-7
/proc/6966/stat : 6966 (python) S 6960 6960 5798 0 -1 4202560 905 0 0 0 1 1 0 0 18 0 1 0 669059562 285945856 5749 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715023 0 0 16781312 514 7539483727106113793 0 0 17 3 0 0 0
/proc/6966/statm: 69811 5749 377 364 0 5729 0

################
# More data... #
################

/proc/6960/task/6979/stat : 6979 (python) S 6958 6960 5798 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 9 0 669059576 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6982] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6982/stat : 6982 (python) S 6958 6960 5798 0 -1 4202560 42 935 0 0 0 0 0 0 25 0 9 0 669059579 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6984] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6984/stat : 6984 (python) S 6958 6960 5798 0 -1 4202560 19 935 0 0 0 0 0 0 25 0 9 0 669059583 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6987] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6987/stat : 6987 (python) S 6958 6960 5798 0 -1 4202560 29 935 0 0 0 0 0 0 25 0 9 0 669059586 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 368.44
Current children cumulated vsize (KiB) 6422684

[startup+69.5008 s]
/proc/loadavg: 11.27 10.79 10.67 13/509 6991
/proc/meminfo: memFree=21245304/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=361668 CPUtime=0.95 cores=0-7
/proc/6960/stat : 6960 (python) S 6958 6960 5798 0 -1 4202496 16096 935 1 0 85 10 0 0 25 0 9 0 669059479 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6960/statm: 90417 7383 1891 364 0 26314 0
[pid=6966] ppid=6960 vsize=279244 CPUtime=0.22 cores=0-7
/proc/6966/stat : 6966 (python) S 6960 6960 5798 0 -1 4202560 931 0 0 0 12 10 0 0 18 0 1 0 669059562 285945856 5749 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715023 0 0 16781312 514 13900254696762736897 0 0 17 3 0 0 0
/proc/6966/statm: 69811 5749 377 364 0 5729 0
[pid=6968] ppid=6966 vsize=1017932 CPUtime=56.98 cores=0-7
/proc/6968/stat : 6968 (gnovelty+2) R 6966 6968 6968 0 -1 4202496 493 0 0 0 5698 0 0 0 25 0 1 0 669059563 1042362368 227 33554432000 134512640 135663704 4289689760 18446744073709551615 134525715 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6968/statm: 254483 227 113 282 0 254199 0
[pid=6969] ppid=6960 vsize=289888 CPUtime=0.24 cores=0-7
/proc/6969/stat : 6969 (python) S 6960 6960 5798 0 -1 4202560 936 0 0 0 12 12 0 0 18 0 1 0 669059566 296845312 5835 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736899 0 0 17 0 0 0 0
/proc/6969/statm: 72472 5835 371 364 0 8387 0
[pid=6971] ppid=6969 vsize=1017932 CPUtime=34.18 cores=0-7
/proc/6971/stat : 6971 (gnovelty+2) R 6969 6971 6971 0 -1 4202496 491 0 0 0 3418 0 0 0 25 0 1 0 669059566 1042362368 226 33554432000 134512640 135663704 4293296656 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6971/statm: 254483 226 113 282 0 254199 0
[pid=6972] ppid=6960 vsize=300144 CPUtime=0.23 cores=0-7
/proc/6972/stat : 6972 (python) S 6960 6960 5798 0 -1 4202560 943 0 0 0 12 11 0 0 18 0 1 0 669059569 307347456 5839 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736898 0 0 17 2 0 0 0
/proc/6972/statm: 75036 5839 371 364 0 10948 0
[pid=6974] ppid=6972 vsize=416524 CPUtime=65.39 cores=0-7
/proc/6974/stat : 6974 (adaptg2wsat2009) R 6972 6974 6974 0 -1 4202496 587 0 0 0 6539 0 0 0 25 0 1 0 669059569 426520576 321 33554432000 134512640 135107411 4291878080 18446744073709551615 134531491 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6974/statm: 104131 321 59 146 0 103007 0
[pid=6975] ppid=6960 vsize=310400 CPUtime=0.23 cores=0-7
/proc/6975/stat : 6975 (python) S 6960 6960 5798 0 -1 4202560 950 0 0 0 12 11 0 0 18 0 1 0 669059572 317849600 5843 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736897 0 0 17 0 0 0 0
/proc/6975/statm: 77600 5843 371 364 0 13509 0
[pid=6977] ppid=6975 vsize=416524 CPUtime=67.16 cores=0-7
/proc/6977/stat : 6977 (adaptg2wsat2009) R 6975 6977 6977 0 -1 4202496 589 0 0 0 6714 2 0 0 25 0 1 0 669059575 426520576 321 33554432000 134512640 135107411 4292046368 18446744073709551615 134532313 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6977/statm: 104131 321 59 146 0 103007 0
[pid=6978] ppid=6960 vsize=320656 CPUtime=0.23 cores=0-7
/proc/6978/stat : 6978 (python) S 6960 6960 5798 0 -1 4202560 950 0 0 0 11 12 0 0 18 0 1 0 669059576 328351744 5847 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736897 0 0 17 0 0 0 0
/proc/6978/statm: 80164 5847 371 364 0 16070 0
[pid=6980] ppid=6978 vsize=416524 CPUtime=41.11 cores=0-7
/proc/6980/stat : 6980 (adaptg2wsat2009) R 6978 6980 6980 0 -1 4202496 589 0 0 0 4111 0 0 0 25 0 1 0 669059578 426520576 321 33554432000 134512640 135107411 4293455152 18446744073709551615 134532379 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6980/statm: 104131 321 59 146 0 103007 0
[pid=6981] ppid=6960 vsize=330912 CPUtime=0.23 cores=0-7
/proc/6981/stat : 6981 (python) S 6960 6960 5798 0 -1 4202560 965 0 0 0 13 10 0 0 18 0 1 0 669059579 338853888 5851 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736899 0 0 17 0 0 0 0
/proc/6981/statm: 82728 5851 371 364 0 18631 0
[pid=6985] ppid=6981 vsize=246808 CPUtime=36.96 cores=0-7
/proc/6985/stat : 6985 (FH) R 6981 6985 6985 0 -1 4202496 552 0 0 0 3696 0 0 0 25 0 1 0 669059583 252731392 287 33554432000 134512640 134936988 4291647072 18446744073709551615 134554998 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6985/statm: 61702 287 41 104 0 61206 0
[pid=6983] ppid=6960 vsize=341168 CPUtime=0.29 cores=0-7
/proc/6983/stat : 6983 (python) S 6960 6960 5798 0 -1 4202560 1002 0 0 0 14 15 0 0 15 0 1 0 669059582 349356032 5855 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 3879068230995640579 0 0 17 1 0 0 0
/proc/6983/statm: 85292 5855 371 364 0 21192 0
[pid=6989] ppid=6983 vsize=2468 CPUtime=34.01 cores=0-7
/proc/6989/stat : 6989 (march_hi) R 6983 6989 6989 0 -1 4202496 1041 0 0 0 3401 0 0 0 25 0 1 0 669059592 2527232 439 33554432000 4194304 4955518 140734968960096 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/6989/statm: 617 439 106 186 0 430 0
[pid=6986] ppid=6960 vsize=351424 CPUtime=0.31 cores=0-7
/proc/6986/stat : 6986 (python) S 6960 6960 5798 0 -1 4202560 1020 0 0 0 16 15 0 0 15 0 1 0 669059586 359858176 5865 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 2514657863809335554 0 0 17 0 0 0 0
/proc/6986/statm: 87856 5865 377 364 0 23753 0
[pid=6988] ppid=6986 vsize=2468 CPUtime=34.11 cores=0-7
/proc/6988/stat : 6988 (march_hi) R 6986 6988 6988 0 -1 4202496 1048 0 0 0 3411 0 0 0 25 0 1 0 669059586 2527232 440 33554432000 4194304 4955518 140737425892800 18446744073709551615 4208624 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6988/statm: 617 440 106 186 0 430 0
[pid=6960/tid=6967] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6967/stat : 6967 (python) S 6958 6960 5798 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 9 0 669059563 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6970] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6970/stat : 6970 (python) S 6958 6960 5798 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 9 0 669059566 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6973] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6973/stat : 6973 (python) S 6958 6960 5798 0 -1 4202560 22 935 0 0 0 0 0 0 22 0 9 0 669059569 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6976] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6976/stat : 6976 (python) S 6958 6960 5798 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 9 0 669059572 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6979] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6979/stat : 6979 (python) S 6958 6960 5798 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 9 0 669059576 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6982] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6982/stat : 6982 (python) S 6958 6960 5798 0 -1 4202560 42 935 0 0 0 0 0 0 25 0 9 0 669059579 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6984] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6984/stat : 6984 (python) S 6958 6960 5798 0 -1 4202560 19 935 0 0 0 0 0 0 25 0 9 0 669059583 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6987] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6987/stat : 6987 (python) S 6958 6960 5798 0 -1 4202560 29 935 0 0 0 0 0 0 25 0 9 0 669059586 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 372.83
Current children cumulated vsize (KiB) 6422684

[startup+69.9018 s]
/proc/loadavg: 11.27 10.79 10.67 13/509 6991
/proc/meminfo: memFree=21245304/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=361668 CPUtime=0.95 cores=0-7
/proc/6960/stat : 6960 (python) S 6958 6960 5798 0 -1 4202496 16096 935 1 0 85 10 0 0 25 0 9 0 669059479 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6960/statm: 90417 7383 1891 364 0 26314 0
[pid=6966] ppid=6960 vsize=279244 CPUtime=0.22 cores=0-7
/proc/6966/stat : 6966 (python) S 6960 6960 5798 0 -1 4202560 931 0 0 0 12 10 0 0 18 0 1 0 669059562 285945856 5749 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715023 0 0 16781312 514 13900254696762736897 0 0 17 3 0 0 0
/proc/6966/statm: 69811 5749 377 364 0 5729 0
[pid=6968] ppid=6966 vsize=1017932 CPUtime=57.38 cores=0-7
/proc/6968/stat : 6968 (gnovelty+2) R 6966 6968 6968 0 -1 4202496 493 0 0 0 5738 0 0 0 25 0 1 0 669059563 1042362368 227 33554432000 134512640 135663704 4289689760 18446744073709551615 134525541 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6968/statm: 254483 227 113 282 0 254199 0
[pid=6969] ppid=6960 vsize=289888 CPUtime=0.24 cores=0-7
/proc/6969/stat : 6969 (python) S 6960 6960 5798 0 -1 4202560 936 0 0 0 12 12 0 0 18 0 1 0 669059566 296845312 5835 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736899 0 0 17 0 0 0 0
/proc/6969/statm: 72472 5835 371 364 0 8387 0
[pid=6971] ppid=6969 vsize=1017932 CPUtime=34.38 cores=0-7
/proc/6971/stat : 6971 (gnovelty+2) R 6969 6971 6971 0 -1 4202496 491 0 0 0 3438 0 0 0 25 0 1 0 669059566 1042362368 226 33554432000 134512640 135663704 4293296656 18446744073709551615 134525224 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6971/statm: 254483 226 113 282 0 254199 0
[pid=6972] ppid=6960 vsize=300144 CPUtime=0.23 cores=0-7
/proc/6972/stat : 6972 (python) S 6960 6960 5798 0 -1 4202560 943 0 0 0 12 11 0 0 18 0 1 0 669059569 307347456 5839 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736898 0 0 17 2 0 0 0
/proc/6972/statm: 75036 5839 371 364 0 10948 0
[pid=6974] ppid=6972 vsize=416524 CPUtime=65.59 cores=0-7
/proc/6974/stat : 6974 (adaptg2wsat2009) R 6972 6974 6974 0 -1 4202496 587 0 0 0 6559 0 0 0 25 0 1 0 669059569 426520576 321 33554432000 134512640 135107411 4291878080 18446744073709551615 134532135 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6974/statm: 104131 321 59 146 0 103007 0
[pid=6975] ppid=6960 vsize=310400 CPUtime=0.23 cores=0-7
/proc/6975/stat : 6975 (python) S 6960 6960 5798 0 -1 4202560 950 0 0 0 12 11 0 0 18 0 1 0 669059572 317849600 5843 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736897 0 0 17 0 0 0 0
/proc/6975/statm: 77600 5843 371 364 0 13509 0
[pid=6977] ppid=6975 vsize=416524 CPUtime=67.56 cores=0-7
/proc/6977/stat : 6977 (adaptg2wsat2009) R 6975 6977 6977 0 -1 4202496 589 0 0 0 6754 2 0 0 25 0 1 0 669059575 426520576 321 33554432000 134512640 135107411 4292046368 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6977/statm: 104131 321 59 146 0 103007 0
[pid=6978] ppid=6960 vsize=320656 CPUtime=0.23 cores=0-7
/proc/6978/stat : 6978 (python) S 6960 6960 5798 0 -1 4202560 950 0 0 0 11 12 0 0 18 0 1 0 669059576 328351744 5847 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736897 0 0 17 0 0 0 0
/proc/6978/statm: 80164 5847 371 364 0 16070 0
[pid=6980] ppid=6978 vsize=416524 CPUtime=41.31 cores=0-7
/proc/6980/stat : 6980 (adaptg2wsat2009) R 6978 6980 6980 0 -1 4202496 589 0 0 0 4131 0 0 0 25 0 1 0 669059578 426520576 321 33554432000 134512640 135107411 4293455152 18446744073709551615 134532376 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6980/statm: 104131 321 59 146 0 103007 0
[pid=6981] ppid=6960 vsize=330912 CPUtime=0.23 cores=0-7
/proc/6981/stat : 6981 (python) S 6960 6960 5798 0 -1 4202560 965 0 0 0 13 10 0 0 18 0 1 0 669059579 338853888 5851 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 13900254696762736899 0 0 17 0 0 0 0
/proc/6981/statm: 82728 5851 371 364 0 18631 0
[pid=6985] ppid=6981 vsize=246808 CPUtime=37.36 cores=0-7
/proc/6985/stat : 6985 (FH) R 6981 6985 6985 0 -1 4202496 552 0 0 0 3736 0 0 0 25 0 1 0 669059583 252731392 287 33554432000 134512640 134936988 4291647072 18446744073709551615 134554083 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6985/statm: 61702 287 41 104 0 61206 0
[pid=6983] ppid=6960 vsize=341168 CPUtime=0.29 cores=0-7
/proc/6983/stat : 6983 (python) S 6960 6960 5798 0 -1 4202560 1005 0 0 0 14 15 0 0 15 0 1 0 669059582 349356032 5856 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 3879068230995640579 0 0 17 1 0 0 0
/proc/6983/statm: 85292 5856 372 364 0 21192 0
[pid=6989] ppid=6983 vsize=2468 CPUtime=34.21 cores=0-7
/proc/6989/stat : 6989 (march_hi) R 6983 6989 6989 0 -1 4202496 1041 0 0 0 3421 0 0 0 25 0 1 0 669059592 2527232 439 33554432000 4194304 4955518 140734968960096 18446744073709551615 4296850 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/6989/statm: 617 439 106 186 0 430 0
[pid=6986] ppid=6960 vsize=351424 CPUtime=0.31 cores=0-7
/proc/6986/stat : 6986 (python) S 6960 6960 5798 0 -1 4202560 1020 0 0 0 16 15 0 0 15 0 1 0 669059586 359858176 5865 33554432000 4194304 5683644 140736187049248 18446744073709551615 239476715078 0 0 16781312 514 2514657863809335554 0 0 17 0 0 0 0
/proc/6986/statm: 87856 5865 377 364 0 23753 0
[pid=6988] ppid=6986 vsize=2468 CPUtime=34.31 cores=0-7
/proc/6988/stat : 6988 (march_hi) R 6986 6988 6988 0 -1 4202496 1049 0 0 0 3431 0 0 0 25 0 1 0 669059586 2527232 441 33554432000 4194304 4955518 140737425892800 18446744073709551615 4297502 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6988/statm: 617 441 106 186 0 430 0
[pid=6960/tid=6967] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6967/stat : 6967 (python) S 6958 6960 5798 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 9 0 669059563 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6970] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6970/stat : 6970 (python) S 6958 6960 5798 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 9 0 669059566 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6973] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6973/stat : 6973 (python) S 6958 6960 5798 0 -1 4202560 22 935 0 0 0 0 0 0 22 0 9 0 669059569 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6976] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6976/stat : 6976 (python) S 6958 6960 5798 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 9 0 669059572 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6979] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6979/stat : 6979 (python) S 6958 6960 5798 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 9 0 669059576 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6982] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6982/stat : 6982 (python) S 6958 6960 5798 0 -1 4202560 42 935 0 0 0 0 0 0 25 0 9 0 669059579 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6984] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6984/stat : 6984 (python) S 6958 6960 5798 0 -1 4202560 19 935 0 0 0 0 0 0 25 0 9 0 669059583 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
[pid=6960/tid=6987] ppid=6958 vsize=361668 CPUtime=0 cores=0-7
/proc/6960/task/6987/stat : 6987 (python) S 6958 6960 5798 0 -1 4202560 29 935 0 0 0 0 0 0 25 0 9 0 669059586 370348032 7383 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 2 18446604453917769856 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 375.03
Current children cumulated vsize (KiB) 6422684

[startup+70.3017 s]
/proc/loadavg: 11.27 10.79 10.67 7/497 6992
/proc/meminfo: memFree=21276460/32950928 swapFree=67056568/67111528
[pid=6960] ppid=6958 vsize=341084 CPUtime=377.31 cores=0-7
/proc/6960/stat : 6960 (python) R 6958 6960 5798 0 -1 4202496 18277 14590 1 0 86 10 37527 108 16 0 4 0 669059479 349270016 7362 33554432000 4194304 5683644 140736187049248 18446744073709551615 5114052 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/6960/statm: 85271 7362 1878 364 0 21192 0
[pid=6960/tid=6970] ppid=6958 vsize=341084 CPUtime=376.35 cores=0-7
/proc/6960/task/6970/stat : 6970 (python) S 6958 6960 5798 0 -1 4202560 28 14590 0 0 0 0 37527 108 18 0 4 0 669059566 349270016 7363 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 0 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6976] ppid=6958 vsize=341084 CPUtime=376.35 cores=0-7
/proc/6960/task/6976/stat : 6976 (python) S 6958 6960 5798 0 -1 4202560 27 14590 0 0 0 0 37527 108 18 0 4 0 669059572 349270016 7363 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 0 18446604453917769856 0 0 -1 2 0 0 0
[pid=6960/tid=6987] ppid=6958 vsize=341084 CPUtime=376.35 cores=0-7
/proc/6960/task/6987/stat : 6987 (python) S 6958 6960 5798 0 -1 4202560 29 14590 0 0 0 0 37527 108 18 0 4 0 669059586 349270016 7363 33554432000 4194304 5683644 140736187049248 18446744073709551615 239488518577 0 0 16781312 0 18446604453917769856 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 377.31
Current children cumulated vsize (KiB) 341084

Child status: 0
Real time (s): 70.3304
CPU time (s): 377.352
CPU user time (s): 376.156
CPU system time (s): 1.19582
CPU usage (%): 536.541
Max. virtual memory (cumulated for all children) (KiB): 6422688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 376.156
system time used= 1.19582
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35097
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2555
involuntary context switches= 5304

runsolver used 0.349946 second user time and 0.769882 second system time

The end

Launcher Data 

Begin job on node148 at 2011-05-16 21:37:04
IDJOB=3385783
IDBENCH=83048
IDSOLVER=1870
FILE ID=node148/3385783-1305574624
RUNJOBID= node148-1305564960-5812
PBS_JOBID= 13350102
Free space on /tmp= 72884 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v50-c4450-S1880985555-004.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385783-1305574624/watcher-3385783-1305574624 -o /tmp/evaluation-result-3385783-1305574624/solver-3385783-1305574624 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385783-1305574624.cnf -seed 202123267 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a1e34b50698b079e87a3cad9c76615ca
RANDOM SEED=202123267

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      21308644 kB
Buffers:        352216 kB
Cached:        5038532 kB
SwapCached:       8488 kB
Active:        8052012 kB
Inactive:      3215300 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      21308644 kB
SwapTotal:    67111528 kB
SwapFree:     67056568 kB
Dirty:           32532 kB
Writeback:           0 kB
AnonPages:     5874932 kB
Mapped:          37460 kB
Slab:           252364 kB
PageTables:      48968 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 141722364 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72852 MiB
End job on node148 at 2011-05-16 21:38:15