Trace number 3322255

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 3316.87 519.225

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S113771637-026.UNKNOWN.cnf
MD5SUM7f4758baa378252dd3709cff507a5405
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark368.443
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data

0.33/0.63	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.33/0.63	c INFO: solving HOME/instance-3322255-1304378264.cnf
0.33/0.63	c INFO: computing task features
0.33/0.67	c INFO: computed variable-clause graph statistics
0.33/0.67	c INFO: computed clause balance statistics
0.52/0.86	c INFO: computed variable balance statistics
0.62/0.94	c INFO: computed small-clause counts
0.62/0.94	c INFO: computed Horn-clause counts
0.62/0.95	c INFO: computed variable graph statistics
0.62/0.95	c INFO: collected features for HOME/instance-3322255-1304378264.cnf in 0.31 s
0.62/0.98	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.55)
0.74/1.02	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.10)
0.74/1.06	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.05)
0.74/1.09	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.03)
0.95/1.13	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.03)
0.95/1.17	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.02)
1.12/1.21	c INFO: running FH@0 for 97 with 39999 remaining (b = 0.02)
1.12/1.25	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.01)
624.10/99.38	c INFO: running march_hi@0 for 2134 with 39901 remaining (b = 0.31)
637.07/101.31	c INFO: running march_hi@0 for 2134 with 39899 remaining (b = 0.29)
638.79/101.60	c INFO: running march_hi@0 for 388 with 39899 remaining (b = 0.11)
782.12/125.45	c INFO: running march_hi@0 for 388 with 39875 remaining (b = 0.09)
782.65/125.60	c INFO: running adaptg2wsat2009++@98 for 97 with 39875 remaining (b = 0.01)
890.82/143.59	c INFO: running FH@0 for 97 with 39857 remaining (b = 0.01)
928.06/149.70	c INFO: running march_hi@0 for 2134 with 39850 remaining (b = 0.25)
1071.77/173.62	c INFO: running march_hi@0 for 485 with 39827 remaining (b = 0.09)
1429.18/228.95	c INFO: running march_hi@0 for 388 with 39771 remaining (b = 0.06)
2146.29/339.21	c INFO: running march_hi@0 for 388 with 39661 remaining (b = 0.05)
3315.98/519.20	s UNSATISFIABLE

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322255-1304378264/watcher-3322255-1304378264 -o /tmp/evaluation-result-3322255-1304378264/solver-3322255-1304378264 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322255-1304378264.cnf -seed 1388405953 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.01 6.44 3.83 3/361 16694
/proc/meminfo: memFree=6841232/32951124 swapFree=61020456/67111528
[pid=16694] ppid=16692 vsize=15776 CPUtime=0 cores=0-7
/proc/16694/stat : 16694 (python) S 16692 16694 15120 0 -1 4202496 935 0 0 0 0 0 0 0 25 0 1 0 628057107 16154624 813 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/16694/statm: 3944 813 356 364 0 431 0

[startup+0.0682209 s]
/proc/loadavg: 10.01 6.44 3.83 3/361 16694
/proc/meminfo: memFree=6841232/32951124 swapFree=61020456/67111528
[pid=16694] ppid=16692 vsize=36512 CPUtime=0.03 cores=0-7
/proc/16694/stat : 16694 (python) S 16692 16694 15120 0 -1 4202496 1611 0 0 0 3 0 0 0 25 0 1 0 628057107 37388288 1444 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/16694/statm: 9128 1444 452 364 0 945 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 36512

[startup+0.101221 s]
/proc/loadavg: 10.01 6.44 3.83 3/361 16694
/proc/meminfo: memFree=6841232/32951124 swapFree=61020456/67111528
[pid=16694] ppid=16692 vsize=93964 CPUtime=0.05 cores=0-7
/proc/16694/stat : 16694 (python) S 16692 16694 15120 0 -1 4202496 2695 0 0 0 4 1 0 0 17 0 1 0 628057107 96219136 2407 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/16694/statm: 23491 2407 764 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93964

[startup+0.300213 s]
/proc/loadavg: 10.01 6.44 3.83 3/361 16694
/proc/meminfo: memFree=6841232/32951124 swapFree=61020456/67111528
[pid=16694] ppid=16692 vsize=135752 CPUtime=0.16 cores=0-7
/proc/16694/stat : 16694 (python) S 16692 16694 15120 0 -1 4202496 5966 935 1 0 13 3 0 0 18 0 1 0 628057107 139010048 4151 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284921861 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/16694/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 135752

[startup+0.701112 s]
/proc/loadavg: 10.01 6.44 3.83 3/361 16694
/proc/meminfo: memFree=6841232/32951124 swapFree=61020456/67111528
[pid=16694] ppid=16692 vsize=279556 CPUtime=0.42 cores=0-7
/proc/16694/stat : 16694 (python) R 16692 16694 15120 0 -1 4202496 9753 935 1 0 35 7 0 0 17 0 1 0 628057107 286265344 7273 33554432000 4194304 5683644 140736998607472 18446744073709551615 47512250917205 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/16694/statm: 69889 7273 1826 364 0 5813 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 279556

[startup+1.50094 s]
/proc/loadavg: 10.01 6.44 3.83 5/365 16702
/proc/meminfo: memFree=6815284/32951124 swapFree=61020456/67111528
[pid=16694] ppid=16692 vsize=426672 CPUtime=0.97 cores=0-7
/proc/16694/stat : 16694 (python) S 16692 16694 15120 0 -1 4202496 15619 935 1 0 88 9 0 0 25 0 9 0 628057107 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/16694/statm: 106668 7531 1891 364 0 42565 0
[pid=16700] ppid=16694 vsize=278704 CPUtime=0 cores=0-7
/proc/16700/stat : 16700 (python) S 16694 16694 15120 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 628057206 285392896 5614 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945935 0 0 16781312 514 3835778534064783359 0 0 17 1 0 0 0
/proc/16700/statm: 69676 5614 354 364 0 5594 0
[pid=16702] ppid=16700 vsize=1017932 CPUtime=0.5 cores=0-7
/proc/16702/stat : 16702 (gnovelty+2) R 16700 16702 16702 0 -1 4202496 510 0 0 0 50 0 0 0 20 0 1 0 628057206 1042362368 247 33554432000 134512640 135663704 4290763312 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16702/statm: 254483 247 113 282 0 254199 0
[pid=16694/tid=16701] ppid=16692 vsize=426672 CPUtime=0 cores=0-7
/proc/16694/task/16701/stat : 16701 (python) S 16692 16694 15120 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 9 0 628057206 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 1723308

[startup+3.10168 s]
/proc/loadavg: 10.01 6.44 3.83 11/386 16723
/proc/meminfo: memFree=6781388/32951124 swapFree=61020456/67111528
[pid=16694] ppid=16692 vsize=426672 CPUtime=0.97 cores=0-7
/proc/16694/stat : 16694 (python) S 16692 16694 15120 0 -1 4202496 15619 935 1 0 88 9 0 0 25 0 9 0 628057107 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/16694/statm: 106668 7531 1891 364 0 42565 0
[pid=16700] ppid=16694 vsize=278704 CPUtime=0 cores=0-7
/proc/16700/stat : 16700 (python) S 16694 16694 15120 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 628057206 285392896 5614 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945935 0 0 16781312 514 3835778534064750849 0 0 17 1 0 0 0
/proc/16700/statm: 69676 5614 354 364 0 5594 0
[pid=16702] ppid=16700 vsize=1017932 CPUtime=2.1 cores=0-7
/proc/16702/stat : 16702 (gnovelty+2) R 16700 16702 16702 0 -1 4202496 510 0 0 0 210 0 0 0 25 0 1 0 628057206 1042362368 247 33554432000 134512640 135663704 4290763312 18446744073709551615 134524874 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16702/statm: 254483 247 113 282 0 254199 0
[pid=16703] ppid=16694 vsize=289356 CPUtime=0 cores=0-7
/proc/16703/stat : 16703 (python) S 16694 16694 15120 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 628057210 296300544 5696 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 3835770837483356417 0 0 17 7 0 0 0
/proc/16703/statm: 72339 5696 348 364 0 8254 0
[pid=16705] ppid=16703 vsize=1017932 CPUtime=2.07 cores=0-7
/proc/16705/stat : 16705 (gnovelty+2) R 16703 16705 16705 0 -1 4202496 510 0 0 0 207 0 0 0 25 0 1 0 628057210 1042362368 247 33554432000 134512640 135663704 4293411456 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/16705/statm: 254483 247 113 282 0 254199 0
[pid=16706] ppid=16694 vsize=365148 CPUtime=0 cores=0-7
/proc/16706/stat : 16706 (python) S 16694 16694 15120 0 -1 4202560 710 0 0 0 0 0 0 0 18 0 1 0 628057213 373911552 5873 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 4158414278317015299 0 0 17 1 0 0 0
/proc/16706/statm: 91287 5873 348 364 0 27199 0
[pid=16708] ppid=16706 vsize=416788 CPUtime=2.03 cores=0-7
/proc/16708/stat : 16708 (adaptg2wsat2009) R 16706 16708 16708 0 -1 4202496 620 0 0 0 203 0 0 0 25 0 1 0 628057214 426790912 365 33554432000 134512640 135107411 4291650096 18446744073709551615 134532360 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/16708/statm: 104197 365 59 146 0 103073 0
[pid=16709] ppid=16694 vsize=375404 CPUtime=0 cores=0-7
/proc/16709/stat : 16709 (python) S 16694 16694 15120 0 -1 4202560 717 0 0 0 0 0 0 0 18 0 1 0 628057217 384413696 5831 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 11977753672089075711 0 0 17 1 0 0 0
/proc/16709/statm: 93851 5831 348 364 0 29760 0
[pid=16711] ppid=16709 vsize=416788 CPUtime=1.98 cores=0-7
/proc/16711/stat : 16711 (adaptg2wsat2009) R 16709 16711 16711 0 -1 4202496 618 0 0 0 198 0 0 0 25 0 1 0 628057217 426790912 362 33554432000 134512640 135107411 4293437792 18446744073709551615 134532088 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/16711/statm: 104197 362 59 146 0 103073 0
[pid=16712] ppid=16694 vsize=385660 CPUtime=0 cores=0-7
/proc/16712/stat : 16712 (python) S 16694 16694 15120 0 -1 4202560 729 0 0 0 0 0 0 0 18 0 1 0 628057221 394915840 5955 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 15381010715770879999 0 0 17 1 0 0 0
/proc/16712/statm: 96415 5955 348 364 0 32321 0
[pid=16714] ppid=16712 vsize=416788 CPUtime=1.02 cores=0-7
/proc/16714/stat : 16714 (adaptg2wsat2009) R 16712 16714 16714 0 -1 4202496 624 0 0 0 102 0 0 0 24 0 1 0 628057223 426790912 364 33554432000 134512640 135107411 4293509136 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/16714/statm: 104197 364 59 146 0 103073 0
[pid=16715] ppid=16694 vsize=395916 CPUtime=0 cores=0-7
/proc/16715/stat : 16715 (python) S 16694 16694 15120 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 628057225 405417984 5976 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 1263243481975849218 0 0 17 4 0 0 0
/proc/16715/statm: 98979 5976 348 364 0 34882 0
[pid=16717] ppid=16715 vsize=1017932 CPUtime=0.94 cores=0-7
/proc/16717/stat : 16717 (gnovelty+2) R 16715 16717 16717 0 -1 4202496 508 0 0 0 94 0 0 0 25 0 1 0 628057227 1042362368 248 33554432000 134512640 135663704 4289767120 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/16717/statm: 254483 248 113 282 0 254199 0
[pid=16718] ppid=16694 vsize=406172 CPUtime=0 cores=0-7
/proc/16718/stat : 16718 (python) S 16694 16694 15120 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 628057229 415920128 5860 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 13672199221904670719 0 0 17 4 0 0 0
/proc/16718/statm: 101543 5860 348 364 0 37443 0
[pid=16720] ppid=16718 vsize=245448 CPUtime=0.91 cores=0-7
/proc/16720/stat : 16720 (FH) R 16718 16720 16720 0 -1 4202496 549 0 0 0 91 0 0 0 25 0 1 0 628057231 251338752 285 33554432000 134512640 134936988 4289034272 18446744073709551615 134544299 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/16720/statm: 61362 285 40 104 0 60866 0
[pid=16721] ppid=16694 vsize=416428 CPUtime=0 cores=0-7
/proc/16721/stat : 16721 (python) S 16694 16694 15120 0 -1 4202560 773 0 0 0 0 0 0 0 18 0 1 0 628057233 426422272 5990 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 4945287471316336639 0 0 17 4 0 0 0
/proc/16721/statm: 104107 5990 354 364 0 40004 0
[pid=16723] ppid=16721 vsize=416788 CPUtime=1.84 cores=0-7
/proc/16723/stat : 16723 (adaptg2wsat2009) R 16721 16723 16723 0 -1 4202496 628 0 0 0 184 0 0 0 25 0 1 0 628057233 426790912 362 33554432000 134512640 135107411 4288224176 18446744073709551615 134531392 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/16723/statm: 104197 362 59 146 0 103073 0
[pid=16694/tid=16701] ppid=16692 vsize=426672 CPUtime=0 cores=0-7
/proc/16694/task/16701/stat : 16701 (python) S 16692 16694 15120 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 9 0 628057206 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 2 0 0 0
[pid=16694/tid=16704] ppid=16692 vsize=426672 CPUtime=0 cores=0-7
/proc/16694/task/16704/stat : 16704 (python) S 16692 16694 15120 0 -1 4202560 23 935 0 0 0 0 0 0 18 0 9 0 628057210 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 3 0 0 0
[pid=16694/tid=16707] ppid=16692 vsize=426672 CPUtime=0 cores=0-7
/proc/16694/task/16707/stat : 16707 (python) S 16692 16694 15120 0 -1 4202560 80 935 0 0 0 0 0 0 19 0 9 0 628057213 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 2 0 0 0
[pid=16694/tid=16710] ppid=16692 vsize=426672 CPUtime=0 cores=0-7
/proc/16694/task/16710/stat : 16710 (python) S 16692 16694 15120 0 -1 4202560 30 935 0 0 0 0 0 0 19 0 9 0 628057217 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 7 0 0 0
[pid=16694/tid=16713] ppid=16692 vsize=426672 CPUtime=0 cores=0-7
/proc/16694/task/16713/stat : 16713 (python) S 16692 16694 15120 0 -1 4202560 34 935 0 0 0 0 0 0 19 0 9 0 628057221 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16716] ppid=16692 vsize=426672 CPUtime=0 cores=0-7
/proc/16694/task/16716/stat : 16716 (python) S 16692 16694 15120 0 -1 4202560 33 935 0 0 0 0 0 0 21 0 9 0 628057225 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16719] ppid=16692 vsize=426672 CPUtime=0 cores=0-7
/proc/16694/task/16719/stat : 16719 (python) S 16692 16694 15120 0 -1 4202560 34 935 0 0 0 0 0 0 23 0 9 0 628057229 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16722] ppid=16692 vsize=426672 CPUtime=0 cores=0-7
/proc/16694/task/16722/stat : 16722 (python) S 16692 16694 15120 0 -1 4202560 35 935 0 0 0 0 0 0 25 0 9 0 628057233 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 13.86
Current children cumulated vsize (KiB) 8305856

[startup+6.30114 s]
/proc/loadavg: 10.01 6.50 3.86 11/386 16723
/proc/meminfo: memFree=6779796/32951124 swapFree=61020456/67111528
[pid=16694] ppid=16692 vsize=426672 CPUtime=0.97 cores=0-7
/proc/16694/stat : 16694 (python) S 16692 16694 15120 0 -1 4202496 15619 935 1 0 88 9 0 0 25 0 9 0 628057107 436912128 7531 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/16694/statm: 106668 7531 1891 364 0 42565 0
[pid=16700] ppid=16694 vsize=278704 CPUtime=0 cores=0-7
/proc/16700/stat : 16700 (python) S 16694 16694 15120 0 -1 4202560 901 0 0 0 0 0 0 0 18 0 1 0 628057206 285392896 5637 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945935 0 0 16781312 514 3835778534064750849 0 0 17 1 0 0 0
/proc/16700/statm: 69676 5637 377 364 0 5594 0
[pid=16702] ppid=16700 vsize=1017932 CPUtime=5.3 cores=0-7
/proc/16702/stat : 16702 (gnovelty+2) R 16700 16702 16702 0 -1 4202496 510 0 0 0 530 0 0 0 25 0 1 0 628057206 1042362368 247 33554432000 134512640 135663704 4290763312 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16702/statm: 254483 247 113 282 0 254199 0
[pid=16703] ppid=16694 vsize=289356 CPUtime=0.01 cores=0-7
/proc/16703/stat : 16703 (python) S 16694 16694 15120 0 -1 4202560 896 0 0 0 1 0 0 0 18 0 1 0 628057210 296300544 5719 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 3835770837483356417 0 0 17 7 0 0 0
/proc/16703/statm: 72339 5719 371 364 0 8254 0
[pid=16705] ppid=16703 vsize=1017932 CPUtime=5.27 cores=0-7
/proc/16705/stat : 16705 (gnovelty+2) R 16703 16705 16705 0 -1 4202496 510 0 0 0 527 0 0 0 25 0 1 0 628057210 1042362368 247 33554432000 134512640 135663704 4293411456 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/16705/statm: 254483 247 113 282 0 254199 0
[pid=16706] ppid=16694 vsize=365148 CPUtime=0 cores=0-7
/proc/16706/stat : 16706 (python) S 16694 16694 15120 0 -1 4202560 785 0 0 0 0 0 0 0 18 0 1 0 628057213 373911552 5896 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 4158414278317015299 0 0 17 1 0 0 0
/proc/16706/statm: 91287 5896 371 364 0 27199 0
[pid=16708] ppid=16706 vsize=416788 CPUtime=5.23 cores=0-7
/proc/16708/stat : 16708 (adaptg2wsat2009) R 16706 16708 16708 0 -1 4202496 620 0 0 0 523 0 0 0 25 0 1 0 628057214 426790912 365 33554432000 134512640 135107411 4291650096 18446744073709551615 134531830 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/16708/statm: 104197 365 59 146 0 103073 0
[pid=16709] ppid=16694 vsize=375404 CPUtime=0.01 cores=0-7
/proc/16709/stat : 16709 (python) S 16694 16694 15120 0 -1 4202560 798 0 0 0 0 1 0 0 18 0 1 0 628057217 384413696 5854 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 11977753672089043203 0 0 17 1 0 0 0
/proc/16709/statm: 93851 5854 371 364 0 29760 0
[pid=16711] ppid=16709 vsize=416788 CPUtime=5.11 cores=0-7
/proc/16711/stat : 16711 (adaptg2wsat2009) R 16709 16711 16711 0 -1 4202496 618 0 0 0 511 0 0 0 25 0 1 0 628057217 426790912 362 33554432000 134512640 135107411 4293437792 18446744073709551615 134531822 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/16711/statm: 104197 362 59 146 0 103073 0
[pid=16712] ppid=16694 vsize=385660 CPUtime=0.01 cores=0-7
/proc/16712/stat : 16712 (python) S 16694 16694 15120 0 -1 4202560 807 0 0 0 0 1 0 0 18 0 1 0 628057221 394915840 5978 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 15381010715770847488 0 0 17 1 0 0 0
/proc/16712/statm: 96415 5978 371 364 0 32321 0
[pid=16714] ppid=16712 vsize=416788 CPUtime=2.62 cores=0-7
/proc/16714/stat : 16714 (adaptg2wsat2009) R 16712 16714 16714 0 -1 4202496 624 0 0 0 262 0 0 0 25 0 1 0 628057223 426790912 364 33554432000 134512640 135107411 4293509136 18446744073709551615 134532224 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/16714/statm: 104197 364 59 146 0 103073 0
[pid=16715] ppid=16694 vsize=395916 CPUtime=0 cores=0-7
/proc/16715/stat : 16715 (python) S 16694 16694 15120 0 -1 4202560 818 0 0 0 0 0 0 0 18 0 1 0 628057225 405417984 5999 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 1263243481975849218 0 0 17 4 0 0 0
/proc/16715/statm: 98979 5999 371 364 0 34882 0
[pid=16717] ppid=16715 vsize=1017932 CPUtime=2.51 cores=0-7
/proc/16717/stat : 16717 (gnovelty+2) R 16715 16717 16717 0 -1 4202496 508 0 0 0 251 0 0 0 25 0 1 0 628057227 1042362368 248 33554432000 134512640 135663704 4289767120 18446744073709551615 134545772 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/16717/statm: 254483 248 113 282 0 254199 0
[pid=16718] ppid=16694 vsize=406172 CPUtime=0.01 cores=0-7
/proc/16718/stat : 16718 (python) S 16694 16694 15120 0 -1 4202560 824 0 0 0 1 0 0 0 18 0 1 0 628057229 415920128 5883 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 13672199221904638211 0 0 17 4 0 0 0
/proc/16718/statm: 101543 5883 371 364 0 37443 0
[pid=16720] ppid=16718 vsize=246936 CPUtime=2.51 cores=0-7

################
# More data... #
################

[pid=16694] ppid=16692 vsize=518976 CPUtime=1.49 cores=0-7
/proc/16694/stat : 16694 (python) S 16692 16694 15120 0 -1 4202496 24331 935 1 0 138 11 0 0 19 0 18 0 628057107 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/16694/statm: 129744 7636 1910 364 0 65614 0
[pid=16700] ppid=16694 vsize=354484 CPUtime=0.28 cores=0-7
/proc/16700/stat : 16700 (python) S 16694 16694 15120 0 -1 4202560 1086 0 0 0 13 15 0 0 19 0 2 0 628057206 362991616 5677 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/16700/statm: 88621 5677 410 364 0 24539 0
[pid=16702] ppid=16700 vsize=1017932 CPUtime=100.26 cores=0-7
/proc/16702/stat : 16702 (gnovelty+2) T 16700 16702 16702 0 -1 4202496 510 0 0 0 10026 0 0 0 25 0 1 0 628057206 1042362368 247 33554432000 134512640 135663704 4290763312 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/16702/statm: 254483 247 113 282 0 254199 0
[pid=16700/tid=16732] ppid=16694 vsize=354484 CPUtime=0 cores=0-7
/proc/16700/task/16732/stat : 16732 (python) S 16694 16694 15120 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 628067235 362991616 5677 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 514 18446604445215845440 0 0 -1 6 0 0 0
[pid=16703] ppid=16694 vsize=289356 CPUtime=0.29 cores=0-7
/proc/16703/stat : 16703 (python) S 16694 16694 15120 0 -1 4202560 1090 0 0 0 16 13 0 0 19 0 2 0 628057210 296300544 5749 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/16703/statm: 72339 5749 400 364 0 8254 0
[pid=16705] ppid=16703 vsize=1017932 CPUtime=98.32 cores=0-7
/proc/16705/stat : 16705 (gnovelty+2) T 16703 16705 16705 0 -1 4202496 510 0 0 0 9832 0 0 0 25 0 1 0 628057210 1042362368 247 33554432000 134512640 135663704 4293411456 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/16705/statm: 254483 247 113 282 0 254199 0
[pid=16703/tid=16728] ppid=16694 vsize=289356 CPUtime=0 cores=0-7
/proc/16703/task/16728/stat : 16728 (python) S 16694 16694 15120 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 628067042 296300544 5749 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 514 18446604445215843648 0 0 -1 7 0 0 0
[pid=16706] ppid=16694 vsize=365148 CPUtime=0.34 cores=0-7
/proc/16706/stat : 16706 (python) S 16694 16694 15120 0 -1 4202560 1013 0 0 0 18 16 0 0 19 0 2 0 628057213 373911552 5926 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/16706/statm: 91287 5926 400 364 0 27199 0
[pid=16708] ppid=16706 vsize=416788 CPUtime=100.72 cores=0-7
/proc/16708/stat : 16708 (adaptg2wsat2009) T 16706 16708 16708 0 -1 4202496 620 0 0 0 10072 0 0 0 25 0 1 0 628057214 426790912 365 33554432000 134512640 135107411 4291650096 18446744073709551615 134532107 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/16708/statm: 104197 365 59 146 0 103073 0
[pid=16706/tid=16740] ppid=16694 vsize=365148 CPUtime=0 cores=0-7
/proc/16706/task/16740/stat : 16740 (python) S 16694 16694 15120 0 -1 4202560 117 0 0 0 0 0 0 0 19 0 2 0 628069647 373911552 5926 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 514 18446604453880899520 0 0 -1 6 0 0 0
[pid=16709] ppid=16694 vsize=375404 CPUtime=0.48 cores=0-7
/proc/16709/stat : 16709 (python) S 16694 16694 15120 0 -1 4202560 974 0 0 0 23 25 0 0 19 0 2 0 628057217 384413696 5884 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/16709/statm: 93851 5884 400 364 0 29760 0
[pid=16711] ppid=16709 vsize=416788 CPUtime=97.9 cores=0-7
/proc/16711/stat : 16711 (adaptg2wsat2009) T 16709 16711 16711 0 -1 4202496 618 0 0 0 9790 0 0 0 25 0 1 0 628057217 426790912 362 33554432000 134512640 135107411 4293437792 18446744073709551615 134531935 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/16711/statm: 104197 362 59 146 0 103073 0
[pid=16709/tid=16755] ppid=16694 vsize=375404 CPUtime=0 cores=0-7
/proc/16709/task/16755/stat : 16755 (python) S 16694 16694 15120 0 -1 4202560 66 0 0 0 0 0 0 0 19 0 2 0 628074464 384413696 5884 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 514 18446604447111546752 0 0 -1 2 0 0 0
[pid=16712] ppid=16694 vsize=385660 CPUtime=0.4 cores=0-7
/proc/16712/stat : 16712 (python) S 16694 16694 15120 0 -1 4202560 987 0 0 0 19 21 0 0 19 0 2 0 628057221 394915840 6008 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/16712/statm: 96415 6008 400 364 0 32321 0
[pid=16714] ppid=16712 vsize=416788 CPUtime=102.94 cores=0-7
/proc/16714/stat : 16714 (adaptg2wsat2009) T 16712 16714 16714 0 -1 4202496 624 0 0 0 10294 0 0 0 25 0 1 0 628057223 426790912 364 33554432000 134512640 135107411 4293509136 18446744073709551615 134532107 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/16714/statm: 104197 364 59 146 0 103073 0
[pid=16712/tid=16745] ppid=16694 vsize=385660 CPUtime=0 cores=0-7
/proc/16712/task/16745/stat : 16745 (python) S 16694 16694 15120 0 -1 4202560 69 0 0 0 0 0 0 0 19 0 2 0 628071461 394915840 6008 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 514 18446604447903929280 0 0 -1 0 0 0 0
[pid=16715] ppid=16694 vsize=395916 CPUtime=0.33 cores=0-7
/proc/16715/stat : 16715 (python) S 16694 16694 15120 0 -1 4202560 997 0 0 0 17 16 0 0 19 0 2 0 628057225 405417984 6029 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/16715/statm: 98979 6029 400 364 0 34882 0
[pid=16717] ppid=16715 vsize=1017932 CPUtime=97.12 cores=0-7
/proc/16717/stat : 16717 (gnovelty+2) T 16715 16717 16717 0 -1 4202496 508 0 0 0 9712 0 0 0 25 0 1 0 628057227 1042362368 248 33554432000 134512640 135663704 4289767120 18446744073709551615 134524509 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/16717/statm: 254483 248 113 282 0 254199 0
[pid=16715/tid=16744] ppid=16694 vsize=395916 CPUtime=0 cores=0-7
/proc/16715/task/16744/stat : 16744 (python) S 16694 16694 15120 0 -1 4202560 71 0 0 0 0 0 0 0 19 0 2 0 628069659 405417984 6029 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 514 18446604440321913152 0 0 -1 5 0 0 0
[pid=16718] ppid=16694 vsize=406172 CPUtime=0.4 cores=0-7
/proc/16718/stat : 16718 (python) S 16694 16694 15120 0 -1 4202560 1005 0 0 0 20 20 0 0 19 0 2 0 628057229 415920128 5913 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/16718/statm: 101543 5913 400 364 0 37443 0
[pid=16720] ppid=16718 vsize=246936 CPUtime=101.44 cores=0-7
/proc/16720/stat : 16720 (FH) T 16718 16720 16720 0 -1 4202496 591 0 0 0 10144 0 0 0 25 0 1 0 628057231 252862464 327 33554432000 134512640 134936988 4289034272 18446744073709551615 134554216 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/16720/statm: 61734 327 41 104 0 61238 0
[pid=16718/tid=16749] ppid=16694 vsize=406172 CPUtime=0 cores=0-7
/proc/16718/task/16749/stat : 16749 (python) S 16694 16694 15120 0 -1 4202560 71 0 0 0 0 0 0 0 19 0 2 0 628072073 415920128 5913 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 514 18446604443211098304 0 0 -1 4 0 0 0
[pid=16721] ppid=16694 vsize=416428 CPUtime=0.59 cores=0-7
/proc/16721/stat : 16721 (python) S 16694 16694 15120 0 -1 4202560 1048 0 0 0 29 30 0 0 18 0 2 0 628057233 426422272 6043 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/16721/statm: 104107 6043 406 364 0 40004 0
[pid=16723] ppid=16721 vsize=416788 CPUtime=198.33 cores=0-7
/proc/16723/stat : 16723 (adaptg2wsat2009) T 16721 16723 16723 0 -1 4202496 628 0 0 0 19833 0 0 0 25 0 1 0 628057233 426790912 362 33554432000 134512640 135107411 4288224176 18446744073709551615 134532336 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/16723/statm: 104197 362 59 146 0 103073 0
[pid=16721/tid=16736] ppid=16694 vsize=416428 CPUtime=0 cores=0-7
/proc/16721/task/16736/stat : 16736 (python) S 16694 16694 15120 0 -1 4202560 76 0 0 0 0 0 0 0 18 0 2 0 628067263 426422272 6043 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 514 18446604445474173120 0 0 -1 4 0 0 0
[pid=16729] ppid=16694 vsize=426684 CPUtime=1.34 cores=0-7
/proc/16729/stat : 16729 (python) S 16694 16694 15120 0 -1 4202560 854 0 0 0 73 61 0 0 15 0 1 0 628067046 436924416 6011 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 6647761655037919490 0 0 17 4 0 0 0
/proc/16729/statm: 106671 6011 371 364 0 42565 0
[pid=16731] ppid=16729 vsize=4152 CPUtime=366.63 cores=0-7
/proc/16731/stat : 16731 (march_hi) R 16729 16731 16731 0 -1 4202496 1682 0 0 0 36663 0 0 0 25 0 1 0 628067047 4251648 832 33554432000 4194304 4955518 140736326832416 18446744073709551615 4235634 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/16731/statm: 1038 832 106 186 0 851 0
[pid=16733] ppid=16694 vsize=436940 CPUtime=1.34 cores=0-7
/proc/16733/stat : 16733 (python) S 16694 16694 15120 0 -1 4202560 864 0 0 0 67 67 0 0 15 0 1 0 628067239 447426560 5953 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 4582478595842081026 0 0 17 1 0 0 0
/proc/16733/statm: 109235 5953 371 364 0 45126 0
[pid=16735] ppid=16733 vsize=4152 CPUtime=317.93 cores=0-7
/proc/16735/stat : 16735 (march_hi) R 16733 16735 16735 0 -1 4202496 1614 0 0 0 31793 0 0 0 25 0 1 0 628067239 4251648 761 33554432000 4194304 4955518 140736122127248 18446744073709551615 4208693 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/16735/statm: 1038 761 106 186 0 851 0
[pid=16737] ppid=16694 vsize=447196 CPUtime=3.45 cores=0-7
/proc/16737/stat : 16737 (python) R 16694 16694 15120 0 -1 4202560 876 0 0 0 255 90 0 0 18 0 1 0 628067267 457928704 5944 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296756031 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/16737/statm: 111799 5944 371 364 0 47687 0
[pid=16739] ppid=16737 vsize=0 CPUtime=370.7 cores=0-7
/proc/16739/stat : 16739 (march_hi) R 16737 16739 16739 0 -1 4202500 1696 0 0 0 37070 0 0 0 25 0 1 0 628067268 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/16739/statm: 0 0 0 0 0 0 0
[pid=16741] ppid=16694 vsize=457452 CPUtime=1.24 cores=0-7
/proc/16741/stat : 16741 (python) S 16694 16694 15120 0 -1 4202560 880 0 0 0 61 63 0 0 15 0 1 0 628069652 468430848 5972 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 17393279997199745283 0 0 17 3 0 0 0
/proc/16741/statm: 114363 5972 371 364 0 50248 0
[pid=16743] ppid=16741 vsize=4152 CPUtime=326.52 cores=0-7
/proc/16743/stat : 16743 (march_hi) R 16741 16743 16743 0 -1 4202496 1624 0 0 0 32652 0 0 0 25 0 1 0 628069653 4251648 770 33554432000 4194304 4955518 140733755378144 18446744073709551615 4237818 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/16743/statm: 1038 770 106 186 0 851 0
[pid=16746] ppid=16694 vsize=467708 CPUtime=0.55 cores=0-7
/proc/16746/stat : 16746 (python) S 16694 16694 15120 0 -1 4202560 1064 0 0 0 28 27 0 0 19 0 2 0 628071467 478932992 5986 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/16746/statm: 116927 5986 400 364 0 52809 0
[pid=16748] ppid=16746 vsize=246936 CPUtime=97.58 cores=0-7
/proc/16748/stat : 16748 (FH) T 16746 16748 16748 0 -1 4202496 593 0 0 0 9758 0 0 0 25 0 1 0 628071467 252862464 327 33554432000 134512640 134936988 4287960208 18446744073709551615 134545269 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/16748/statm: 61734 327 41 104 0 61238 0
[pid=16746/tid=16766] ppid=16694 vsize=467708 CPUtime=0 cores=0-7
/proc/16746/task/16766/stat : 16766 (python) S 16694 16694 15120 0 -1 4202560 78 0 0 0 0 0 0 0 19 0 2 0 628091023 478932992 5986 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 514 18446604445215842752 0 0 -1 3 0 0 0
[pid=16750] ppid=16694 vsize=477964 CPUtime=1.16 cores=0-7
/proc/16750/stat : 16750 (python) S 16694 16694 15120 0 -1 4202560 903 0 0 0 61 55 0 0 15 0 1 0 628072078 489435136 6108 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 12491063424295338242 0 0 17 6 0 0 0
/proc/16750/statm: 119491 6108 371 364 0 55370 0
[pid=16752] ppid=16750 vsize=4152 CPUtime=309.35 cores=0-7
/proc/16752/stat : 16752 (march_hi) R 16750 16752 16752 0 -1 4202496 1607 0 0 0 30935 0 0 0 25 0 1 0 628072078 4251648 752 33554432000 4194304 4955518 140735762920416 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16752/statm: 1038 752 106 186 0 851 0
[pid=16756] ppid=16694 vsize=488220 CPUtime=1.12 cores=0-7
/proc/16756/stat : 16756 (python) S 16694 16694 15120 0 -1 4202560 1000 0 0 0 59 53 0 0 15 0 1 0 628074469 499937280 6060 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 4267503698856345857 0 0 17 5 0 0 0
/proc/16756/statm: 122055 6060 380 364 0 57931 0
[pid=16758] ppid=16756 vsize=4152 CPUtime=298.34 cores=0-7
/proc/16758/stat : 16758 (march_hi) R 16756 16758 16758 0 -1 4202496 1598 0 0 0 29833 1 0 0 25 0 1 0 628074470 4251648 737 33554432000 4194304 4955518 140734287556752 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/16758/statm: 1038 737 106 186 0 851 0
[pid=16759] ppid=16694 vsize=498476 CPUtime=0.9 cores=0-7
/proc/16759/stat : 16759 (python) S 16694 16694 15120 0 -1 4202560 994 0 0 0 49 41 0 0 15 0 1 0 628080003 510439424 6063 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 12352331445149073665 0 0 17 0 0 0 0
/proc/16759/statm: 124619 6063 380 364 0 60492 0
[pid=16761] ppid=16759 vsize=3640 CPUtime=201.85 cores=0-7
/proc/16761/stat : 16761 (march_hi) R 16759 16761 16761 0 -1 4202496 1496 0 0 0 20184 1 0 0 25 0 1 0 628080003 3727360 637 33554432000 4194304 4955518 140733473377952 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/16761/statm: 910 637 106 186 0 723 0
[pid=16767] ppid=16694 vsize=508732 CPUtime=0.57 cores=0-7
/proc/16767/stat : 16767 (python) S 16694 16694 15120 0 -1 4202560 962 0 0 0 31 26 0 0 15 0 1 0 628091029 520941568 6102 33554432000 4194304 5683644 140736998607472 18446744073709551615 224284945990 0 0 16781312 514 18446744073709519108 0 0 17 4 0 0 0
/proc/16767/statm: 127183 6102 374 364 0 63053 0
[pid=16769] ppid=16767 vsize=3072 CPUtime=113.78 cores=0-7
/proc/16769/stat : 16769 (march_hi) R 16767 16769 16769 0 -1 4202496 1420 0 0 0 11377 1 0 0 25 0 1 0 628091029 3145728 557 33554432000 4194304 4955518 140735273472448 18446744073709551615 4237818 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/16769/statm: 768 557 106 186 0 581 0
[pid=16694/tid=16701] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16701/stat : 16701 (python) S 16692 16694 15120 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 18 0 628057206 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 2 0 0 0
[pid=16694/tid=16704] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16704/stat : 16704 (python) S 16692 16694 15120 0 -1 4202560 23 935 0 0 0 0 0 0 18 0 18 0 628057210 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 3 0 0 0
[pid=16694/tid=16707] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16707/stat : 16707 (python) S 16692 16694 15120 0 -1 4202560 80 935 0 0 0 0 0 0 19 0 18 0 628057213 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 2 0 0 0
[pid=16694/tid=16710] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16710/stat : 16710 (python) S 16692 16694 15120 0 -1 4202560 30 935 0 0 0 0 0 0 19 0 18 0 628057217 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 7 0 0 0
[pid=16694/tid=16713] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16713/stat : 16713 (python) S 16692 16694 15120 0 -1 4202560 34 935 0 0 0 0 0 0 19 0 18 0 628057221 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16716] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16716/stat : 16716 (python) S 16692 16694 15120 0 -1 4202560 33 935 0 0 0 0 0 0 21 0 18 0 628057225 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16719] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16719/stat : 16719 (python) S 16692 16694 15120 0 -1 4202560 34 935 0 0 0 0 0 0 23 0 18 0 628057229 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16722] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16722/stat : 16722 (python) S 16692 16694 15120 0 -1 4202560 42 935 0 0 0 0 0 0 18 0 18 0 628057233 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16730] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16730/stat : 16730 (python) S 16692 16694 15120 0 -1 4202560 39 935 0 0 0 0 0 0 19 0 18 0 628067046 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 3 0 0 0
[pid=16694/tid=16734] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16734/stat : 16734 (python) S 16692 16694 15120 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 18 0 628067239 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16738] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16738/stat : 16738 (python) S 16692 16694 15120 0 -1 4202560 35 935 0 0 0 0 0 0 19 0 18 0 628067268 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16742] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16742/stat : 16742 (python) S 16692 16694 15120 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 18 0 628069653 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16747] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16747/stat : 16747 (python) S 16692 16694 15120 0 -1 4202560 38 935 0 0 0 0 0 0 20 0 18 0 628071467 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16751] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16751/stat : 16751 (python) S 16692 16694 15120 0 -1 4202560 35 935 0 0 0 0 0 0 19 0 18 0 628072078 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16757] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16757/stat : 16757 (python) S 16692 16694 15120 0 -1 4202560 35 935 0 0 0 0 0 0 19 0 18 0 628074469 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16760] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16760/stat : 16760 (python) S 16692 16694 15120 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 18 0 628080003 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
[pid=16694/tid=16768] ppid=16692 vsize=518976 CPUtime=0 cores=0-7
/proc/16694/task/16768/stat : 16768 (python) S 16692 16694 15120 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 18 0 628091029 531431424 7636 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 2 18446604449148633152 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3315.98
Current children cumulated vsize (KiB) 12959208

[startup+519.215 s]
/proc/loadavg: 10.23 9.47 6.51 12/422 16773
/proc/meminfo: memFree=6722564/32951124 swapFree=61020456/67111528
[pid=16694] ppid=16692 vsize=385588 CPUtime=3316.85 cores=0-7
/proc/16694/stat : 16694 (python) R 16692 16694 15120 0 -1 4202496 27902 36370 1 0 140 12 330873 660 17 0 2 0 628057107 394842112 7460 33554432000 4194304 5683644 140736998607472 18446744073709551615 4501813 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/16694/statm: 96397 7460 1876 364 0 32321 0
[pid=16694/tid=16738] ppid=16692 vsize=385588 CPUtime=3315.33 cores=0-7
/proc/16694/task/16738/stat : 16738 (python) S 16692 16694 15120 0 -1 4202560 36 36370 0 0 0 0 330873 660 18 0 2 0 628067268 394842112 7460 33554432000 4194304 5683644 140736998607472 18446744073709551615 224296749489 0 0 16781312 0 18446604449148633152 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3316.85
Current children cumulated vsize (KiB) 385588

Child status: 0
Real time (s): 519.225
CPU time (s): 3316.87
CPU user time (s): 3310.15
CPU system time (s): 6.72498
CPU usage (%): 638.812
Max. virtual memory (cumulated for all children) (KiB): 12964124

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3310.15
system time used= 6.72498
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 65186
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10209
involuntary context switches= 27574

runsolver used 4.75328 second user time and 8.60369 second system time

The end

Launcher Data

Begin job on node118 at 2011-05-03 01:17:44
IDJOB=3322255
IDBENCH=83033
IDSOLVER=1712
FILE ID=node118/3322255-1304378264
RUNJOBID= node118-1304366467-15134
PBS_JOBID= 13181753
Free space on /tmp= 73236 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S113771637-026.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322255-1304378264/watcher-3322255-1304378264 -o /tmp/evaluation-result-3322255-1304378264/solver-3322255-1304378264 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322255-1304378264.cnf -seed 1388405953 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7f4758baa378252dd3709cff507a5405
RANDOM SEED=1388405953

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       6841512 kB
Buffers:         22248 kB
Cached:         217056 kB
SwapCached:      96740 kB
Active:       12825776 kB
Inactive:     13042816 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       6841512 kB
SwapTotal:    67111528 kB
SwapFree:     61020456 kB
Dirty:           31844 kB
Writeback:           0 kB
AnonPages:    25544704 kB
Mapped:          17820 kB
Slab:            80612 kB
PageTables:      90204 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 89515456 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73204 MiB
End job on node118 at 2011-05-03 01:26:24