Trace number 3378528

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? 3471.28 1110.19

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v550-c2343-S1554089933-067.UNKNOWN.cnf
MD5SUMfa2c840574747ca3ff8efe8a9137bb94
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables550
Number of clauses2343
Sum of the clauses size7029
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32343
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.33/0.45	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.33/0.45	c INFO: solving HOME/instance-3378528-1305466014.cnf
0.33/0.45	c INFO: computing task features
0.33/0.45	c INFO: computed variable-clause graph statistics
0.33/0.46	c INFO: computed clause balance statistics
0.42/0.50	c INFO: computed variable balance statistics
0.42/0.53	c INFO: computed small-clause counts
0.42/0.53	c INFO: computed Horn-clause counts
0.42/0.53	c INFO: computed variable graph statistics
0.42/0.53	c INFO: collected features for HOME/instance-3378528-1305466014.cnf in 0.09 s
0.42/0.54	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.57)
0.42/0.55	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.32)
0.42/0.56	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.28)
0.42/0.57	c INFO: running march_hi@0 for 97 with 1199 remaining (b = 0.08)
349.75/100.88	c INFO: running gnovelty+2@0 for 97 with 1099 remaining (b = 0.08)
522.28/150.31	c INFO: running march_hi@98 for 97 with 1050 remaining (b = 0.07)
955.75/295.56	c INFO: running march_hi@0 for 679 with 904 remaining (b = 0.32)
1036.89/318.87	c INFO: running march_hi@195 for 194 with 881 remaining (b = 0.13)
1290.02/391.40	c INFO: running march_hi@0 for 679 with 809 remaining (b = 0.29)
1314.47/399.68	c INFO: running kcnfs-2006@0 for 582 with 800 remaining (b = 0.24)
2212.48/700.25	c INFO: running march_hi@585 for 97 with 500 remaining (b = 0.05)
2801.76/897.44	c INFO: running march_hi@0 for 303 with 303 remaining (b = 0.13)
3096.21/995.87	c INFO: running march_hi@0 for 97 with 204 remaining (b = 0.05)
3470.85/1110.16	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378528-1305466014/watcher-3378528-1305466014 -o /tmp/evaluation-result-3378528-1305466014/solver-3378528-1305466014 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378528-1305466014.cnf -seed 2097300198 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.95 8.17 8.00 6/468 9911
/proc/meminfo: memFree=21128936/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=15776 CPUtime=0 cores=0,2,4,6
/proc/9911/stat : 9911 (python) S 9909 9911 8588 0 -1 4202496 935 0 0 0 0 0 0 0 25 0 1 0 658201800 16154624 814 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640857600 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/9911/statm: 3944 814 356 364 0 431 0

[startup+0.110013 s]
/proc/loadavg: 7.95 8.17 8.00 6/468 9911
/proc/meminfo: memFree=21128936/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=107428 CPUtime=0.08 cores=0,2,4,6
/proc/9911/stat : 9911 (python) R 9909 9911 8588 0 -1 4202496 3382 0 0 0 5 3 0 0 17 0 1 0 658201800 110006272 3039 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640857600 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/9911/statm: 26857 3039 871 364 0 2088 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 107428

[startup+0.200998 s]
/proc/loadavg: 7.95 8.17 8.00 6/468 9911
/proc/meminfo: memFree=21128936/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=131292 CPUtime=0.16 cores=0,2,4,6
/proc/9911/stat : 9911 (python) R 9909 9911 8588 0 -1 4202496 5710 936 1 0 11 5 0 0 19 0 1 0 658201800 134443008 4098 33554432000 4194304 5683644 140737063229136 18446744073709551615 5211941 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/9911/statm: 32823 4098 1015 364 0 3084 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 131292

[startup+0.30098 s]
/proc/loadavg: 7.95 8.17 8.00 6/468 9911
/proc/meminfo: memFree=21128936/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=198916 CPUtime=0.24 cores=0,2,4,6
/proc/9911/stat : 9911 (python) R 9909 9911 8588 0 -1 4202496 7021 936 1 0 16 8 0 0 18 0 1 0 658201800 203689984 5053 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640517441 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/9911/statm: 49729 5053 1466 364 0 3756 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 198916

[startup+0.700837 s]
/proc/loadavg: 7.95 8.17 8.00 6/468 9911
/proc/meminfo: memFree=21128936/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=320276 CPUtime=0.49 cores=0,2,4,6
/proc/9911/stat : 9911 (python) S 9909 9911 8588 0 -1 4202496 12254 936 1 0 37 12 0 0 23 0 5 0 658201800 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/9911/statm: 80069 7258 1873 364 0 15978 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 320276

[startup+1.50069 s]
/proc/loadavg: 7.95 8.17 8.00 10/481 9928
/proc/meminfo: memFree=21087168/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=320276 CPUtime=0.49 cores=0,2,4,6
/proc/9911/stat : 9911 (python) S 9909 9911 8588 0 -1 4202496 12254 936 1 0 37 12 0 0 23 0 5 0 658201800 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/9911/statm: 80069 7258 1873 364 0 15978 0
[pid=9917] ppid=9911 vsize=278588 CPUtime=0 cores=0,2,4,6
/proc/9917/stat : 9917 (python) S 9911 9911 8588 0 -1 4202560 727 0 0 0 0 0 0 0 19 0 1 0 658201855 285274112 5571 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879631 0 0 16781312 514 7850204888481923071 0 0 17 0 0 0 0
/proc/9917/statm: 69647 5571 354 364 0 5565 0
[pid=9919] ppid=9917 vsize=1017800 CPUtime=0.93 cores=0,2,4,6
/proc/9919/stat : 9919 (gnovelty+2) R 9917 9919 9919 0 -1 4202496 445 0 0 0 93 0 0 0 23 0 1 0 658201855 1042227200 181 33554432000 134512640 135663704 4292926016 18446744073709551615 134545583 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9919/statm: 254450 181 113 282 0 254166 0
[pid=9920] ppid=9911 vsize=289384 CPUtime=0 cores=0,2,4,6
/proc/9920/stat : 9920 (python) S 9911 9911 8588 0 -1 4202560 747 0 0 0 0 0 0 0 15 0 1 0 658201856 296329216 5704 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 5606933849054347522 0 0 17 2 0 0 0
/proc/9920/statm: 72346 5704 348 364 0 8261 0
[pid=9922] ppid=9920 vsize=2588 CPUtime=0.93 cores=0,2,4,6
/proc/9922/stat : 9922 (march_hi) R 9920 9922 9922 0 -1 4202496 695 0 0 0 93 0 0 0 23 0 1 0 658201856 2650112 432 33554432000 4194304 4955518 140733280127408 18446744073709551615 4346669 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9922/statm: 647 432 104 186 0 460 0
[pid=9923] ppid=9911 vsize=299168 CPUtime=0 cores=0,2,4,6
/proc/9923/stat : 9923 (python) S 9911 9911 8588 0 -1 4202560 749 0 0 0 0 0 0 0 17 0 1 0 658201857 306348032 5605 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 1284726564793057538 0 0 17 0 0 0 0
/proc/9923/statm: 74792 5605 348 364 0 10704 0
[pid=9927] ppid=9923 vsize=2588 CPUtime=0.91 cores=0,2,4,6
/proc/9927/stat : 9927 (march_hi) R 9923 9927 9927 0 -1 4202496 689 0 0 0 91 0 0 0 25 0 1 0 658201858 2650112 431 33554432000 4194304 4955518 140734106320352 18446744073709551615 4282800 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9927/statm: 647 431 104 186 0 460 0
[pid=9925] ppid=9911 vsize=310032 CPUtime=0 cores=0,2,4,6
/proc/9925/stat : 9925 (python) S 9911 9911 8588 0 -1 4202560 753 0 0 0 0 0 0 0 15 0 1 0 658201858 317472768 5729 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 17085254013701554435 0 0 17 0 0 0 0
/proc/9925/statm: 77508 5729 348 364 0 13417 0
[pid=9928] ppid=9925 vsize=2384 CPUtime=0.46 cores=0,2,4,6
/proc/9928/stat : 9928 (march_hi) R 9925 9928 9928 0 -1 4202496 652 0 0 0 46 0 0 0 25 0 1 0 658201858 2441216 390 33554432000 4194304 4955518 140733544638992 18446744073709551615 4227824 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9928/statm: 596 390 104 186 0 409 0
[pid=9911/tid=9918] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9918/stat : 9918 (python) S 9909 9911 8588 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 5 0 658201855 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9921] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9921/stat : 9921 (python) S 9909 9911 8588 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 5 0 658201856 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9924] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9924/stat : 9924 (python) S 9909 9911 8588 0 -1 4202560 34 936 0 0 0 0 0 0 22 0 5 0 658201857 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9926] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9926/stat : 9926 (python) S 9909 9911 8588 0 -1 4202560 16 936 0 0 0 0 0 0 24 0 5 0 658201858 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.72
Current children cumulated vsize (KiB) 2522808

[startup+3.1014 s]
/proc/loadavg: 8.03 8.19 8.00 11/481 9928
/proc/meminfo: memFree=21084000/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=320276 CPUtime=0.49 cores=0,2,4,6
/proc/9911/stat : 9911 (python) S 9909 9911 8588 0 -1 4202496 12254 936 1 0 37 12 0 0 23 0 5 0 658201800 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/9911/statm: 80069 7258 1873 364 0 15978 0
[pid=9917] ppid=9911 vsize=278588 CPUtime=0 cores=0,2,4,6
/proc/9917/stat : 9917 (python) S 9911 9911 8588 0 -1 4202560 727 0 0 0 0 0 0 0 18 0 1 0 658201855 285274112 5571 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879631 0 0 16781312 514 7850204888481890562 0 0 17 0 0 0 0
/proc/9917/statm: 69647 5571 354 364 0 5565 0
[pid=9919] ppid=9917 vsize=1017800 CPUtime=2.51 cores=0,2,4,6
/proc/9919/stat : 9919 (gnovelty+2) R 9917 9919 9919 0 -1 4202496 445 0 0 0 251 0 0 0 25 0 1 0 658201855 1042227200 181 33554432000 134512640 135663704 4292926016 18446744073709551615 134525506 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9919/statm: 254450 181 113 282 0 254166 0
[pid=9920] ppid=9911 vsize=289384 CPUtime=0 cores=0,2,4,6
/proc/9920/stat : 9920 (python) S 9911 9911 8588 0 -1 4202560 749 0 0 0 0 0 0 0 15 0 1 0 658201856 296329216 5704 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 10809501127100301570 0 0 17 2 0 0 0
/proc/9920/statm: 72346 5704 348 364 0 8261 0
[pid=9922] ppid=9920 vsize=2840 CPUtime=2.52 cores=0,2,4,6
/proc/9922/stat : 9922 (march_hi) R 9920 9922 9922 0 -1 4202496 769 0 0 0 252 0 0 0 25 0 1 0 658201856 2908160 506 33554432000 4194304 4955518 140733280127408 18446744073709551615 4224642 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9922/statm: 710 506 104 186 0 523 0
[pid=9923] ppid=9911 vsize=299168 CPUtime=0 cores=0,2,4,6
/proc/9923/stat : 9923 (python) S 9911 9911 8588 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 658201857 306348032 5605 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 1284726564793057538 0 0 17 0 0 0 0
/proc/9923/statm: 74792 5605 348 364 0 10704 0
[pid=9927] ppid=9923 vsize=2840 CPUtime=2.51 cores=0,2,4,6
/proc/9927/stat : 9927 (march_hi) R 9923 9927 9927 0 -1 4202496 763 0 0 0 251 0 0 0 25 0 1 0 658201858 2908160 505 33554432000 4194304 4955518 140734106320352 18446744073709551615 4209643 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9927/statm: 710 505 104 186 0 523 0
[pid=9925] ppid=9911 vsize=310032 CPUtime=0 cores=0,2,4,6
/proc/9925/stat : 9925 (python) S 9911 9911 8588 0 -1 4202560 753 0 0 0 0 0 0 0 15 0 1 0 658201858 317472768 5729 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 17085254013701554435 0 0 17 0 0 0 0
/proc/9925/statm: 77508 5729 348 364 0 13417 0
[pid=9928] ppid=9925 vsize=2688 CPUtime=1.26 cores=0,2,4,6
/proc/9928/stat : 9928 (march_hi) R 9925 9928 9928 0 -1 4202496 708 0 0 0 126 0 0 0 25 0 1 0 658201858 2752512 446 33554432000 4194304 4955518 140733544638992 18446744073709551615 4224622 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9928/statm: 672 446 104 186 0 485 0
[pid=9911/tid=9918] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9918/stat : 9918 (python) S 9909 9911 8588 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 5 0 658201855 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9921] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9921/stat : 9921 (python) S 9909 9911 8588 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 5 0 658201856 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9924] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9924/stat : 9924 (python) S 9909 9911 8588 0 -1 4202560 34 936 0 0 0 0 0 0 22 0 5 0 658201857 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9926] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9926/stat : 9926 (python) S 9909 9911 8588 0 -1 4202560 16 936 0 0 0 0 0 0 24 0 5 0 658201858 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9.29
Current children cumulated vsize (KiB) 2523616

[startup+6.30082 s]
/proc/loadavg: 8.03 8.19 8.00 10/481 9928
/proc/meminfo: memFree=21080840/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=320276 CPUtime=0.49 cores=0,2,4,6
/proc/9911/stat : 9911 (python) S 9909 9911 8588 0 -1 4202496 12254 936 1 0 37 12 0 0 23 0 5 0 658201800 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/9911/statm: 80069 7258 1873 364 0 15978 0
[pid=9917] ppid=9911 vsize=278588 CPUtime=0.01 cores=0,2,4,6
/proc/9917/stat : 9917 (python) S 9911 9911 8588 0 -1 4202560 890 0 0 0 0 1 0 0 18 0 1 0 658201855 285274112 5594 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879631 0 0 16781312 514 7850204888481890562 0 0 17 0 0 0 0
/proc/9917/statm: 69647 5594 377 364 0 5565 0
[pid=9919] ppid=9917 vsize=1017800 CPUtime=5.66 cores=0,2,4,6
/proc/9919/stat : 9919 (gnovelty+2) R 9917 9919 9919 0 -1 4202496 445 0 0 0 566 0 0 0 25 0 1 0 658201855 1042227200 181 33554432000 134512640 135663704 4292926016 18446744073709551615 134545699 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9919/statm: 254450 181 113 282 0 254166 0
[pid=9920] ppid=9911 vsize=289384 CPUtime=0.01 cores=0,2,4,6
/proc/9920/stat : 9920 (python) S 9911 9911 8588 0 -1 4202560 914 0 0 0 1 0 0 0 15 0 1 0 658201856 296329216 5727 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 10809501127100301570 0 0 17 2 0 0 0
/proc/9920/statm: 72346 5727 371 364 0 8261 0
[pid=9922] ppid=9920 vsize=3824 CPUtime=5.7 cores=0,2,4,6
/proc/9922/stat : 9922 (march_hi) R 9920 9922 9922 0 -1 4202496 934 0 0 0 570 0 0 0 25 0 1 0 658201856 3915776 671 33554432000 4194304 4955518 140733280127408 18446744073709551615 4209717 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9922/statm: 956 671 104 186 0 769 0
[pid=9923] ppid=9911 vsize=299168 CPUtime=0.02 cores=0,2,4,6
/proc/9923/stat : 9923 (python) S 9911 9911 8588 0 -1 4202560 907 0 0 0 1 1 0 0 15 0 1 0 658201857 306348032 5628 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 7911985347334996226 0 0 17 0 0 0 0
/proc/9923/statm: 74792 5628 371 364 0 10704 0
[pid=9927] ppid=9923 vsize=3824 CPUtime=5.65 cores=0,2,4,6
/proc/9927/stat : 9927 (march_hi) R 9923 9927 9927 0 -1 4202496 925 0 0 0 565 0 0 0 25 0 1 0 658201858 3915776 667 33554432000 4194304 4955518 140734106320352 18446744073709551615 4307246 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9927/statm: 956 667 104 186 0 769 0
[pid=9925] ppid=9911 vsize=310032 CPUtime=0.02 cores=0,2,4,6
/proc/9925/stat : 9925 (python) S 9911 9911 8588 0 -1 4202560 916 0 0 0 1 1 0 0 15 0 1 0 658201858 317472768 5752 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 17085254013701554435 0 0 17 0 0 0 0
/proc/9925/statm: 77508 5752 371 364 0 13417 0
[pid=9928] ppid=9925 vsize=2840 CPUtime=2.86 cores=0,2,4,6
/proc/9928/stat : 9928 (march_hi) R 9925 9928 9928 0 -1 4202496 783 0 0 0 286 0 0 0 25 0 1 0 658201858 2908160 521 33554432000 4194304 4955518 140733544638992 18446744073709551615 4286523 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9928/statm: 710 521 104 186 0 523 0
[pid=9911/tid=9918] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9918/stat : 9918 (python) S 9909 9911 8588 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 5 0 658201855 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9921] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9921/stat : 9921 (python) S 9909 9911 8588 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 5 0 658201856 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9924] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9924/stat : 9924 (python) S 9909 9911 8588 0 -1 4202560 34 936 0 0 0 0 0 0 22 0 5 0 658201857 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9926] ppid=9909 vsize=320276 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9926/stat : 9926 (python) S 9909 9911 8588 0 -1 4202560 16 936 0 0 0 0 0 0 24 0 5 0 658201858 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 20.42
Current children cumulated vsize (KiB) 2525736

[startup+12.7007 s]
/proc/loadavg: 8.18 8.21 8.01 10/481 9928
/proc/meminfo: memFree=21071876/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=320276 CPUtime=0.49 cores=0,2,4,6
/proc/9911/stat : 9911 (python) S 9909 9911 8588 0 -1 4202496 12254 936 1 0 37 12 0 0 23 0 5 0 658201800 327962624 7258 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/9911/statm: 80069 7258 1873 364 0 15978 0
[pid=9917] ppid=9911 vsize=278588 CPUtime=0.03 cores=0,2,4,6
/proc/9917/stat : 9917 (python) S 9911 9911 8588 0 -1 4202560 895 0 0 0 1 2 0 0 18 0 1 0 658201855 285274112 5594 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879631 0 0 16781312 514 17286803286870950146 0 0 17 0 0 0 0
/proc/9917/statm: 69647 5594 377 364 0 5565 0
[pid=9919] ppid=9917 vsize=1017800 CPUtime=11.97 cores=0,2,4,6
/proc/9919/stat : 9919 (gnovelty+2) R 9917 9919 9919 0 -1 4202496 445 0 0 0 1197 0 0 0 25 0 1 0 658201855 1042227200 181 33554432000 134512640 135663704 4292926016 18446744073709551615 134544204 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9919/statm: 254450 181 113 282 0 254166 0
[pid=9920] ppid=9911 vsize=289384 CPUtime=0.03 cores=0,2,4,6

################
# More data... #
################


[startup+1110.02 s]
/proc/loadavg: 4.64 5.80 7.14 5/470 10002
/proc/meminfo: memFree=21138956/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=361624 CPUtime=0.56 cores=0,2,4,6
/proc/9911/stat : 9911 (python) S 9909 9911 8588 0 -1 4202496 16427 936 1 0 44 12 0 0 18 0 9 0 658201800 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/9911/statm: 90406 7372 1890 364 0 26303 0
[pid=9917] ppid=9911 vsize=288832 CPUtime=0.34 cores=0,2,4,6
/proc/9917/stat : 9917 (python) S 9911 9911 8588 0 -1 4202560 1158 0 0 0 16 18 0 0 19 0 2 0 658201855 295763968 5638 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/9917/statm: 72208 5638 416 364 0 8126 0
[pid=9919] ppid=9917 vsize=1017800 CPUtime=98.84 cores=0,2,4,6
/proc/9919/stat : 9919 (gnovelty+2) T 9917 9919 9919 0 -1 4202496 445 0 0 0 9884 0 0 0 25 0 1 0 658201855 1042227200 181 33554432000 134512640 135663704 4292926016 18446744073709551615 135008519 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/9919/statm: 254450 181 113 282 0 254166 0
[pid=9917/tid=9938] ppid=9911 vsize=288832 CPUtime=0 cores=0,2,4,6
/proc/9917/task/9938/stat : 9938 (python) S 9911 9911 8588 0 -1 4202560 43 0 0 0 0 0 0 0 19 0 2 0 658211888 295763968 5638 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604441855559616 0 0 -1 0 0 0 0
[pid=9920] ppid=9911 vsize=289384 CPUtime=2.16 cores=0,2,4,6
/proc/9920/stat : 9920 (python) S 9911 9911 8588 0 -1 4202560 1150 0 0 0 116 100 0 0 15 0 2 0 658201856 296329216 5757 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/9920/statm: 72346 5757 400 364 0 8261 0
[pid=9922] ppid=9920 vsize=94052 CPUtime=568.53 cores=0,2,4,6
/proc/9922/stat : 9922 (march_hi) R 9920 9922 9922 0 -1 4202496 19329 0 0 0 56850 3 0 0 25 0 1 0 658201856 96309248 19066 33554432000 4194304 4955518 140733280127408 18446744073709551615 4209628 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9922/statm: 23513 19066 104 186 0 23326 0
[pid=9920/tid=9956] ppid=9911 vsize=289384 CPUtime=0 cores=0,2,4,6
/proc/9920/task/9956/stat : 9956 (python) S 9911 9911 8588 0 -1 4202560 43 0 0 0 0 0 0 0 16 0 2 0 658240940 296329216 5757 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604444172824896 0 0 -1 2 0 0 0
[pid=9923] ppid=9911 vsize=299168 CPUtime=1.86 cores=0,2,4,6
/proc/9923/stat : 9923 (python) S 9911 9911 8588 0 -1 4202560 1150 0 0 0 97 89 0 0 15 0 2 0 658201857 306348032 5658 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/9923/statm: 74792 5658 400 364 0 10704 0
[pid=9927] ppid=9923 vsize=77832 CPUtime=465.52 cores=0,2,4,6
/proc/9927/stat : 9927 (march_hi) R 9923 9927 9927 0 -1 4202496 16030 0 0 0 46547 5 0 0 25 0 1 0 658201858 79699968 15772 33554432000 4194304 4955518 140734106320352 18446744073709551615 4224727 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9927/statm: 19458 15772 104 186 0 19271 0
[pid=9923/tid=9961] ppid=9911 vsize=299168 CPUtime=0 cores=0,2,4,6
/proc/9923/task/9961/stat : 9961 (python) S 9911 9911 8588 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 658241768 306348032 5658 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604450459878592 0 0 -1 6 0 0 0
[pid=9925] ppid=9911 vsize=310032 CPUtime=3.16 cores=0,2,4,6
/proc/9925/stat : 9925 (python) S 9911 9911 8588 0 -1 4202560 1160 0 0 0 170 146 0 0 15 0 2 0 658201858 317472768 5782 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/9925/statm: 77508 5782 400 364 0 13417 0
[pid=9928] ppid=9925 vsize=77832 CPUtime=488.13 cores=0,2,4,6
/proc/9928/stat : 9928 (march_hi) T 9925 9928 9928 0 -1 4202496 16822 0 0 0 48810 3 0 0 25 0 1 0 658201858 79699968 16560 33554432000 4194304 4955518 140733544638992 18446744073709551615 4227679 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/9928/statm: 19458 16560 104 186 0 19271 0
[pid=9925/tid=9944] ppid=9911 vsize=310032 CPUtime=0 cores=0,2,4,6
/proc/9925/task/9944/stat : 9944 (python) S 9911 9911 8588 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 658216831 317472768 5782 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604447498390528 0 0 -1 4 0 0 0
[pid=9939] ppid=9911 vsize=320288 CPUtime=0.66 cores=0,2,4,6
/proc/9939/stat : 9939 (python) S 9911 9911 8588 0 -1 4202560 1117 0 0 0 35 31 0 0 19 0 2 0 658211889 327974912 5786 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/9939/statm: 80072 5786 400 364 0 15978 0
[pid=9941] ppid=9939 vsize=1017800 CPUtime=97.1 cores=0,2,4,6
/proc/9941/stat : 9941 (gnovelty+2) T 9939 9941 9941 0 -1 4202496 443 0 0 0 9710 0 0 0 25 0 1 0 658211889 1042227200 182 33554432000 134512640 135663704 4293902752 18446744073709551615 134545622 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/9941/statm: 254450 182 113 282 0 254166 0
[pid=9939/tid=9950] ppid=9911 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/9939/task/9950/stat : 9950 (python) S 9911 9911 8588 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 658231356 327974912 5786 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604451186668864 0 0 -1 6 0 0 0
[pid=9951] ppid=9911 vsize=330644 CPUtime=2.54 cores=0,2,4,6
/proc/9951/stat : 9951 (python) S 9911 9911 8588 0 -1 4202560 1149 0 0 0 139 115 0 0 16 0 2 0 658231357 338579456 5815 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/9951/statm: 82661 5815 400 364 0 18564 0
[pid=9953] ppid=9951 vsize=123520 CPUtime=680.16 cores=0,2,4,6
/proc/9953/stat : 9953 (march_hi) T 9951 9953 9953 0 -1 4202496 22266 0 0 0 68007 9 0 0 25 0 1 0 658231357 126484480 22006 33554432000 4194304 4955518 140733840528320 18446744073709551615 4224682 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/9953/statm: 30880 22006 104 186 0 30693 0
[pid=9951/tid=9998] ppid=9911 vsize=330644 CPUtime=0 cores=0,2,4,6
/proc/9951/task/9998/stat : 9998 (python) S 9911 9911 8588 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 658301387 338579456 5815 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604447246209152 0 0 -1 0 0 0 0
[pid=9957] ppid=9911 vsize=340900 CPUtime=2.54 cores=0,2,4,6
/proc/9957/stat : 9957 (python) S 9911 9911 8588 0 -1 4202560 1005 0 0 0 139 115 0 0 15 0 1 0 658240940 349081600 5809 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 17286803286870950147 0 0 17 6 0 0 0
/proc/9957/statm: 85225 5809 371 364 0 21125 0
[pid=9959] ppid=9957 vsize=123520 CPUtime=682.56 cores=0,2,4,6
/proc/9959/stat : 9959 (march_hi) R 9957 9959 9959 0 -1 4202496 22692 0 0 0 68251 5 0 0 25 0 1 0 658240941 126484480 22431 33554432000 4194304 4955518 140733419918944 18446744073709551615 4227518 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9959/statm: 30880 22431 104 186 0 30693 0
[pid=9962] ppid=9911 vsize=350524 CPUtime=2.39 cores=0,2,4,6
/proc/9962/stat : 9962 (python) S 9911 9911 8588 0 -1 4202560 1026 0 0 0 130 109 0 0 18 0 1 0 658241768 358936576 5673 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 17286803286870950148 0 0 17 0 0 0 0
/proc/9962/statm: 87631 5673 377 364 0 23528 0
[pid=9964] ppid=9962 vsize=182448 CPUtime=373.45 cores=0,2,4,6
/proc/9964/stat : 9964 (kcnfs-2006) R 9962 9964 9964 0 -1 4202496 616 0 0 0 37345 0 0 0 25 0 1 0 658241769 186826752 350 33554432000 134512640 135163436 4290174336 18446744073709551615 134559450 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9964/statm: 45612 350 77 159 0 45452 0
[pid=9911/tid=9918] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9918/stat : 9918 (python) S 9909 9911 8588 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 9 0 658201855 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9921] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9921/stat : 9921 (python) S 9909 9911 8588 0 -1 4202560 34 936 0 0 0 0 0 0 18 0 9 0 658201856 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9924] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9924/stat : 9924 (python) S 9909 9911 8588 0 -1 4202560 37 936 0 0 0 0 0 0 18 0 9 0 658201857 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9926] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9926/stat : 9926 (python) S 9909 9911 8588 0 -1 4202560 30 936 0 0 0 0 0 0 18 0 9 0 658201858 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9940] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9940/stat : 9940 (python) S 9909 9911 8588 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 9 0 658211889 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9952] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9952/stat : 9952 (python) S 9909 9911 8588 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 658231357 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9958] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9958/stat : 9958 (python) S 9909 9911 8588 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 9 0 658240940 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9963] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9963/stat : 9963 (python) S 9909 9911 8588 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 9 0 658241769 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3470.5
Current children cumulated vsize (KiB) 5606200

[startup+1110.1 s]
/proc/loadavg: 4.64 5.80 7.14 5/470 10002
/proc/meminfo: memFree=21138956/32951124 swapFree=56449232/67111528
[pid=9911] ppid=9909 vsize=361624 CPUtime=0.56 cores=0,2,4,6
/proc/9911/stat : 9911 (python) S 9909 9911 8588 0 -1 4202496 16427 936 1 0 44 12 0 0 18 0 9 0 658201800 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/9911/statm: 90406 7372 1890 364 0 26303 0
[pid=9917] ppid=9911 vsize=288832 CPUtime=0.34 cores=0,2,4,6
/proc/9917/stat : 9917 (python) S 9911 9911 8588 0 -1 4202560 1158 0 0 0 16 18 0 0 19 0 2 0 658201855 295763968 5638 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/9917/statm: 72208 5638 416 364 0 8126 0
[pid=9919] ppid=9917 vsize=1017800 CPUtime=98.84 cores=0,2,4,6
/proc/9919/stat : 9919 (gnovelty+2) T 9917 9919 9919 0 -1 4202496 445 0 0 0 9884 0 0 0 25 0 1 0 658201855 1042227200 181 33554432000 134512640 135663704 4292926016 18446744073709551615 135008519 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/9919/statm: 254450 181 113 282 0 254166 0
[pid=9917/tid=9938] ppid=9911 vsize=288832 CPUtime=0 cores=0,2,4,6
/proc/9917/task/9938/stat : 9938 (python) S 9911 9911 8588 0 -1 4202560 43 0 0 0 0 0 0 0 19 0 2 0 658211888 295763968 5638 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604441855559616 0 0 -1 0 0 0 0
[pid=9920] ppid=9911 vsize=289384 CPUtime=2.16 cores=0,2,4,6
/proc/9920/stat : 9920 (python) S 9911 9911 8588 0 -1 4202560 1150 0 0 0 116 100 0 0 15 0 2 0 658201856 296329216 5757 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/9920/statm: 72346 5757 400 364 0 8261 0
[pid=9922] ppid=9920 vsize=94052 CPUtime=568.62 cores=0,2,4,6
/proc/9922/stat : 9922 (march_hi) R 9920 9922 9922 0 -1 4202496 19332 0 0 0 56859 3 0 0 25 0 1 0 658201856 96309248 19069 33554432000 4194304 4955518 140733280127408 18446744073709551615 4224651 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9922/statm: 23513 19069 104 186 0 23326 0
[pid=9920/tid=9956] ppid=9911 vsize=289384 CPUtime=0 cores=0,2,4,6
/proc/9920/task/9956/stat : 9956 (python) S 9911 9911 8588 0 -1 4202560 43 0 0 0 0 0 0 0 16 0 2 0 658240940 296329216 5757 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604444172824896 0 0 -1 2 0 0 0
[pid=9923] ppid=9911 vsize=299168 CPUtime=1.86 cores=0,2,4,6
/proc/9923/stat : 9923 (python) S 9911 9911 8588 0 -1 4202560 1150 0 0 0 97 89 0 0 15 0 2 0 658201857 306348032 5658 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/9923/statm: 74792 5658 400 364 0 10704 0
[pid=9927] ppid=9923 vsize=77832 CPUtime=465.61 cores=0,2,4,6
/proc/9927/stat : 9927 (march_hi) R 9923 9927 9927 0 -1 4202496 16033 0 0 0 46556 5 0 0 25 0 1 0 658201858 79699968 15775 33554432000 4194304 4955518 140734106320352 18446744073709551615 4224608 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9927/statm: 19458 15775 104 186 0 19271 0
[pid=9923/tid=9961] ppid=9911 vsize=299168 CPUtime=0 cores=0,2,4,6
/proc/9923/task/9961/stat : 9961 (python) S 9911 9911 8588 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 658241768 306348032 5658 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604450459878592 0 0 -1 6 0 0 0
[pid=9925] ppid=9911 vsize=310032 CPUtime=3.16 cores=0,2,4,6
/proc/9925/stat : 9925 (python) S 9911 9911 8588 0 -1 4202560 1160 0 0 0 170 146 0 0 15 0 2 0 658201858 317472768 5782 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/9925/statm: 77508 5782 400 364 0 13417 0
[pid=9928] ppid=9925 vsize=77832 CPUtime=488.13 cores=0,2,4,6
/proc/9928/stat : 9928 (march_hi) T 9925 9928 9928 0 -1 4202496 16822 0 0 0 48810 3 0 0 25 0 1 0 658201858 79699968 16560 33554432000 4194304 4955518 140733544638992 18446744073709551615 4227679 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/9928/statm: 19458 16560 104 186 0 19271 0
[pid=9925/tid=9944] ppid=9911 vsize=310032 CPUtime=0 cores=0,2,4,6
/proc/9925/task/9944/stat : 9944 (python) S 9911 9911 8588 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 658216831 317472768 5782 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604447498390528 0 0 -1 4 0 0 0
[pid=9939] ppid=9911 vsize=320288 CPUtime=0.66 cores=0,2,4,6
/proc/9939/stat : 9939 (python) S 9911 9911 8588 0 -1 4202560 1117 0 0 0 35 31 0 0 19 0 2 0 658211889 327974912 5786 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/9939/statm: 80072 5786 400 364 0 15978 0
[pid=9941] ppid=9939 vsize=1017800 CPUtime=97.1 cores=0,2,4,6
/proc/9941/stat : 9941 (gnovelty+2) T 9939 9941 9941 0 -1 4202496 443 0 0 0 9710 0 0 0 25 0 1 0 658211889 1042227200 182 33554432000 134512640 135663704 4293902752 18446744073709551615 134545622 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/9941/statm: 254450 182 113 282 0 254166 0
[pid=9939/tid=9950] ppid=9911 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/9939/task/9950/stat : 9950 (python) S 9911 9911 8588 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 658231356 327974912 5786 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604451186668864 0 0 -1 6 0 0 0
[pid=9951] ppid=9911 vsize=330644 CPUtime=2.54 cores=0,2,4,6
/proc/9951/stat : 9951 (python) S 9911 9911 8588 0 -1 4202560 1149 0 0 0 139 115 0 0 16 0 2 0 658231357 338579456 5815 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/9951/statm: 82661 5815 400 364 0 18564 0
[pid=9953] ppid=9951 vsize=123520 CPUtime=680.16 cores=0,2,4,6
/proc/9953/stat : 9953 (march_hi) T 9951 9953 9953 0 -1 4202496 22266 0 0 0 68007 9 0 0 25 0 1 0 658231357 126484480 22006 33554432000 4194304 4955518 140733840528320 18446744073709551615 4224682 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/9953/statm: 30880 22006 104 186 0 30693 0
[pid=9951/tid=9998] ppid=9911 vsize=330644 CPUtime=0 cores=0,2,4,6
/proc/9951/task/9998/stat : 9998 (python) S 9911 9911 8588 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 658301387 338579456 5815 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 514 18446604447246209152 0 0 -1 0 0 0 0
[pid=9957] ppid=9911 vsize=340900 CPUtime=2.54 cores=0,2,4,6
/proc/9957/stat : 9957 (python) S 9911 9911 8588 0 -1 4202560 1005 0 0 0 139 115 0 0 15 0 1 0 658240940 349081600 5809 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 17286803286870950147 0 0 17 6 0 0 0
/proc/9957/statm: 85225 5809 371 364 0 21125 0
[pid=9959] ppid=9957 vsize=123520 CPUtime=682.65 cores=0,2,4,6
/proc/9959/stat : 9959 (march_hi) R 9957 9959 9959 0 -1 4202496 22694 0 0 0 68260 5 0 0 25 0 1 0 658240941 126484480 22433 33554432000 4194304 4955518 140733419918944 18446744073709551615 4289794 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9959/statm: 30880 22433 104 186 0 30693 0
[pid=9962] ppid=9911 vsize=350524 CPUtime=2.39 cores=0,2,4,6
/proc/9962/stat : 9962 (python) S 9911 9911 8588 0 -1 4202560 1026 0 0 0 130 109 0 0 18 0 1 0 658241768 358936576 5673 33554432000 4194304 5683644 140737063229136 18446744073709551615 253640879686 0 0 16781312 514 17286803286870950148 0 0 17 0 0 0 0
/proc/9962/statm: 87631 5673 377 364 0 23528 0
[pid=9964] ppid=9962 vsize=182448 CPUtime=373.53 cores=0,2,4,6
/proc/9964/stat : 9964 (kcnfs-2006) R 9962 9964 9964 0 -1 4202496 616 0 0 0 37353 0 0 0 25 0 1 0 658241769 186826752 350 33554432000 134512640 135163436 4290174336 18446744073709551615 134667395 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9964/statm: 45612 350 77 159 0 45452 0
[pid=9911/tid=9918] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9918/stat : 9918 (python) S 9909 9911 8588 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 9 0 658201855 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9921] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9921/stat : 9921 (python) S 9909 9911 8588 0 -1 4202560 34 936 0 0 0 0 0 0 18 0 9 0 658201856 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9924] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9924/stat : 9924 (python) S 9909 9911 8588 0 -1 4202560 37 936 0 0 0 0 0 0 18 0 9 0 658201857 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9926] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9926/stat : 9926 (python) S 9909 9911 8588 0 -1 4202560 30 936 0 0 0 0 0 0 18 0 9 0 658201858 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9940] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9940/stat : 9940 (python) S 9909 9911 8588 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 9 0 658211889 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9952] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9952/stat : 9952 (python) S 9909 9911 8588 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 658231357 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9958] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9958/stat : 9958 (python) S 9909 9911 8588 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 9 0 658240940 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
[pid=9911/tid=9963] ppid=9909 vsize=361624 CPUtime=0 cores=0,2,4,6
/proc/9911/task/9963/stat : 9963 (python) S 9909 9911 8588 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 9 0 658241769 370302976 7372 33554432000 4194304 5683644 140737063229136 18446744073709551615 253652683185 0 0 16781312 2 18446604445201890304 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3470.85
Current children cumulated vsize (KiB) 5606200

Child status: 0
Real time (s): 1110.19
CPU time (s): 3471.28
CPU user time (s): 3463.56
CPU system time (s): 7.72383
CPU usage (%): 312.675
Max. virtual memory (cumulated for all children) (KiB): 5606200

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3463.56
system time used= 7.72382
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 129479
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7286
involuntary context switches= 32110

runsolver used 5.60715 second user time and 11.3483 second system time

The end

Launcher Data 

Begin job on node106 at 2011-05-15 15:26:54
IDJOB=3378528
IDBENCH=82937
IDSOLVER=1859
FILE ID=node106/3378528-1305466014
RUNJOBID= node106-1305463093-8606
PBS_JOBID= 13324980
Free space on /tmp= 73352 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v550-c2343-S1554089933-067.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378528-1305466014/watcher-3378528-1305466014 -o /tmp/evaluation-result-3378528-1305466014/solver-3378528-1305466014 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378528-1305466014.cnf -seed 2097300198 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fa2c840574747ca3ff8efe8a9137bb94
RANDOM SEED=2097300198

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21129092 kB
Buffers:        304092 kB
Cached:        6293636 kB
SwapCached:      27536 kB
Active:        3218932 kB
Inactive:      8337400 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21129092 kB
SwapTotal:    67111528 kB
SwapFree:     56449232 kB
Dirty:           33596 kB
Writeback:           0 kB
AnonPages:     4939936 kB
Mapped:          27148 kB
Slab:           132612 kB
PageTables:      65104 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 126454760 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73356 MiB
End job on node106 at 2011-05-15 15:45:24