Trace number 3378381

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? 3196.48 1232.21

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v500-c2130-S1383368897-031.UNKNOWN.cnf
MD5SUM4d20714634af5755393f1c67cf27956c
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables500
Number of clauses2130
Sum of the clauses size6390
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32130
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.31/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.46	c INFO: solving HOME/instance-3378381-1305465186.cnf
0.31/0.46	c INFO: computing task features
0.31/0.47	c INFO: computed variable-clause graph statistics
0.31/0.47	c INFO: computed clause balance statistics
0.40/0.51	c INFO: computed variable balance statistics
0.40/0.54	c INFO: computed small-clause counts
0.40/0.54	c INFO: computed Horn-clause counts
0.40/0.54	c INFO: computed variable graph statistics
0.40/0.54	c INFO: collected features for HOME/instance-3378381-1305465186.cnf in 0.08 s
0.40/0.55	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.57)
0.40/0.56	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.35)
0.40/0.57	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.06)
0.40/0.59	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.33)
426.25/149.07	c INFO: running march_hi@0 for 679 with 1051 remaining (b = 0.39)
546.59/197.19	c INFO: running march_hi@0 for 679 with 1003 remaining (b = 0.35)
1558.06/607.17	c INFO: running kcnfs-2006@0 for 593 with 593 remaining (b = 0.29)
1748.61/702.24	c INFO: running march_hi@0 for 498 with 498 remaining (b = 0.25)
2383.96/956.13	c INFO: running march_hi@0 for 97 with 244 remaining (b = 0.05)
2795.26/1098.57	c INFO: running march_hi@390 for 101 with 101 remaining (b = 0.06)
3196.22/1232.19	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378381-1305465186/watcher-3378381-1305465186 -o /tmp/evaluation-result-3378381-1305465186/solver-3378381-1305465186 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378381-1305465186.cnf -seed 1815956075 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.01 9.09 7.98 10/351 25739
/proc/meminfo: memFree=11582280/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=45816 CPUtime=0.04 cores=0,2,4,6
/proc/25739/stat : 25739 (python) R 25737 25739 25078 0 -1 4202496 1928 0 0 0 4 0 0 0 25 0 1 0 658118277 46915584 1701 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080230400 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/25739/statm: 11454 1701 470 364 0 1203 0

[startup+0.105484 s]
/proc/loadavg: 9.01 9.09 7.98 10/351 25739
/proc/meminfo: memFree=11582280/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=102012 CPUtime=0.06 cores=0,2,4,6
/proc/25739/stat : 25739 (python) S 25737 25739 25078 0 -1 4202496 3008 0 0 0 5 1 0 0 25 0 1 0 658118277 104460288 2701 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/25739/statm: 25503 2701 841 364 0 1803 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 102012

[startup+0.200159 s]
/proc/loadavg: 9.01 9.09 7.98 10/351 25739
/proc/meminfo: memFree=11582280/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=126804 CPUtime=0.14 cores=0,2,4,6
/proc/25739/stat : 25739 (python) R 25737 25739 25078 0 -1 4202496 5379 932 1 0 11 3 0 0 25 0 1 0 658118277 129847296 3997 33554432000 4194304 5683644 140733495279216 18446744073709551615 5010974 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/25739/statm: 31701 3997 1003 364 0 2996 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 126804

[startup+0.300139 s]
/proc/loadavg: 9.01 9.09 7.98 10/351 25739
/proc/meminfo: memFree=11582280/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=168676 CPUtime=0.22 cores=0,2,4,6
/proc/25739/stat : 25739 (python) R 25737 25739 25078 0 -1 4202496 6723 932 1 0 16 6 0 0 25 0 1 0 658118277 172724224 4798 33554432000 4194304 5683644 140733495279216 18446744073709551615 4335117 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/25739/statm: 42169 4798 1331 364 0 3454 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 168676

[startup+0.701061 s]
/proc/loadavg: 9.01 9.09 7.98 10/351 25739
/proc/meminfo: memFree=11582280/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=320204 CPUtime=0.48 cores=0,2,4,6
/proc/25739/stat : 25739 (python) S 25737 25739 25078 0 -1 4202496 12190 932 1 0 39 9 0 0 25 0 5 0 658118277 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25739/statm: 80051 7240 1873 364 0 15960 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 320204

[startup+1.50091 s]
/proc/loadavg: 9.01 9.09 7.98 12/364 25756
/proc/meminfo: memFree=11547700/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=320204 CPUtime=0.48 cores=0,2,4,6
/proc/25739/stat : 25739 (python) S 25737 25739 25078 0 -1 4202496 12190 932 1 0 39 9 0 0 25 0 5 0 658118277 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25739/statm: 80051 7240 1873 364 0 15960 0
[pid=25745] ppid=25739 vsize=278584 CPUtime=0 cores=0,2,4,6
/proc/25745/stat : 25745 (python) S 25739 25739 25078 0 -1 4202560 732 0 0 0 0 0 0 0 25 0 1 0 658118332 285270016 5553 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252431 0 0 16781312 514 3716657994067345407 0 0 17 6 0 0 0
/proc/25745/statm: 69646 5553 354 364 0 5564 0
[pid=25749] ppid=25745 vsize=1017800 CPUtime=0.4 cores=0,2,4,6
/proc/25749/stat : 25749 (gnovelty+2) R 25745 25749 25749 0 -1 4202496 440 0 0 0 40 0 0 0 25 0 1 0 658118334 1042227200 178 33554432000 134512640 135663704 4289439152 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25749/statm: 254450 178 113 282 0 254166 0
[pid=25747] ppid=25739 vsize=289348 CPUtime=0 cores=0,2,4,6
/proc/25747/stat : 25747 (python) S 25739 25739 25078 0 -1 4202560 750 0 0 0 0 0 0 0 20 0 1 0 658118333 296292352 5695 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 191310629481447683 0 0 17 2 0 0 0
/proc/25747/statm: 72337 5695 348 364 0 8252 0
[pid=25752] ppid=25747 vsize=2344 CPUtime=0.73 cores=0,2,4,6
/proc/25752/stat : 25752 (march_hi) R 25747 25752 25752 0 -1 4202496 653 0 0 0 73 0 0 0 25 0 1 0 658118335 2400256 391 33554432000 4194304 4955518 140735698114720 18446744073709551615 4282408 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25752/statm: 586 391 104 186 0 399 0
[pid=25750] ppid=25739 vsize=299096 CPUtime=0 cores=0,2,4,6
/proc/25750/stat : 25750 (python) S 25739 25739 25078 0 -1 4202560 733 0 0 0 0 0 0 0 25 0 1 0 658118334 306274304 5587 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 4528985431005462527 0 0 17 6 0 0 0
/proc/25750/statm: 74774 5587 348 364 0 10686 0
[pid=25753] ppid=25750 vsize=1017800 CPUtime=0.4 cores=0,2,4,6
/proc/25753/stat : 25753 (gnovelty+2) R 25750 25753 25753 0 -1 4202496 438 0 0 0 40 0 0 0 25 0 1 0 658118335 1042227200 177 33554432000 134512640 135663704 4289990512 18446744073709551615 134545793 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25753/statm: 254450 177 113 282 0 254166 0
[pid=25754] ppid=25739 vsize=309960 CPUtime=0 cores=0,2,4,6
/proc/25754/stat : 25754 (python) S 25739 25739 25078 0 -1 4202560 753 0 0 0 0 0 0 0 21 0 1 0 658118336 317399040 5711 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 9242569514170679556 0 0 17 2 0 0 0
/proc/25754/statm: 77490 5711 348 364 0 13399 0
[pid=25756] ppid=25754 vsize=2344 CPUtime=0.59 cores=0,2,4,6
/proc/25756/stat : 25756 (march_hi) R 25754 25756 25756 0 -1 4202496 643 0 0 0 59 0 0 0 25 0 1 0 658118336 2400256 385 33554432000 4194304 4955518 140736150135376 18446744073709551615 4413751 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/25756/statm: 586 385 104 186 0 399 0
[pid=25739/tid=25746] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25746/stat : 25746 (python) S 25737 25739 25078 0 -1 4202560 40 932 0 0 0 0 0 0 25 0 5 0 658118332 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25748] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25748/stat : 25748 (python) S 25737 25739 25078 0 -1 4202560 35 932 0 0 0 0 0 0 25 0 5 0 658118333 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25751] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25751/stat : 25751 (python) S 25737 25739 25078 0 -1 4202560 18 932 0 0 0 0 0 0 25 0 5 0 658118335 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25755] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25755/stat : 25755 (python) S 25737 25739 25078 0 -1 4202560 25 932 0 0 0 0 0 0 25 0 5 0 658118336 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.6
Current children cumulated vsize (KiB) 3537480

[startup+3.1006 s]
/proc/loadavg: 9.17 9.12 7.99 12/364 25756
/proc/meminfo: memFree=11545592/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=320204 CPUtime=0.48 cores=0,2,4,6
/proc/25739/stat : 25739 (python) S 25737 25739 25078 0 -1 4202496 12190 932 1 0 39 9 0 0 25 0 5 0 658118277 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25739/statm: 80051 7240 1873 364 0 15960 0
[pid=25745] ppid=25739 vsize=278584 CPUtime=0 cores=0,2,4,6
/proc/25745/stat : 25745 (python) S 25739 25739 25078 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 658118332 285270016 5553 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252431 0 0 16781312 514 3716657994067312898 0 0 17 6 0 0 0
/proc/25745/statm: 69646 5553 354 364 0 5564 0
[pid=25749] ppid=25745 vsize=1017800 CPUtime=1.2 cores=0,2,4,6
/proc/25749/stat : 25749 (gnovelty+2) R 25745 25749 25749 0 -1 4202496 440 0 0 0 120 0 0 0 25 0 1 0 658118334 1042227200 178 33554432000 134512640 135663704 4289439152 18446744073709551615 134545786 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25749/statm: 254450 178 113 282 0 254166 0
[pid=25747] ppid=25739 vsize=289348 CPUtime=0 cores=0,2,4,6
/proc/25747/stat : 25747 (python) S 25739 25739 25078 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 658118333 296292352 5695 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 191310629481447683 0 0 17 2 0 0 0
/proc/25747/statm: 72337 5695 348 364 0 8252 0
[pid=25752] ppid=25747 vsize=2968 CPUtime=2.33 cores=0,2,4,6
/proc/25752/stat : 25752 (march_hi) R 25747 25752 25752 0 -1 4202496 777 0 0 0 233 0 0 0 25 0 1 0 658118335 3039232 515 33554432000 4194304 4955518 140735698114720 18446744073709551615 4209717 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25752/statm: 742 515 104 186 0 555 0
[pid=25750] ppid=25739 vsize=299096 CPUtime=0 cores=0,2,4,6
/proc/25750/stat : 25750 (python) S 25739 25739 25078 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 658118334 306274304 5587 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 4528985431005430018 0 0 17 6 0 0 0
/proc/25750/statm: 74774 5587 348 364 0 10686 0
[pid=25753] ppid=25750 vsize=1017800 CPUtime=1.2 cores=0,2,4,6
/proc/25753/stat : 25753 (gnovelty+2) R 25750 25753 25753 0 -1 4202496 438 0 0 0 120 0 0 0 25 0 1 0 658118335 1042227200 177 33554432000 134512640 135663704 4289990512 18446744073709551615 134525691 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25753/statm: 254450 177 113 282 0 254166 0
[pid=25754] ppid=25739 vsize=309960 CPUtime=0 cores=0,2,4,6
/proc/25754/stat : 25754 (python) S 25739 25739 25078 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 658118336 317399040 5711 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 9242569514170679556 0 0 17 2 0 0 0
/proc/25754/statm: 77490 5711 348 364 0 13399 0
[pid=25756] ppid=25754 vsize=2816 CPUtime=1.37 cores=0,2,4,6
/proc/25756/stat : 25756 (march_hi) R 25754 25756 25756 0 -1 4202496 732 0 0 0 137 0 0 0 25 0 1 0 658118336 2883584 474 33554432000 4194304 4955518 140736150135376 18446744073709551615 4209692 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/25756/statm: 704 474 104 186 0 517 0
[pid=25739/tid=25746] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25746/stat : 25746 (python) S 25737 25739 25078 0 -1 4202560 40 932 0 0 0 0 0 0 25 0 5 0 658118332 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25748] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25748/stat : 25748 (python) S 25737 25739 25078 0 -1 4202560 35 932 0 0 0 0 0 0 25 0 5 0 658118333 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25751] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25751/stat : 25751 (python) S 25737 25739 25078 0 -1 4202560 18 932 0 0 0 0 0 0 25 0 5 0 658118335 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25755] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25755/stat : 25755 (python) S 25737 25739 25078 0 -1 4202560 25 932 0 0 0 0 0 0 25 0 5 0 658118336 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.58
Current children cumulated vsize (KiB) 3538576

[startup+6.30099 s]
/proc/loadavg: 9.17 9.12 7.99 12/364 25756
/proc/meminfo: memFree=11540904/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=320204 CPUtime=0.48 cores=0,2,4,6
/proc/25739/stat : 25739 (python) S 25737 25739 25078 0 -1 4202496 12190 932 1 0 39 9 0 0 25 0 5 0 658118277 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25739/statm: 80051 7240 1873 364 0 15960 0
[pid=25745] ppid=25739 vsize=278584 CPUtime=0 cores=0,2,4,6
/proc/25745/stat : 25745 (python) S 25739 25739 25078 0 -1 4202560 898 0 0 0 0 0 0 0 18 0 1 0 658118332 285270016 5576 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252431 0 0 16781312 514 3716657994067312898 0 0 17 6 0 0 0
/proc/25745/statm: 69646 5576 377 364 0 5564 0
[pid=25749] ppid=25745 vsize=1017800 CPUtime=2.8 cores=0,2,4,6
/proc/25749/stat : 25749 (gnovelty+2) R 25745 25749 25749 0 -1 4202496 440 0 0 0 280 0 0 0 25 0 1 0 658118334 1042227200 178 33554432000 134512640 135663704 4289439152 18446744073709551615 134545635 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25749/statm: 254450 178 113 282 0 254166 0
[pid=25747] ppid=25739 vsize=289348 CPUtime=0.02 cores=0,2,4,6
/proc/25747/stat : 25747 (python) S 25739 25739 25078 0 -1 4202560 917 0 0 0 1 1 0 0 15 0 1 0 658118333 296292352 5718 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 4095621169254727939 0 0 17 2 0 0 0
/proc/25747/statm: 72337 5718 371 364 0 8252 0
[pid=25752] ppid=25747 vsize=3708 CPUtime=4.72 cores=0,2,4,6
/proc/25752/stat : 25752 (march_hi) R 25747 25752 25752 0 -1 4202496 902 0 0 0 472 0 0 0 25 0 1 0 658118335 3796992 640 33554432000 4194304 4955518 140735698114720 18446744073709551615 4227794 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25752/statm: 927 640 104 186 0 740 0
[pid=25750] ppid=25739 vsize=299096 CPUtime=0 cores=0,2,4,6
/proc/25750/stat : 25750 (python) S 25739 25739 25078 0 -1 4202560 894 0 0 0 0 0 0 0 18 0 1 0 658118334 306274304 5610 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 4528985431005430018 0 0 17 2 0 0 0
/proc/25750/statm: 74774 5610 371 364 0 10686 0
[pid=25753] ppid=25750 vsize=1017800 CPUtime=2.79 cores=0,2,4,6
/proc/25753/stat : 25753 (gnovelty+2) R 25750 25753 25753 0 -1 4202496 438 0 0 0 279 0 0 0 25 0 1 0 658118335 1042227200 177 33554432000 134512640 135663704 4289990512 18446744073709551615 134545572 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25753/statm: 254450 177 113 282 0 254166 0
[pid=25754] ppid=25739 vsize=309960 CPUtime=0 cores=0,2,4,6
/proc/25754/stat : 25754 (python) S 25739 25739 25078 0 -1 4202560 911 0 0 0 0 0 0 0 15 0 1 0 658118336 317399040 5734 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 9242569514170679556 0 0 17 6 0 0 0
/proc/25754/statm: 77490 5734 371 364 0 13399 0
[pid=25756] ppid=25754 vsize=3196 CPUtime=3.72 cores=0,2,4,6
/proc/25756/stat : 25756 (march_hi) R 25754 25756 25756 0 -1 4202496 831 0 0 0 372 0 0 0 25 0 1 0 658118336 3272704 573 33554432000 4194304 4955518 140736150135376 18446744073709551615 4227679 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/25756/statm: 799 573 104 186 0 612 0
[pid=25739/tid=25746] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25746/stat : 25746 (python) S 25737 25739 25078 0 -1 4202560 40 932 0 0 0 0 0 0 25 0 5 0 658118332 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25748] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25748/stat : 25748 (python) S 25737 25739 25078 0 -1 4202560 35 932 0 0 0 0 0 0 25 0 5 0 658118333 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25751] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25751/stat : 25751 (python) S 25737 25739 25078 0 -1 4202560 18 932 0 0 0 0 0 0 25 0 5 0 658118335 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25755] ppid=25737 vsize=320204 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25755/stat : 25755 (python) S 25737 25739 25078 0 -1 4202560 25 932 0 0 0 0 0 0 25 0 5 0 658118336 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 14.53
Current children cumulated vsize (KiB) 3539696

[startup+12.7008 s]
/proc/loadavg: 9.45 9.19 8.03 12/364 25756
/proc/meminfo: memFree=11534084/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=320204 CPUtime=0.48 cores=0,2,4,6
/proc/25739/stat : 25739 (python) S 25737 25739 25078 0 -1 4202496 12190 932 1 0 39 9 0 0 25 0 5 0 658118277 327888896 7240 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25739/statm: 80051 7240 1873 364 0 15960 0
[pid=25745] ppid=25739 vsize=278584 CPUtime=0.02 cores=0,2,4,6
/proc/25745/stat : 25745 (python) S 25739 25739 25078 0 -1 4202560 901 0 0 0 1 1 0 0 18 0 1 0 658118332 285270016 5576 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252431 0 0 16781312 514 17884708913962516738 0 0 17 6 0 0 0
/proc/25745/statm: 69646 5576 377 364 0 5564 0
[pid=25749] ppid=25745 vsize=1017800 CPUtime=6 cores=0,2,4,6
/proc/25749/stat : 25749 (gnovelty+2) R 25745 25749 25749 0 -1 4202496 440 0 0 0 600 0 0 0 25 0 1 0 658118334 1042227200 178 33554432000 134512640 135663704 4289439152 18446744073709551615 134524594 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25749/statm: 254450 178 113 282 0 254166 0
[pid=25747] ppid=25739 vsize=289348 CPUtime=0.03 cores=0,2,4,6

################
# More data... #
################

/proc/25753/stat : 25753 (gnovelty+2) T 25750 25753 25753 0 -1 4202496 438 0 0 0 9825 0 0 0 25 0 1 0 658118335 1042227200 177 33554432000 134512640 135663704 4289990512 18446744073709551615 134525187 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/25753/statm: 254450 177 113 282 0 254166 0
[pid=25750/tid=25770] ppid=25739 vsize=299096 CPUtime=0 cores=0,2,4,6
/proc/25750/task/25770/stat : 25770 (python) S 25739 25739 25078 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 658137995 306274304 5640 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604453967179840 0 0 -1 2 0 0 0
[pid=25754] ppid=25739 vsize=309960 CPUtime=1.62 cores=0,2,4,6
/proc/25754/stat : 25754 (python) S 25739 25739 25078 0 -1 4202560 1153 0 0 0 89 73 0 0 17 0 2 0 658118336 317399040 5764 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25754/statm: 77490 5764 400 364 0 13399 0
[pid=25756] ppid=25754 vsize=56228 CPUtime=390.41 cores=0,2,4,6
/proc/25756/stat : 25756 (march_hi) T 25754 25756 25756 0 -1 4202496 13409 0 0 0 39038 3 0 0 25 0 1 0 658118336 57577472 13151 33554432000 4194304 4955518 140736150135376 18446744073709551615 4209643 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/25756/statm: 14057 13151 104 186 0 13870 0
[pid=25754/tid=25787] ppid=25739 vsize=309960 CPUtime=0 cores=0,2,4,6
/proc/25754/task/25787/stat : 25787 (python) S 25739 25739 25078 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 658178993 317399040 5764 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604448423934656 0 0 -1 6 0 0 0
[pid=25763] ppid=25739 vsize=320216 CPUtime=2.91 cores=0,2,4,6
/proc/25763/stat : 25763 (python) S 25739 25739 25078 0 -1 4202560 1003 0 0 0 158 133 0 0 15 0 1 0 658133184 327901184 5755 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 4965838718028972290 0 0 17 0 0 0 0
/proc/25763/statm: 80054 5755 371 364 0 15960 0
[pid=25765] ppid=25763 vsize=90216 CPUtime=603.04 cores=0,2,4,6
/proc/25765/stat : 25765 (march_hi) R 25763 25765 25765 0 -1 4202496 19594 0 0 0 60295 9 0 0 25 0 1 0 658133185 92381184 19335 33554432000 4194304 4955518 140737483846256 18446744073709551615 4224682 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25765/statm: 22554 19335 104 186 0 22367 0
[pid=25771] ppid=25739 vsize=330472 CPUtime=2.41 cores=0,2,4,6
/proc/25771/stat : 25771 (python) S 25739 25739 25078 0 -1 4202560 1174 0 0 0 126 115 0 0 15 0 2 0 658137995 338403328 5791 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/25771/statm: 82618 5791 400 364 0 18521 0
[pid=25773] ppid=25771 vsize=119684 CPUtime=785.47 cores=0,2,4,6
/proc/25773/stat : 25773 (march_hi) R 25771 25773 25773 0 -1 4202496 24844 0 0 0 78540 7 0 0 25 0 1 0 658137996 122556416 24585 33554432000 4194304 4955518 140734098731872 18446744073709551615 4224642 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25773/statm: 29921 24585 104 186 0 29734 0
[pid=25771/tid=25856] ppid=25739 vsize=330472 CPUtime=0 cores=0,2,4,6
/proc/25771/task/25856/stat : 25856 (python) S 25739 25739 25078 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 658213890 338403328 5791 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604444028138432 0 0 -1 2 0 0 0
[pid=25788] ppid=25739 vsize=340968 CPUtime=1.64 cores=0,2,4,6
/proc/25788/stat : 25788 (python) S 25739 25739 25078 0 -1 4202560 1002 0 0 0 90 74 0 0 18 0 1 0 658178994 349151232 5806 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 17884708913962516737 0 0 17 2 0 0 0
/proc/25788/statm: 85242 5806 371 364 0 21142 0
[pid=25790] ppid=25788 vsize=182448 CPUtime=310.55 cores=0,2,4,6
/proc/25790/stat : 25790 (kcnfs-2006) R 25788 25790 25790 0 -1 4202496 587 0 0 0 31055 0 0 0 25 0 1 0 658178994 186826752 328 33554432000 134512640 135163436 4293562944 18446744073709551615 134587444 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25790/statm: 45612 328 77 159 0 45452 0
[pid=25796] ppid=25739 vsize=351224 CPUtime=1.46 cores=0,2,4,6
/proc/25796/stat : 25796 (python) S 25739 25739 25078 0 -1 4202560 1047 0 0 0 78 68 0 0 16 0 1 0 658188501 359653376 5816 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 17884708913962516738 0 0 17 4 0 0 0
/proc/25796/statm: 87806 5816 377 364 0 23703 0
[pid=25798] ppid=25796 vsize=75872 CPUtime=400.91 cores=0,2,4,6
/proc/25798/stat : 25798 (march_hi) R 25796 25798 25798 0 -1 4202496 13748 0 0 0 40087 4 0 0 25 0 1 0 658188502 77692928 13472 33554432000 4194304 4955518 140735260799936 18446744073709551615 4209667 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25798/statm: 18968 13472 104 186 0 18781 0
[pid=25857] ppid=25739 vsize=361932 CPUtime=0.4 cores=0,2,4,6
/proc/25857/stat : 25857 (python) S 25739 25739 25078 0 -1 4202560 1149 0 0 0 21 19 0 0 17 0 2 0 658213890 370618368 5963 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/25857/statm: 90483 5963 406 364 0 26377 0
[pid=25859] ppid=25857 vsize=17692 CPUtime=102.12 cores=0,2,4,6
/proc/25859/stat : 25859 (march_hi) T 25857 25859 25859 0 -1 4202496 4323 0 0 0 10212 0 0 0 25 0 1 0 658213891 18116608 4054 33554432000 4194304 4955518 140735806037264 18446744073709551615 4289745 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/25859/statm: 4423 4054 104 186 0 4236 0
[pid=25857/tid=25864] ppid=25739 vsize=361932 CPUtime=0 cores=0,2,4,6
/proc/25857/task/25864/stat : 25864 (python) S 25739 25739 25078 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 658228133 370618368 5963 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604453967182528 0 0 -1 4 0 0 0
[pid=25739/tid=25746] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25746/stat : 25746 (python) S 25737 25739 25078 0 -1 4202560 40 932 0 0 0 0 0 0 25 0 10 0 658118332 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25748] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25748/stat : 25748 (python) S 25737 25739 25078 0 -1 4202560 35 932 0 0 0 0 0 0 25 0 10 0 658118333 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25751] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25751/stat : 25751 (python) S 25737 25739 25078 0 -1 4202560 18 932 0 0 0 0 0 0 25 0 10 0 658118335 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25755] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25755/stat : 25755 (python) S 25737 25739 25078 0 -1 4202560 25 932 0 0 0 0 0 0 25 0 10 0 658118336 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25764] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25764/stat : 25764 (python) S 25737 25739 25078 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 10 0 658133185 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25772] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25772/stat : 25772 (python) S 25737 25739 25078 0 -1 4202560 28 932 0 0 0 0 0 0 18 0 10 0 658137996 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25789] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25789/stat : 25789 (python) S 25737 25739 25078 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 658178994 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25797] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25797/stat : 25797 (python) S 25737 25739 25078 0 -1 4202560 23 932 0 0 0 0 0 0 20 0 10 0 658188502 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25858] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25858/stat : 25858 (python) S 25737 25739 25078 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 10 0 658213891 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3193.46
Current children cumulated vsize (KiB) 5897392

[startup+1232 s]
/proc/loadavg: 10.26 10.19 9.58 12/383 25868
/proc/meminfo: memFree=11137188/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=371380 CPUtime=0.53 cores=0,2,4,6
/proc/25739/stat : 25739 (python) S 25737 25739 25078 0 -1 4202496 16850 932 1 0 43 10 0 0 18 0 10 0 658118277 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25739/statm: 92845 7245 1884 364 0 28739 0
[pid=25745] ppid=25739 vsize=288828 CPUtime=0.37 cores=0,2,4,6
/proc/25745/stat : 25745 (python) S 25739 25739 25078 0 -1 4202560 1178 0 0 0 21 16 0 0 19 0 2 0 658118332 295759872 5620 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25745/statm: 72207 5620 416 364 0 8125 0
[pid=25749] ppid=25745 vsize=1017800 CPUtime=98.4 cores=0,2,4,6
/proc/25749/stat : 25749 (gnovelty+2) T 25745 25749 25749 0 -1 4202496 440 0 0 0 9840 0 0 0 25 0 1 0 658118334 1042227200 178 33554432000 134512640 135663704 4289439152 18446744073709551615 134525678 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/25749/statm: 254450 178 113 282 0 254166 0
[pid=25745/tid=25762] ppid=25739 vsize=288828 CPUtime=0 cores=0,2,4,6
/proc/25745/task/25762/stat : 25762 (python) S 25739 25739 25078 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 658133184 295759872 5620 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604445188110528 0 0 -1 6 0 0 0
[pid=25747] ppid=25739 vsize=289348 CPUtime=1.86 cores=0,2,4,6
/proc/25747/stat : 25747 (python) S 25739 25739 25078 0 -1 4202560 1148 0 0 0 102 84 0 0 16 0 2 0 658118333 296292352 5748 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/25747/statm: 72337 5748 400 364 0 8252 0
[pid=25752] ppid=25747 vsize=56228 CPUtime=390.63 cores=0,2,4,6
/proc/25752/stat : 25752 (march_hi) T 25747 25752 25752 0 -1 4202496 13395 0 0 0 39060 3 0 0 25 0 1 0 658118335 57577472 13133 33554432000 4194304 4955518 140735698114720 18446744073709551615 4209624 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/25752/statm: 14057 13133 104 186 0 13870 0
[pid=25747/tid=25795] ppid=25739 vsize=289348 CPUtime=0 cores=0,2,4,6
/proc/25747/task/25795/stat : 25795 (python) S 25739 25739 25078 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 658188501 296292352 5748 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604449571312064 0 0 -1 2 0 0 0
[pid=25750] ppid=25739 vsize=299096 CPUtime=0.48 cores=0,2,4,6
/proc/25750/stat : 25750 (python) S 25739 25739 25078 0 -1 4202560 1113 0 0 0 25 23 0 0 19 0 2 0 658118334 306274304 5640 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/25750/statm: 74774 5640 400 364 0 10686 0
[pid=25753] ppid=25750 vsize=1017800 CPUtime=98.25 cores=0,2,4,6
/proc/25753/stat : 25753 (gnovelty+2) T 25750 25753 25753 0 -1 4202496 438 0 0 0 9825 0 0 0 25 0 1 0 658118335 1042227200 177 33554432000 134512640 135663704 4289990512 18446744073709551615 134525187 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/25753/statm: 254450 177 113 282 0 254166 0
[pid=25750/tid=25770] ppid=25739 vsize=299096 CPUtime=0 cores=0,2,4,6
/proc/25750/task/25770/stat : 25770 (python) S 25739 25739 25078 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 658137995 306274304 5640 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604453967179840 0 0 -1 2 0 0 0
[pid=25754] ppid=25739 vsize=309960 CPUtime=1.62 cores=0,2,4,6
/proc/25754/stat : 25754 (python) S 25739 25739 25078 0 -1 4202560 1153 0 0 0 89 73 0 0 17 0 2 0 658118336 317399040 5764 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25754/statm: 77490 5764 400 364 0 13399 0
[pid=25756] ppid=25754 vsize=56228 CPUtime=390.41 cores=0,2,4,6
/proc/25756/stat : 25756 (march_hi) T 25754 25756 25756 0 -1 4202496 13409 0 0 0 39038 3 0 0 25 0 1 0 658118336 57577472 13151 33554432000 4194304 4955518 140736150135376 18446744073709551615 4209643 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/25756/statm: 14057 13151 104 186 0 13870 0
[pid=25754/tid=25787] ppid=25739 vsize=309960 CPUtime=0 cores=0,2,4,6
/proc/25754/task/25787/stat : 25787 (python) S 25739 25739 25078 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 658178993 317399040 5764 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604448423934656 0 0 -1 6 0 0 0
[pid=25763] ppid=25739 vsize=320216 CPUtime=2.93 cores=0,2,4,6
/proc/25763/stat : 25763 (python) S 25739 25739 25078 0 -1 4202560 1003 0 0 0 159 134 0 0 15 0 1 0 658133184 327901184 5755 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 17884708913962516738 0 0 17 0 0 0 0
/proc/25763/statm: 80054 5755 371 364 0 15960 0
[pid=25765] ppid=25763 vsize=90216 CPUtime=603.44 cores=0,2,4,6
/proc/25765/stat : 25765 (march_hi) R 25763 25765 25765 0 -1 4202496 19607 0 0 0 60335 9 0 0 25 0 1 0 658133185 92381184 19348 33554432000 4194304 4955518 140737483846256 18446744073709551615 4207342 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25765/statm: 22554 19348 104 186 0 22367 0
[pid=25771] ppid=25739 vsize=330472 CPUtime=2.42 cores=0,2,4,6
/proc/25771/stat : 25771 (python) R 25739 25739 25078 0 -1 4202560 1174 0 0 0 127 115 0 0 16 0 2 0 658137995 338403328 5791 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080275591 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/25771/statm: 82619 5791 400 364 0 18522 0
[pid=25773] ppid=25771 vsize=119684 CPUtime=786.25 cores=0,2,4,6
/proc/25773/stat : 25773 (march_hi) R 25771 25773 25773 0 -1 4202496 24866 0 0 0 78618 7 0 0 25 0 1 0 658137996 122556416 24607 33554432000 4194304 4955518 140734098731872 18446744073709551615 4238717 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25773/statm: 29921 24607 104 186 0 29734 0
[pid=25771/tid=25856] ppid=25739 vsize=330472 CPUtime=0 cores=0,2,4,6
/proc/25771/task/25856/stat : 25856 (python) S 25739 25739 25078 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 658213890 338403328 5791 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604444028138432 0 0 -1 2 0 0 0
[pid=25788] ppid=25739 vsize=340968 CPUtime=1.66 cores=0,2,4,6
/proc/25788/stat : 25788 (python) S 25739 25739 25078 0 -1 4202560 1002 0 0 0 91 75 0 0 18 0 1 0 658178994 349151232 5806 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 17884708913962516737 0 0 17 2 0 0 0
/proc/25788/statm: 85242 5806 371 364 0 21142 0
[pid=25790] ppid=25788 vsize=182448 CPUtime=310.95 cores=0,2,4,6
/proc/25790/stat : 25790 (kcnfs-2006) R 25788 25790 25790 0 -1 4202496 587 0 0 0 31095 0 0 0 25 0 1 0 658178994 186826752 328 33554432000 134512640 135163436 4293562944 18446744073709551615 134675205 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25790/statm: 45612 328 77 159 0 45452 0
[pid=25796] ppid=25739 vsize=351224 CPUtime=1.46 cores=0,2,4,6
/proc/25796/stat : 25796 (python) S 25739 25739 25078 0 -1 4202560 1047 0 0 0 78 68 0 0 15 0 1 0 658188501 359653376 5816 33554432000 4194304 5683644 140733495279216 18446744073709551615 208080252486 0 0 16781312 514 17884708913962516738 0 0 17 4 0 0 0
/proc/25796/statm: 87806 5816 377 364 0 23703 0
[pid=25798] ppid=25796 vsize=75872 CPUtime=401.72 cores=0,2,4,6
/proc/25798/stat : 25798 (march_hi) R 25796 25798 25798 0 -1 4202496 13771 0 0 0 40168 4 0 0 25 0 1 0 658188502 77692928 13495 33554432000 4194304 4955518 140735260799936 18446744073709551615 4224615 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25798/statm: 18968 13495 104 186 0 18781 0
[pid=25857] ppid=25739 vsize=361932 CPUtime=0.4 cores=0,2,4,6
/proc/25857/stat : 25857 (python) S 25739 25739 25078 0 -1 4202560 1149 0 0 0 21 19 0 0 17 0 2 0 658213890 370618368 5963 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/25857/statm: 90483 5963 406 364 0 26377 0
[pid=25859] ppid=25857 vsize=17692 CPUtime=102.12 cores=0,2,4,6
/proc/25859/stat : 25859 (march_hi) T 25857 25859 25859 0 -1 4202496 4323 0 0 0 10212 0 0 0 25 0 1 0 658213891 18116608 4054 33554432000 4194304 4955518 140735806037264 18446744073709551615 4289745 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/25859/statm: 4423 4054 104 186 0 4236 0
[pid=25857/tid=25864] ppid=25739 vsize=361932 CPUtime=0 cores=0,2,4,6
/proc/25857/task/25864/stat : 25864 (python) S 25739 25739 25078 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 658228133 370618368 5963 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 514 18446604453967182528 0 0 -1 4 0 0 0
[pid=25739/tid=25746] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25746/stat : 25746 (python) S 25737 25739 25078 0 -1 4202560 40 932 0 0 0 0 0 0 25 0 10 0 658118332 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25748] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25748/stat : 25748 (python) S 25737 25739 25078 0 -1 4202560 35 932 0 0 0 0 0 0 25 0 10 0 658118333 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25751] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25751/stat : 25751 (python) S 25737 25739 25078 0 -1 4202560 18 932 0 0 0 0 0 0 25 0 10 0 658118335 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25755] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25755/stat : 25755 (python) S 25737 25739 25078 0 -1 4202560 25 932 0 0 0 0 0 0 25 0 10 0 658118336 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25764] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25764/stat : 25764 (python) S 25737 25739 25078 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 10 0 658133185 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25772] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25772/stat : 25772 (python) S 25737 25739 25078 0 -1 4202560 28 932 0 0 0 0 0 0 18 0 10 0 658137996 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25789] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25789/stat : 25789 (python) S 25737 25739 25078 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 658178994 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25797] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25797/stat : 25797 (python) S 25737 25739 25078 0 -1 4202560 23 932 0 0 0 0 0 0 20 0 10 0 658188502 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
[pid=25739/tid=25858] ppid=25737 vsize=371380 CPUtime=0 cores=0,2,4,6
/proc/25739/task/25858/stat : 25858 (python) S 25737 25739 25078 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 10 0 658213891 380293120 7245 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 2 18446604441208660288 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3195.9
Current children cumulated vsize (KiB) 5897392

[startup+1232.2 s]
/proc/loadavg: 10.26 10.19 9.58 12/383 25868
/proc/meminfo: memFree=11137188/32950928 swapFree=67083212/67111528
[pid=25739] ppid=25737 vsize=320472 CPUtime=3196.44 cores=0,2,4,6
/proc/25739/stat : 25739 (python) R 25737 25739 25078 0 -1 4202496 19515 102042 1 0 45 10 318946 643 16 0 2 0 658118277 328163328 7315 33554432000 4194304 5683644 140733495279216 18446744073709551615 4438573 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/25739/statm: 80118 7315 1867 364 0 16041 0
[pid=25739/tid=25772] ppid=25737 vsize=320472 CPUtime=3195.89 cores=0,2,4,6
/proc/25739/task/25772/stat : 25772 (python) S 25737 25739 25078 0 -1 4202560 28 102042 0 0 0 0 318946 643 18 0 2 0 658137996 328163328 7315 33554432000 4194304 5683644 140733495279216 18446744073709551615 208092055985 0 0 16781312 0 18446604441208660288 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3196.44
Current children cumulated vsize (KiB) 320472

Child status: 0
Real time (s): 1232.21
CPU time (s): 3196.48
CPU user time (s): 3189.93
CPU system time (s): 6.55
CPU usage (%): 259.41
Max. virtual memory (cumulated for all children) (KiB): 5897392

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3189.93
system time used= 6.55
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 123124
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8932
involuntary context switches= 31551

runsolver used 5.2862 second user time and 11.2283 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-15 15:13:06
IDJOB=3378381
IDBENCH=82790
IDSOLVER=1859
FILE ID=node127/3378381-1305465186
RUNJOBID= node127-1305463542-25096
PBS_JOBID= 13325002
Free space on /tmp= 73464 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v500-c2130-S1383368897-031.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378381-1305465186/watcher-3378381-1305465186 -o /tmp/evaluation-result-3378381-1305465186/solver-3378381-1305465186 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378381-1305465186.cnf -seed 1815956075 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4d20714634af5755393f1c67cf27956c
RANDOM SEED=1815956075

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      11587644 kB
Buffers:        317760 kB
Cached:        4164540 kB
SwapCached:       1620 kB
Active:       18136556 kB
Inactive:      2876216 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      11587644 kB
SwapTotal:    67111528 kB
SwapFree:     67083212 kB
Dirty:           32736 kB
Writeback:           0 kB
AnonPages:    16528392 kB
Mapped:          35964 kB
Slab:           230520 kB
PageTables:      55940 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 62433320 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73432 MiB
End job on node127 at 2011-05-15 15:33:38