Trace number 3322132

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 229.156 29.3289

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v400-c1704-S895193371-061.UNKNOWN.cnf
MD5SUM737aa440f80cd8be0050a0f138c79eb6
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark27.2119
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses1704
Sum of the clauses size5112
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31704
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.33/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.33/0.47	c INFO: solving HOME/instance-3322132-1304375053.cnf
0.33/0.47	c INFO: computing task features
0.33/0.48	c INFO: computed variable-clause graph statistics
0.33/0.48	c INFO: computed clause balance statistics
0.41/0.51	c INFO: computed variable balance statistics
0.41/0.53	c INFO: computed small-clause counts
0.41/0.53	c INFO: computed Horn-clause counts
0.41/0.54	c INFO: computed variable graph statistics
0.41/0.54	c INFO: collected features for HOME/instance-3322132-1304375053.cnf in 0.06 s
0.41/0.57	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.56)
0.51/0.61	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.39)
0.51/0.65	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.38)
0.51/0.68	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.35)
0.61/0.72	c INFO: running march_hi@0 for 97 with 39999 remaining (b = 0.11)
0.61/0.76	c INFO: running TNM@0 for 97 with 39999 remaining (b = 0.07)
0.72/0.81	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.24)
0.72/0.85	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.21)
229.02/29.30	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322132-1304375053/watcher-3322132-1304375053 -o /tmp/evaluation-result-3322132-1304375053/solver-3322132-1304375053 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322132-1304375053.cnf -seed 883508955 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.51 8.53 8.40 1/296 24583
/proc/meminfo: memFree=21099692/32951124 swapFree=67111524/67111528
[pid=24583] ppid=24581 vsize=15780 CPUtime=0 cores=0-7
/proc/24583/stat : 24583 (python) R 24581 24583 23451 0 -1 4202496 917 0 0 0 0 0 0 0 25 0 1 0 529921137 16158720 796 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510340743 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/24583/statm: 3945 798 347 364 0 432 0

[startup+0.033573 s]
/proc/loadavg: 8.51 8.53 8.40 1/296 24583
/proc/meminfo: memFree=21099692/32951124 swapFree=67111524/67111528
[pid=24583] ppid=24581 vsize=18888 CPUtime=0.02 cores=0-7
/proc/24583/stat : 24583 (python) R 24581 24583 23451 0 -1 4202496 1284 0 0 0 2 0 0 0 25 0 1 0 529921137 19341312 1136 33554432000 4194304 5683644 140735982069424 18446744073709551615 4318891 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/24583/statm: 4722 1136 421 364 0 691 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18888

[startup+0.100561 s]
/proc/loadavg: 8.51 8.53 8.40 1/296 24583
/proc/meminfo: memFree=21099692/32951124 swapFree=67111524/67111528
[pid=24583] ppid=24581 vsize=104220 CPUtime=0.07 cores=0-7
/proc/24583/stat : 24583 (python) R 24581 24583 23451 0 -1 4202496 3047 0 0 0 5 2 0 0 25 0 1 0 529921137 106721280 2731 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510295552 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/24583/statm: 26055 2731 847 364 0 1803 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104220

[startup+0.300523 s]
/proc/loadavg: 8.51 8.53 8.40 1/296 24583
/proc/meminfo: memFree=21099692/32951124 swapFree=67111524/67111528
[pid=24583] ppid=24581 vsize=166548 CPUtime=0.24 cores=0-7
/proc/24583/stat : 24583 (python) S 24581 24583 23451 0 -1 4202496 6695 936 1 0 18 6 0 0 17 0 1 0 529921137 170545152 4780 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510295552 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/24583/statm: 41637 4780 1322 364 0 3454 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 166548

[startup+0.700445 s]
/proc/loadavg: 8.51 8.53 8.40 1/296 24583
/proc/meminfo: memFree=21099692/32951124 swapFree=67111524/67111528
[pid=24583] ppid=24581 vsize=385600 CPUtime=0.61 cores=0-7
/proc/24583/stat : 24583 (python) R 24581 24583 23451 0 -1 4202496 12528 936 1 0 51 10 0 0 18 0 5 0 529921137 394854400 7474 33554432000 4194304 5683644 140735982069424 18446744073709551615 233513736119 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/24583/statm: 96400 7474 1880 364 0 32309 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 385600

[startup+1.50127 s]
/proc/loadavg: 8.51 8.53 8.40 9/321 24612
/proc/meminfo: memFree=21044304/32951124 swapFree=67111524/67111528
[pid=24583] ppid=24581 vsize=426624 CPUtime=0.76 cores=0-7
/proc/24583/stat : 24583 (python) S 24581 24583 23451 0 -1 4202496 15260 936 1 0 65 11 0 0 19 0 9 0 529921137 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/24583/statm: 106656 7387 1889 364 0 42553 0
[pid=24589] ppid=24583 vsize=278640 CPUtime=0 cores=0-7
/proc/24589/stat : 24589 (python) S 24583 24583 23451 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 529921195 285327360 5576 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317583 0 0 16781312 514 4259517121270120447 0 0 17 1 0 0 0
/proc/24589/statm: 69660 5576 354 364 0 5578 0
[pid=24591] ppid=24589 vsize=1017800 CPUtime=0.91 cores=0-7
/proc/24591/stat : 24591 (gnovelty+2) R 24589 24591 24591 0 -1 4202496 430 0 0 0 91 0 0 0 21 0 1 0 529921195 1042227200 168 33554432000 134512640 135663704 4290403888 18446744073709551615 134524923 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24591/statm: 254450 168 113 282 0 254166 0
[pid=24592] ppid=24583 vsize=289308 CPUtime=0 cores=0-7
/proc/24592/stat : 24592 (python) S 24583 24583 23451 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 529921198 296251392 5684 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 5633325838972715265 0 0 17 7 0 0 0
/proc/24592/statm: 72327 5684 348 364 0 8242 0
[pid=24594] ppid=24592 vsize=1972 CPUtime=0.88 cores=0-7
/proc/24594/stat : 24594 (march_hi) R 24592 24594 24594 0 -1 4202496 578 0 0 0 88 0 0 0 25 0 1 0 529921198 2019328 315 33554432000 4194304 4955518 140734492560736 18446744073709551615 4224687 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/24594/statm: 493 315 104 186 0 306 0
[pid=24595] ppid=24583 vsize=365100 CPUtime=0 cores=0-7
/proc/24595/stat : 24595 (python) S 24583 24583 23451 0 -1 4202560 718 0 0 0 0 0 0 0 15 0 1 0 529921202 373862400 5861 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 4441508285899571460 0 0 17 1 0 0 0
/proc/24595/statm: 91275 5861 348 364 0 27187 0
[pid=24597] ppid=24595 vsize=1972 CPUtime=0.84 cores=0-7
/proc/24597/stat : 24597 (march_hi) R 24595 24597 24597 0 -1 4202496 570 0 0 0 84 0 0 0 25 0 1 0 529921202 2019328 316 33554432000 4194304 4955518 140737477881744 18446744073709551615 4282766 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/24597/statm: 493 316 104 186 0 306 0
[pid=24598] ppid=24583 vsize=375356 CPUtime=0 cores=0-7
/proc/24598/stat : 24598 (python) S 24583 24583 23451 0 -1 4202560 722 0 0 0 0 0 0 0 15 0 1 0 529921206 384364544 5819 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 5010360142860878082 0 0 17 1 0 0 0
/proc/24598/statm: 93839 5819 348 364 0 29748 0
[pid=24600] ppid=24598 vsize=1972 CPUtime=0.8 cores=0-7
/proc/24600/stat : 24600 (march_hi) R 24598 24600 24600 0 -1 4202496 570 0 0 0 80 0 0 0 25 0 1 0 529921206 2019328 315 33554432000 4194304 4955518 140735662203664 18446744073709551615 4238735 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/24600/statm: 493 315 104 186 0 306 0
[pid=24601] ppid=24583 vsize=385612 CPUtime=0 cores=0-7
/proc/24601/stat : 24601 (python) S 24583 24583 23451 0 -1 4202560 734 0 0 0 0 0 0 0 15 0 1 0 529921209 394866688 5942 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 16231069818361446660 0 0 17 7 0 0 0
/proc/24601/statm: 96403 5942 348 364 0 32309 0
[pid=24603] ppid=24601 vsize=1972 CPUtime=0.75 cores=0-7
/proc/24603/stat : 24603 (march_hi) R 24601 24603 24603 0 -1 4202496 573 0 0 0 75 0 0 0 22 0 1 0 529921210 2019328 315 33554432000 4194304 4955518 140737026704176 18446744073709551615 4238910 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24603/statm: 493 315 104 186 0 306 0
[pid=24604] ppid=24583 vsize=395868 CPUtime=0 cores=0-7
/proc/24604/stat : 24604 (python) S 24583 24583 23451 0 -1 4202560 715 0 0 0 0 0 0 0 21 0 1 0 529921214 405368832 5942 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 4520796818157600767 0 0 17 4 0 0 0
/proc/24604/statm: 98967 5942 344 364 0 34870 0
[pid=24606] ppid=24604 vsize=454908 CPUtime=0.72 cores=0-7
/proc/24606/stat : 24606 (TNM) R 24604 24606 24606 0 -1 4202496 418 0 0 0 72 0 0 0 25 0 1 0 529921214 465825792 160 33554432000 134512640 135008748 4294581712 18446744073709551615 134527367 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24606/statm: 113727 160 46 122 0 112627 0
[pid=24607] ppid=24583 vsize=406124 CPUtime=0 cores=0-7
/proc/24607/stat : 24607 (python) S 24583 24583 23451 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 529921218 415870976 5855 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 4765441728750518531 0 0 17 1 0 0 0
/proc/24607/statm: 101531 5855 348 364 0 37431 0
[pid=24609] ppid=24607 vsize=1972 CPUtime=0.62 cores=0-7
/proc/24609/stat : 24609 (march_hi) R 24607 24609 24609 0 -1 4202496 568 0 0 0 62 0 0 0 22 0 1 0 529921220 2019328 309 33554432000 4194304 4955518 140736534276608 18446744073709551615 4227502 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/24609/statm: 493 309 104 186 0 306 0
[pid=24610] ppid=24583 vsize=416380 CPUtime=0 cores=0-7
/proc/24610/stat : 24610 (python) S 24583 24583 23451 0 -1 4202560 780 0 0 0 0 0 0 0 15 0 1 0 529921222 426373120 5848 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 4765454922890051841 0 0 17 1 0 0 0
/proc/24610/statm: 104095 5848 354 364 0 39992 0
[pid=24612] ppid=24610 vsize=1972 CPUtime=0.63 cores=0-7
/proc/24612/stat : 24612 (march_hi) R 24610 24612 24612 0 -1 4202496 572 0 0 0 63 0 0 0 24 0 1 0 529921223 2019328 308 33554432000 4194304 4955518 140733594508304 18446744073709551615 4209692 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24612/statm: 493 308 104 186 0 306 0
[pid=24583/tid=24590] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24590/stat : 24590 (python) S 24581 24583 23451 0 -1 4202560 25 936 0 0 0 0 0 0 18 0 9 0 529921195 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24593] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24593/stat : 24593 (python) S 24581 24583 23451 0 -1 4202560 22 936 0 0 0 0 0 0 18 0 9 0 529921198 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 3 0 0 0
[pid=24583/tid=24596] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24596/stat : 24596 (python) S 24581 24583 23451 0 -1 4202560 73 936 0 0 0 0 0 0 20 0 9 0 529921202 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24599] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24599/stat : 24599 (python) S 24581 24583 23451 0 -1 4202560 30 936 0 0 0 0 0 0 21 0 9 0 529921206 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 5 0 0 0
[pid=24583/tid=24602] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24602/stat : 24602 (python) S 24581 24583 23451 0 -1 4202560 35 936 0 0 0 0 0 0 20 0 9 0 529921210 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 4 0 0 0
[pid=24583/tid=24605] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24605/stat : 24605 (python) S 24581 24583 23451 0 -1 4202560 31 936 0 0 0 0 0 0 22 0 9 0 529921214 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 4 0 0 0
[pid=24583/tid=24608] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24608/stat : 24608 (python) S 24581 24583 23451 0 -1 4202560 32 936 0 0 0 0 0 0 19 0 9 0 529921218 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24611] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24611/stat : 24611 (python) S 24581 24583 23451 0 -1 4202560 72 936 0 0 0 0 0 0 20 0 9 0 529921222 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 6.91
Current children cumulated vsize (KiB) 4823552

[startup+3.10098 s]
/proc/loadavg: 8.51 8.53 8.40 9/321 24612
/proc/meminfo: memFree=21042940/32951124 swapFree=67111524/67111528
[pid=24583] ppid=24581 vsize=426624 CPUtime=0.76 cores=0-7
/proc/24583/stat : 24583 (python) S 24581 24583 23451 0 -1 4202496 15260 936 1 0 65 11 0 0 19 0 9 0 529921137 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/24583/statm: 106656 7387 1889 364 0 42553 0
[pid=24589] ppid=24583 vsize=278640 CPUtime=0 cores=0-7
/proc/24589/stat : 24589 (python) S 24583 24583 23451 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 529921195 285327360 5576 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317583 0 0 16781312 514 4259517121270087937 0 0 17 1 0 0 0
/proc/24589/statm: 69660 5576 354 364 0 5578 0
[pid=24591] ppid=24589 vsize=1017800 CPUtime=2.51 cores=0-7
/proc/24591/stat : 24591 (gnovelty+2) R 24589 24591 24591 0 -1 4202496 430 0 0 0 251 0 0 0 25 0 1 0 529921195 1042227200 168 33554432000 134512640 135663704 4290403888 18446744073709551615 134525332 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24591/statm: 254450 168 113 282 0 254166 0
[pid=24592] ppid=24583 vsize=289308 CPUtime=0 cores=0-7
/proc/24592/stat : 24592 (python) S 24583 24583 23451 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 529921198 296251392 5684 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 5633325838972715265 0 0 17 7 0 0 0
/proc/24592/statm: 72327 5684 348 364 0 8242 0
[pid=24594] ppid=24592 vsize=2128 CPUtime=2.48 cores=0-7
/proc/24594/stat : 24594 (march_hi) R 24592 24594 24594 0 -1 4202496 601 0 0 0 248 0 0 0 25 0 1 0 529921198 2179072 338 33554432000 4194304 4955518 140734492560736 18446744073709551615 4307015 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/24594/statm: 532 338 104 186 0 345 0
[pid=24595] ppid=24583 vsize=365100 CPUtime=0 cores=0-7
/proc/24595/stat : 24595 (python) S 24583 24583 23451 0 -1 4202560 719 0 0 0 0 0 0 0 15 0 1 0 529921202 373862400 5861 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 5010364540907389188 0 0 17 1 0 0 0
/proc/24595/statm: 91275 5861 348 364 0 27187 0
[pid=24597] ppid=24595 vsize=2128 CPUtime=2.44 cores=0-7
/proc/24597/stat : 24597 (march_hi) R 24595 24597 24597 0 -1 4202496 593 0 0 0 244 0 0 0 25 0 1 0 529921202 2179072 339 33554432000 4194304 4955518 140737477881744 18446744073709551615 4238727 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/24597/statm: 532 339 104 186 0 345 0
[pid=24598] ppid=24583 vsize=375356 CPUtime=0 cores=0-7
/proc/24598/stat : 24598 (python) S 24583 24583 23451 0 -1 4202560 723 0 0 0 0 0 0 0 15 0 1 0 529921206 384364544 5819 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 5010360142860878082 0 0 17 1 0 0 0
/proc/24598/statm: 93839 5819 348 364 0 29748 0
[pid=24600] ppid=24598 vsize=2128 CPUtime=2.4 cores=0-7
/proc/24600/stat : 24600 (march_hi) R 24598 24600 24600 0 -1 4202496 593 0 0 0 240 0 0 0 25 0 1 0 529921206 2179072 338 33554432000 4194304 4955518 140735662203664 18446744073709551615 4263703 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/24600/statm: 532 338 104 186 0 345 0
[pid=24601] ppid=24583 vsize=385612 CPUtime=0 cores=0-7
/proc/24601/stat : 24601 (python) S 24583 24583 23451 0 -1 4202560 736 0 0 0 0 0 0 0 15 0 1 0 529921209 394866688 5942 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 16231069818361446660 0 0 17 7 0 0 0
/proc/24601/statm: 96403 5942 348 364 0 32309 0
[pid=24603] ppid=24601 vsize=2128 CPUtime=2.34 cores=0-7
/proc/24603/stat : 24603 (march_hi) R 24601 24603 24603 0 -1 4202496 595 0 0 0 234 0 0 0 25 0 1 0 529921210 2179072 337 33554432000 4194304 4955518 140737026704176 18446744073709551615 4227671 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24603/statm: 532 337 104 186 0 345 0
[pid=24604] ppid=24583 vsize=395868 CPUtime=0 cores=0-7
/proc/24604/stat : 24604 (python) S 24583 24583 23451 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 529921214 405368832 5946 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 4520796818157568258 0 0 17 4 0 0 0
/proc/24604/statm: 98967 5946 348 364 0 34870 0
[pid=24606] ppid=24604 vsize=454908 CPUtime=2.32 cores=0-7
/proc/24606/stat : 24606 (TNM) R 24604 24606 24606 0 -1 4202496 418 0 0 0 232 0 0 0 25 0 1 0 529921214 465825792 160 33554432000 134512640 135008748 4294581712 18446744073709551615 134527542 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24606/statm: 113727 160 46 122 0 112627 0
[pid=24607] ppid=24583 vsize=406124 CPUtime=0 cores=0-7
/proc/24607/stat : 24607 (python) S 24583 24583 23451 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 529921218 415870976 5855 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 4765441728750518531 0 0 17 1 0 0 0
/proc/24607/statm: 101531 5855 348 364 0 37431 0
[pid=24609] ppid=24607 vsize=2128 CPUtime=2.22 cores=0-7
/proc/24609/stat : 24609 (march_hi) R 24607 24609 24609 0 -1 4202496 597 0 0 0 222 0 0 0 25 0 1 0 529921220 2179072 338 33554432000 4194304 4955518 140736534276608 18446744073709551615 4209737 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/24609/statm: 532 338 104 186 0 345 0
[pid=24610] ppid=24583 vsize=416380 CPUtime=0 cores=0-7
/proc/24610/stat : 24610 (python) S 24583 24583 23451 0 -1 4202560 781 0 0 0 0 0 0 0 15 0 1 0 529921222 426373120 5848 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 4765454922890051841 0 0 17 1 0 0 0
/proc/24610/statm: 104095 5848 354 364 0 39992 0
[pid=24612] ppid=24610 vsize=2128 CPUtime=2.23 cores=0-7
/proc/24612/stat : 24612 (march_hi) R 24610 24612 24612 0 -1 4202496 601 0 0 0 223 0 0 0 25 0 1 0 529921223 2179072 337 33554432000 4194304 4955518 140733594508304 18446744073709551615 4227664 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24612/statm: 532 337 104 186 0 345 0
[pid=24583/tid=24590] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24590/stat : 24590 (python) S 24581 24583 23451 0 -1 4202560 25 936 0 0 0 0 0 0 18 0 9 0 529921195 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24593] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24593/stat : 24593 (python) S 24581 24583 23451 0 -1 4202560 22 936 0 0 0 0 0 0 18 0 9 0 529921198 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 3 0 0 0
[pid=24583/tid=24596] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24596/stat : 24596 (python) S 24581 24583 23451 0 -1 4202560 73 936 0 0 0 0 0 0 20 0 9 0 529921202 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24599] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24599/stat : 24599 (python) S 24581 24583 23451 0 -1 4202560 30 936 0 0 0 0 0 0 21 0 9 0 529921206 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 5 0 0 0
[pid=24583/tid=24602] ppid=24581 vsize=426624 CPUtime=0 cores=0-7

################
# More data... #
################

[pid=24592] ppid=24583 vsize=289308 CPUtime=0.68 cores=0-7
/proc/24592/stat : 24592 (python) S 24583 24583 23451 0 -1 4202560 935 0 0 0 57 11 0 0 16 0 1 0 529921198 296251392 5707 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 3 0 0 0
/proc/24592/statm: 72327 5707 371 364 0 8242 0
[pid=24594] ppid=24592 vsize=0 CPUtime=27.46 cores=0-7
/proc/24594/stat : 24594 (march_hi) R 24592 24594 24594 0 -1 4202500 1067 0 0 0 2746 0 0 0 25 0 1 0 529921198 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/24594/statm: 0 0 0 0 0 0 0
[pid=24595] ppid=24583 vsize=365100 CPUtime=0.6 cores=0-7
/proc/24595/stat : 24595 (python) R 24583 24583 23451 0 -1 4202560 815 0 0 0 49 11 0 0 16 0 1 0 529921202 373862400 5884 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/24595/statm: 91275 5884 371 364 0 27187 0
[pid=24597] ppid=24595 vsize=0 CPUtime=27.46 cores=0-7
/proc/24597/stat : 24597 (march_hi) R 24595 24597 24597 0 -1 4202500 1059 0 0 0 2746 0 0 0 25 0 1 0 529921202 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/24597/statm: 0 0 0 0 0 0 0
[pid=24598] ppid=24583 vsize=375356 CPUtime=0.4 cores=0-7
/proc/24598/stat : 24598 (python) R 24583 24583 23451 0 -1 4202560 803 0 0 0 32 8 0 0 16 0 1 0 529921206 384364544 5842 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/24598/statm: 93839 5842 371 364 0 29748 0
[pid=24600] ppid=24598 vsize=0 CPUtime=27.6 cores=0-7
/proc/24600/stat : 24600 (march_hi) R 24598 24600 24600 0 -1 4202500 1059 0 0 0 2760 0 0 0 25 0 1 0 529921206 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/24600/statm: 0 0 0 0 0 0 0
[pid=24601] ppid=24583 vsize=385612 CPUtime=0.07 cores=0-7
/proc/24601/stat : 24601 (python) S 24583 24583 23451 0 -1 4202560 836 0 0 0 5 2 0 0 15 0 1 0 529921209 394866688 5965 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 16231069818361446660 0 0 17 7 0 0 0
/proc/24601/statm: 96403 5965 371 364 0 32309 0
[pid=24603] ppid=24601 vsize=4044 CPUtime=27.54 cores=0-7
/proc/24603/stat : 24603 (march_hi) R 24601 24603 24603 0 -1 4202496 1060 0 0 0 2754 0 0 0 25 0 1 0 529921210 4141056 802 33554432000 4194304 4955518 140737026704176 18446744073709551615 4286689 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24603/statm: 1011 802 104 186 0 824 0
[pid=24604] ppid=24583 vsize=395868 CPUtime=0.04 cores=0-7
/proc/24604/stat : 24604 (python) S 24583 24583 23451 0 -1 4202560 810 0 0 0 1 3 0 0 18 0 1 0 529921214 405368832 5969 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 3164763900646228226 0 0 17 4 0 0 0
/proc/24604/statm: 98967 5969 371 364 0 34870 0
[pid=24606] ppid=24604 vsize=454908 CPUtime=27.87 cores=0-7
/proc/24606/stat : 24606 (TNM) R 24604 24606 24606 0 -1 4202496 418 0 0 0 2787 0 0 0 25 0 1 0 529921214 465825792 160 33554432000 134512640 135008748 4294581712 18446744073709551615 134527722 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24606/statm: 113727 160 46 122 0 112627 0
[pid=24607] ppid=24583 vsize=406124 CPUtime=0.08 cores=0-7
/proc/24607/stat : 24607 (python) S 24583 24583 23451 0 -1 4202560 844 0 0 0 5 3 0 0 15 0 1 0 529921218 415870976 5878 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 5602248318907285763 0 0 17 1 0 0 0
/proc/24607/statm: 101531 5878 371 364 0 37431 0
[pid=24609] ppid=24607 vsize=4044 CPUtime=27.59 cores=0-7
/proc/24609/stat : 24609 (march_hi) R 24607 24609 24609 0 -1 4202496 1063 0 0 0 2759 0 0 0 25 0 1 0 529921220 4141056 804 33554432000 4194304 4955518 140736534276608 18446744073709551615 4224682 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/24609/statm: 1011 804 104 186 0 824 0
[pid=24610] ppid=24583 vsize=416380 CPUtime=0.4 cores=0-7
/proc/24610/stat : 24610 (python) R 24583 24583 23451 0 -1 4202560 879 0 0 0 33 7 0 0 16 0 1 0 529921222 426373120 5871 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/24610/statm: 104095 5871 377 364 0 39992 0
[pid=24612] ppid=24610 vsize=0 CPUtime=27.46 cores=0-7
/proc/24612/stat : 24612 (march_hi) R 24610 24612 24612 0 -1 4202500 1068 0 0 0 2746 0 0 0 25 0 1 0 529921223 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24612/statm: 0 0 0 0 0 0 0
[pid=24583/tid=24590] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24590/stat : 24590 (python) S 24581 24583 23451 0 -1 4202560 25 936 0 0 0 0 0 0 18 0 9 0 529921195 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24593] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24593/stat : 24593 (python) S 24581 24583 23451 0 -1 4202560 22 936 0 0 0 0 0 0 18 0 9 0 529921198 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 3 0 0 0
[pid=24583/tid=24596] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24596/stat : 24596 (python) S 24581 24583 23451 0 -1 4202560 73 936 0 0 0 0 0 0 20 0 9 0 529921202 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24599] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24599/stat : 24599 (python) S 24581 24583 23451 0 -1 4202560 30 936 0 0 0 0 0 0 21 0 9 0 529921206 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 5 0 0 0
[pid=24583/tid=24602] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24602/stat : 24602 (python) S 24581 24583 23451 0 -1 4202560 35 936 0 0 0 0 0 0 20 0 9 0 529921210 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 4 0 0 0
[pid=24583/tid=24605] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24605/stat : 24605 (python) S 24581 24583 23451 0 -1 4202560 31 936 0 0 0 0 0 0 22 0 9 0 529921214 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 4 0 0 0
[pid=24583/tid=24608] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24608/stat : 24608 (python) S 24581 24583 23451 0 -1 4202560 32 936 0 0 0 0 0 0 19 0 9 0 529921218 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24611] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24611/stat : 24611 (python) S 24581 24583 23451 0 -1 4202560 72 936 0 0 0 0 0 0 20 0 9 0 529921222 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 224.18
Current children cumulated vsize (KiB) 4819808

[startup+29.2013 s]
/proc/loadavg: 8.31 8.48 8.38 13/321 24613
/proc/meminfo: memFree=21043616/32951124 swapFree=67111524/67111528
[pid=24583] ppid=24581 vsize=426624 CPUtime=0.76 cores=0-7
/proc/24583/stat : 24583 (python) S 24581 24583 23451 0 -1 4202496 15260 936 1 0 65 11 0 0 19 0 9 0 529921137 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/24583/statm: 106656 7387 1889 364 0 42553 0
[pid=24589] ppid=24583 vsize=278640 CPUtime=0.06 cores=0-7
/proc/24589/stat : 24589 (python) S 24583 24583 23451 0 -1 4202560 907 0 0 0 3 3 0 0 18 0 1 0 529921195 285327360 5599 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317583 0 0 16781312 514 3164763900646228225 0 0 17 1 0 0 0
/proc/24589/statm: 69660 5599 377 364 0 5578 0
[pid=24591] ppid=24589 vsize=1017800 CPUtime=28.61 cores=0-7
/proc/24591/stat : 24591 (gnovelty+2) R 24589 24591 24591 0 -1 4202496 430 0 0 0 2861 0 0 0 25 0 1 0 529921195 1042227200 168 33554432000 134512640 135663704 4290403888 18446744073709551615 134524594 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24591/statm: 254450 168 113 282 0 254166 0
[pid=24592] ppid=24583 vsize=289308 CPUtime=1.18 cores=0-7
/proc/24592/stat : 24592 (python) S 24583 24583 23451 0 -1 4202560 935 0 0 0 100 18 0 0 17 0 1 0 529921198 296251392 5707 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 3 0 0 0
/proc/24592/statm: 72327 5707 371 364 0 8242 0
[pid=24594] ppid=24592 vsize=0 CPUtime=27.46 cores=0-7
/proc/24594/stat : 24594 (march_hi) R 24592 24594 24594 0 -1 4202500 1067 0 0 0 2746 0 0 0 25 0 1 0 529921198 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/24594/statm: 0 0 0 0 0 0 0
[pid=24595] ppid=24583 vsize=365100 CPUtime=1.1 cores=0-7
/proc/24595/stat : 24595 (python) R 24583 24583 23451 0 -1 4202560 815 0 0 0 91 19 0 0 16 0 1 0 529921202 373862400 5884 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/24595/statm: 91275 5884 371 364 0 27187 0
[pid=24597] ppid=24595 vsize=0 CPUtime=27.46 cores=0-7
/proc/24597/stat : 24597 (march_hi) R 24595 24597 24597 0 -1 4202500 1059 0 0 0 2746 0 0 0 25 0 1 0 529921202 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/24597/statm: 0 0 0 0 0 0 0
[pid=24598] ppid=24583 vsize=375356 CPUtime=0.9 cores=0-7
/proc/24598/stat : 24598 (python) R 24583 24583 23451 0 -1 4202560 803 0 0 0 75 15 0 0 16 0 1 0 529921206 384364544 5842 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/24598/statm: 93839 5842 371 364 0 29748 0
[pid=24600] ppid=24598 vsize=0 CPUtime=27.6 cores=0-7
/proc/24600/stat : 24600 (march_hi) R 24598 24600 24600 0 -1 4202500 1059 0 0 0 2760 0 0 0 25 0 1 0 529921206 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/24600/statm: 0 0 0 0 0 0 0
[pid=24601] ppid=24583 vsize=385612 CPUtime=0.48 cores=0-7
/proc/24601/stat : 24601 (python) R 24583 24583 23451 0 -1 4202560 838 0 0 0 40 8 0 0 16 0 1 0 529921209 394866688 5965 33554432000 4194304 5683644 140735982069424 18446744073709551615 4960852 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/24601/statm: 96403 5965 371 364 0 32309 0
[pid=24603] ppid=24601 vsize=0 CPUtime=27.63 cores=0-7
/proc/24603/stat : 24603 (march_hi) R 24601 24603 24603 0 -1 4202500 1062 0 0 0 2763 0 0 0 25 0 1 0 529921210 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/24603/statm: 0 0 0 0 0 0 0
[pid=24604] ppid=24583 vsize=395868 CPUtime=0.06 cores=0-7
/proc/24604/stat : 24604 (python) S 24583 24583 23451 0 -1 4202560 810 0 0 0 2 4 0 0 18 0 1 0 529921214 405368832 5969 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 3164763900646228226 0 0 17 4 0 0 0
/proc/24604/statm: 98967 5969 371 364 0 34870 0
[pid=24606] ppid=24604 vsize=454908 CPUtime=28.36 cores=0-7
/proc/24606/stat : 24606 (TNM) R 24604 24606 24606 0 -1 4202496 418 0 0 0 2836 0 0 0 25 0 1 0 529921214 465825792 160 33554432000 134512640 135008748 4294581712 18446744073709551615 134528491 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24606/statm: 113727 160 46 122 0 112627 0
[pid=24607] ppid=24583 vsize=406124 CPUtime=0.53 cores=0-7
/proc/24607/stat : 24607 (python) R 24583 24583 23451 0 -1 4202560 844 0 0 0 45 8 0 0 16 0 1 0 529921218 415870976 5878 33554432000 4194304 5683644 140735982069424 18446744073709551615 233510317638 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/24607/statm: 101531 5878 371 364 0 37431 0
[pid=24609] ppid=24607 vsize=0 CPUtime=27.64 cores=0-7
/proc/24609/stat : 24609 (march_hi) R 24607 24609 24609 0 -1 4202500 1064 0 0 0 2764 0 0 0 25 0 1 0 529921220 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/24609/statm: 0 0 0 0 0 0 0
[pid=24610] ppid=24583 vsize=416380 CPUtime=0.9 cores=0-7
/proc/24610/stat : 24610 (python) R 24583 24583 23451 0 -1 4202560 879 0 0 0 76 14 0 0 16 0 1 0 529921222 426373120 5871 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522127679 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/24610/statm: 104095 5871 377 364 0 39992 0
[pid=24612] ppid=24610 vsize=0 CPUtime=27.46 cores=0-7
/proc/24612/stat : 24612 (march_hi) R 24610 24612 24612 0 -1 4202500 1068 0 0 0 2746 0 0 0 25 0 1 0 529921223 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24612/statm: 0 0 0 0 0 0 0
[pid=24583/tid=24590] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24590/stat : 24590 (python) S 24581 24583 23451 0 -1 4202560 25 936 0 0 0 0 0 0 18 0 9 0 529921195 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24593] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24593/stat : 24593 (python) S 24581 24583 23451 0 -1 4202560 22 936 0 0 0 0 0 0 18 0 9 0 529921198 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 3 0 0 0
[pid=24583/tid=24596] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24596/stat : 24596 (python) S 24581 24583 23451 0 -1 4202560 73 936 0 0 0 0 0 0 20 0 9 0 529921202 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24599] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24599/stat : 24599 (python) S 24581 24583 23451 0 -1 4202560 30 936 0 0 0 0 0 0 21 0 9 0 529921206 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 5 0 0 0
[pid=24583/tid=24602] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24602/stat : 24602 (python) S 24581 24583 23451 0 -1 4202560 35 936 0 0 0 0 0 0 20 0 9 0 529921210 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 4 0 0 0
[pid=24583/tid=24605] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24605/stat : 24605 (python) S 24581 24583 23451 0 -1 4202560 31 936 0 0 0 0 0 0 22 0 9 0 529921214 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 4 0 0 0
[pid=24583/tid=24608] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24608/stat : 24608 (python) S 24581 24583 23451 0 -1 4202560 32 936 0 0 0 0 0 0 19 0 9 0 529921218 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24611] ppid=24581 vsize=426624 CPUtime=0 cores=0-7
/proc/24583/task/24611/stat : 24611 (python) S 24581 24583 23451 0 -1 4202560 72 936 0 0 0 0 0 0 20 0 9 0 529921222 436862976 7387 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 228.19
Current children cumulated vsize (KiB) 4811720

[startup+29.3013 s]
/proc/loadavg: 8.31 8.48 8.38 13/321 24613
/proc/meminfo: memFree=21043616/32951124 swapFree=67111524/67111528
[pid=24583] ppid=24581 vsize=426624 CPUtime=115.39 cores=0-7
/proc/24583/stat : 24583 (python) S 24581 24583 23451 0 -1 4202496 15289 8783 1 0 65 11 11406 57 17 0 9 0 529921137 436862976 7388 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522127679 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/24583/statm: 106656 7388 1890 364 0 42553 0
[pid=24595] ppid=24583 vsize=0 CPUtime=28.66 cores=0-7
/proc/24595/stat : 24595 (python) Z 24583 24583 23451 0 -1 4202588 1110 1059 0 0 100 20 2746 0 18 0 1 0 529921202 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24595/statm: 0 0 0 0 0 0 0
[pid=24601] ppid=24583 vsize=0 CPUtime=28.2 cores=0-7
/proc/24601/stat : 24601 (python) Z 24583 24583 23451 0 -1 4202588 1102 1062 0 0 48 9 2763 0 17 0 1 0 529921209 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 7 0 0 0
/proc/24601/statm: 0 0 0 0 0 0 0
[pid=24604] ppid=24583 vsize=0 CPUtime=28.51 cores=0-7
/proc/24604/stat : 24604 (python) R 24583 24583 23451 0 -1 4202564 855 418 0 0 2 4 2845 0 15 0 1 0 529921214 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 4 0 0 0
/proc/24604/statm: 0 0 0 0 0 0 0
[pid=24607] ppid=24583 vsize=0 CPUtime=28.26 cores=0-7
/proc/24607/stat : 24607 (python) Z 24583 24583 23451 0 -1 4202588 1140 1064 0 0 53 9 2764 0 17 0 1 0 529921218 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 1 0 0 0
/proc/24607/statm: 0 0 0 0 0 0 0
[pid=24583/tid=24590] ppid=24581 vsize=426624 CPUtime=114.63 cores=0-7
/proc/24583/task/24590/stat : 24590 (python) S 24581 24583 23451 0 -1 4202560 25 8783 0 0 0 0 11406 57 18 0 9 0 529921195 436862976 7388 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24593] ppid=24581 vsize=426624 CPUtime=114.63 cores=0-7
/proc/24583/task/24593/stat : 24593 (python) S 24581 24583 23451 0 -1 4202560 22 8783 0 0 0 0 11406 57 18 0 9 0 529921198 436862976 7388 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 3 0 0 0
[pid=24583/tid=24596] ppid=24581 vsize=426624 CPUtime=114.63 cores=0-7
/proc/24583/task/24596/stat : 24596 (python) S 24581 24583 23451 0 -1 4202560 73 8783 0 0 0 0 11406 57 20 0 9 0 529921202 436862976 7388 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24599] ppid=24581 vsize=426624 CPUtime=114.63 cores=0-7
/proc/24583/task/24599/stat : 24599 (python) S 24581 24583 23451 0 -1 4202560 30 8783 0 0 0 0 11406 57 21 0 9 0 529921206 436862976 7388 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 5 0 0 0
[pid=24583/tid=24602] ppid=24581 vsize=426624 CPUtime=114.63 cores=0-7
/proc/24583/task/24602/stat : 24602 (python) S 24581 24583 23451 0 -1 4202560 35 8783 0 0 0 0 11406 57 20 0 9 0 529921210 436862976 7388 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 4 0 0 0
[pid=24583/tid=24605] ppid=24581 vsize=426624 CPUtime=114.63 cores=0-7
/proc/24583/task/24605/stat : 24605 (python) S 24581 24583 23451 0 -1 4202560 31 8783 0 0 0 0 11406 57 22 0 9 0 529921214 436862976 7388 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 4 0 0 0
[pid=24583/tid=24608] ppid=24581 vsize=426624 CPUtime=114.63 cores=0-7
/proc/24583/task/24608/stat : 24608 (python) S 24581 24583 23451 0 -1 4202560 32 8783 0 0 0 0 11406 57 19 0 9 0 529921218 436862976 7388 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 0 0 0 0
[pid=24583/tid=24611] ppid=24581 vsize=426624 CPUtime=143.16 cores=0-7
/proc/24583/task/24611/stat : 24611 (python) S 24581 24583 23451 0 -1 4202560 72 10056 0 0 0 0 14254 62 20 0 9 0 529921222 436862976 7388 33554432000 4194304 5683644 140735982069424 18446744073709551615 233522121137 0 0 16781312 2 18446604453950347072 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 229.02
Current children cumulated vsize (KiB) 426624

Child status: 0
Real time (s): 29.3289
CPU time (s): 229.156
CPU user time (s): 228
CPU system time (s): 1.15582
CPU usage (%): 781.332
Max. virtual memory (cumulated for all children) (KiB): 4835984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 228
system time used= 1.15582
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36222
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5052
involuntary context switches= 4561

runsolver used 0.094985 second user time and 0.188971 second system time

The end

Launcher Data 

Begin job on node145 at 2011-05-03 00:24:13
IDJOB=3322132
IDBENCH=82910
IDSOLVER=1712
FILE ID=node145/3322132-1304375053
RUNJOBID= node145-1304366464-23465
PBS_JOBID= 13181729
Free space on /tmp= 73616 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v400-c1704-S895193371-061.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322132-1304375053/watcher-3322132-1304375053 -o /tmp/evaluation-result-3322132-1304375053/solver-3322132-1304375053 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322132-1304375053.cnf -seed 883508955 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 737aa440f80cd8be0050a0f138c79eb6
RANDOM SEED=883508955

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21099724 kB
Buffers:       1329488 kB
Cached:        6070808 kB
SwapCached:          4 kB
Active:        6305116 kB
Inactive:      4977472 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21099724 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           32388 kB
Writeback:           0 kB
AnonPages:     3882696 kB
Mapped:          24068 kB
Slab:           476684 kB
PageTables:      25412 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 57406288 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73584 MiB
End job on node145 at 2011-05-03 00:24:42