Trace number 3385565

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)SAT 45.722 7.22354

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v175-c3727-S82160031-050.SATISFIABLE.cnf
MD5SUM90ea123f6d02a54bb761f724a5a1c9d1
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark4.63129
Satisfiable
(Un)Satisfiability was proved
Number of variables175
Number of clauses3727
Sum of the clauses size18635
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53727
Number of clauses of size over 50

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.47	c INFO: solving HOME/instance-3385565-1305568273.cnf
0.32/0.47	c INFO: computing task features
0.32/0.49	c INFO: computed variable-clause graph statistics
0.32/0.49	c INFO: computed clause balance statistics
0.40/0.58	c INFO: computed variable balance statistics
0.50/0.63	c INFO: computed small-clause counts
0.50/0.63	c INFO: computed Horn-clause counts
0.50/0.64	c INFO: computed variable graph statistics
0.50/0.64	c INFO: collected features for HOME/instance-3385565-1305568273.cnf in 0.17 s
0.50/0.67	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.63)
0.61/0.70	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.09)
0.61/0.73	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.26)
0.61/0.76	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.23)
0.61/0.79	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.20)
0.70/0.82	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.18)
0.70/0.86	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.04)
0.70/0.89	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.13)
45.61/7.20	s SATISFIABLE
45.61/7.20	v -1 2 -3 4 -5 6 7 8 -9 10 -11 -12 -13 14 -15 16 -17 18 -19 -20 -21 22 -23 -24 -25 26 -27 28 -29 -30 -31 32 -33 -34 -35 -36 -37 -38 39 40 -41 42 -43 -44 45 -46 47 48 -49 -50 -51 52 -53 54 -55 56 -57 58 59 -60 -61 -62 63 -64 -65 66 -67 -68 69 -70 71 72 -73 -74 75 -76 -77 78 79 -80 -81 82 83 84 -85 86 -87 -88 89 90 91 -92 93 -94 95 96 97 98 -99 -100 101 102 -103 104 -105 106 -107 -108 -109 -110 111 112 -113 114 -115 116 -117 -118 -119 -120 121 -122 123 124 125 126 127 128 -129 130 131 -132 -133 134 135 -136 -137 -138 139 -140 141 142 -143 144 -145 -146 147 -148 -149 -150 -151 -152 153 -154 155 156 -157 158 159 160 -161 -162 -163 164 -165 -166 -167 -168 -169 170 -171 -172 173 174 -175 0

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385565-1305568273/watcher-3385565-1305568273 -o /tmp/evaluation-result-3385565-1305568273/solver-3385565-1305568273 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385565-1305568273.cnf -seed 1823898591 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.60 9.81 9.55 2/391 12912
/proc/meminfo: memFree=23124672/32951124 swapFree=44485784/67111528
[pid=12912] ppid=12910 vsize=16240 CPUtime=0 cores=0-7
/proc/12912/stat : 12912 (python) R 12910 12912 12176 0 -1 4202496 1037 0 0 0 0 0 0 0 25 0 1 0 668427749 16629760 910 33554432000 4194304 5683644 140735318706544 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12912/statm: 4060 910 380 364 0 547 0

[startup+0.026551 s]
/proc/loadavg: 9.60 9.81 9.55 2/391 12912
/proc/meminfo: memFree=23124672/32951124 swapFree=44485784/67111528
[pid=12912] ppid=12910 vsize=16812 CPUtime=0.01 cores=0-7
/proc/12912/stat : 12912 (python) R 12910 12912 12176 0 -1 4202496 1226 0 0 0 1 0 0 0 25 0 1 0 668427749 17215488 1085 33554432000 4194304 5683644 140735318706544 18446744073709551615 5308656 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12912/statm: 4203 1085 417 364 0 690 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16812

[startup+0.100538 s]
/proc/loadavg: 9.60 9.81 9.55 2/391 12912
/proc/meminfo: memFree=23124672/32951124 swapFree=44485784/67111528
[pid=12912] ppid=12910 vsize=104220 CPUtime=0.07 cores=0-7
/proc/12912/stat : 12912 (python) R 12910 12912 12176 0 -1 4202496 3047 0 0 0 5 2 0 0 17 0 1 0 668427749 106721280 2733 33554432000 4194304 5683644 140735318706544 18446744073709551615 4509181 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12912/statm: 26055 2733 847 364 0 1803 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104220

[startup+0.300487 s]
/proc/loadavg: 9.60 9.81 9.55 2/391 12912
/proc/meminfo: memFree=23124672/32951124 swapFree=44485784/67111528
[pid=12912] ppid=12910 vsize=170752 CPUtime=0.24 cores=0-7
/proc/12912/stat : 12912 (python) R 12910 12912 12176 0 -1 4202496 6731 938 1 0 19 5 0 0 17 0 1 0 668427749 174850048 4805 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446941029 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12912/statm: 42688 4805 1336 364 0 3453 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 170752

[startup+0.700414 s]
/proc/loadavg: 9.60 9.81 9.55 2/391 12912
/proc/meminfo: memFree=23124672/32951124 swapFree=44485784/67111528
[pid=12912] ppid=12910 vsize=289284 CPUtime=0.61 cores=0-7
/proc/12912/stat : 12912 (python) R 12910 12912 12176 0 -1 4202496 10279 938 1 0 53 8 0 0 18 0 2 0 668427749 296226816 7208 33554432000 4194304 5683644 140735318706544 18446744073709551615 244450383709 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/12912/statm: 72321 7208 1874 364 0 8239 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 289284

[startup+1.50123 s]
/proc/loadavg: 9.60 9.81 9.55 10/416 12941
/proc/meminfo: memFree=23066308/32951124 swapFree=44485784/67111528
[pid=12912] ppid=12910 vsize=361348 CPUtime=0.79 cores=0-7
/proc/12912/stat : 12912 (python) S 12910 12912 12176 0 -1 4202496 15814 938 1 0 70 9 0 0 24 0 9 0 668427749 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/12912/statm: 90337 7302 1889 364 0 26234 0
[pid=12918] ppid=12912 vsize=278572 CPUtime=0 cores=0-7
/proc/12918/stat : 12918 (python) S 12912 12912 12176 0 -1 4202560 734 0 0 0 0 0 0 0 19 0 1 0 668427816 285257728 5558 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965263 0 0 16781312 514 6366964802123726847 0 0 17 0 0 0 0
/proc/12918/statm: 69643 5558 354 364 0 5561 0
[pid=12920] ppid=12918 vsize=1017932 CPUtime=0.82 cores=0-7
/proc/12920/stat : 12920 (gnovelty+2) R 12918 12920 12920 0 -1 4202496 467 0 0 0 82 0 0 0 23 0 1 0 668427817 1042362368 201 33554432000 134512640 135663704 4293003808 18446744073709551615 134544186 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/12920/statm: 254483 201 113 282 0 254199 0
[pid=12921] ppid=12912 vsize=289296 CPUtime=0 cores=0-7
/proc/12921/stat : 12921 (python) S 12912 12912 12176 0 -1 4202560 735 0 0 0 0 0 0 0 19 0 1 0 668427819 296239104 5682 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 4165754068188266495 0 0 17 2 0 0 0
/proc/12921/statm: 72324 5682 348 364 0 8239 0
[pid=12923] ppid=12921 vsize=1017932 CPUtime=0.77 cores=0-7
/proc/12923/stat : 12923 (gnovelty+2) R 12921 12923 12923 0 -1 4202496 469 0 0 0 77 0 0 0 22 0 1 0 668427820 1042362368 202 33554432000 134512640 135663704 4293055168 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/12923/statm: 254483 202 113 282 0 254199 0
[pid=12924] ppid=12912 vsize=299080 CPUtime=0 cores=0-7
/proc/12924/stat : 12924 (python) S 12912 12912 12176 0 -1 4202560 747 0 0 0 0 0 0 0 15 0 1 0 668427822 306257920 5583 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 8959335318855581955 0 0 17 6 0 0 0
/proc/12924/statm: 74770 5583 348 364 0 10682 0
[pid=12926] ppid=12924 vsize=2280 CPUtime=0.76 cores=0-7
/proc/12926/stat : 12926 (march_hi) R 12924 12926 12926 0 -1 4202496 756 0 0 0 76 0 0 0 22 0 1 0 668427823 2334720 383 33554432000 4194304 4955518 140735908163088 18446744073709551615 4208598 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/12926/statm: 570 383 106 186 0 383 0
[pid=12927] ppid=12912 vsize=309944 CPUtime=0 cores=0-7
/proc/12927/stat : 12927 (python) S 12912 12912 12176 0 -1 4202560 761 0 0 0 0 0 0 0 15 0 1 0 668427826 317382656 5707 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 2691116285927850242 0 0 17 6 0 0 0
/proc/12927/statm: 77486 5707 348 364 0 13395 0
[pid=12929] ppid=12927 vsize=2280 CPUtime=0.72 cores=0-7
/proc/12929/stat : 12929 (march_hi) R 12927 12929 12929 0 -1 4202496 759 0 0 0 72 0 0 0 22 0 1 0 668427826 2334720 382 33554432000 4194304 4955518 140734441315776 18446744073709551615 4208624 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/12929/statm: 570 382 106 186 0 383 0
[pid=12930] ppid=12912 vsize=320200 CPUtime=0 cores=0-7
/proc/12930/stat : 12930 (python) S 12912 12912 12176 0 -1 4202560 773 0 0 0 0 0 0 0 15 0 1 0 668427829 327884800 5728 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 6431443737389269251 0 0 17 3 0 0 0
/proc/12930/statm: 80050 5728 348 364 0 15956 0
[pid=12932] ppid=12930 vsize=2136 CPUtime=0.41 cores=0-7
/proc/12932/stat : 12932 (march_hi) R 12930 12932 12932 0 -1 4202496 707 0 0 0 41 0 0 0 21 0 1 0 668427829 2187264 331 33554432000 4194304 4955518 140737268421904 18446744073709551615 4235376 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12932/statm: 534 331 106 186 0 347 0
[pid=12933] ppid=12912 vsize=330456 CPUtime=0 cores=0-7
/proc/12933/stat : 12933 (python) S 12912 12912 12176 0 -1 4202560 781 0 0 0 0 0 0 0 15 0 1 0 668427832 338386944 5732 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 15903432945470243073 0 0 17 4 0 0 0
/proc/12933/statm: 82614 5732 348 364 0 18517 0
[pid=12935] ppid=12933 vsize=2280 CPUtime=0.66 cores=0-7
/proc/12935/stat : 12935 (march_hi) R 12933 12935 12935 0 -1 4202496 759 0 0 0 66 0 0 0 22 0 1 0 668427833 2334720 378 33554432000 4194304 4955518 140733426742176 18446744073709551615 4224622 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/12935/statm: 570 378 106 186 0 383 0
[pid=12936] ppid=12912 vsize=340308 CPUtime=0 cores=0-7
/proc/12936/stat : 12936 (python) S 12912 12912 12176 0 -1 4202560 743 0 0 0 0 0 0 0 21 0 1 0 668427835 348475392 5628 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 3646380509354786815 0 0 17 2 0 0 0
/proc/12936/statm: 85077 5628 344 364 0 20977 0
[pid=12938] ppid=12936 vsize=416392 CPUtime=0.27 cores=0-7
/proc/12938/stat : 12938 (adaptg2wsat2009) R 12936 12938 12938 0 -1 4202496 553 0 0 0 27 0 0 0 23 0 1 0 668427838 426385408 284 33554432000 134512640 135107411 4291539472 18446744073709551615 134531768 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12938/statm: 104098 284 59 146 0 102974 0
[pid=12939] ppid=12912 vsize=351104 CPUtime=0 cores=0-7
/proc/12939/stat : 12939 (python) S 12912 12912 12176 0 -1 4202560 826 0 0 0 0 0 0 0 19 0 1 0 668427839 359530496 5763 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 15414282212505256193 0 0 17 2 0 0 0
/proc/12939/statm: 87776 5763 354 364 0 23673 0
[pid=12941] ppid=12939 vsize=2280 CPUtime=0.59 cores=0-7
/proc/12941/stat : 12941 (march_hi) R 12939 12941 12941 0 -1 4202496 759 0 0 0 59 0 0 0 25 0 1 0 668427839 2334720 374 33554432000 4194304 4955518 140736672458496 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/12941/statm: 570 374 106 186 0 383 0
[pid=12912/tid=12919] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12919/stat : 12919 (python) S 12910 12912 12176 0 -1 4202560 26 938 0 0 0 0 0 0 20 0 9 0 668427817 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12922] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12922/stat : 12922 (python) S 12910 12912 12176 0 -1 4202560 23 938 0 0 0 0 0 0 20 0 9 0 668427820 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12925] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12925/stat : 12925 (python) S 12910 12912 12176 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 9 0 668427823 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12928] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12928/stat : 12928 (python) S 12910 12912 12176 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 9 0 668427826 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 6 0 0 0
[pid=12912/tid=12931] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12931/stat : 12931 (python) S 12910 12912 12176 0 -1 4202560 25 938 0 0 0 0 0 0 19 0 9 0 668427829 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 4 0 0 0
[pid=12912/tid=12934] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12934/stat : 12934 (python) S 12910 12912 12176 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 9 0 668427832 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 4 0 0 0
[pid=12912/tid=12937] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12937/stat : 12937 (python) S 12910 12912 12176 0 -1 4202560 25 938 0 0 0 0 0 0 22 0 9 0 668427836 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 2 0 0 0
[pid=12912/tid=12940] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12940/stat : 12940 (python) S 12910 12912 12176 0 -1 4202560 28 938 0 0 0 0 0 0 24 0 9 0 668427839 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.79
Current children cumulated vsize (KiB) 5343820

[startup+3.10093 s]
/proc/loadavg: 9.60 9.81 9.55 10/416 12941
/proc/meminfo: memFree=23062092/32951124 swapFree=44485784/67111528
[pid=12912] ppid=12910 vsize=361348 CPUtime=0.79 cores=0-7
/proc/12912/stat : 12912 (python) S 12910 12912 12176 0 -1 4202496 15814 938 1 0 70 9 0 0 24 0 9 0 668427749 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/12912/statm: 90337 7302 1889 364 0 26234 0
[pid=12918] ppid=12912 vsize=278572 CPUtime=0 cores=0-7
/proc/12918/stat : 12918 (python) S 12912 12912 12176 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 668427816 285257728 5558 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965263 0 0 16781312 514 6366964802123694339 0 0 17 0 0 0 0
/proc/12918/statm: 69643 5558 354 364 0 5561 0
[pid=12920] ppid=12918 vsize=1017932 CPUtime=2.42 cores=0-7
/proc/12920/stat : 12920 (gnovelty+2) R 12918 12920 12920 0 -1 4202496 467 0 0 0 242 0 0 0 25 0 1 0 668427817 1042362368 201 33554432000 134512640 135663704 4293003808 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/12920/statm: 254483 201 113 282 0 254199 0
[pid=12921] ppid=12912 vsize=289296 CPUtime=0 cores=0-7
/proc/12921/stat : 12921 (python) S 12912 12912 12176 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 668427819 296239104 5682 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 4165754068188233987 0 0 17 2 0 0 0
/proc/12921/statm: 72324 5682 348 364 0 8239 0
[pid=12923] ppid=12921 vsize=1017932 CPUtime=2.36 cores=0-7
/proc/12923/stat : 12923 (gnovelty+2) R 12921 12923 12923 0 -1 4202496 469 0 0 0 236 0 0 0 25 0 1 0 668427820 1042362368 202 33554432000 134512640 135663704 4293055168 18446744073709551615 134525224 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/12923/statm: 254483 202 113 282 0 254199 0
[pid=12924] ppid=12912 vsize=299080 CPUtime=0 cores=0-7
/proc/12924/stat : 12924 (python) S 12912 12912 12176 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 668427822 306257920 5583 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 8959335318855581955 0 0 17 6 0 0 0
/proc/12924/statm: 74770 5583 348 364 0 10682 0
[pid=12926] ppid=12924 vsize=2760 CPUtime=2.36 cores=0-7
/proc/12926/stat : 12926 (march_hi) R 12924 12926 12926 0 -1 4202496 850 0 0 0 236 0 0 0 25 0 1 0 668427823 2826240 477 33554432000 4194304 4955518 140735908163088 18446744073709551615 4235606 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/12926/statm: 690 477 106 186 0 503 0
[pid=12927] ppid=12912 vsize=309944 CPUtime=0 cores=0-7
/proc/12927/stat : 12927 (python) S 12912 12912 12176 0 -1 4202560 770 0 0 0 0 0 0 0 15 0 1 0 668427826 317382656 5707 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 2691116285927850242 0 0 17 6 0 0 0
/proc/12927/statm: 77486 5707 348 364 0 13395 0
[pid=12929] ppid=12927 vsize=2760 CPUtime=2.31 cores=0-7
/proc/12929/stat : 12929 (march_hi) R 12927 12929 12929 0 -1 4202496 853 0 0 0 231 0 0 0 25 0 1 0 668427826 2826240 476 33554432000 4194304 4955518 140734441315776 18446744073709551615 4297061 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/12929/statm: 690 476 106 186 0 503 0
[pid=12930] ppid=12912 vsize=320200 CPUtime=0 cores=0-7
/proc/12930/stat : 12930 (python) S 12912 12912 12176 0 -1 4202560 774 0 0 0 0 0 0 0 15 0 1 0 668427829 327884800 5728 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 2434239583353831423 0 0 17 3 0 0 0
/proc/12930/statm: 80050 5728 348 364 0 15956 0
[pid=12932] ppid=12930 vsize=2380 CPUtime=1.21 cores=0-7
/proc/12932/stat : 12932 (march_hi) R 12930 12932 12932 0 -1 4202496 790 0 0 0 121 0 0 0 25 0 1 0 668427829 2437120 413 33554432000 4194304 4955518 140737268421904 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12932/statm: 595 413 106 186 0 408 0
[pid=12933] ppid=12912 vsize=330456 CPUtime=0 cores=0-7
/proc/12933/stat : 12933 (python) S 12912 12912 12176 0 -1 4202560 785 0 0 0 0 0 0 0 15 0 1 0 668427832 338386944 5732 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 15903432945470243073 0 0 17 4 0 0 0
/proc/12933/statm: 82614 5732 348 364 0 18517 0
[pid=12935] ppid=12933 vsize=2760 CPUtime=2.26 cores=0-7
/proc/12935/stat : 12935 (march_hi) R 12933 12935 12935 0 -1 4202496 853 0 0 0 226 0 0 0 25 0 1 0 668427833 2826240 472 33554432000 4194304 4955518 140733426742176 18446744073709551615 4285655 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/12935/statm: 690 472 106 186 0 503 0
[pid=12936] ppid=12912 vsize=340308 CPUtime=0 cores=0-7
/proc/12936/stat : 12936 (python) S 12912 12912 12176 0 -1 4202560 761 0 0 0 0 0 0 0 18 0 1 0 668427835 348475392 5632 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 3646380509354754307 0 0 17 2 0 0 0
/proc/12936/statm: 85077 5632 348 364 0 20977 0
[pid=12938] ppid=12936 vsize=416392 CPUtime=1.07 cores=0-7
/proc/12938/stat : 12938 (adaptg2wsat2009) R 12936 12938 12938 0 -1 4202496 553 0 0 0 107 0 0 0 25 0 1 0 668427838 426385408 284 33554432000 134512640 135107411 4291539472 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12938/statm: 104098 284 59 146 0 102974 0
[pid=12939] ppid=12912 vsize=351104 CPUtime=0 cores=0-7
/proc/12939/stat : 12939 (python) S 12912 12912 12176 0 -1 4202560 829 0 0 0 0 0 0 0 15 0 1 0 668427839 359530496 5763 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 15414282212505256193 0 0 17 2 0 0 0
/proc/12939/statm: 87776 5763 354 364 0 23673 0
[pid=12941] ppid=12939 vsize=2760 CPUtime=2.19 cores=0-7
/proc/12941/stat : 12941 (march_hi) R 12939 12941 12941 0 -1 4202496 853 0 0 0 219 0 0 0 25 0 1 0 668427839 2826240 468 33554432000 4194304 4955518 140736672458496 18446744073709551615 4224450 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/12941/statm: 690 468 106 186 0 503 0
[pid=12912/tid=12919] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12919/stat : 12919 (python) S 12910 12912 12176 0 -1 4202560 26 938 0 0 0 0 0 0 20 0 9 0 668427817 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12922] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12922/stat : 12922 (python) S 12910 12912 12176 0 -1 4202560 23 938 0 0 0 0 0 0 20 0 9 0 668427820 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12925] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12925/stat : 12925 (python) S 12910 12912 12176 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 9 0 668427823 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12928] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12928/stat : 12928 (python) S 12910 12912 12176 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 9 0 668427826 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 6 0 0 0
[pid=12912/tid=12931] ppid=12910 vsize=361348 CPUtime=0 cores=0-7

################
# More data... #
################

[pid=12921] ppid=12912 vsize=289296 CPUtime=0.01 cores=0-7
/proc/12921/stat : 12921 (python) S 12912 12912 12176 0 -1 4202560 893 0 0 0 0 1 0 0 18 0 1 0 668427819 296239104 5705 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 4165754068188233987 0 0 17 2 0 0 0
/proc/12921/statm: 72324 5705 371 364 0 8239 0
[pid=12923] ppid=12921 vsize=1017932 CPUtime=5.9 cores=0-7
/proc/12923/stat : 12923 (gnovelty+2) R 12921 12923 12923 0 -1 4202496 469 0 0 0 590 0 0 0 25 0 1 0 668427820 1042362368 202 33554432000 134512640 135663704 4293055168 18446744073709551615 134545644 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/12923/statm: 254483 202 113 282 0 254199 0
[pid=12924] ppid=12912 vsize=299080 CPUtime=0.02 cores=0-7
/proc/12924/stat : 12924 (python) S 12912 12912 12176 0 -1 4202560 904 0 0 0 1 1 0 0 15 0 1 0 668427822 306257920 5606 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 8959335318855581955 0 0 17 6 0 0 0
/proc/12924/statm: 74770 5606 371 364 0 10682 0
[pid=12926] ppid=12924 vsize=3612 CPUtime=5.94 cores=0-7
/proc/12926/stat : 12926 (march_hi) R 12924 12926 12926 0 -1 4202496 1061 0 0 0 594 0 0 0 25 0 1 0 668427823 3698688 688 33554432000 4194304 4955518 140735908163088 18446744073709551615 4244599 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/12926/statm: 903 688 106 186 0 716 0
[pid=12927] ppid=12912 vsize=309944 CPUtime=0.01 cores=0-7
/proc/12927/stat : 12927 (python) S 12912 12912 12176 0 -1 4202560 930 0 0 0 1 0 0 0 15 0 1 0 668427826 317382656 5730 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 2691116285927850242 0 0 17 6 0 0 0
/proc/12927/statm: 77486 5730 371 364 0 13395 0
[pid=12929] ppid=12927 vsize=3612 CPUtime=5.88 cores=0-7
/proc/12929/stat : 12929 (march_hi) R 12927 12929 12929 0 -1 4202496 1063 0 0 0 588 0 0 0 25 0 1 0 668427826 3698688 686 33554432000 4194304 4955518 140734441315776 18446744073709551615 4261539 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/12929/statm: 903 686 106 186 0 716 0
[pid=12930] ppid=12912 vsize=320200 CPUtime=0.01 cores=0-7
/proc/12930/stat : 12930 (python) S 12912 12912 12176 0 -1 4202560 948 0 0 0 0 1 0 0 15 0 1 0 668427829 327884800 5751 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 6431443737389269251 0 0 17 3 0 0 0
/proc/12930/statm: 80050 5751 371 364 0 15956 0
[pid=12932] ppid=12930 vsize=3100 CPUtime=3.01 cores=0-7
/proc/12932/stat : 12932 (march_hi) R 12930 12932 12932 0 -1 4202496 895 0 0 0 301 0 0 0 25 0 1 0 668427829 3174400 518 33554432000 4194304 4955518 140737268421904 18446744073709551615 4297074 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12932/statm: 775 518 106 186 0 588 0
[pid=12933] ppid=12912 vsize=330456 CPUtime=0.01 cores=0-7
/proc/12933/stat : 12933 (python) S 12912 12912 12176 0 -1 4202560 950 0 0 0 1 0 0 0 15 0 1 0 668427832 338386944 5755 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 15903432945470243073 0 0 17 4 0 0 0
/proc/12933/statm: 82614 5755 371 364 0 18517 0
[pid=12935] ppid=12933 vsize=3612 CPUtime=5.84 cores=0-7
/proc/12935/stat : 12935 (march_hi) R 12933 12935 12935 0 -1 4202496 1065 0 0 0 584 0 0 0 25 0 1 0 668427833 3698688 684 33554432000 4194304 4955518 140733426742176 18446744073709551615 4224642 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/12935/statm: 903 684 106 186 0 716 0
[pid=12936] ppid=12912 vsize=340308 CPUtime=0.01 cores=0-7
/proc/12936/stat : 12936 (python) S 12912 12912 12176 0 -1 4202560 942 0 0 0 0 1 0 0 18 0 1 0 668427835 348475392 5655 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 3646380509354754307 0 0 17 2 0 0 0
/proc/12936/statm: 85077 5655 371 364 0 20977 0
[pid=12938] ppid=12936 vsize=416392 CPUtime=2.85 cores=0-7
/proc/12938/stat : 12938 (adaptg2wsat2009) R 12936 12938 12938 0 -1 4202496 553 0 0 0 285 0 0 0 25 0 1 0 668427838 426385408 284 33554432000 134512640 135107411 4291539472 18446744073709551615 134531508 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12938/statm: 104098 284 59 146 0 102974 0
[pid=12939] ppid=12912 vsize=351104 CPUtime=0.01 cores=0-7
/proc/12939/stat : 12939 (python) S 12912 12912 12176 0 -1 4202560 1003 0 0 0 1 0 0 0 15 0 1 0 668427839 359530496 5786 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 15414282212505256193 0 0 17 2 0 0 0
/proc/12939/statm: 87776 5786 377 364 0 23673 0
[pid=12941] ppid=12939 vsize=3612 CPUtime=5.74 cores=0-7
/proc/12941/stat : 12941 (march_hi) R 12939 12941 12941 0 -1 4202496 1062 0 0 0 574 0 0 0 25 0 1 0 668427839 3698688 677 33554432000 4194304 4955518 140736672458496 18446744073709551615 4208710 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/12941/statm: 903 677 106 186 0 716 0
[pid=12912/tid=12919] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12919/stat : 12919 (python) S 12910 12912 12176 0 -1 4202560 26 938 0 0 0 0 0 0 20 0 9 0 668427817 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12922] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12922/stat : 12922 (python) S 12910 12912 12176 0 -1 4202560 23 938 0 0 0 0 0 0 20 0 9 0 668427820 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12925] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12925/stat : 12925 (python) S 12910 12912 12176 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 9 0 668427823 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12928] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12928/stat : 12928 (python) S 12910 12912 12176 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 9 0 668427826 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 6 0 0 0
[pid=12912/tid=12931] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12931/stat : 12931 (python) S 12910 12912 12176 0 -1 4202560 25 938 0 0 0 0 0 0 19 0 9 0 668427829 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 4 0 0 0
[pid=12912/tid=12934] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12934/stat : 12934 (python) S 12910 12912 12176 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 9 0 668427832 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 4 0 0 0
[pid=12912/tid=12937] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12937/stat : 12937 (python) S 12910 12912 12176 0 -1 4202560 25 938 0 0 0 0 0 0 22 0 9 0 668427836 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 2 0 0 0
[pid=12912/tid=12940] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12940/stat : 12940 (python) S 12910 12912 12176 0 -1 4202560 28 938 0 0 0 0 0 0 24 0 9 0 668427839 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 42.06
Current children cumulated vsize (KiB) 5350112

[startup+7.10119 s]
/proc/loadavg: 9.55 9.79 9.55 10/416 12941
/proc/meminfo: memFree=23057140/32951124 swapFree=44485784/67111528
[pid=12912] ppid=12910 vsize=361348 CPUtime=0.79 cores=0-7
/proc/12912/stat : 12912 (python) S 12910 12912 12176 0 -1 4202496 15814 938 1 0 70 9 0 0 24 0 9 0 668427749 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/12912/statm: 90337 7302 1889 364 0 26234 0
[pid=12918] ppid=12912 vsize=278572 CPUtime=0.01 cores=0-7
/proc/12918/stat : 12918 (python) S 12912 12912 12176 0 -1 4202560 894 0 0 0 1 0 0 0 18 0 1 0 668427816 285257728 5581 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965263 0 0 16781312 514 6366964802123694339 0 0 17 0 0 0 0
/proc/12918/statm: 69643 5581 377 364 0 5561 0
[pid=12920] ppid=12918 vsize=1017932 CPUtime=6.42 cores=0-7
/proc/12920/stat : 12920 (gnovelty+2) R 12918 12920 12920 0 -1 4202496 467 0 0 0 642 0 0 0 25 0 1 0 668427817 1042362368 201 33554432000 134512640 135663704 4293003808 18446744073709551615 134545786 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/12920/statm: 254483 201 113 282 0 254199 0
[pid=12921] ppid=12912 vsize=289296 CPUtime=0.01 cores=0-7
/proc/12921/stat : 12921 (python) S 12912 12912 12176 0 -1 4202560 893 0 0 0 0 1 0 0 18 0 1 0 668427819 296239104 5705 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 4165754068188233987 0 0 17 2 0 0 0
/proc/12921/statm: 72324 5705 371 364 0 8239 0
[pid=12923] ppid=12921 vsize=1017932 CPUtime=6.3 cores=0-7
/proc/12923/stat : 12923 (gnovelty+2) R 12921 12923 12923 0 -1 4202496 469 0 0 0 630 0 0 0 25 0 1 0 668427820 1042362368 202 33554432000 134512640 135663704 4293055168 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/12923/statm: 254483 202 113 282 0 254199 0
[pid=12924] ppid=12912 vsize=299080 CPUtime=0.02 cores=0-7
/proc/12924/stat : 12924 (python) S 12912 12912 12176 0 -1 4202560 904 0 0 0 1 1 0 0 15 0 1 0 668427822 306257920 5606 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 8959335318855581955 0 0 17 6 0 0 0
/proc/12924/statm: 74770 5606 371 364 0 10682 0
[pid=12926] ppid=12924 vsize=3612 CPUtime=6.34 cores=0-7
/proc/12926/stat : 12926 (march_hi) R 12924 12926 12926 0 -1 4202496 1082 0 0 0 634 0 0 0 25 0 1 0 668427823 3698688 709 33554432000 4194304 4955518 140735908163088 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/12926/statm: 903 709 106 186 0 716 0
[pid=12927] ppid=12912 vsize=309944 CPUtime=0.01 cores=0-7
/proc/12927/stat : 12927 (python) S 12912 12912 12176 0 -1 4202560 930 0 0 0 1 0 0 0 15 0 1 0 668427826 317382656 5730 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 2691116285927850242 0 0 17 6 0 0 0
/proc/12927/statm: 77486 5730 371 364 0 13395 0
[pid=12929] ppid=12927 vsize=3612 CPUtime=6.28 cores=0-7
/proc/12929/stat : 12929 (march_hi) R 12927 12929 12929 0 -1 4202496 1084 0 0 0 628 0 0 0 25 0 1 0 668427826 3698688 707 33554432000 4194304 4955518 140734441315776 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/12929/statm: 903 707 106 186 0 716 0
[pid=12930] ppid=12912 vsize=320200 CPUtime=0.01 cores=0-7
/proc/12930/stat : 12930 (python) S 12912 12912 12176 0 -1 4202560 948 0 0 0 0 1 0 0 15 0 1 0 668427829 327884800 5751 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 6431443737389269251 0 0 17 3 0 0 0
/proc/12930/statm: 80050 5751 371 364 0 15956 0
[pid=12932] ppid=12930 vsize=3100 CPUtime=3.21 cores=0-7
/proc/12932/stat : 12932 (march_hi) R 12930 12932 12932 0 -1 4202496 905 0 0 0 321 0 0 0 25 0 1 0 668427829 3174400 528 33554432000 4194304 4955518 140737268421904 18446744073709551615 4237818 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12932/statm: 775 528 106 186 0 588 0
[pid=12933] ppid=12912 vsize=330456 CPUtime=0.01 cores=0-7
/proc/12933/stat : 12933 (python) S 12912 12912 12176 0 -1 4202560 950 0 0 0 1 0 0 0 15 0 1 0 668427832 338386944 5755 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 15903432945470243073 0 0 17 4 0 0 0
/proc/12933/statm: 82614 5755 371 364 0 18517 0
[pid=12935] ppid=12933 vsize=3612 CPUtime=6.24 cores=0-7
/proc/12935/stat : 12935 (march_hi) R 12933 12935 12935 0 -1 4202496 1087 0 0 0 624 0 0 0 25 0 1 0 668427833 3698688 706 33554432000 4194304 4955518 140733426742176 18446744073709551615 4285951 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/12935/statm: 903 706 106 186 0 716 0
[pid=12936] ppid=12912 vsize=340308 CPUtime=0.01 cores=0-7
/proc/12936/stat : 12936 (python) S 12912 12912 12176 0 -1 4202560 942 0 0 0 0 1 0 0 18 0 1 0 668427835 348475392 5655 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 3646380509354754307 0 0 17 2 0 0 0
/proc/12936/statm: 85077 5655 371 364 0 20977 0
[pid=12938] ppid=12936 vsize=416392 CPUtime=3.05 cores=0-7
/proc/12938/stat : 12938 (adaptg2wsat2009) R 12936 12938 12938 0 -1 4202496 553 0 0 0 305 0 0 0 25 0 1 0 668427838 426385408 284 33554432000 134512640 135107411 4291539472 18446744073709551615 134539290 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12938/statm: 104098 284 59 146 0 102974 0
[pid=12939] ppid=12912 vsize=351104 CPUtime=0.01 cores=0-7
/proc/12939/stat : 12939 (python) S 12912 12912 12176 0 -1 4202560 1003 0 0 0 1 0 0 0 15 0 1 0 668427839 359530496 5786 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 15414282212505256193 0 0 17 2 0 0 0
/proc/12939/statm: 87776 5786 377 364 0 23673 0
[pid=12941] ppid=12939 vsize=3612 CPUtime=6.14 cores=0-7
/proc/12941/stat : 12941 (march_hi) R 12939 12941 12941 0 -1 4202496 1085 0 0 0 614 0 0 0 25 0 1 0 668427839 3698688 700 33554432000 4194304 4955518 140736672458496 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/12941/statm: 903 700 106 186 0 716 0
[pid=12912/tid=12919] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12919/stat : 12919 (python) S 12910 12912 12176 0 -1 4202560 26 938 0 0 0 0 0 0 20 0 9 0 668427817 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12922] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12922/stat : 12922 (python) S 12910 12912 12176 0 -1 4202560 23 938 0 0 0 0 0 0 20 0 9 0 668427820 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12925] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12925/stat : 12925 (python) S 12910 12912 12176 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 9 0 668427823 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12928] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12928/stat : 12928 (python) S 12910 12912 12176 0 -1 4202560 22 938 0 0 0 0 0 0 20 0 9 0 668427826 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 6 0 0 0
[pid=12912/tid=12931] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12931/stat : 12931 (python) S 12910 12912 12176 0 -1 4202560 25 938 0 0 0 0 0 0 19 0 9 0 668427829 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 4 0 0 0
[pid=12912/tid=12934] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12934/stat : 12934 (python) S 12910 12912 12176 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 9 0 668427832 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 4 0 0 0
[pid=12912/tid=12937] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12937/stat : 12937 (python) S 12910 12912 12176 0 -1 4202560 25 938 0 0 0 0 0 0 22 0 9 0 668427836 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 2 0 0 0
[pid=12912/tid=12940] ppid=12910 vsize=361348 CPUtime=0 cores=0-7
/proc/12912/task/12940/stat : 12940 (python) S 12910 12912 12176 0 -1 4202560 28 938 0 0 0 0 0 0 24 0 9 0 668427839 370020352 7302 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 44.86
Current children cumulated vsize (KiB) 5350112

[startup+7.20117 s]
/proc/loadavg: 9.55 9.79 9.55 10/416 12941
/proc/meminfo: memFree=23057140/32951124 swapFree=44485784/67111528
[pid=12912] ppid=12910 vsize=361348 CPUtime=29.55 cores=0-7
/proc/12912/stat : 12912 (python) S 12910 12912 12176 0 -1 4202496 15873 11188 1 0 70 9 2870 6 17 0 9 0 668427749 370020352 7303 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458775359 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/12912/statm: 90337 7303 1890 364 0 26234 0
[pid=12918] ppid=12912 vsize=0 CPUtime=6.53 cores=0-7
/proc/12918/stat : 12918 (python) R 12912 12912 12176 0 -1 4202564 938 467 0 0 1 0 652 0 15 0 1 0 668427816 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12918/statm: 0 0 0 0 0 0 0
[pid=12921] ppid=12912 vsize=0 CPUtime=6.4 cores=0-7
/proc/12921/stat : 12921 (python) Z 12912 12912 12176 0 -1 4202588 1135 471 0 0 0 1 639 0 15 0 1 0 668427819 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 2 0 0 0
/proc/12921/statm: 0 0 0 0 0 0 0
[pid=12936] ppid=12912 vsize=340308 CPUtime=0.01 cores=0-7
/proc/12936/stat : 12936 (python) S 12912 12912 12176 0 -1 4202560 942 0 0 0 0 1 0 0 18 0 1 0 668427835 348475392 5655 33554432000 4194304 5683644 140735318706544 18446744073709551615 244446965318 0 0 16781312 514 3646380509354754307 0 0 17 2 0 0 0
/proc/12936/statm: 85077 5655 371 364 0 20977 0
[pid=12938] ppid=12936 vsize=416392 CPUtime=3.12 cores=0-7
/proc/12938/stat : 12938 (adaptg2wsat2009) R 12936 12938 12938 0 -1 4202496 553 0 0 0 312 0 0 0 25 0 1 0 668427838 426385408 284 33554432000 134512640 135107411 4291539472 18446744073709551615 134531500 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/12938/statm: 104098 284 59 146 0 102974 0
[pid=12912/tid=12919] ppid=12910 vsize=361348 CPUtime=28.76 cores=0-7
/proc/12912/task/12919/stat : 12919 (python) S 12910 12912 12176 0 -1 4202560 26 11188 0 0 0 0 2870 6 20 0 9 0 668427817 370020352 7303 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12922] ppid=12910 vsize=361348 CPUtime=28.76 cores=0-7
/proc/12912/task/12922/stat : 12922 (python) S 12910 12912 12176 0 -1 4202560 23 11188 0 0 0 0 2870 6 20 0 9 0 668427820 370020352 7303 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12925] ppid=12910 vsize=361348 CPUtime=28.76 cores=0-7
/proc/12912/task/12925/stat : 12925 (python) S 12910 12912 12176 0 -1 4202560 22 11188 0 0 0 0 2870 6 20 0 9 0 668427823 370020352 7303 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 0 0 0 0
[pid=12912/tid=12928] ppid=12910 vsize=361348 CPUtime=28.76 cores=0-7
/proc/12912/task/12928/stat : 12928 (python) S 12910 12912 12176 0 -1 4202560 22 11188 0 0 0 0 2870 6 20 0 9 0 668427826 370020352 7303 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 6 0 0 0
[pid=12912/tid=12931] ppid=12910 vsize=361348 CPUtime=28.76 cores=0-7
/proc/12912/task/12931/stat : 12931 (python) S 12910 12912 12176 0 -1 4202560 25 11188 0 0 0 0 2870 6 19 0 9 0 668427829 370020352 7303 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 4 0 0 0
[pid=12912/tid=12934] ppid=12910 vsize=361348 CPUtime=28.76 cores=0-7
/proc/12912/task/12934/stat : 12934 (python) S 12910 12912 12176 0 -1 4202560 24 11188 0 0 0 0 2870 6 20 0 9 0 668427832 370020352 7303 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 4 0 0 0
[pid=12912/tid=12937] ppid=12910 vsize=361348 CPUtime=35.31 cores=0-7
/proc/12912/task/12937/stat : 12937 (python) S 12910 12912 12176 0 -1 4202560 25 12593 0 0 0 0 3524 7 22 0 9 0 668427836 370020352 7303 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 2 0 0 0
[pid=12912/tid=12940] ppid=12910 vsize=361348 CPUtime=35.31 cores=0-7
/proc/12912/task/12940/stat : 12940 (python) S 12910 12912 12176 0 -1 4202560 28 12593 0 0 0 0 3524 7 24 0 9 0 668427839 370020352 7303 33554432000 4194304 5683644 140735318706544 18446744073709551615 244458768817 0 0 16781312 2 18446604447645868224 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 45.61
Current children cumulated vsize (KiB) 1118048

Child status: 0
Real time (s): 7.22354
CPU time (s): 45.722
CPU user time (s): 45.5141
CPU system time (s): 0.207968
CPU usage (%): 632.959
Max. virtual memory (cumulated for all children) (KiB): 5350112

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 45.5141
system time used= 0.207968
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35957
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2051
involuntary context switches= 843

runsolver used 0.027995 second user time and 0.075988 second system time

The end

Launcher Data 

Begin job on node105 at 2011-05-16 19:51:13
IDJOB=3385565
IDBENCH=82830
IDSOLVER=1870
FILE ID=node105/3385565-1305568273
RUNJOBID= node105-1305564966-12190
PBS_JOBID= 13350145
Free space on /tmp= 73528 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v175-c3727-S82160031-050.SATISFIABLE.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385565-1305568273/watcher-3385565-1305568273 -o /tmp/evaluation-result-3385565-1305568273/solver-3385565-1305568273 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385565-1305568273.cnf -seed 1823898591 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 90ea123f6d02a54bb761f724a5a1c9d1
RANDOM SEED=1823898591

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23124828 kB
Buffers:        322036 kB
Cached:        7167348 kB
SwapCached:      39636 kB
Active:        2444968 kB
Inactive:      7088376 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23124828 kB
SwapTotal:    67111528 kB
SwapFree:     44485784 kB
Dirty:           32228 kB
Writeback:           0 kB
AnonPages:     2012800 kB
Mapped:          17032 kB
Slab:           145472 kB
PageTables:      76120 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 103870784 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73500 MiB
End job on node105 at 2011-05-16 19:51:20