Trace number 3385826

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 1046 147.43

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v450-c1917-S1959079526-027.UNKNOWN.cnf
MD5SUMf44a4cf4fe89dcbd323f749ee3ba0f10
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark142.579
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses1917
Sum of the clauses size5751
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31917
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.37/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.67	c INFO: solving HOME/instance-3385826-1305575665.cnf
0.37/0.67	c INFO: computing task features
0.37/0.67	c INFO: computed variable-clause graph statistics
0.37/0.68	c INFO: computed clause balance statistics
0.45/0.71	c INFO: computed variable balance statistics
0.45/0.74	c INFO: computed small-clause counts
0.45/0.74	c INFO: computed Horn-clause counts
0.45/0.74	c INFO: computed variable graph statistics
0.45/0.74	c INFO: collected features for HOME/instance-3385826-1305575665.cnf in 0.07 s
0.45/0.77	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.56)
0.55/0.80	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.37)
0.55/0.83	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.33)
0.55/0.86	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.33)
0.55/0.90	c INFO: running march_hi@0 for 97 with 4999 remaining (b = 0.09)
0.65/0.93	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.07)
0.65/0.96	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.24)
0.65/0.99	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.21)
719.50/100.71	c INFO: running march_hi@0 for 97 with 4899 remaining (b = 0.05)
722.31/101.15	c INFO: running march_hi@0 for 485 with 4899 remaining (b = 0.19)
849.50/119.37	c INFO: running kcnfs-2006@0 for 582 with 4881 remaining (b = 0.19)
1045.11/147.41	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385826-1305575665/watcher-3385826-1305575665 -o /tmp/evaluation-result-3385826-1305575665/solver-3385826-1305575665 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385826-1305575665.cnf -seed 1172052096 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.22 8.53 8.48 2/472 1193
/proc/meminfo: memFree=11850116/32951124 swapFree=65586204/67111528
[pid=1193] ppid=1191 vsize=15760 CPUtime=0 cores=0-7
/proc/1193/stat : 1193 (python) R 1191 1193 800 0 -1 4202496 852 0 0 0 0 0 0 0 20 0 1 0 747797142 16138240 734 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735221895 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/1193/statm: 3943 738 335 364 0 430 0

[startup+0.0949161 s]
/proc/loadavg: 8.22 8.53 8.48 2/472 1193
/proc/meminfo: memFree=11850116/32951124 swapFree=65586204/67111528
[pid=1193] ppid=1191 vsize=85360 CPUtime=0.05 cores=0-7
/proc/1193/stat : 1193 (python) R 1191 1193 800 0 -1 4202496 2573 0 0 0 4 1 0 0 20 0 1 0 747797142 87408640 2301 33554432000 4194304 5683644 140737293044384 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/1193/statm: 21340 2302 707 364 0 1557 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85360

[startup+0.100915 s]
/proc/loadavg: 8.22 8.53 8.48 2/472 1193
/proc/meminfo: memFree=11850116/32951124 swapFree=65586204/67111528
[pid=1193] ppid=1191 vsize=89768 CPUtime=0.06 cores=0-7
/proc/1193/stat : 1193 (python) S 1191 1193 800 0 -1 4202496 2672 0 0 0 5 1 0 0 20 0 1 0 747797142 91922432 2388 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735176704 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/1193/statm: 22442 2388 750 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89768

[startup+0.300901 s]
/proc/loadavg: 8.22 8.53 8.48 2/472 1193
/proc/meminfo: memFree=11850116/32951124 swapFree=65586204/67111528
[pid=1193] ppid=1191 vsize=135748 CPUtime=0.18 cores=0-7
/proc/1193/stat : 1193 (python) S 1191 1193 800 0 -1 4202496 5962 934 1 0 14 4 0 0 17 0 1 0 747797142 139005952 4151 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735174661 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/1193/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700786 s]
/proc/loadavg: 8.22 8.53 8.48 2/472 1193
/proc/meminfo: memFree=11850116/32951124 swapFree=65586204/67111528
[pid=1193] ppid=1191 vsize=278288 CPUtime=0.45 cores=0-7
/proc/1193/stat : 1193 (python) R 1191 1193 800 0 -1 4202496 9307 934 1 0 33 12 0 0 16 0 1 0 747797142 284966912 6978 33554432000 4194304 5683644 140737293044384 18446744073709551615 4623653 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/1193/statm: 69572 6978 1826 364 0 5496 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 278288

[startup+1.50161 s]
/proc/loadavg: 8.22 8.53 8.48 10/496 1221
/proc/meminfo: memFree=11791644/32951124 swapFree=65586204/67111528
[pid=1193] ppid=1191 vsize=361252 CPUtime=0.74 cores=0-7
/proc/1193/stat : 1193 (python) S 1191 1193 800 0 -1 4202496 15678 934 1 0 60 14 0 0 20 0 9 0 747797142 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/1193/statm: 90313 7294 1889 364 0 26210 0
[pid=1199] ppid=1193 vsize=278624 CPUtime=0 cores=0-7
/proc/1199/stat : 1199 (python) S 1193 1193 800 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 747797219 285310976 5568 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198735 0 0 16781312 514 17186012159759351807 0 0 17 6 0 0 0
/proc/1199/statm: 69656 5568 354 364 0 5574 0
[pid=1201] ppid=1199 vsize=1017800 CPUtime=0.72 cores=0-7
/proc/1201/stat : 1201 (gnovelty+2) R 1199 1201 1201 0 -1 4202496 435 0 0 0 72 0 0 0 21 0 1 0 747797220 1042227200 173 33554432000 134512640 135663704 4291556144 18446744073709551615 134545611 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1201/statm: 254450 173 113 282 0 254166 0
[pid=1202] ppid=1193 vsize=289336 CPUtime=0 cores=0-7
/proc/1202/stat : 1202 (python) S 1193 1193 800 0 -1 4202560 747 0 0 0 0 0 0 0 15 0 1 0 747797222 296280064 5692 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 13278195002527154436 0 0 17 2 0 0 0
/proc/1202/statm: 72334 5692 348 364 0 8249 0
[pid=1204] ppid=1202 vsize=2152 CPUtime=0.67 cores=0-7
/proc/1204/stat : 1204 (march_hi) R 1202 1204 1204 0 -1 4202496 593 0 0 0 67 0 0 0 22 0 1 0 747797223 2203648 332 33554432000 4194304 4955518 140734002054624 18446744073709551615 4227571 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1204/statm: 538 332 104 186 0 351 0
[pid=1205] ppid=1193 vsize=299120 CPUtime=0 cores=0-7
/proc/1205/stat : 1205 (python) S 1193 1193 800 0 -1 4202560 754 0 0 0 0 0 0 0 15 0 1 0 747797226 306298880 5593 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 5607404792218353922 0 0 17 2 0 0 0
/proc/1205/statm: 74780 5593 348 364 0 10692 0
[pid=1207] ppid=1205 vsize=2152 CPUtime=0.65 cores=0-7
/proc/1207/stat : 1207 (march_hi) R 1205 1207 1207 0 -1 4202496 595 0 0 0 65 0 0 0 25 0 1 0 747797226 2203648 332 33554432000 4194304 4955518 140733768665632 18446744073709551615 4209688 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1207/statm: 538 332 104 186 0 351 0
[pid=1208] ppid=1193 vsize=309984 CPUtime=0 cores=0-7
/proc/1208/stat : 1208 (python) S 1193 1193 800 0 -1 4202560 759 0 0 0 0 0 0 0 15 0 1 0 747797229 317423616 5717 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 10697324552788082946 0 0 17 4 0 0 0
/proc/1208/statm: 77496 5717 348 364 0 13405 0
[pid=1210] ppid=1208 vsize=2152 CPUtime=0.62 cores=0-7
/proc/1210/stat : 1210 (march_hi) R 1208 1210 1210 0 -1 4202496 596 0 0 0 62 0 0 0 22 0 1 0 747797229 2203648 332 33554432000 4194304 4955518 140735524297408 18446744073709551615 4238422 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1210/statm: 538 332 104 186 0 351 0
[pid=1211] ppid=1193 vsize=320240 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (python) S 1193 1193 800 0 -1 4202560 763 0 0 0 0 0 0 0 16 0 1 0 747797232 327925760 5721 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 9918408525439009026 0 0 17 6 0 0 0
/proc/1211/statm: 80060 5721 348 364 0 15966 0
[pid=1213] ppid=1211 vsize=2152 CPUtime=0.59 cores=0-7
/proc/1213/stat : 1213 (march_hi) R 1211 1213 1213 0 -1 4202496 595 0 0 0 59 0 0 0 25 0 1 0 747797232 2203648 332 33554432000 4194304 4955518 140734926131584 18446744073709551615 4227613 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1213/statm: 538 332 104 186 0 351 0
[pid=1214] ppid=1193 vsize=330496 CPUtime=0 cores=0-7
/proc/1214/stat : 1214 (python) S 1193 1193 800 0 -1 4202560 765 0 0 0 0 0 0 0 23 0 1 0 747797235 338427904 5725 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 9552654608069820415 0 0 17 6 0 0 0
/proc/1214/statm: 82624 5725 348 364 0 18527 0
[pid=1216] ppid=1214 vsize=1017800 CPUtime=0.56 cores=0-7
/proc/1216/stat : 1216 (gnovelty+2) R 1214 1216 1216 0 -1 4202496 440 0 0 0 56 0 0 0 25 0 1 0 747797236 1042227200 174 33554432000 134512640 135663704 4288210256 18446744073709551615 134545793 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1216/statm: 254450 174 113 282 0 254166 0
[pid=1217] ppid=1193 vsize=340752 CPUtime=0 cores=0-7
/proc/1217/stat : 1217 (python) S 1193 1193 800 0 -1 4202560 783 0 0 0 0 0 0 0 17 0 1 0 747797239 348930048 5729 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 6580524319976161539 0 0 17 4 0 0 0
/proc/1217/statm: 85188 5729 348 364 0 21088 0
[pid=1221] ppid=1217 vsize=2000 CPUtime=0.49 cores=0-7
/proc/1221/stat : 1221 (march_hi) R 1217 1221 1221 0 -1 4202496 592 0 0 0 49 0 0 0 21 0 1 0 747797242 2048000 326 33554432000 4194304 4955518 140736519826768 18446744073709551615 4298062 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1221/statm: 500 326 104 186 0 313 0
[pid=1219] ppid=1193 vsize=351008 CPUtime=0 cores=0-7
/proc/1219/stat : 1219 (python) S 1193 1193 800 0 -1 4202560 821 0 0 0 0 0 0 0 17 0 1 0 747797242 359432192 5755 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 5607404792218353922 0 0 17 1 0 0 0
/proc/1219/statm: 87752 5755 354 364 0 23649 0
[pid=1193/tid=1200] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1200/stat : 1200 (python) S 1191 1193 800 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 9 0 747797220 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1203] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1203/stat : 1203 (python) S 1191 1193 800 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 9 0 747797223 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1206] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1206/stat : 1206 (python) S 1191 1193 800 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 9 0 747797226 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1209] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1209/stat : 1209 (python) S 1191 1193 800 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 9 0 747797229 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
[pid=1193/tid=1212] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1212/stat : 1212 (python) S 1191 1193 800 0 -1 4202560 25 934 0 0 0 0 0 0 22 0 9 0 747797232 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1215] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1215/stat : 1215 (python) S 1191 1193 800 0 -1 4202560 28 934 0 0 0 0 0 0 24 0 9 0 747797235 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1218] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1218/stat : 1218 (python) S 1191 1193 800 0 -1 4202560 35 934 0 0 0 0 0 0 19 0 9 0 747797239 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
[pid=1193/tid=1220] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1220/stat : 1220 (python) S 1191 1193 800 0 -1 4202560 21 934 0 0 0 0 0 0 20 0 9 0 747797242 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.04
Current children cumulated vsize (KiB) 4927020

[startup+3.10133 s]
/proc/loadavg: 8.28 8.53 8.48 10/497 1222
/proc/meminfo: memFree=11789264/32951124 swapFree=65586204/67111528
[pid=1193] ppid=1191 vsize=361252 CPUtime=0.74 cores=0-7
/proc/1193/stat : 1193 (python) S 1191 1193 800 0 -1 4202496 15678 934 1 0 60 14 0 0 20 0 9 0 747797142 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/1193/statm: 90313 7294 1889 364 0 26210 0
[pid=1199] ppid=1193 vsize=278624 CPUtime=0 cores=0-7
/proc/1199/stat : 1199 (python) S 1193 1193 800 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 747797219 285310976 5568 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198735 0 0 16781312 514 17186012159759319298 0 0 17 6 0 0 0
/proc/1199/statm: 69656 5568 354 364 0 5574 0
[pid=1201] ppid=1199 vsize=1017800 CPUtime=2.32 cores=0-7
/proc/1201/stat : 1201 (gnovelty+2) R 1199 1201 1201 0 -1 4202496 435 0 0 0 232 0 0 0 25 0 1 0 747797220 1042227200 173 33554432000 134512640 135663704 4291556144 18446744073709551615 134525009 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1201/statm: 254450 173 113 282 0 254166 0
[pid=1202] ppid=1193 vsize=289336 CPUtime=0 cores=0-7
/proc/1202/stat : 1202 (python) S 1193 1193 800 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 747797222 296280064 5692 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 13278195002527154436 0 0 17 2 0 0 0
/proc/1202/statm: 72334 5692 348 364 0 8249 0
[pid=1204] ppid=1202 vsize=2152 CPUtime=2.25 cores=0-7
/proc/1204/stat : 1204 (march_hi) R 1202 1204 1204 0 -1 4202496 608 0 0 0 225 0 0 0 25 0 1 0 747797223 2203648 347 33554432000 4194304 4955518 140734002054624 18446744073709551615 4224656 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1204/statm: 538 347 104 186 0 351 0
[pid=1205] ppid=1193 vsize=299120 CPUtime=0 cores=0-7
/proc/1205/stat : 1205 (python) S 1193 1193 800 0 -1 4202560 758 0 0 0 0 0 0 0 15 0 1 0 747797226 306298880 5593 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 7020544475365605634 0 0 17 2 0 0 0
/proc/1205/statm: 74780 5593 348 364 0 10692 0
[pid=1207] ppid=1205 vsize=2152 CPUtime=2.25 cores=0-7
/proc/1207/stat : 1207 (march_hi) R 1205 1207 1207 0 -1 4202496 610 0 0 0 225 0 0 0 25 0 1 0 747797226 2203648 347 33554432000 4194304 4955518 140733768665632 18446744073709551615 4244887 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1207/statm: 538 347 104 186 0 351 0
[pid=1208] ppid=1193 vsize=309984 CPUtime=0 cores=0-7
/proc/1208/stat : 1208 (python) S 1193 1193 800 0 -1 4202560 768 0 0 0 0 0 0 0 15 0 1 0 747797229 317423616 5717 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 10697324552788082946 0 0 17 4 0 0 0
/proc/1208/statm: 77496 5717 348 364 0 13405 0
[pid=1210] ppid=1208 vsize=2152 CPUtime=2.22 cores=0-7
/proc/1210/stat : 1210 (march_hi) R 1208 1210 1210 0 -1 4202496 611 0 0 0 222 0 0 0 25 0 1 0 747797229 2203648 347 33554432000 4194304 4955518 140735524297408 18446744073709551615 4209667 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1210/statm: 538 347 104 186 0 351 0
[pid=1211] ppid=1193 vsize=320240 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (python) S 1193 1193 800 0 -1 4202560 770 0 0 0 0 0 0 0 15 0 1 0 747797232 327925760 5721 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 9918408525439009026 0 0 17 6 0 0 0
/proc/1211/statm: 80060 5721 348 364 0 15966 0
[pid=1213] ppid=1211 vsize=2152 CPUtime=2.19 cores=0-7
/proc/1213/stat : 1213 (march_hi) R 1211 1213 1213 0 -1 4202496 610 0 0 0 219 0 0 0 25 0 1 0 747797232 2203648 347 33554432000 4194304 4955518 140734926131584 18446744073709551615 4263536 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1213/statm: 538 347 104 186 0 351 0
[pid=1214] ppid=1193 vsize=330496 CPUtime=0 cores=0-7
/proc/1214/stat : 1214 (python) S 1193 1193 800 0 -1 4202560 765 0 0 0 0 0 0 0 18 0 1 0 747797235 338427904 5725 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 9552654608069787908 0 0 17 6 0 0 0
/proc/1214/statm: 82624 5725 348 364 0 18527 0
[pid=1216] ppid=1214 vsize=1017800 CPUtime=2.16 cores=0-7
/proc/1216/stat : 1216 (gnovelty+2) R 1214 1216 1216 0 -1 4202496 440 0 0 0 216 0 0 0 25 0 1 0 747797236 1042227200 174 33554432000 134512640 135663704 4288210256 18446744073709551615 134545786 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1216/statm: 254450 174 113 282 0 254166 0
[pid=1217] ppid=1193 vsize=340752 CPUtime=0 cores=0-7
/proc/1217/stat : 1217 (python) S 1193 1193 800 0 -1 4202560 786 0 0 0 0 0 0 0 15 0 1 0 747797239 348930048 5729 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 6580524319976161539 0 0 17 4 0 0 0
/proc/1217/statm: 85188 5729 348 364 0 21088 0
[pid=1221] ppid=1217 vsize=2152 CPUtime=2.09 cores=0-7
/proc/1221/stat : 1221 (march_hi) R 1217 1221 1221 0 -1 4202496 613 0 0 0 209 0 0 0 25 0 1 0 747797242 2203648 347 33554432000 4194304 4955518 140736519826768 18446744073709551615 4224551 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1221/statm: 538 347 104 186 0 351 0
[pid=1219] ppid=1193 vsize=351008 CPUtime=0 cores=0-7
/proc/1219/stat : 1219 (python) S 1193 1193 800 0 -1 4202560 823 0 0 0 0 0 0 0 15 0 1 0 747797242 359432192 5755 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 13262128938622091522 0 0 17 1 0 0 0
/proc/1219/statm: 87752 5755 354 364 0 23649 0
[pid=1222] ppid=1219 vsize=2152 CPUtime=1.01 cores=0-7
/proc/1222/stat : 1222 (march_hi) R 1219 1222 1222 0 -1 4202496 608 0 0 0 101 0 0 0 25 0 1 0 747797242 2203648 337 33554432000 4194304 4955518 140733886463888 18446744073709551615 4238677 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1222/statm: 538 337 104 186 0 351 0
[pid=1193/tid=1200] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1200/stat : 1200 (python) S 1191 1193 800 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 9 0 747797220 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1203] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1203/stat : 1203 (python) S 1191 1193 800 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 9 0 747797223 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1206] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1206/stat : 1206 (python) S 1191 1193 800 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 9 0 747797226 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1209] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1209/stat : 1209 (python) S 1191 1193 800 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 9 0 747797229 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
[pid=1193/tid=1212] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1212/stat : 1212 (python) S 1191 1193 800 0 -1 4202560 25 934 0 0 0 0 0 0 22 0 9 0 747797232 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1215] ppid=1191 vsize=361252 CPUtime=0 cores=0-7
/proc/1193/task/1215/stat : 1215 (python) S 1191 1193 800 0 -1 4202560 28 934 0 0 0 0 0 0 24 0 9 0 747797235 369922048 7294 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0

################
# More data... #
################

[pid=1211] ppid=1193 vsize=385776 CPUtime=2.83 cores=0-7
/proc/1211/stat : 1211 (python) R 1193 1193 800 0 -1 4202560 1162 0 0 0 220 63 0 0 18 0 2 0 747797232 395034624 5777 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747008831 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/1211/statm: 96444 5777 401 364 0 32350 0
[pid=1213] ppid=1211 vsize=0 CPUtime=143.3 cores=0-7
/proc/1213/stat : 1213 (march_hi) R 1211 1213 1213 0 -1 4202500 2121 0 0 0 14330 0 0 0 25 0 1 0 747797232 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/1213/statm: 0 0 0 0 0 0 0
[pid=1211/tid=1226] ppid=1193 vsize=385776 CPUtime=0 cores=0-7
/proc/1211/task/1226/stat : 1226 (python) S 1193 1193 800 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 747807210 395034624 5777 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 514 18446604452619154432 0 0 -1 0 0 0 0
[pid=1214] ppid=1193 vsize=330496 CPUtime=0.42 cores=0-7
/proc/1214/stat : 1214 (python) S 1193 1193 800 0 -1 4202560 1126 0 0 0 23 19 0 0 19 0 2 0 747797235 338427904 5778 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/1214/statm: 82624 5778 400 364 0 18527 0
[pid=1216] ppid=1214 vsize=1017800 CPUtime=98.72 cores=0-7
/proc/1216/stat : 1216 (gnovelty+2) T 1214 1216 1216 0 -1 4202496 440 0 0 0 9872 0 0 0 25 0 1 0 747797236 1042227200 174 33554432000 134512640 135663704 4288210256 18446744073709551615 134525347 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/1216/statm: 254450 174 113 282 0 254166 0
[pid=1214/tid=1231] ppid=1193 vsize=330496 CPUtime=0 cores=0-7
/proc/1214/task/1231/stat : 1231 (python) S 1193 1193 800 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 747809076 338427904 5778 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 514 18446604442251942080 0 0 -1 6 0 0 0
[pid=1217] ppid=1193 vsize=340752 CPUtime=0.59 cores=0-7
/proc/1217/stat : 1217 (python) S 1193 1193 800 0 -1 4202560 1015 0 0 0 32 27 0 0 15 0 1 0 747797239 348930048 5753 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 6957608979547521283 0 0 17 4 0 0 0
/proc/1217/statm: 85188 5753 372 364 0 21088 0
[pid=1221] ppid=1217 vsize=8432 CPUtime=135.91 cores=0-7
/proc/1221/stat : 1221 (march_hi) R 1217 1221 1221 0 -1 4202496 1990 0 0 0 13590 1 0 0 25 0 1 0 747797242 8634368 1722 33554432000 4194304 4955518 140736519826768 18446744073709551615 4244449 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1221/statm: 2108 1722 104 186 0 1921 0
[pid=1219] ppid=1193 vsize=351008 CPUtime=0.58 cores=0-7
/proc/1219/stat : 1219 (python) S 1193 1193 800 0 -1 4202560 1062 0 0 0 30 28 0 0 15 0 1 0 747797242 359432192 5778 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 13262128938622091522 0 0 17 1 0 0 0
/proc/1219/statm: 87752 5778 377 364 0 23649 0
[pid=1222] ppid=1219 vsize=6284 CPUtime=108.05 cores=0-7
/proc/1222/stat : 1222 (march_hi) R 1219 1222 1222 0 -1 4202496 1565 0 0 0 10805 0 0 0 25 0 1 0 747797242 6434816 1292 33554432000 4194304 4955518 140733886463888 18446744073709551615 4238422 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1222/statm: 1571 1292 104 186 0 1384 0
[pid=1228] ppid=1193 vsize=361396 CPUtime=0.17 cores=0-7
/proc/1228/stat : 1228 (python) S 1193 1193 800 0 -1 4202560 978 0 0 0 9 8 0 0 15 0 1 0 747807257 370069504 5793 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 173850384832364803 0 0 17 4 0 0 0
/proc/1228/statm: 90349 5793 371 364 0 26243 0
[pid=1230] ppid=1228 vsize=2692 CPUtime=22.61 cores=0-7
/proc/1230/stat : 1230 (march_hi) R 1228 1230 1230 0 -1 4202496 749 0 0 0 2261 0 0 0 25 0 1 0 747807258 2756608 476 33554432000 4194304 4955518 140735366033552 18446744073709551615 4209699 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1230/statm: 673 476 104 186 0 486 0
[pid=1232] ppid=1193 vsize=437188 CPUtime=0.07 cores=0-7
/proc/1232/stat : 1232 (python) S 1193 1193 800 0 -1 4202560 844 0 0 0 3 4 0 0 18 0 1 0 747809079 447680512 5970 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 12628568344170037507 0 0 17 4 0 0 0
/proc/1232/statm: 109297 5970 371 364 0 45188 0
[pid=1234] ppid=1232 vsize=182452 CPUtime=27.61 cores=0-7
/proc/1234/stat : 1234 (kcnfs-2006) R 1232 1234 1234 0 -1 4202496 570 0 0 0 2761 0 0 0 25 0 1 0 747809080 186830848 310 33554432000 134512640 135163436 4293826048 18446744073709551615 134572087 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1234/statm: 45613 310 77 159 0 45453 0
[pid=1193/tid=1200] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1200/stat : 1200 (python) S 1191 1193 800 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 11 0 747797220 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1203] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1203/stat : 1203 (python) S 1191 1193 800 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 11 0 747797223 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1206] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1206/stat : 1206 (python) S 1191 1193 800 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 11 0 747797226 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1209] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1209/stat : 1209 (python) S 1191 1193 800 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 11 0 747797229 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
[pid=1193/tid=1212] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1212/stat : 1212 (python) S 1191 1193 800 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 11 0 747797232 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1215] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1215/stat : 1215 (python) S 1191 1193 800 0 -1 4202560 28 934 0 0 0 0 0 0 24 0 11 0 747797235 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1218] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1218/stat : 1218 (python) S 1191 1193 800 0 -1 4202560 35 934 0 0 0 0 0 0 19 0 11 0 747797239 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
[pid=1193/tid=1220] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1220/stat : 1220 (python) S 1191 1193 800 0 -1 4202560 21 934 0 0 0 0 0 0 20 0 11 0 747797242 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
[pid=1193/tid=1229] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1229/stat : 1229 (python) S 1191 1193 800 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 11 0 747807257 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 1 0 0 0
[pid=1193/tid=1233] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1233/stat : 1233 (python) S 1191 1193 800 0 -1 4202560 82 934 0 0 0 0 0 0 20 0 11 0 747809080 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1043.68
Current children cumulated vsize (KiB) 6102112

[startup+147.301 s]
/proc/loadavg: 9.21 8.78 8.57 14/506 1235
/proc/meminfo: memFree=11753340/32951124 swapFree=65586204/67111528
[pid=1193] ppid=1191 vsize=447432 CPUtime=0.84 cores=0-7
/proc/1193/stat : 1193 (python) S 1191 1193 800 0 -1 4202496 17388 934 1 0 70 14 0 0 19 0 11 0 747797142 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/1193/statm: 111858 7497 1894 364 0 47749 0
[pid=1199] ppid=1193 vsize=288868 CPUtime=0.35 cores=0-7
/proc/1199/stat : 1199 (python) S 1193 1193 800 0 -1 4202560 1081 0 0 0 19 16 0 0 19 0 2 0 747797219 295800832 5629 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/1199/statm: 72217 5629 410 364 0 8135 0
[pid=1201] ppid=1199 vsize=1017800 CPUtime=98.38 cores=0-7
/proc/1201/stat : 1201 (gnovelty+2) T 1199 1201 1201 0 -1 4202496 435 0 0 0 9838 0 0 0 25 0 1 0 747797220 1042227200 173 33554432000 134512640 135663704 4291556144 18446744073709551615 134546218 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/1201/statm: 254450 173 113 282 0 254166 0
[pid=1199/tid=1227] ppid=1193 vsize=288868 CPUtime=0 cores=0-7
/proc/1199/task/1227/stat : 1227 (python) S 1193 1193 800 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 747807254 295800832 5629 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 514 18446604452619156224 0 0 -1 6 0 0 0
[pid=1202] ppid=1193 vsize=289336 CPUtime=0.58 cores=0-7
/proc/1202/stat : 1202 (python) S 1193 1193 800 0 -1 4202560 967 0 0 0 32 26 0 0 15 0 1 0 747797222 296280064 5716 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 13278195002527154436 0 0 17 6 0 0 0
/proc/1202/statm: 72334 5716 372 364 0 8249 0
[pid=1204] ppid=1202 vsize=8432 CPUtime=118.98 cores=0-7
/proc/1204/stat : 1204 (march_hi) R 1202 1204 1204 0 -1 4202496 1712 0 0 0 11898 0 0 0 25 0 1 0 747797223 8634368 1449 33554432000 4194304 4955518 140734002054624 18446744073709551615 4209747 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1204/statm: 2108 1449 104 186 0 1921 0
[pid=1205] ppid=1193 vsize=299120 CPUtime=0.59 cores=0-7
/proc/1205/stat : 1205 (python) S 1193 1193 800 0 -1 4202560 975 0 0 0 34 25 0 0 15 0 1 0 747797226 306298880 5616 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 7020544475365605634 0 0 17 2 0 0 0
/proc/1205/statm: 74780 5616 371 364 0 10692 0
[pid=1207] ppid=1205 vsize=8432 CPUtime=140.29 cores=0-7
/proc/1207/stat : 1207 (march_hi) R 1205 1207 1207 0 -1 4202496 2065 0 0 0 14028 1 0 0 25 0 1 0 747797226 8634368 1800 33554432000 4194304 4955518 140733768665632 18446744073709551615 4224687 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1207/statm: 2108 1800 104 186 0 1921 0
[pid=1208] ppid=1193 vsize=309984 CPUtime=0.61 cores=0-7
/proc/1208/stat : 1208 (python) S 1193 1193 800 0 -1 4202560 1001 0 0 0 32 29 0 0 16 0 1 0 747797229 317423616 5741 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 12628568344170037506 0 0 17 0 0 0 0
/proc/1208/statm: 77496 5741 372 364 0 13405 0
[pid=1210] ppid=1208 vsize=8432 CPUtime=142.72 cores=0-7
/proc/1210/stat : 1210 (march_hi) R 1208 1210 1210 0 -1 4202496 2089 0 0 0 14271 1 0 0 25 0 1 0 747797229 8634368 1823 33554432000 4194304 4955518 140735524297408 18446744073709551615 4224672 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1210/statm: 2108 1823 104 186 0 1921 0
[pid=1211] ppid=1193 vsize=385776 CPUtime=3.04 cores=0-7
/proc/1211/stat : 1211 (python) R 1193 1193 800 0 -1 4202560 1162 0 0 0 239 65 0 0 18 0 2 0 747797232 395034624 5777 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747008831 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/1211/statm: 96444 5777 401 364 0 32350 0
[pid=1213] ppid=1211 vsize=0 CPUtime=143.3 cores=0-7
/proc/1213/stat : 1213 (march_hi) R 1211 1213 1213 0 -1 4202500 2121 0 0 0 14330 0 0 0 25 0 1 0 747797232 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/1213/statm: 0 0 0 0 0 0 0
[pid=1211/tid=1226] ppid=1193 vsize=385776 CPUtime=0 cores=0-7
/proc/1211/task/1226/stat : 1226 (python) S 1193 1193 800 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 747807210 395034624 5777 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 514 18446604452619154432 0 0 -1 0 0 0 0
[pid=1214] ppid=1193 vsize=330496 CPUtime=0.42 cores=0-7
/proc/1214/stat : 1214 (python) S 1193 1193 800 0 -1 4202560 1126 0 0 0 23 19 0 0 19 0 2 0 747797235 338427904 5778 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/1214/statm: 82624 5778 400 364 0 18527 0
[pid=1216] ppid=1214 vsize=1017800 CPUtime=98.72 cores=0-7
/proc/1216/stat : 1216 (gnovelty+2) T 1214 1216 1216 0 -1 4202496 440 0 0 0 9872 0 0 0 25 0 1 0 747797236 1042227200 174 33554432000 134512640 135663704 4288210256 18446744073709551615 134525347 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/1216/statm: 254450 174 113 282 0 254166 0
[pid=1214/tid=1231] ppid=1193 vsize=330496 CPUtime=0 cores=0-7
/proc/1214/task/1231/stat : 1231 (python) S 1193 1193 800 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 747809076 338427904 5778 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 514 18446604442251942080 0 0 -1 6 0 0 0
[pid=1217] ppid=1193 vsize=340752 CPUtime=0.59 cores=0-7
/proc/1217/stat : 1217 (python) S 1193 1193 800 0 -1 4202560 1015 0 0 0 32 27 0 0 15 0 1 0 747797239 348930048 5753 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 6957608979547521283 0 0 17 4 0 0 0
/proc/1217/statm: 85188 5753 372 364 0 21088 0
[pid=1221] ppid=1217 vsize=8432 CPUtime=136.11 cores=0-7
/proc/1221/stat : 1221 (march_hi) R 1217 1221 1221 0 -1 4202496 1993 0 0 0 13610 1 0 0 25 0 1 0 747797242 8634368 1725 33554432000 4194304 4955518 140736519826768 18446744073709551615 4224615 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1221/statm: 2108 1725 104 186 0 1921 0
[pid=1219] ppid=1193 vsize=351008 CPUtime=0.58 cores=0-7
/proc/1219/stat : 1219 (python) S 1193 1193 800 0 -1 4202560 1062 0 0 0 30 28 0 0 15 0 1 0 747797242 359432192 5778 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 13262128938622091522 0 0 17 1 0 0 0
/proc/1219/statm: 87752 5778 377 364 0 23649 0
[pid=1222] ppid=1219 vsize=6284 CPUtime=108.25 cores=0-7
/proc/1222/stat : 1222 (march_hi) R 1219 1222 1222 0 -1 4202496 1566 0 0 0 10825 0 0 0 25 0 1 0 747797242 6434816 1293 33554432000 4194304 4955518 140733886463888 18446744073709551615 4227654 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1222/statm: 1571 1293 104 186 0 1384 0
[pid=1228] ppid=1193 vsize=361396 CPUtime=0.17 cores=0-7
/proc/1228/stat : 1228 (python) S 1193 1193 800 0 -1 4202560 978 0 0 0 9 8 0 0 15 0 1 0 747807257 370069504 5793 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 173850384832364803 0 0 17 4 0 0 0
/proc/1228/statm: 90349 5793 371 364 0 26243 0
[pid=1230] ppid=1228 vsize=2692 CPUtime=22.71 cores=0-7
/proc/1230/stat : 1230 (march_hi) R 1228 1230 1230 0 -1 4202496 749 0 0 0 2271 0 0 0 25 0 1 0 747807258 2756608 476 33554432000 4194304 4955518 140735366033552 18446744073709551615 4244951 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1230/statm: 673 476 104 186 0 486 0
[pid=1232] ppid=1193 vsize=437188 CPUtime=0.07 cores=0-7
/proc/1232/stat : 1232 (python) S 1193 1193 800 0 -1 4202560 844 0 0 0 3 4 0 0 18 0 1 0 747809079 447680512 5970 33554432000 4194304 5683644 140737293044384 18446744073709551615 216735198790 0 0 16781312 514 12628568344170037507 0 0 17 4 0 0 0
/proc/1232/statm: 109297 5970 371 364 0 45188 0
[pid=1234] ppid=1232 vsize=182452 CPUtime=27.81 cores=0-7
/proc/1234/stat : 1234 (kcnfs-2006) R 1232 1234 1234 0 -1 4202496 570 0 0 0 2781 0 0 0 25 0 1 0 747809080 186830848 310 33554432000 134512640 135163436 4293826048 18446744073709551615 134559376 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1234/statm: 45613 310 77 159 0 45453 0
[pid=1193/tid=1200] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1200/stat : 1200 (python) S 1191 1193 800 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 11 0 747797220 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1203] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1203/stat : 1203 (python) S 1191 1193 800 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 11 0 747797223 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1206] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1206/stat : 1206 (python) S 1191 1193 800 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 11 0 747797226 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1209] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1209/stat : 1209 (python) S 1191 1193 800 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 11 0 747797229 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
[pid=1193/tid=1212] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1212/stat : 1212 (python) S 1191 1193 800 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 11 0 747797232 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1215] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1215/stat : 1215 (python) S 1191 1193 800 0 -1 4202560 28 934 0 0 0 0 0 0 24 0 11 0 747797235 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1218] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1218/stat : 1218 (python) S 1191 1193 800 0 -1 4202560 35 934 0 0 0 0 0 0 19 0 11 0 747797239 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
[pid=1193/tid=1220] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1220/stat : 1220 (python) S 1191 1193 800 0 -1 4202560 21 934 0 0 0 0 0 0 20 0 11 0 747797242 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
[pid=1193/tid=1229] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1229/stat : 1229 (python) S 1191 1193 800 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 11 0 747807257 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 1 0 0 0
[pid=1193/tid=1233] ppid=1191 vsize=447432 CPUtime=0 cores=0-7
/proc/1193/task/1233/stat : 1233 (python) S 1191 1193 800 0 -1 4202560 82 934 0 0 0 0 0 0 20 0 11 0 747809080 458170368 7497 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 2 18446604453891943488 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1045.11
Current children cumulated vsize (KiB) 6102112

[startup+147.418 s]
/proc/loadavg: 9.21 8.78 8.57 14/506 1235
/proc/meminfo: memFree=11753340/32951124 swapFree=65586204/67111528
[pid=1193] ppid=1191 vsize=396080 CPUtime=1045.97 cores=0-7
/proc/1193/stat : 1193 (python) R 1191 1193 800 0 -1 4202496 19547 25372 1 0 71 15 104249 262 17 0 3 0 747797142 405585920 7366 33554432000 4194304 5683644 140737293044384 18446744073709551615 5119411 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/1193/statm: 99020 7366 1873 364 0 34944 0
[pid=1193/tid=1212] ppid=1191 vsize=396080 CPUtime=1045.11 cores=0-7
/proc/1193/task/1212/stat : 1212 (python) S 1191 1193 800 0 -1 4202560 30 25372 0 0 0 0 104249 262 18 0 3 0 747797232 405585920 7366 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 0 18446604453891943488 0 0 -1 6 0 0 0
[pid=1193/tid=1218] ppid=1191 vsize=396080 CPUtime=1045.11 cores=0-7
/proc/1193/task/1218/stat : 1218 (python) S 1191 1193 800 0 -1 4202560 38 25372 0 0 0 0 104249 262 17 0 3 0 747797239 405585920 7366 33554432000 4194304 5683644 140737293044384 18446744073709551615 216747002289 0 0 16781312 0 18446604453891943488 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1045.97
Current children cumulated vsize (KiB) 396080

Child status: 0
Real time (s): 147.43
CPU time (s): 1046
CPU user time (s): 1043.22
CPU system time (s): 2.77958
CPU usage (%): 709.487
Max. virtual memory (cumulated for all children) (KiB): 6110544

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1043.22
system time used= 2.77958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 47141
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6963
involuntary context switches= 9411

runsolver used 0.839872 second user time and 1.73074 second system time

The end

Launcher Data 

Begin job on node119 at 2011-05-16 21:54:25
IDJOB=3385826
IDBENCH=83091
IDSOLVER=1870
FILE ID=node119/3385826-1305575665
RUNJOBID= node119-1305573364-814
PBS_JOBID= 13350159
Free space on /tmp= 73052 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v450-c1917-S1959079526-027.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385826-1305575665/watcher-3385826-1305575665 -o /tmp/evaluation-result-3385826-1305575665/solver-3385826-1305575665 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385826-1305575665.cnf -seed 1172052096 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f44a4cf4fe89dcbd323f749ee3ba0f10
RANDOM SEED=1172052096

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      11850272 kB
Buffers:        319936 kB
Cached:        5570448 kB
SwapCached:       4756 kB
Active:       16956368 kB
Inactive:      3781208 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      11850272 kB
SwapTotal:    67111528 kB
SwapFree:     65586204 kB
Dirty:           31964 kB
Writeback:           0 kB
AnonPages:    14846208 kB
Mapped:          35688 kB
Slab:           217780 kB
PageTables:      71756 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 141818312 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73024 MiB
End job on node119 at 2011-05-16 21:56:52