Trace number 3385678

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 253.956 32.4125

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v400-c1704-S1409021001-079.UNKNOWN.cnf
MD5SUMcfd96c3ec450000d8fe8684f0b30ec79
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark30.4254
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses1704
Sum of the clauses size5112
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31704
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.32/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.46	c INFO: solving HOME/instance-3385678-1305572165.cnf
0.32/0.46	c INFO: computing task features
0.32/0.47	c INFO: computed variable-clause graph statistics
0.32/0.47	c INFO: computed clause balance statistics
0.41/0.50	c INFO: computed variable balance statistics
0.41/0.53	c INFO: computed small-clause counts
0.41/0.53	c INFO: computed Horn-clause counts
0.41/0.53	c INFO: computed variable graph statistics
0.41/0.53	c INFO: collected features for HOME/instance-3385678-1305572165.cnf in 0.07 s
0.41/0.56	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.56)
0.41/0.59	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.39)
0.51/0.62	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.35)
0.51/0.65	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.35)
0.51/0.68	c INFO: running march_hi@0 for 97 with 4999 remaining (b = 0.11)
0.61/0.71	c INFO: running TNM@0 for 97 with 4999 remaining (b = 0.07)
0.61/0.75	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.24)
0.61/0.78	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.22)
253.45/32.38	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385678-1305572165/watcher-3385678-1305572165 -o /tmp/evaluation-result-3385678-1305572165/solver-3385678-1305572165 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385678-1305572165.cnf -seed 695416865 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.93 8.36 8.36 1/391 1232
/proc/meminfo: memFree=12648132/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=15184 CPUtime=0 cores=0-7
/proc/1232/stat : 1232 (python) S 1230 1232 1091 0 -1 4202496 724 0 0 0 0 0 0 0 25 0 1 0 668816168 15548416 615 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/1232/statm: 3796 615 321 364 0 283 0

[startup+0.0578109 s]
/proc/loadavg: 7.93 8.36 8.36 1/391 1232
/proc/meminfo: memFree=12648132/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=36512 CPUtime=0.03 cores=0-7
/proc/1232/stat : 1232 (python) S 1230 1232 1091 0 -1 4202496 1613 0 0 0 3 0 0 0 25 0 1 0 668816168 37388288 1445 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/1232/statm: 9128 1445 452 364 0 945 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 36512

[startup+0.100804 s]
/proc/loadavg: 7.93 8.36 8.36 1/391 1232
/proc/meminfo: memFree=12648132/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=104232 CPUtime=0.07 cores=0-7
/proc/1232/stat : 1232 (python) S 1230 1232 1091 0 -1 4202496 3071 0 0 0 5 2 0 0 17 0 1 0 668816168 106733568 2752 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/1232/statm: 26059 2755 847 364 0 1807 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104232

[startup+0.300766 s]
/proc/loadavg: 7.93 8.36 8.36 1/391 1232
/proc/meminfo: memFree=12648132/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=187744 CPUtime=0.23 cores=0-7
/proc/1232/stat : 1232 (python) R 1230 1232 1091 0 -1 4202496 6779 938 1 0 17 6 0 0 18 0 1 0 668816168 192249856 4846 33554432000 4194304 5683644 140735814055440 18446744073709551615 208075263915 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1232/statm: 46936 4846 1366 364 0 3724 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 187744

[startup+0.700613 s]
/proc/loadavg: 7.93 8.36 8.36 1/391 1232
/proc/meminfo: memFree=12648132/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=395836 CPUtime=0.61 cores=0-7
/proc/1232/stat : 1232 (python) R 1230 1232 1091 0 -1 4202496 13234 938 1 0 50 11 0 0 25 0 6 0 668816168 405336064 7394 33554432000 4194304 5683644 140735814055440 18446744073709551615 47889489084704 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1232/statm: 98959 7394 1882 364 0 34865 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 395836

[startup+1.50146 s]
/proc/loadavg: 7.93 8.36 8.36 11/416 1261
/proc/meminfo: memFree=12593744/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=426604 CPUtime=0.68 cores=0-7
/proc/1232/stat : 1232 (python) S 1230 1232 1091 0 -1 4202496 15179 938 1 0 57 11 0 0 25 0 9 0 668816168 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1232/statm: 106651 7428 1889 364 0 42548 0
[pid=1238] ppid=1232 vsize=278448 CPUtime=0 cores=0-7
/proc/1238/stat : 1238 (python) S 1232 1232 1091 0 -1 4202560 733 0 0 0 0 0 0 0 19 0 1 0 668816224 285130752 5547 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252431 0 0 16781312 514 10254691408015261695 0 0 17 1 0 0 0
/proc/1238/statm: 69612 5547 354 364 0 5530 0
[pid=1240] ppid=1238 vsize=1017800 CPUtime=0.93 cores=0-7
/proc/1240/stat : 1240 (gnovelty+2) R 1238 1240 1240 0 -1 4202496 433 0 0 0 93 0 0 0 23 0 1 0 668816225 1042227200 169 33554432000 134512640 135663704 4293027600 18446744073709551615 134544132 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1240/statm: 254450 169 113 282 0 254166 0
[pid=1241] ppid=1232 vsize=289288 CPUtime=0 cores=0-7
/proc/1241/stat : 1241 (python) S 1232 1232 1091 0 -1 4202560 746 0 0 0 0 0 0 0 15 0 1 0 668816227 296230912 5679 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 14038881127087702275 0 0 17 7 0 0 0
/proc/1241/statm: 72322 5679 348 364 0 8237 0
[pid=1243] ppid=1241 vsize=1928 CPUtime=0.9 cores=0-7
/proc/1243/stat : 1243 (march_hi) R 1241 1243 1243 0 -1 4202496 579 0 0 0 90 0 0 0 25 0 1 0 668816227 1974272 315 33554432000 4194304 4955518 140733517813696 18446744073709551615 4238462 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1243/statm: 482 315 104 186 0 295 0
[pid=1244] ppid=1232 vsize=365080 CPUtime=0 cores=0-7
/proc/1244/stat : 1244 (python) S 1232 1232 1091 0 -1 4202560 709 0 0 0 0 0 0 0 15 0 1 0 668816230 373841920 5856 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 232260840546337028 0 0 17 7 0 0 0
/proc/1244/statm: 91270 5856 348 364 0 27182 0
[pid=1246] ppid=1244 vsize=1928 CPUtime=0.87 cores=0-7
/proc/1246/stat : 1246 (march_hi) R 1244 1246 1246 0 -1 4202496 567 0 0 0 87 0 0 0 25 0 1 0 668816231 1974272 314 33554432000 4194304 4955518 140733828594816 18446744073709551615 4286757 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1246/statm: 482 314 104 186 0 295 0
[pid=1247] ppid=1232 vsize=375336 CPUtime=0 cores=0-7
/proc/1247/stat : 1247 (python) S 1232 1232 1091 0 -1 4202560 723 0 0 0 0 0 0 0 15 0 1 0 668816233 384344064 5817 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 5206249134465450243 0 0 17 7 0 0 0
/proc/1247/statm: 93834 5817 348 364 0 29743 0
[pid=1249] ppid=1247 vsize=1928 CPUtime=0.82 cores=0-7
/proc/1249/stat : 1249 (march_hi) R 1247 1249 1249 0 -1 4202496 569 0 0 0 82 0 0 0 25 0 1 0 668816234 1974272 314 33554432000 4194304 4955518 140733624986624 18446744073709551615 4330502 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1249/statm: 482 314 104 186 0 295 0
[pid=1250] ppid=1232 vsize=385592 CPUtime=0 cores=0-7
/proc/1250/stat : 1250 (python) S 1232 1232 1091 0 -1 4202560 731 0 0 0 0 0 0 0 19 0 1 0 668816236 394846208 5841 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 6911367368773959938 0 0 17 1 0 0 0
/proc/1250/statm: 96398 5841 349 364 0 32304 0
[pid=1252] ppid=1250 vsize=1928 CPUtime=0.8 cores=0-7
/proc/1252/stat : 1252 (march_hi) R 1250 1252 1252 0 -1 4202496 573 0 0 0 80 0 0 0 25 0 1 0 668816237 1974272 315 33554432000 4194304 4955518 140737482081632 18446744073709551615 4209740 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1252/statm: 482 315 104 186 0 295 0
[pid=1253] ppid=1232 vsize=395848 CPUtime=0 cores=0-7
/proc/1253/stat : 1253 (python) S 1232 1232 1091 0 -1 4202560 713 0 0 0 0 0 0 0 25 0 1 0 668816240 405348352 5856 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 13113685523023527935 0 0 17 2 0 0 0
/proc/1253/statm: 98962 5856 344 364 0 34865 0
[pid=1255] ppid=1253 vsize=454912 CPUtime=0.77 cores=0-7
/proc/1255/stat : 1255 (TNM) R 1253 1255 1255 0 -1 4202496 417 0 0 0 77 0 0 0 25 0 1 0 668816240 465829888 160 33554432000 134512640 135008748 4286728176 18446744073709551615 134529509 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1255/statm: 113728 160 46 122 0 112628 0
[pid=1256] ppid=1232 vsize=406104 CPUtime=0 cores=0-7
/proc/1256/stat : 1256 (python) S 1232 1232 1091 0 -1 4202560 754 0 0 0 0 0 0 0 20 0 1 0 668816243 415850496 5864 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 10942374908293775616 0 0 17 2 0 0 0
/proc/1256/statm: 101526 5864 349 364 0 37426 0
[pid=1258] ppid=1256 vsize=1928 CPUtime=0.73 cores=0-7
/proc/1258/stat : 1258 (march_hi) R 1256 1258 1258 0 -1 4202496 569 0 0 0 73 0 0 0 25 0 1 0 668816243 1974272 311 33554432000 4194304 4955518 140734663198848 18446744073709551615 4227651 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1258/statm: 482 311 104 186 0 295 0
[pid=1259] ppid=1232 vsize=416360 CPUtime=0 cores=0-7
/proc/1259/stat : 1259 (python) S 1232 1232 1091 0 -1 4202560 786 0 0 0 0 0 0 0 20 0 1 0 668816246 426352640 5889 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 6911354174634426627 0 0 17 6 0 0 0
/proc/1259/statm: 104090 5889 354 364 0 39987 0
[pid=1261] ppid=1259 vsize=1928 CPUtime=0.68 cores=0-7
/proc/1261/stat : 1261 (march_hi) R 1259 1261 1261 0 -1 4202496 576 0 0 0 68 0 0 0 25 0 1 0 668816249 1974272 310 33554432000 4194304 4955518 140735304503648 18446744073709551615 4284431 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1261/statm: 482 310 104 186 0 295 0
[pid=1232/tid=1239] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1239/stat : 1239 (python) S 1230 1232 1091 0 -1 4202560 27 938 0 0 0 0 0 0 19 0 9 0 668816224 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 4 0 0 0
[pid=1232/tid=1242] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1242/stat : 1242 (python) S 1230 1232 1091 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 9 0 668816227 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 3 0 0 0
[pid=1232/tid=1245] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1245/stat : 1245 (python) S 1230 1232 1091 0 -1 4202560 76 938 0 0 0 0 0 0 21 0 9 0 668816230 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1248] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1248/stat : 1248 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 23 0 9 0 668816233 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1251] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1251/stat : 1251 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816237 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 0 0 0 0
[pid=1232/tid=1254] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1254/stat : 1254 (python) S 1230 1232 1091 0 -1 4202560 32 938 0 0 0 0 0 0 25 0 9 0 668816240 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 0 0 0 0
[pid=1232/tid=1257] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1257/stat : 1257 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816243 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 2 0 0 0
[pid=1232/tid=1260] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1260/stat : 1260 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816246 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 7.18
Current children cumulated vsize (KiB) 4822940

[startup+3.10115 s]
/proc/loadavg: 7.93 8.36 8.36 9/416 1261
/proc/meminfo: memFree=12592752/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=426604 CPUtime=0.68 cores=0-7
/proc/1232/stat : 1232 (python) S 1230 1232 1091 0 -1 4202496 15179 938 1 0 57 11 0 0 25 0 9 0 668816168 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1232/statm: 106651 7428 1889 364 0 42548 0
[pid=1238] ppid=1232 vsize=278448 CPUtime=0 cores=0-7
/proc/1238/stat : 1238 (python) S 1232 1232 1091 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 668816224 285130752 5547 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252431 0 0 16781312 514 10254691408015229188 0 0 17 1 0 0 0
/proc/1238/statm: 69612 5547 354 364 0 5530 0
[pid=1240] ppid=1238 vsize=1017800 CPUtime=2.53 cores=0-7
/proc/1240/stat : 1240 (gnovelty+2) R 1238 1240 1240 0 -1 4202496 433 0 0 0 253 0 0 0 25 0 1 0 668816225 1042227200 169 33554432000 134512640 135663704 4293027600 18446744073709551615 134544196 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1240/statm: 254450 169 113 282 0 254166 0
[pid=1241] ppid=1232 vsize=289288 CPUtime=0 cores=0-7
/proc/1241/stat : 1241 (python) S 1232 1232 1091 0 -1 4202560 749 0 0 0 0 0 0 0 15 0 1 0 668816227 296230912 5679 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 14038881127087702275 0 0 17 7 0 0 0
/proc/1241/statm: 72322 5679 348 364 0 8237 0
[pid=1243] ppid=1241 vsize=2060 CPUtime=2.5 cores=0-7
/proc/1243/stat : 1243 (march_hi) R 1241 1243 1243 0 -1 4202496 594 0 0 0 250 0 0 0 25 0 1 0 668816227 2109440 330 33554432000 4194304 4955518 140733517813696 18446744073709551615 4225345 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1243/statm: 515 330 104 186 0 328 0
[pid=1244] ppid=1232 vsize=365080 CPUtime=0 cores=0-7
/proc/1244/stat : 1244 (python) S 1232 1232 1091 0 -1 4202560 711 0 0 0 0 0 0 0 15 0 1 0 668816230 373841920 5856 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 232260840546337028 0 0 17 7 0 0 0
/proc/1244/statm: 91270 5856 348 364 0 27182 0
[pid=1246] ppid=1244 vsize=2060 CPUtime=2.47 cores=0-7
/proc/1246/stat : 1246 (march_hi) R 1244 1246 1246 0 -1 4202496 582 0 0 0 247 0 0 0 25 0 1 0 668816231 2109440 329 33554432000 4194304 4955518 140733828594816 18446744073709551615 4227800 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1246/statm: 515 329 104 186 0 328 0
[pid=1247] ppid=1232 vsize=375336 CPUtime=0 cores=0-7
/proc/1247/stat : 1247 (python) S 1232 1232 1091 0 -1 4202560 726 0 0 0 0 0 0 0 15 0 1 0 668816233 384344064 5817 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 5206249134465450243 0 0 17 7 0 0 0
/proc/1247/statm: 93834 5817 348 364 0 29743 0
[pid=1249] ppid=1247 vsize=2060 CPUtime=2.4 cores=0-7
/proc/1249/stat : 1249 (march_hi) R 1247 1249 1249 0 -1 4202496 583 0 0 0 240 0 0 0 25 0 1 0 668816234 2109440 328 33554432000 4194304 4955518 140733624986624 18446744073709551615 4209699 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1249/statm: 515 328 104 186 0 328 0
[pid=1250] ppid=1232 vsize=385592 CPUtime=0 cores=0-7
/proc/1250/stat : 1250 (python) S 1232 1232 1091 0 -1 4202560 735 0 0 0 0 0 0 0 15 0 1 0 668816236 394846208 5841 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 6911367368773959938 0 0 17 1 0 0 0
/proc/1250/statm: 96398 5841 349 364 0 32304 0
[pid=1252] ppid=1250 vsize=2060 CPUtime=2.4 cores=0-7
/proc/1252/stat : 1252 (march_hi) R 1250 1252 1252 0 -1 4202496 587 0 0 0 240 0 0 0 25 0 1 0 668816237 2109440 329 33554432000 4194304 4955518 140737482081632 18446744073709551615 4224608 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1252/statm: 515 329 104 186 0 328 0
[pid=1253] ppid=1232 vsize=395848 CPUtime=0 cores=0-7
/proc/1253/stat : 1253 (python) S 1232 1232 1091 0 -1 4202560 730 0 0 0 0 0 0 0 18 0 1 0 668816240 405348352 5860 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 13113685523023495426 0 0 17 2 0 0 0
/proc/1253/statm: 98962 5860 348 364 0 34865 0
[pid=1255] ppid=1253 vsize=454912 CPUtime=2.37 cores=0-7
/proc/1255/stat : 1255 (TNM) R 1253 1255 1255 0 -1 4202496 417 0 0 0 237 0 0 0 25 0 1 0 668816240 465829888 160 33554432000 134512640 135008748 4286728176 18446744073709551615 134529402 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1255/statm: 113728 160 46 122 0 112628 0
[pid=1256] ppid=1232 vsize=406104 CPUtime=0 cores=0-7
/proc/1256/stat : 1256 (python) S 1232 1232 1091 0 -1 4202560 757 0 0 0 0 0 0 0 15 0 1 0 668816243 415850496 5864 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 10942374908293775616 0 0 17 2 0 0 0
/proc/1256/statm: 101526 5864 349 364 0 37426 0
[pid=1258] ppid=1256 vsize=2060 CPUtime=2.33 cores=0-7
/proc/1258/stat : 1258 (march_hi) R 1256 1258 1258 0 -1 4202496 587 0 0 0 233 0 0 0 25 0 1 0 668816243 2109440 329 33554432000 4194304 4955518 140734663198848 18446744073709551615 4209664 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1258/statm: 515 329 104 186 0 328 0
[pid=1259] ppid=1232 vsize=416360 CPUtime=0 cores=0-7
/proc/1259/stat : 1259 (python) S 1232 1232 1091 0 -1 4202560 790 0 0 0 0 0 0 0 15 0 1 0 668816246 426352640 5889 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 6911354174634426627 0 0 17 6 0 0 0
/proc/1259/statm: 104090 5889 354 364 0 39987 0
[pid=1261] ppid=1259 vsize=2060 CPUtime=2.28 cores=0-7
/proc/1261/stat : 1261 (march_hi) R 1259 1261 1261 0 -1 4202496 595 0 0 0 228 0 0 0 25 0 1 0 668816249 2109440 329 33554432000 4194304 4955518 140735304503648 18446744073709551615 4298069 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1261/statm: 515 329 104 186 0 328 0
[pid=1232/tid=1239] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1239/stat : 1239 (python) S 1230 1232 1091 0 -1 4202560 27 938 0 0 0 0 0 0 19 0 9 0 668816224 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 4 0 0 0
[pid=1232/tid=1242] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1242/stat : 1242 (python) S 1230 1232 1091 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 9 0 668816227 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 3 0 0 0
[pid=1232/tid=1245] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1245/stat : 1245 (python) S 1230 1232 1091 0 -1 4202560 76 938 0 0 0 0 0 0 21 0 9 0 668816230 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1248] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1248/stat : 1248 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 23 0 9 0 668816233 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1251] ppid=1230 vsize=426604 CPUtime=0 cores=0-7

################
# More data... #
################

/proc/1232/task/1242/stat : 1242 (python) S 1230 1232 1091 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 9 0 668816227 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 3 0 0 0
[pid=1232/tid=1245] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1245/stat : 1245 (python) S 1230 1232 1091 0 -1 4202560 76 938 0 0 0 0 0 0 21 0 9 0 668816230 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1248] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1248/stat : 1248 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 23 0 9 0 668816233 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1251] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1251/stat : 1251 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816237 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 0 0 0 0
[pid=1232/tid=1254] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1254/stat : 1254 (python) S 1230 1232 1091 0 -1 4202560 32 938 0 0 0 0 0 0 25 0 9 0 668816240 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 0 0 0 0
[pid=1232/tid=1257] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1257/stat : 1257 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816243 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 2 0 0 0
[pid=1232/tid=1260] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1260/stat : 1260 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816246 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 243.53
Current children cumulated vsize (KiB) 4830428

[startup+31.9147 s]
/proc/loadavg: 8.03 8.34 8.36 15/416 1261
/proc/meminfo: memFree=12597404/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=426604 CPUtime=0.68 cores=0-7
/proc/1232/stat : 1232 (python) S 1230 1232 1091 0 -1 4202496 15179 938 1 0 57 11 0 0 25 0 9 0 668816168 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1232/statm: 106651 7428 1889 364 0 42548 0
[pid=1238] ppid=1232 vsize=278448 CPUtime=0.08 cores=0-7
/proc/1238/stat : 1238 (python) S 1232 1232 1091 0 -1 4202560 904 0 0 0 3 5 0 0 18 0 1 0 668816224 285130752 5570 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252431 0 0 16781312 514 3335320144346841348 0 0 17 7 0 0 0
/proc/1238/statm: 69612 5570 377 364 0 5530 0
[pid=1240] ppid=1238 vsize=1017800 CPUtime=31.34 cores=0-7
/proc/1240/stat : 1240 (gnovelty+2) R 1238 1240 1240 0 -1 4202496 433 0 0 0 3134 0 0 0 25 0 1 0 668816225 1042227200 169 33554432000 134512640 135663704 4293027600 18446744073709551615 134546181 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1240/statm: 254450 169 113 282 0 254166 0
[pid=1241] ppid=1232 vsize=289288 CPUtime=0.55 cores=0-7
/proc/1241/stat : 1241 (python) R 1232 1232 1091 0 -1 4202560 934 0 0 0 44 11 0 0 16 0 1 0 668816227 296230912 5702 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 3 0 0 0
/proc/1241/statm: 72322 5702 371 364 0 8237 0
[pid=1243] ppid=1241 vsize=0 CPUtime=30.8 cores=0-7
/proc/1243/stat : 1243 (march_hi) R 1241 1243 1243 0 -1 4202500 874 0 0 0 3080 0 0 0 25 0 1 0 668816227 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/1243/statm: 0 0 0 0 0 0 0
[pid=1244] ppid=1232 vsize=365080 CPUtime=0.59 cores=0-7
/proc/1244/stat : 1244 (python) R 1232 1232 1091 0 -1 4202560 813 0 0 0 50 9 0 0 16 0 1 0 668816230 373841920 5879 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/1244/statm: 91270 5879 371 364 0 27182 0
[pid=1246] ppid=1244 vsize=0 CPUtime=30.67 cores=0-7
/proc/1246/stat : 1246 (march_hi) R 1244 1246 1246 0 -1 4202500 862 0 0 0 3067 0 0 0 25 0 1 0 668816231 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1246/statm: 0 0 0 0 0 0 0
[pid=1247] ppid=1232 vsize=375336 CPUtime=0.11 cores=0-7
/proc/1247/stat : 1247 (python) S 1232 1232 1091 0 -1 4202560 821 0 0 0 6 5 0 0 15 0 1 0 668816233 384344064 5842 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 5206249134465450243 0 0 17 7 0 0 0
/proc/1247/statm: 93834 5842 372 364 0 29743 0
[pid=1249] ppid=1247 vsize=3176 CPUtime=30.67 cores=0-7
/proc/1249/stat : 1249 (march_hi) R 1247 1249 1249 0 -1 4202496 858 0 0 0 3067 0 0 0 25 0 1 0 668816234 3252224 584 33554432000 4194304 4955518 140733624986624 18446744073709551615 4224693 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1249/statm: 794 584 104 186 0 607 0
[pid=1250] ppid=1232 vsize=385592 CPUtime=0.49 cores=0-7
/proc/1250/stat : 1250 (python) R 1232 1232 1091 0 -1 4202560 819 0 0 0 39 10 0 0 16 0 1 0 668816236 394846208 5865 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/1250/statm: 96398 5865 373 364 0 32304 0
[pid=1252] ppid=1250 vsize=0 CPUtime=30.63 cores=0-7
/proc/1252/stat : 1252 (march_hi) R 1250 1252 1252 0 -1 4202500 868 0 0 0 3063 0 0 0 25 0 1 0 668816237 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1252/statm: 0 0 0 0 0 0 0
[pid=1253] ppid=1232 vsize=395848 CPUtime=0.08 cores=0-7
/proc/1253/stat : 1253 (python) R 1232 1232 1091 0 -1 4202560 814 0 0 0 4 4 0 0 18 0 1 0 668816240 405348352 5883 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/1253/statm: 98962 5883 371 364 0 34865 0
[pid=1255] ppid=1253 vsize=454912 CPUtime=31.19 cores=0-7
/proc/1255/stat : 1255 (TNM) R 1253 1255 1255 0 -1 4202496 417 0 0 0 3119 0 0 0 25 0 1 0 668816240 465829888 160 33554432000 134512640 135008748 4286728176 18446744073709551615 134529155 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1255/statm: 113728 160 46 122 0 112628 0
[pid=1256] ppid=1232 vsize=406104 CPUtime=0.32 cores=0-7
/proc/1256/stat : 1256 (python) R 1232 1232 1091 0 -1 4202560 846 0 0 0 25 7 0 0 16 0 1 0 668816243 415850496 5887 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/1256/statm: 101526 5887 372 364 0 37426 0
[pid=1258] ppid=1256 vsize=0 CPUtime=30.73 cores=0-7
/proc/1258/stat : 1258 (march_hi) R 1256 1258 1258 0 -1 4202500 868 0 0 0 3073 0 0 0 25 0 1 0 668816243 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/1258/statm: 0 0 0 0 0 0 0
[pid=1259] ppid=1232 vsize=416360 CPUtime=0.34 cores=0-7
/proc/1259/stat : 1259 (python) S 1232 1232 1091 0 -1 4202560 879 0 0 0 27 7 0 0 16 0 1 0 668816246 426352640 5912 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/1259/statm: 104090 5912 377 364 0 39987 0
[pid=1261] ppid=1259 vsize=0 CPUtime=30.75 cores=0-7
/proc/1261/stat : 1261 (march_hi) R 1259 1261 1261 0 -1 4202500 876 0 0 0 3075 0 0 0 25 0 1 0 668816249 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/1261/statm: 0 0 0 0 0 0 0
[pid=1232/tid=1239] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1239/stat : 1239 (python) S 1230 1232 1091 0 -1 4202560 27 938 0 0 0 0 0 0 19 0 9 0 668816224 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 4 0 0 0
[pid=1232/tid=1242] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1242/stat : 1242 (python) S 1230 1232 1091 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 9 0 668816227 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 3 0 0 0
[pid=1232/tid=1245] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1245/stat : 1245 (python) S 1230 1232 1091 0 -1 4202560 76 938 0 0 0 0 0 0 21 0 9 0 668816230 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1248] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1248/stat : 1248 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 23 0 9 0 668816233 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1251] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1251/stat : 1251 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816237 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 0 0 0 0
[pid=1232/tid=1254] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1254/stat : 1254 (python) S 1230 1232 1091 0 -1 4202560 32 938 0 0 0 0 0 0 25 0 9 0 668816240 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 0 0 0 0
[pid=1232/tid=1257] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1257/stat : 1257 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816243 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 2 0 0 0
[pid=1232/tid=1260] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1260/stat : 1260 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816246 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 250.02
Current children cumulated vsize (KiB) 4814548

[startup+32.3416 s]
/proc/loadavg: 8.03 8.34 8.36 15/416 1261
/proc/meminfo: memFree=12597404/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=426604 CPUtime=0.68 cores=0-7
/proc/1232/stat : 1232 (python) S 1230 1232 1091 0 -1 4202496 15179 938 1 0 57 11 0 0 25 0 9 0 668816168 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1232/statm: 106651 7428 1889 364 0 42548 0
[pid=1238] ppid=1232 vsize=278448 CPUtime=0.08 cores=0-7
/proc/1238/stat : 1238 (python) S 1232 1232 1091 0 -1 4202560 904 0 0 0 3 5 0 0 18 0 1 0 668816224 285130752 5570 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252431 0 0 16781312 514 3335320144346841348 0 0 17 7 0 0 0
/proc/1238/statm: 69612 5570 377 364 0 5530 0
[pid=1240] ppid=1238 vsize=1017800 CPUtime=31.77 cores=0-7
/proc/1240/stat : 1240 (gnovelty+2) R 1238 1240 1240 0 -1 4202496 433 0 0 0 3177 0 0 0 25 0 1 0 668816225 1042227200 169 33554432000 134512640 135663704 4293027600 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1240/statm: 254450 169 113 282 0 254166 0
[pid=1241] ppid=1232 vsize=289288 CPUtime=0.98 cores=0-7
/proc/1241/stat : 1241 (python) R 1232 1232 1091 0 -1 4202560 934 0 0 0 81 17 0 0 16 0 1 0 668816227 296230912 5702 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 0 0 0 17 3 0 0 0
/proc/1241/statm: 72322 5702 371 364 0 8237 0
[pid=1243] ppid=1241 vsize=0 CPUtime=30.8 cores=0-7
/proc/1243/stat : 1243 (march_hi) R 1241 1243 1243 0 -1 4202500 874 0 0 0 3080 0 0 0 25 0 1 0 668816227 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/1243/statm: 0 0 0 0 0 0 0
[pid=1244] ppid=1232 vsize=365080 CPUtime=1.02 cores=0-7
/proc/1244/stat : 1244 (python) R 1232 1232 1091 0 -1 4202560 813 0 0 0 88 14 0 0 16 0 1 0 668816230 373841920 5879 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/1244/statm: 91270 5879 371 364 0 27182 0
[pid=1246] ppid=1244 vsize=0 CPUtime=30.67 cores=0-7
/proc/1246/stat : 1246 (march_hi) R 1244 1246 1246 0 -1 4202500 862 0 0 0 3067 0 0 0 25 0 1 0 668816231 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1246/statm: 0 0 0 0 0 0 0
[pid=1247] ppid=1232 vsize=375336 CPUtime=0.22 cores=0-7
/proc/1247/stat : 1247 (python) R 1232 1232 1091 0 -1 4202560 821 0 0 0 15 7 0 0 15 0 1 0 668816233 384344064 5842 33554432000 4194304 5683644 140735814055440 18446744073709551615 4532133 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/1247/statm: 93834 5842 372 364 0 29743 0
[pid=1249] ppid=1247 vsize=0 CPUtime=31 cores=0-7
/proc/1249/stat : 1249 (march_hi) R 1247 1249 1249 0 -1 4202500 864 0 0 0 3100 0 0 0 25 0 1 0 668816234 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/1249/statm: 0 0 0 0 0 0 0
[pid=1250] ppid=1232 vsize=385592 CPUtime=0.91 cores=0-7
/proc/1250/stat : 1250 (python) R 1232 1232 1091 0 -1 4202560 819 0 0 0 77 14 0 0 16 0 1 0 668816236 394846208 5865 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/1250/statm: 96398 5865 373 364 0 32304 0
[pid=1252] ppid=1250 vsize=0 CPUtime=30.63 cores=0-7
/proc/1252/stat : 1252 (march_hi) R 1250 1252 1252 0 -1 4202500 868 0 0 0 3063 0 0 0 25 0 1 0 668816237 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/1252/statm: 0 0 0 0 0 0 0
[pid=1253] ppid=1232 vsize=395848 CPUtime=0.08 cores=0-7
/proc/1253/stat : 1253 (python) S 1232 1232 1091 0 -1 4202560 814 0 0 0 4 4 0 0 18 0 1 0 668816240 405348352 5883 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 3335320144346841346 0 0 17 4 0 0 0
/proc/1253/statm: 98962 5883 371 364 0 34865 0
[pid=1255] ppid=1253 vsize=454912 CPUtime=31.62 cores=0-7
/proc/1255/stat : 1255 (TNM) R 1253 1255 1255 0 -1 4202496 417 0 0 0 3162 0 0 0 25 0 1 0 668816240 465829888 160 33554432000 134512640 135008748 4286728176 18446744073709551615 134536565 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1255/statm: 113728 160 46 122 0 112628 0
[pid=1256] ppid=1232 vsize=406104 CPUtime=0.74 cores=0-7
/proc/1256/stat : 1256 (python) R 1232 1232 1091 0 -1 4202560 846 0 0 0 61 13 0 0 16 0 1 0 668816243 415850496 5887 33554432000 4194304 5683644 140735814055440 18446744073709551615 208080252486 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/1256/statm: 101526 5887 372 364 0 37426 0
[pid=1258] ppid=1256 vsize=0 CPUtime=30.73 cores=0-7
/proc/1258/stat : 1258 (march_hi) R 1256 1258 1258 0 -1 4202500 868 0 0 0 3073 0 0 0 25 0 1 0 668816243 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/1258/statm: 0 0 0 0 0 0 0
[pid=1259] ppid=1232 vsize=416360 CPUtime=0.77 cores=0-7
/proc/1259/stat : 1259 (python) R 1232 1232 1091 0 -1 4202560 879 0 0 0 63 14 0 0 16 0 1 0 668816246 426352640 5912 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/1259/statm: 104090 5912 377 364 0 39987 0
[pid=1261] ppid=1259 vsize=0 CPUtime=30.75 cores=0-7
/proc/1261/stat : 1261 (march_hi) R 1259 1261 1261 0 -1 4202500 876 0 0 0 3075 0 0 0 25 0 1 0 668816249 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/1261/statm: 0 0 0 0 0 0 0
[pid=1232/tid=1239] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1239/stat : 1239 (python) S 1230 1232 1091 0 -1 4202560 27 938 0 0 0 0 0 0 19 0 9 0 668816224 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 4 0 0 0
[pid=1232/tid=1242] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1242/stat : 1242 (python) S 1230 1232 1091 0 -1 4202560 24 938 0 0 0 0 0 0 20 0 9 0 668816227 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 3 0 0 0
[pid=1232/tid=1245] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1245/stat : 1245 (python) S 1230 1232 1091 0 -1 4202560 76 938 0 0 0 0 0 0 21 0 9 0 668816230 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1248] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1248/stat : 1248 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 23 0 9 0 668816233 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
[pid=1232/tid=1251] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1251/stat : 1251 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816237 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 0 0 0 0
[pid=1232/tid=1254] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1254/stat : 1254 (python) S 1230 1232 1091 0 -1 4202560 32 938 0 0 0 0 0 0 25 0 9 0 668816240 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 0 0 0 0
[pid=1232/tid=1257] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1257/stat : 1257 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816243 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 2 0 0 0
[pid=1232/tid=1260] ppid=1230 vsize=426604 CPUtime=0 cores=0-7
/proc/1232/task/1260/stat : 1260 (python) S 1230 1232 1091 0 -1 4202560 33 938 0 0 0 0 0 0 25 0 9 0 668816246 436842496 7428 33554432000 4194304 5683644 140735814055440 18446744073709551615 208092055985 0 0 16781312 2 18446604451638879296 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 253.45
Current children cumulated vsize (KiB) 4811372

[startup+32.4016 s]
/proc/loadavg: 8.03 8.34 8.36 15/416 1261
/proc/meminfo: memFree=12597404/32950928 swapFree=57376972/67111528
[pid=1232] ppid=1230 vsize=375276 CPUtime=253.93 cores=0-7
/proc/1232/stat : 1232 (python) R 1230 1232 1091 0 -1 4202496 18697 15282 1 0 59 12 25223 99 17 0 1 0 668816168 384282624 7375 33554432000 4194304 5683644 140735814055440 18446744073709551615 4619670 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1232/statm: 93819 7375 1874 364 0 29743 0
Current children cumulated CPU time (s) 253.93
Current children cumulated vsize (KiB) 375276

Child status: 0
Real time (s): 32.4125
CPU time (s): 253.956
CPU user time (s): 252.842
CPU system time (s): 1.11483
CPU usage (%): 783.514
Max. virtual memory (cumulated for all children) (KiB): 4830428

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 252.842
system time used= 1.11483
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 34875
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4937
involuntary context switches= 4760

runsolver used 0.115982 second user time and 0.312952 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-16 20:56:05
IDJOB=3385678
IDBENCH=82943
IDSOLVER=1870
FILE ID=node127/3385678-1305572165
RUNJOBID= node127-1305572154-1105
PBS_JOBID= 13350154
Free space on /tmp= 73384 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v400-c1704-S1409021001-079.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385678-1305572165/watcher-3385678-1305572165 -o /tmp/evaluation-result-3385678-1305572165/solver-3385678-1305572165 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385678-1305572165.cnf -seed 695416865 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= cfd96c3ec450000d8fe8684f0b30ec79
RANDOM SEED=695416865

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12648412 kB
Buffers:         74044 kB
Cached:         451876 kB
SwapCached:     117872 kB
Active:        5579464 kB
Inactive:     14496060 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12648412 kB
SwapTotal:    67111528 kB
SwapFree:     57376972 kB
Dirty:           32444 kB
Writeback:           0 kB
AnonPages:    19438596 kB
Mapped:          26276 kB
Slab:            73296 kB
PageTables:      81220 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 84611104 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73352 MiB
End job on node127 at 2011-05-16 20:56:38