Trace number 3322163

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 58.905 8.21476

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v350-c1491-S1733949620-064.UNKNOWN.cnf
MD5SUM60552051d2d5a0c0eefaeedea18e63df
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark7.26989
Satisfiable
(Un)Satisfiability was proved
Number of variables350
Number of clauses1491
Sum of the clauses size4473
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31491
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.67	c INFO: solving HOME/instance-3322163-1304375444.cnf
0.36/0.67	c INFO: computing task features
0.36/0.68	c INFO: computed variable-clause graph statistics
0.36/0.68	c INFO: computed clause balance statistics
0.44/0.71	c INFO: computed variable balance statistics
0.44/0.73	c INFO: computed small-clause counts
0.44/0.73	c INFO: computed Horn-clause counts
0.44/0.73	c INFO: computed variable graph statistics
0.44/0.73	c INFO: collected features for HOME/instance-3322163-1304375444.cnf in 0.06 s
0.44/0.77	c INFO: running TNM@0 for 97 with 39999 remaining (b = 0.56)
0.54/0.81	c INFO: running march_hi@0 for 194 with 39999 remaining (b = 0.28)
0.54/0.84	c INFO: running march_hi@0 for 194 with 39999 remaining (b = 0.20)
0.54/0.88	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.28)
0.64/0.92	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.07)
0.64/0.97	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.30)
1.47/1.01	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.27)
1.47/1.05	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.20)
58.00/8.19	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322163-1304375444/watcher-3322163-1304375444 -o /tmp/evaluation-result-3322163-1304375444/solver-3322163-1304375444 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322163-1304375444.cnf -seed 622586028 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 1/248 2465
/proc/meminfo: memFree=16823064/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=15184 CPUtime=0 cores=0-7
/proc/2465/stat : 2465 (python) S 2463 2465 1221 0 -1 4202496 726 0 0 0 0 0 0 0 25 0 1 0 549144153 15548416 616 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/2465/statm: 3796 616 322 364 0 283 0

[startup+0.0465851 s]
/proc/loadavg: 0.00 0.00 0.00 1/248 2465
/proc/meminfo: memFree=16823064/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=18880 CPUtime=0.02 cores=0-7
/proc/2465/stat : 2465 (python) R 2463 2465 1221 0 -1 4202496 1286 0 0 0 2 0 0 0 25 0 1 0 549144153 19333120 1139 33554432000 4194304 5683644 140734585142960 18446744073709551615 4887614 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/2465/statm: 4720 1139 421 364 0 689 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18880

[startup+0.100505 s]
/proc/loadavg: 0.00 0.00 0.00 1/248 2465
/proc/meminfo: memFree=16823064/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=87700 CPUtime=0.06 cores=0-7
/proc/2465/stat : 2465 (python) S 2463 2465 1221 0 -1 4202496 2636 0 0 0 4 2 0 0 25 0 1 0 549144153 89804800 2353 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/2465/statm: 21925 2353 717 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87700

[startup+0.300555 s]
/proc/loadavg: 0.00 0.00 0.00 1/248 2465
/proc/meminfo: memFree=16823064/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=135748 CPUtime=0.19 cores=0-7
/proc/2465/stat : 2465 (python) R 2463 2465 1221 0 -1 4202496 5963 934 1 0 13 6 0 0 25 0 1 0 549144153 139005952 4151 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278875653 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/2465/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700398 s]
/proc/loadavg: 0.00 0.00 0.00 1/248 2465
/proc/meminfo: memFree=16823064/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=278264 CPUtime=0.44 cores=0-7
/proc/2465/stat : 2465 (python) R 2463 2465 1221 0 -1 4202496 9285 934 1 0 31 13 0 0 25 0 1 0 549144153 284942336 6954 33554432000 4194304 5683644 140734585142960 18446744073709551615 47384177406949 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/2465/statm: 69566 6954 1826 364 0 5490 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 278264

[startup+1.50125 s]
/proc/loadavg: 0.00 0.00 0.00 8/267 2488
/proc/meminfo: memFree=16772556/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=361232 CPUtime=0.79 cores=0-7
/proc/2465/stat : 2465 (python) S 2463 2465 1221 0 -1 4202496 15847 934 1 0 64 15 0 0 22 0 9 0 549144153 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/2465/statm: 90308 7273 1889 364 0 26205 0
[pid=2471] ppid=2465 vsize=278592 CPUtime=0 cores=0-7
/proc/2471/stat : 2471 (python) S 2465 2465 1221 0 -1 4202560 714 0 0 0 0 0 0 0 25 0 1 0 549144230 285278208 5563 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899727 0 0 16781312 514 4253162493817389055 0 0 17 1 0 0 0
/proc/2471/statm: 69648 5563 347 364 0 5566 0
[pid=2473] ppid=2471 vsize=454892 CPUtime=0.72 cores=0-7
/proc/2473/stat : 2473 (TNM) R 2471 2473 2473 0 -1 4202496 413 0 0 0 72 0 0 0 25 0 1 0 549144231 465809408 150 33554432000 134512640 135008748 4293897760 18446744073709551615 134527542 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2473/statm: 113723 150 46 122 0 112623 0
[pid=2474] ppid=2465 vsize=289284 CPUtime=0 cores=0-7
/proc/2474/stat : 2474 (python) S 2465 2465 1221 0 -1 4202560 750 0 0 0 0 0 0 0 20 0 1 0 549144234 296226816 5679 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 16662091570589171969 0 0 17 5 0 0 0
/proc/2474/statm: 72321 5679 348 364 0 8236 0
[pid=2476] ppid=2474 vsize=1808 CPUtime=0.68 cores=0-7
/proc/2476/stat : 2476 (march_hi) R 2474 2476 2476 0 -1 4202496 544 0 0 0 68 0 0 0 25 0 1 0 549144234 1851392 283 33554432000 4194304 4955518 140736494765168 18446744073709551615 4263648 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2476/statm: 452 283 104 186 0 265 0
[pid=2477] ppid=2465 vsize=299360 CPUtime=0 cores=0-7
/proc/2477/stat : 2477 (python) S 2465 2465 1221 0 -1 4202560 759 0 0 0 0 0 0 0 20 0 1 0 549144238 306544640 5621 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 17684272346560430339 0 0 17 2 0 0 0
/proc/2477/statm: 74840 5621 348 364 0 10752 0
[pid=2479] ppid=2477 vsize=1808 CPUtime=0.64 cores=0-7
/proc/2479/stat : 2479 (march_hi) R 2477 2479 2479 0 -1 4202496 548 0 0 0 64 0 0 0 25 0 1 0 549144238 1851392 283 33554432000 4194304 4955518 140737392854688 18446744073709551615 4227571 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2479/statm: 452 283 104 186 0 265 0
[pid=2480] ppid=2465 vsize=309964 CPUtime=0 cores=0-7
/proc/2480/stat : 2480 (python) S 2465 2465 1221 0 -1 4202560 766 0 0 0 0 0 0 0 20 0 1 0 549144242 317403136 5712 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 581335716278010116 0 0 17 7 0 0 0
/proc/2480/statm: 77491 5712 348 364 0 13400 0
[pid=2482] ppid=2480 vsize=1808 CPUtime=0.59 cores=0-7
/proc/2482/stat : 2482 (march_hi) R 2480 2482 2482 0 -1 4202496 549 0 0 0 59 0 0 0 25 0 1 0 549144242 1851392 283 33554432000 4194304 4955518 140733503338144 18446744073709551615 4209688 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2482/statm: 452 283 104 186 0 265 0
[pid=2483] ppid=2465 vsize=320220 CPUtime=0 cores=0-7
/proc/2483/stat : 2483 (python) S 2465 2465 1221 0 -1 4202560 766 0 0 0 0 0 0 0 25 0 1 0 549144246 327905280 5716 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 6998074031106686975 0 0 17 2 0 0 0
/proc/2483/statm: 80055 5716 348 364 0 15961 0
[pid=2485] ppid=2483 vsize=1017800 CPUtime=0.54 cores=0-7
/proc/2485/stat : 2485 (gnovelty+2) R 2483 2485 2485 0 -1 4202496 427 0 0 0 54 0 0 0 25 0 1 0 549144246 1042227200 163 33554432000 134512640 135663704 4290080912 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2485/statm: 254450 163 113 282 0 254166 0
[pid=2486] ppid=2465 vsize=330476 CPUtime=0 cores=0-7
/proc/2486/stat : 2486 (python) S 2465 2465 1221 0 -1 4202560 773 0 0 0 0 0 0 0 22 0 1 0 549144250 338407424 5720 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 4477466439296450817 0 0 17 0 0 0 0
/proc/2486/statm: 82619 5720 348 364 0 18522 0
[pid=2488] ppid=2486 vsize=1808 CPUtime=0.51 cores=0-7
/proc/2488/stat : 2488 (march_hi) R 2486 2488 2488 0 -1 4202496 544 0 0 0 51 0 0 0 25 0 1 0 549144250 1851392 279 33554432000 4194304 4955518 140736538685584 18446744073709551615 4238948 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2488/statm: 452 279 104 186 0 265 0
[pid=2465/tid=2472] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2472/stat : 2472 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 9 0 549144230 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 6 0 0 0
[pid=2465/tid=2475] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2475/stat : 2475 (python) S 2463 2465 1221 0 -1 4202560 23 934 0 0 0 0 0 0 25 0 9 0 549144234 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
[pid=2465/tid=2478] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2478/stat : 2478 (python) S 2463 2465 1221 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 549144238 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 4 0 0 0
[pid=2465/tid=2481] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2481/stat : 2481 (python) S 2463 2465 1221 0 -1 4202560 21 934 0 0 0 0 0 0 18 0 9 0 549144242 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2484] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2484/stat : 2484 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 9 0 549144246 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2487] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2487/stat : 2487 (python) S 2463 2465 1221 0 -1 4202560 28 934 0 0 0 0 0 0 25 0 9 0 549144250 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.47
Current children cumulated vsize (KiB) 3669052

[startup+3.10097 s]
/proc/loadavg: 0.00 0.00 0.00 9/273 2494
/proc/meminfo: memFree=16762208/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=361232 CPUtime=0.79 cores=0-7
/proc/2465/stat : 2465 (python) S 2463 2465 1221 0 -1 4202496 15847 934 1 0 64 15 0 0 22 0 9 0 549144153 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/2465/statm: 90308 7273 1889 364 0 26205 0
[pid=2471] ppid=2465 vsize=278592 CPUtime=0 cores=0-7
/proc/2471/stat : 2471 (python) S 2465 2465 1221 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 549144230 285278208 5570 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899727 0 0 16781312 514 4253162493817356545 0 0 17 1 0 0 0
/proc/2471/statm: 69648 5570 354 364 0 5566 0
[pid=2473] ppid=2471 vsize=454892 CPUtime=2.32 cores=0-7
/proc/2473/stat : 2473 (TNM) R 2471 2473 2473 0 -1 4202496 413 0 0 0 232 0 0 0 25 0 1 0 549144231 465809408 150 33554432000 134512640 135008748 4293897760 18446744073709551615 134527809 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2473/statm: 113723 150 46 122 0 112623 0
[pid=2474] ppid=2465 vsize=289284 CPUtime=0 cores=0-7
/proc/2474/stat : 2474 (python) S 2465 2465 1221 0 -1 4202560 754 0 0 0 0 0 0 0 15 0 1 0 549144234 296226816 5679 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 16662091570589171969 0 0 17 5 0 0 0
/proc/2474/statm: 72321 5679 348 364 0 8236 0
[pid=2476] ppid=2474 vsize=1948 CPUtime=2.28 cores=0-7
/proc/2476/stat : 2476 (march_hi) R 2474 2476 2476 0 -1 4202496 570 0 0 0 228 0 0 0 25 0 1 0 549144234 1994752 309 33554432000 4194304 4955518 140736494765168 18446744073709551615 4209695 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2476/statm: 487 309 104 186 0 300 0
[pid=2477] ppid=2465 vsize=299360 CPUtime=0 cores=0-7
/proc/2477/stat : 2477 (python) S 2465 2465 1221 0 -1 4202560 765 0 0 0 0 0 0 0 15 0 1 0 549144238 306544640 5621 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 17684272346560430339 0 0 17 2 0 0 0
/proc/2477/statm: 74840 5621 348 364 0 10752 0
[pid=2479] ppid=2477 vsize=1948 CPUtime=2.24 cores=0-7
/proc/2479/stat : 2479 (march_hi) R 2477 2479 2479 0 -1 4202496 574 0 0 0 224 0 0 0 25 0 1 0 549144238 1994752 309 33554432000 4194304 4955518 140737392854688 18446744073709551615 4286856 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2479/statm: 487 309 104 186 0 300 0
[pid=2480] ppid=2465 vsize=309964 CPUtime=0 cores=0-7
/proc/2480/stat : 2480 (python) S 2465 2465 1221 0 -1 4202560 770 0 0 0 0 0 0 0 15 0 1 0 549144242 317403136 5712 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 10116144696578244868 0 0 17 7 0 0 0
/proc/2480/statm: 77491 5712 348 364 0 13400 0
[pid=2482] ppid=2480 vsize=1948 CPUtime=2.18 cores=0-7
/proc/2482/stat : 2482 (march_hi) R 2480 2482 2482 0 -1 4202496 574 0 0 0 218 0 0 0 25 0 1 0 549144242 1994752 308 33554432000 4194304 4955518 140733503338144 18446744073709551615 4235311 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2482/statm: 487 308 104 186 0 300 0
[pid=2483] ppid=2465 vsize=320220 CPUtime=0 cores=0-7
/proc/2483/stat : 2483 (python) S 2465 2465 1221 0 -1 4202560 766 0 0 0 0 0 0 0 18 0 1 0 549144246 327905280 5716 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 6998074031106654468 0 0 17 2 0 0 0
/proc/2483/statm: 80055 5716 348 364 0 15961 0
[pid=2485] ppid=2483 vsize=1017800 CPUtime=2.14 cores=0-7
/proc/2485/stat : 2485 (gnovelty+2) R 2483 2485 2485 0 -1 4202496 427 0 0 0 214 0 0 0 25 0 1 0 549144246 1042227200 163 33554432000 134512640 135663704 4290080912 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2485/statm: 254450 163 113 282 0 254166 0
[pid=2486] ppid=2465 vsize=330476 CPUtime=0 cores=0-7
/proc/2486/stat : 2486 (python) S 2465 2465 1221 0 -1 4202560 778 0 0 0 0 0 0 0 15 0 1 0 549144250 338407424 5720 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 4477466439296450817 0 0 17 0 0 0 0
/proc/2486/statm: 82619 5720 348 364 0 18522 0
[pid=2488] ppid=2486 vsize=1948 CPUtime=2.1 cores=0-7
/proc/2488/stat : 2488 (march_hi) R 2486 2488 2488 0 -1 4202496 573 0 0 0 210 0 0 0 25 0 1 0 549144250 1994752 308 33554432000 4194304 4955518 140736538685584 18446744073709551615 4209695 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2488/statm: 487 308 104 186 0 300 0
[pid=2489] ppid=2465 vsize=340732 CPUtime=0 cores=0-7
/proc/2489/stat : 2489 (python) S 2465 2465 1221 0 -1 4202560 791 0 0 0 0 0 0 0 15 0 1 0 549144254 348909568 5724 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 4477259731110428929 0 0 17 1 0 0 0
/proc/2489/statm: 85183 5724 348 364 0 21083 0
[pid=2491] ppid=2489 vsize=1948 CPUtime=2.04 cores=0-7
/proc/2491/stat : 2491 (march_hi) R 2489 2491 2491 0 -1 4202496 571 0 0 0 204 0 0 0 25 0 1 0 549144254 1994752 307 33554432000 4194304 4955518 140736964163360 18446744073709551615 4238727 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2491/statm: 487 307 104 186 0 300 0
[pid=2492] ppid=2465 vsize=350988 CPUtime=0 cores=0-7
/proc/2492/stat : 2492 (python) S 2465 2465 1221 0 -1 4202560 823 0 0 0 0 0 0 0 15 0 1 0 549144258 359411712 5734 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 3127600411922366722 0 0 17 6 0 0 0
/proc/2492/statm: 87747 5734 354 364 0 23644 0
[pid=2494] ppid=2492 vsize=1948 CPUtime=2.04 cores=0-7
/proc/2494/stat : 2494 (march_hi) R 2492 2494 2494 0 -1 4202496 566 0 0 0 204 0 0 0 25 0 1 0 549144258 1994752 297 33554432000 4194304 4955518 140735424629056 18446744073709551615 4224682 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2494/statm: 487 297 104 186 0 300 0
[pid=2465/tid=2472] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2472/stat : 2472 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 9 0 549144230 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 6 0 0 0
[pid=2465/tid=2475] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2475/stat : 2475 (python) S 2463 2465 1221 0 -1 4202560 23 934 0 0 0 0 0 0 25 0 9 0 549144234 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
[pid=2465/tid=2478] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2478/stat : 2478 (python) S 2463 2465 1221 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 549144238 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 4 0 0 0
[pid=2465/tid=2481] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2481/stat : 2481 (python) S 2463 2465 1221 0 -1 4202560 21 934 0 0 0 0 0 0 18 0 9 0 549144242 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2484] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2484/stat : 2484 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 9 0 549144246 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2487] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2487/stat : 2487 (python) S 2463 2465 1221 0 -1 4202560 28 934 0 0 0 0 0 0 25 0 9 0 549144250 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 6 0 0 0
[pid=2465/tid=2490] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2490/stat : 2490 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 9 0 549144254 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
[pid=2465/tid=2493] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2493/stat : 2493 (python) S 2463 2465 1221 0 -1 4202560 34 934 0 0 0 0 0 0 22 0 9 0 549144258 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 18.13
Current children cumulated vsize (KiB) 4365228

[startup+6.3014 s]
/proc/loadavg: 0.64 0.13 0.04 9/273 2494
/proc/meminfo: memFree=16759484/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=361232 CPUtime=0.79 cores=0-7
/proc/2465/stat : 2465 (python) S 2463 2465 1221 0 -1 4202496 15847 934 1 0 64 15 0 0 22 0 9 0 549144153 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/2465/statm: 90308 7273 1889 364 0 26205 0

################
# More data... #
################

/proc/2465/task/2475/stat : 2475 (python) S 2463 2465 1221 0 -1 4202560 23 934 0 0 0 0 0 0 25 0 9 0 549144234 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
[pid=2465/tid=2478] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2478/stat : 2478 (python) S 2463 2465 1221 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 549144238 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 4 0 0 0
[pid=2465/tid=2481] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2481/stat : 2481 (python) S 2463 2465 1221 0 -1 4202560 21 934 0 0 0 0 0 0 18 0 9 0 549144242 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2484] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2484/stat : 2484 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 9 0 549144246 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2487] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2487/stat : 2487 (python) S 2463 2465 1221 0 -1 4202560 28 934 0 0 0 0 0 0 25 0 9 0 549144250 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 6 0 0 0
[pid=2465/tid=2490] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2490/stat : 2490 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 9 0 549144254 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
[pid=2465/tid=2493] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2493/stat : 2493 (python) S 2463 2465 1221 0 -1 4202560 34 934 0 0 0 0 0 0 22 0 9 0 549144258 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.02
Current children cumulated vsize (KiB) 4366452

[startup+7.90111 s]
/proc/loadavg: 0.64 0.13 0.04 9/273 2494
/proc/meminfo: memFree=16759248/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=361232 CPUtime=0.79 cores=0-7
/proc/2465/stat : 2465 (python) S 2463 2465 1221 0 -1 4202496 15847 934 1 0 64 15 0 0 22 0 9 0 549144153 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/2465/statm: 90308 7273 1889 364 0 26205 0
[pid=2471] ppid=2465 vsize=278592 CPUtime=0 cores=0-7
/proc/2471/stat : 2471 (python) S 2465 2465 1221 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 1 0 549144230 285278208 5592 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899727 0 0 16781312 514 4253162493817356545 0 0 17 1 0 0 0
/proc/2471/statm: 69648 5592 376 364 0 5566 0
[pid=2473] ppid=2471 vsize=454892 CPUtime=7.12 cores=0-7
/proc/2473/stat : 2473 (TNM) R 2471 2473 2473 0 -1 4202496 413 0 0 0 712 0 0 0 25 0 1 0 549144231 465809408 150 33554432000 134512640 135008748 4293897760 18446744073709551615 134527645 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2473/statm: 113723 150 46 122 0 112623 0
[pid=2474] ppid=2465 vsize=289284 CPUtime=0.01 cores=0-7
/proc/2474/stat : 2474 (python) S 2465 2465 1221 0 -1 4202560 916 0 0 0 1 0 0 0 15 0 1 0 549144234 296226816 5702 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 5602249912340152577 0 0 17 5 0 0 0
/proc/2474/statm: 72321 5702 371 364 0 8236 0
[pid=2476] ppid=2474 vsize=2252 CPUtime=7.06 cores=0-7
/proc/2476/stat : 2476 (march_hi) R 2474 2476 2476 0 -1 4202496 630 0 0 0 706 0 0 0 25 0 1 0 549144234 2306048 369 33554432000 4194304 4955518 140736494765168 18446744073709551615 4224691 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2476/statm: 563 369 104 186 0 376 0
[pid=2477] ppid=2465 vsize=299360 CPUtime=0 cores=0-7
/proc/2477/stat : 2477 (python) S 2465 2465 1221 0 -1 4202560 912 0 0 0 0 0 0 0 15 0 1 0 549144238 306544640 5644 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 17684272346560430339 0 0 17 2 0 0 0
/proc/2477/statm: 74840 5644 371 364 0 10752 0
[pid=2479] ppid=2477 vsize=2252 CPUtime=7.04 cores=0-7
/proc/2479/stat : 2479 (march_hi) R 2477 2479 2479 0 -1 4202496 634 0 0 0 704 0 0 0 25 0 1 0 549144238 2306048 369 33554432000 4194304 4955518 140737392854688 18446744073709551615 4238735 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2479/statm: 563 369 104 186 0 376 0
[pid=2480] ppid=2465 vsize=309964 CPUtime=0.01 cores=0-7
/proc/2480/stat : 2480 (python) S 2465 2465 1221 0 -1 4202560 931 0 0 0 1 0 0 0 15 0 1 0 549144242 317403136 5735 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 10116144696578244868 0 0 17 7 0 0 0
/proc/2480/statm: 77491 5735 371 364 0 13400 0
[pid=2482] ppid=2480 vsize=2152 CPUtime=6.92 cores=0-7
/proc/2482/stat : 2482 (march_hi) R 2480 2482 2482 0 -1 4202496 633 0 0 0 692 0 0 0 25 0 1 0 549144242 2203648 367 33554432000 4194304 4955518 140733503338144 18446744073709551615 4286797 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2482/statm: 538 367 104 186 0 351 0
[pid=2483] ppid=2465 vsize=320220 CPUtime=0 cores=0-7
/proc/2483/stat : 2483 (python) S 2465 2465 1221 0 -1 4202560 935 0 0 0 0 0 0 0 18 0 1 0 549144246 327905280 5739 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 6998074031106654468 0 0 17 2 0 0 0
/proc/2483/statm: 80055 5739 371 364 0 15961 0
[pid=2485] ppid=2483 vsize=1017800 CPUtime=6.92 cores=0-7
/proc/2485/stat : 2485 (gnovelty+2) R 2483 2485 2485 0 -1 4202496 427 0 0 0 692 0 0 0 25 0 1 0 549144246 1042227200 163 33554432000 134512640 135663704 4290080912 18446744073709551615 134563438 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2485/statm: 254450 163 113 282 0 254166 0
[pid=2486] ppid=2465 vsize=330476 CPUtime=0.01 cores=0-7
/proc/2486/stat : 2486 (python) S 2465 2465 1221 0 -1 4202560 944 0 0 0 1 0 0 0 15 0 1 0 549144250 338407424 5743 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 4477466439296450817 0 0 17 0 0 0 0
/proc/2486/statm: 82619 5743 371 364 0 18522 0
[pid=2488] ppid=2486 vsize=2152 CPUtime=6.87 cores=0-7
/proc/2488/stat : 2488 (march_hi) R 2486 2488 2488 0 -1 4202496 633 0 0 0 687 0 0 0 25 0 1 0 549144250 2203648 368 33554432000 4194304 4955518 140736538685584 18446744073709551615 4238727 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2488/statm: 538 368 104 186 0 351 0
[pid=2489] ppid=2465 vsize=340732 CPUtime=0.01 cores=0-7
/proc/2489/stat : 2489 (python) S 2465 2465 1221 0 -1 4202560 962 0 0 0 1 0 0 0 15 0 1 0 549144254 348909568 5747 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 5602249912340152577 0 0 17 1 0 0 0
/proc/2489/statm: 85183 5747 371 364 0 21083 0
[pid=2491] ppid=2489 vsize=2152 CPUtime=6.81 cores=0-7
/proc/2491/stat : 2491 (march_hi) R 2489 2491 2491 0 -1 4202496 631 0 0 0 681 0 0 0 25 0 1 0 549144254 2203648 367 33554432000 4194304 4955518 140736964163360 18446744073709551615 4224656 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2491/statm: 538 367 104 186 0 351 0
[pid=2492] ppid=2465 vsize=350988 CPUtime=0 cores=0-7
/proc/2492/stat : 2492 (python) S 2465 2465 1221 0 -1 4202560 994 0 0 0 0 0 0 0 15 0 1 0 549144258 359411712 5757 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 5602249912340152578 0 0 17 6 0 0 0
/proc/2492/statm: 87747 5757 377 364 0 23644 0
[pid=2494] ppid=2492 vsize=2152 CPUtime=6.83 cores=0-7
/proc/2494/stat : 2494 (march_hi) R 2492 2494 2494 0 -1 4202496 636 0 0 0 683 0 0 0 25 0 1 0 549144258 2203648 367 33554432000 4194304 4955518 140735424629056 18446744073709551615 4209628 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2494/statm: 538 367 104 186 0 351 0
[pid=2465/tid=2472] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2472/stat : 2472 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 9 0 549144230 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 6 0 0 0
[pid=2465/tid=2475] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2475/stat : 2475 (python) S 2463 2465 1221 0 -1 4202560 23 934 0 0 0 0 0 0 25 0 9 0 549144234 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
[pid=2465/tid=2478] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2478/stat : 2478 (python) S 2463 2465 1221 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 549144238 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 4 0 0 0
[pid=2465/tid=2481] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2481/stat : 2481 (python) S 2463 2465 1221 0 -1 4202560 21 934 0 0 0 0 0 0 18 0 9 0 549144242 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2484] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2484/stat : 2484 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 9 0 549144246 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2487] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2487/stat : 2487 (python) S 2463 2465 1221 0 -1 4202560 28 934 0 0 0 0 0 0 25 0 9 0 549144250 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 6 0 0 0
[pid=2465/tid=2490] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2490/stat : 2490 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 9 0 549144254 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
[pid=2465/tid=2493] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2493/stat : 2493 (python) S 2463 2465 1221 0 -1 4202560 34 934 0 0 0 0 0 0 22 0 9 0 549144258 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 56.4
Current children cumulated vsize (KiB) 4366652

[startup+8.10108 s]
/proc/loadavg: 0.64 0.13 0.04 9/273 2494
/proc/meminfo: memFree=16759248/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=361232 CPUtime=0.79 cores=0-7
/proc/2465/stat : 2465 (python) S 2463 2465 1221 0 -1 4202496 15847 934 1 0 64 15 0 0 22 0 9 0 549144153 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/2465/statm: 90308 7273 1889 364 0 26205 0
[pid=2471] ppid=2465 vsize=278592 CPUtime=0 cores=0-7
/proc/2471/stat : 2471 (python) S 2465 2465 1221 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 1 0 549144230 285278208 5592 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899727 0 0 16781312 514 4253162493817356545 0 0 17 1 0 0 0
/proc/2471/statm: 69648 5592 376 364 0 5566 0
[pid=2473] ppid=2471 vsize=454892 CPUtime=7.32 cores=0-7
/proc/2473/stat : 2473 (TNM) R 2471 2473 2473 0 -1 4202496 413 0 0 0 732 0 0 0 25 0 1 0 549144231 465809408 150 33554432000 134512640 135008748 4293897760 18446744073709551615 134528467 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2473/statm: 113723 150 46 122 0 112623 0
[pid=2474] ppid=2465 vsize=289284 CPUtime=0.01 cores=0-7
/proc/2474/stat : 2474 (python) S 2465 2465 1221 0 -1 4202560 919 0 0 0 1 0 0 0 15 0 1 0 549144234 296226816 5702 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 16662091570589171969 0 0 17 5 0 0 0
/proc/2474/statm: 72321 5702 371 364 0 8236 0
[pid=2476] ppid=2474 vsize=2252 CPUtime=7.26 cores=0-7
/proc/2476/stat : 2476 (march_hi) R 2474 2476 2476 0 -1 4202496 633 0 0 0 726 0 0 0 25 0 1 0 549144234 2306048 372 33554432000 4194304 4955518 140736494765168 18446744073709551615 4295786 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2476/statm: 563 372 104 186 0 376 0
[pid=2477] ppid=2465 vsize=299360 CPUtime=0 cores=0-7
/proc/2477/stat : 2477 (python) S 2465 2465 1221 0 -1 4202560 913 0 0 0 0 0 0 0 15 0 1 0 549144238 306544640 5644 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 17684272346560430339 0 0 17 2 0 0 0
/proc/2477/statm: 74840 5644 371 364 0 10752 0
[pid=2479] ppid=2477 vsize=2252 CPUtime=7.24 cores=0-7
/proc/2479/stat : 2479 (march_hi) R 2477 2479 2479 0 -1 4202496 637 0 0 0 724 0 0 0 25 0 1 0 549144238 2306048 372 33554432000 4194304 4955518 140737392854688 18446744073709551615 4209727 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2479/statm: 563 372 104 186 0 376 0
[pid=2480] ppid=2465 vsize=309964 CPUtime=0.01 cores=0-7
/proc/2480/stat : 2480 (python) S 2465 2465 1221 0 -1 4202560 931 0 0 0 1 0 0 0 15 0 1 0 549144242 317403136 5735 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 10116144696578244868 0 0 17 7 0 0 0
/proc/2480/statm: 77491 5735 371 364 0 13400 0
[pid=2482] ppid=2480 vsize=2252 CPUtime=7.12 cores=0-7
/proc/2482/stat : 2482 (march_hi) R 2480 2482 2482 0 -1 4202496 636 0 0 0 712 0 0 0 25 0 1 0 549144242 2306048 370 33554432000 4194304 4955518 140733503338144 18446744073709551615 4209701 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2482/statm: 563 370 104 186 0 376 0
[pid=2483] ppid=2465 vsize=320220 CPUtime=0 cores=0-7
/proc/2483/stat : 2483 (python) S 2465 2465 1221 0 -1 4202560 935 0 0 0 0 0 0 0 18 0 1 0 549144246 327905280 5739 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 6998074031106654468 0 0 17 2 0 0 0
/proc/2483/statm: 80055 5739 371 364 0 15961 0
[pid=2485] ppid=2483 vsize=1017800 CPUtime=7.12 cores=0-7
/proc/2485/stat : 2485 (gnovelty+2) R 2483 2485 2485 0 -1 4202496 427 0 0 0 712 0 0 0 25 0 1 0 549144246 1042227200 163 33554432000 134512640 135663704 4290080912 18446744073709551615 134546755 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2485/statm: 254450 163 113 282 0 254166 0
[pid=2486] ppid=2465 vsize=330476 CPUtime=0.01 cores=0-7
/proc/2486/stat : 2486 (python) S 2465 2465 1221 0 -1 4202560 944 0 0 0 1 0 0 0 15 0 1 0 549144250 338407424 5743 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 4477466439296450817 0 0 17 0 0 0 0
/proc/2486/statm: 82619 5743 371 364 0 18522 0
[pid=2488] ppid=2486 vsize=2252 CPUtime=7.07 cores=0-7
/proc/2488/stat : 2488 (march_hi) R 2486 2488 2488 0 -1 4202496 635 0 0 0 707 0 0 0 25 0 1 0 549144250 2306048 370 33554432000 4194304 4955518 140736538685584 18446744073709551615 4227760 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2488/statm: 563 370 104 186 0 376 0
[pid=2489] ppid=2465 vsize=340732 CPUtime=0.01 cores=0-7
/proc/2489/stat : 2489 (python) S 2465 2465 1221 0 -1 4202560 962 0 0 0 1 0 0 0 15 0 1 0 549144254 348909568 5747 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 4477259731110428929 0 0 17 1 0 0 0
/proc/2489/statm: 85183 5747 371 364 0 21083 0
[pid=2491] ppid=2489 vsize=2252 CPUtime=7.01 cores=0-7
/proc/2491/stat : 2491 (march_hi) R 2489 2491 2491 0 -1 4202496 633 0 0 0 701 0 0 0 25 0 1 0 549144254 2306048 369 33554432000 4194304 4955518 140736964163360 18446744073709551615 4299850 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2491/statm: 563 369 104 186 0 376 0
[pid=2492] ppid=2465 vsize=350988 CPUtime=0 cores=0-7
/proc/2492/stat : 2492 (python) S 2465 2465 1221 0 -1 4202560 994 0 0 0 0 0 0 0 15 0 1 0 549144258 359411712 5757 33554432000 4194304 5683644 140734585142960 18446744073709551615 237278899782 0 0 16781312 514 3127600411922366722 0 0 17 6 0 0 0
/proc/2492/statm: 87747 5757 377 364 0 23644 0
[pid=2494] ppid=2492 vsize=2152 CPUtime=7.03 cores=0-7
/proc/2494/stat : 2494 (march_hi) R 2492 2494 2494 0 -1 4202496 638 0 0 0 703 0 0 0 25 0 1 0 549144258 2203648 369 33554432000 4194304 4955518 140735424629056 18446744073709551615 4298080 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2494/statm: 538 369 104 186 0 351 0
[pid=2465/tid=2472] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2472/stat : 2472 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 9 0 549144230 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 6 0 0 0
[pid=2465/tid=2475] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2475/stat : 2475 (python) S 2463 2465 1221 0 -1 4202560 23 934 0 0 0 0 0 0 25 0 9 0 549144234 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
[pid=2465/tid=2478] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2478/stat : 2478 (python) S 2463 2465 1221 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 549144238 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 4 0 0 0
[pid=2465/tid=2481] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2481/stat : 2481 (python) S 2463 2465 1221 0 -1 4202560 21 934 0 0 0 0 0 0 18 0 9 0 549144242 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2484] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2484/stat : 2484 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 9 0 549144246 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 2 0 0 0
[pid=2465/tid=2487] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2487/stat : 2487 (python) S 2463 2465 1221 0 -1 4202560 28 934 0 0 0 0 0 0 25 0 9 0 549144250 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 6 0 0 0
[pid=2465/tid=2490] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2490/stat : 2490 (python) S 2463 2465 1221 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 9 0 549144254 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
[pid=2465/tid=2493] ppid=2463 vsize=361232 CPUtime=0 cores=0-7
/proc/2465/task/2493/stat : 2493 (python) S 2463 2465 1221 0 -1 4202560 34 934 0 0 0 0 0 0 22 0 9 0 549144258 369901568 7273 33554432000 4194304 5683644 140734585142960 18446744073709551615 237290703281 0 0 16781312 2 18446604453925344384 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 58
Current children cumulated vsize (KiB) 4366952

[startup+8.20107 s]
/proc/loadavg: 0.64 0.13 0.04 9/273 2494
/proc/meminfo: memFree=16759248/32950904 swapFree=67082284/67111528
[pid=2465] ppid=2463 vsize=309904 CPUtime=58.87 cores=0-7
/proc/2465/stat : 2465 (python) R 2463 2465 1221 0 -1 4202496 17982 13662 1 0 64 15 5799 9 17 0 1 0 549144153 317341696 7238 33554432000 4194304 5683644 140734585142960 18446744073709551615 4516304 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2465/statm: 77476 7238 1874 364 0 13400 0
Current children cumulated CPU time (s) 58.87
Current children cumulated vsize (KiB) 309904

Child status: 0
Real time (s): 8.21476
CPU time (s): 58.905
CPU user time (s): 58.6501
CPU system time (s): 0.254961
CPU usage (%): 717.064
Max. virtual memory (cumulated for all children) (KiB): 4366952

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 58.6501
system time used= 0.254961
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33855
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5534
involuntary context switches= 2517

runsolver used 0.021996 second user time and 0.050992 second system time

The end

Launcher Data 

Begin job on node121 at 2011-05-03 00:30:44
IDJOB=3322163
IDBENCH=82941
IDSOLVER=1712
FILE ID=node121/3322163-1304375444
RUNJOBID= node121-1304366467-1235
PBS_JOBID= 13181750
Free space on /tmp= 73492 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v350-c1491-S1733949620-064.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322163-1304375444/watcher-3322163-1304375444 -o /tmp/evaluation-result-3322163-1304375444/solver-3322163-1304375444 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322163-1304375444.cnf -seed 622586028 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 60552051d2d5a0c0eefaeedea18e63df
RANDOM SEED=622586028

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      16823344 kB
Buffers:       2199832 kB
Cached:        9689408 kB
SwapCached:       2776 kB
Active:       12575720 kB
Inactive:      3016568 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      16823344 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           31856 kB
Writeback:           0 kB
AnonPages:     3700224 kB
Mapped:          21032 kB
Slab:           452808 kB
PageTables:      19032 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS: 24724832 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73460 MiB
End job on node121 at 2011-05-03 00:30:52