Trace number 3317387

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 1214.44 304.7

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v100-c2130-S2051088205-036.UNKNOWN.cnf
MD5SUM901aadbc76f4961d582bc9856b3c63b3
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark300.4
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of clauses2130
Sum of the clauses size10650
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52130
Number of clauses of size over 50

Solver Data 

0.29/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.29/0.47	c INFO: solving HOME/instance-3317387-1304269316.cnf
0.29/0.47	c INFO: computing task features
0.29/0.48	c INFO: computed variable-clause graph statistics
0.29/0.48	c INFO: computed clause balance statistics
0.38/0.54	c INFO: computed variable balance statistics
0.38/0.57	c INFO: computed small-clause counts
0.38/0.57	c INFO: computed Horn-clause counts
0.38/0.57	c INFO: computed variable graph statistics
0.38/0.57	c INFO: collected features for HOME/instance-3317387-1304269316.cnf in 0.10 s
0.48/0.60	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.62)
0.48/0.63	c INFO: running march_hi@0 for 194 with 4799 remaining (b = 0.19)
0.48/0.66	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.07)
0.48/0.69	c INFO: running march_hi@0 for 388 with 4799 remaining (b = 0.29)
399.96/100.79	c INFO: running march_hi@0 for 485 with 4699 remaining (b = 0.31)
400.35/100.85	c INFO: running march_hi@0 for 485 with 4699 remaining (b = 0.27)
781.59/196.33	c INFO: running march_hi@0 for 97 with 4604 remaining (b = 0.06)
1174.89/294.87	c INFO: running march_hi@98 for 97 with 4505 remaining (b = 0.07)
1214.01/304.67	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317387-1304269316/watcher-3317387-1304269316 -o /tmp/evaluation-result-3317387-1304269316/solver-3317387-1304269316 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317387-1304269316.cnf -seed 1899396134 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.04 9.12 7.90 6/262 9268
/proc/meminfo: memFree=28946384/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=15780 CPUtime=0 cores=0,2,4,6
/proc/9268/stat : 9268 (python) R 9266 9268 8573 0 -1 4202496 879 0 0 0 0 0 0 0 25 0 1 0 617162333 16158720 760 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284586693 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/9268/statm: 3945 761 343 364 0 432 0

[startup+0.0238021 s]
/proc/loadavg: 9.04 9.12 7.90 6/262 9268
/proc/meminfo: memFree=28946384/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=16540 CPUtime=0.01 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 1185 0 0 0 1 0 0 0 25 0 1 0 617162333 16936960 1046 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/9268/statm: 4135 1046 417 364 0 622 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16540

[startup+0.100834 s]
/proc/loadavg: 9.04 9.12 7.90 6/262 9268
/proc/meminfo: memFree=28946384/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=104232 CPUtime=0.06 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 3072 0 0 0 5 1 0 0 17 0 1 0 617162333 106733568 2752 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/9268/statm: 26058 2752 847 364 0 1806 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104232

[startup+0.300793 s]
/proc/loadavg: 9.04 9.12 7.90 6/262 9268
/proc/meminfo: memFree=28946384/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=170756 CPUtime=0.21 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 6736 935 1 0 16 5 0 0 17 0 1 0 617162333 174854144 4806 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/9268/statm: 42689 4806 1336 364 0 3454 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 170756

[startup+0.700642 s]
/proc/loadavg: 9.04 9.12 7.90 6/262 9268
/proc/meminfo: memFree=28946384/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=320100 CPUtime=0.57 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 12309 935 1 0 49 8 0 0 22 0 5 0 617162333 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/9268/statm: 80025 7238 1881 364 0 15934 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 320100

[startup+1.5005 s]
/proc/loadavg: 9.04 9.12 7.90 10/275 9285
/proc/meminfo: memFree=28907956/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=320100 CPUtime=0.57 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 12309 935 1 0 49 8 0 0 22 0 5 0 617162333 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/9268/statm: 80025 7238 1881 364 0 15934 0
[pid=9274] ppid=9268 vsize=278456 CPUtime=0 cores=0,2,4,6
/proc/9274/stat : 9274 (python) S 9268 9268 8573 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 617162393 285138944 5549 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945935 0 0 16781312 514 11483084215386374143 0 0 17 4 0 0 0
/proc/9274/statm: 69614 5549 354 364 0 5532 0
[pid=9276] ppid=9274 vsize=1017800 CPUtime=0.89 cores=0,2,4,6
/proc/9276/stat : 9276 (gnovelty+2) R 9274 9276 9276 0 -1 4202496 436 0 0 0 89 0 0 0 21 0 1 0 617162394 1042227200 171 33554432000 134512640 135663704 4288850800 18446744073709551615 134524744 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9276/statm: 254450 171 113 282 0 254166 0
[pid=9277] ppid=9268 vsize=289244 CPUtime=0 cores=0,2,4,6
/proc/9277/stat : 9277 (python) S 9268 9268 8573 0 -1 4202560 754 0 0 0 0 0 0 0 15 0 1 0 617162397 296185856 5668 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 2870138769162338561 0 0 17 0 0 0 0
/proc/9277/statm: 72311 5668 348 364 0 8226 0
[pid=9279] ppid=9277 vsize=1560 CPUtime=0.86 cores=0,2,4,6
/proc/9279/stat : 9279 (march_hi) R 9277 9279 9279 0 -1 4202496 505 0 0 0 86 0 0 0 25 0 1 0 617162397 1597440 240 33554432000 4194304 4955518 140736046559728 18446744073709551615 4297451 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9279/statm: 390 240 106 186 0 203 0
[pid=9280] ppid=9268 vsize=299160 CPUtime=0 cores=0,2,4,6
/proc/9280/stat : 9280 (python) S 9268 9268 8573 0 -1 4202560 748 0 0 0 0 0 0 0 19 0 1 0 617162399 306339840 5573 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 2393196463556395007 0 0 17 4 0 0 0
/proc/9280/statm: 74790 5573 348 364 0 10702 0
[pid=9282] ppid=9280 vsize=1017800 CPUtime=0.82 cores=0,2,4,6
/proc/9282/stat : 9282 (gnovelty+2) R 9280 9282 9282 0 -1 4202496 437 0 0 0 82 0 0 0 23 0 1 0 617162400 1042227200 172 33554432000 134512640 135663704 4294379632 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9282/statm: 254450 172 113 282 0 254166 0
[pid=9283] ppid=9268 vsize=309856 CPUtime=0 cores=0,2,4,6
/proc/9283/stat : 9283 (python) S 9268 9268 8573 0 -1 4202560 771 0 0 0 0 0 0 0 15 0 1 0 617162402 317292544 5701 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 15560943869511041281 0 0 17 2 0 0 0
/proc/9283/statm: 77464 5701 348 364 0 13373 0
[pid=9285] ppid=9283 vsize=1560 CPUtime=0.8 cores=0,2,4,6
/proc/9285/stat : 9285 (march_hi) R 9283 9285 9285 0 -1 4202496 504 0 0 0 80 0 0 0 25 0 1 0 617162403 1597440 241 33554432000 4194304 4955518 140734350854432 18446744073709551615 4224828 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9285/statm: 390 241 106 186 0 203 0
[pid=9268/tid=9275] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9275/stat : 9275 (python) S 9266 9268 8573 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 5 0 617162394 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9278] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9278/stat : 9278 (python) S 9266 9268 8573 0 -1 4202560 19 935 0 0 0 0 0 0 21 0 5 0 617162397 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 0 0 0 0
[pid=9268/tid=9281] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9281/stat : 9281 (python) S 9266 9268 8573 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 5 0 617162400 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 4 0 0 0
[pid=9268/tid=9284] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9284/stat : 9284 (python) S 9266 9268 8573 0 -1 4202560 24 935 0 0 0 0 0 0 22 0 5 0 617162403 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3.94
Current children cumulated vsize (KiB) 3535536

[startup+3.10124 s]
/proc/loadavg: 9.04 9.12 7.90 10/275 9285
/proc/meminfo: memFree=28907708/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=320100 CPUtime=0.57 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 12309 935 1 0 49 8 0 0 22 0 5 0 617162333 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/9268/statm: 80025 7238 1881 364 0 15934 0
[pid=9274] ppid=9268 vsize=278456 CPUtime=0 cores=0,2,4,6
/proc/9274/stat : 9274 (python) S 9268 9268 8573 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 617162393 285138944 5549 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945935 0 0 16781312 514 11483084215386341636 0 0 17 4 0 0 0
/proc/9274/statm: 69614 5549 354 364 0 5532 0
[pid=9276] ppid=9274 vsize=1017800 CPUtime=2.49 cores=0,2,4,6
/proc/9276/stat : 9276 (gnovelty+2) R 9274 9276 9276 0 -1 4202496 436 0 0 0 249 0 0 0 25 0 1 0 617162394 1042227200 171 33554432000 134512640 135663704 4288850800 18446744073709551615 134547193 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9276/statm: 254450 171 113 282 0 254166 0
[pid=9277] ppid=9268 vsize=289244 CPUtime=0 cores=0,2,4,6
/proc/9277/stat : 9277 (python) S 9268 9268 8573 0 -1 4202560 757 0 0 0 0 0 0 0 15 0 1 0 617162397 296185856 5668 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 2870138769162338561 0 0 17 0 0 0 0
/proc/9277/statm: 72311 5668 348 364 0 8226 0
[pid=9279] ppid=9277 vsize=1560 CPUtime=2.46 cores=0,2,4,6
/proc/9279/stat : 9279 (march_hi) R 9277 9279 9279 0 -1 4202496 506 0 0 0 246 0 0 0 25 0 1 0 617162397 1597440 241 33554432000 4194304 4955518 140736046559728 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9279/statm: 390 241 106 186 0 203 0
[pid=9280] ppid=9268 vsize=299160 CPUtime=0 cores=0,2,4,6
/proc/9280/stat : 9280 (python) S 9268 9268 8573 0 -1 4202560 748 0 0 0 0 0 0 0 18 0 1 0 617162399 306339840 5573 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 2393196463556362499 0 0 17 4 0 0 0
/proc/9280/statm: 74790 5573 348 364 0 10702 0
[pid=9282] ppid=9280 vsize=1017800 CPUtime=2.41 cores=0,2,4,6
/proc/9282/stat : 9282 (gnovelty+2) R 9280 9282 9282 0 -1 4202496 437 0 0 0 241 0 0 0 25 0 1 0 617162400 1042227200 172 33554432000 134512640 135663704 4294379632 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9282/statm: 254450 172 113 282 0 254166 0
[pid=9283] ppid=9268 vsize=309856 CPUtime=0 cores=0,2,4,6
/proc/9283/stat : 9283 (python) S 9268 9268 8573 0 -1 4202560 773 0 0 0 0 0 0 0 15 0 1 0 617162402 317292544 5701 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 15560943869511041281 0 0 17 2 0 0 0
/proc/9283/statm: 77464 5701 348 364 0 13373 0
[pid=9285] ppid=9283 vsize=1560 CPUtime=2.4 cores=0,2,4,6
/proc/9285/stat : 9285 (march_hi) R 9283 9285 9285 0 -1 4202496 505 0 0 0 240 0 0 0 25 0 1 0 617162403 1597440 242 33554432000 4194304 4955518 140734350854432 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9285/statm: 390 242 106 186 0 203 0
[pid=9268/tid=9275] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9275/stat : 9275 (python) S 9266 9268 8573 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 5 0 617162394 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9278] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9278/stat : 9278 (python) S 9266 9268 8573 0 -1 4202560 19 935 0 0 0 0 0 0 21 0 5 0 617162397 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 0 0 0 0
[pid=9268/tid=9281] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9281/stat : 9281 (python) S 9266 9268 8573 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 5 0 617162400 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 4 0 0 0
[pid=9268/tid=9284] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9284/stat : 9284 (python) S 9266 9268 8573 0 -1 4202560 24 935 0 0 0 0 0 0 22 0 5 0 617162403 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 10.33
Current children cumulated vsize (KiB) 3535536

[startup+6.3007 s]
/proc/loadavg: 9.04 9.12 7.91 10/275 9285
/proc/meminfo: memFree=28906064/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=320100 CPUtime=0.57 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 12309 935 1 0 49 8 0 0 22 0 5 0 617162333 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/9268/statm: 80025 7238 1881 364 0 15934 0
[pid=9274] ppid=9268 vsize=278456 CPUtime=0 cores=0,2,4,6
/proc/9274/stat : 9274 (python) S 9268 9268 8573 0 -1 4202560 889 0 0 0 0 0 0 0 18 0 1 0 617162393 285138944 5571 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945935 0 0 16781312 514 11483084215386341636 0 0 17 4 0 0 0
/proc/9274/statm: 69614 5571 376 364 0 5532 0
[pid=9276] ppid=9274 vsize=1017800 CPUtime=5.67 cores=0,2,4,6
/proc/9276/stat : 9276 (gnovelty+2) R 9274 9276 9276 0 -1 4202496 436 0 0 0 567 0 0 0 25 0 1 0 617162394 1042227200 171 33554432000 134512640 135663704 4288850800 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9276/statm: 254450 171 113 282 0 254166 0
[pid=9277] ppid=9268 vsize=289244 CPUtime=0 cores=0,2,4,6
/proc/9277/stat : 9277 (python) S 9268 9268 8573 0 -1 4202560 905 0 0 0 0 0 0 0 15 0 1 0 617162397 296185856 5691 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 2870138769162338561 0 0 17 0 0 0 0
/proc/9277/statm: 72311 5691 371 364 0 8226 0
[pid=9279] ppid=9277 vsize=1776 CPUtime=5.64 cores=0,2,4,6
/proc/9279/stat : 9279 (march_hi) R 9277 9279 9279 0 -1 4202496 533 0 0 0 564 0 0 0 25 0 1 0 617162397 1818624 268 33554432000 4194304 4955518 140736046559728 18446744073709551615 4224577 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9279/statm: 444 268 106 186 0 257 0
[pid=9280] ppid=9268 vsize=299160 CPUtime=0 cores=0,2,4,6
/proc/9280/stat : 9280 (python) S 9268 9268 8573 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 1 0 617162399 306339840 5596 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 2393196463556362499 0 0 17 4 0 0 0
/proc/9280/statm: 74790 5596 371 364 0 10702 0
[pid=9282] ppid=9280 vsize=1017800 CPUtime=5.59 cores=0,2,4,6
/proc/9282/stat : 9282 (gnovelty+2) R 9280 9282 9282 0 -1 4202496 437 0 0 0 559 0 0 0 25 0 1 0 617162400 1042227200 172 33554432000 134512640 135663704 4294379632 18446744073709551615 134525309 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9282/statm: 254450 172 113 282 0 254166 0
[pid=9283] ppid=9268 vsize=309856 CPUtime=0 cores=0,2,4,6
/proc/9283/stat : 9283 (python) S 9268 9268 8573 0 -1 4202560 923 0 0 0 0 0 0 0 15 0 1 0 617162402 317292544 5724 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 15560943869511041281 0 0 17 2 0 0 0
/proc/9283/statm: 77464 5724 371 364 0 13373 0
[pid=9285] ppid=9283 vsize=1776 CPUtime=5.58 cores=0,2,4,6
/proc/9285/stat : 9285 (march_hi) R 9283 9285 9285 0 -1 4202496 532 0 0 0 558 0 0 0 25 0 1 0 617162403 1818624 269 33554432000 4194304 4955518 140734350854432 18446744073709551615 4208724 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9285/statm: 444 269 106 186 0 257 0
[pid=9268/tid=9275] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9275/stat : 9275 (python) S 9266 9268 8573 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 5 0 617162394 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9278] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9278/stat : 9278 (python) S 9266 9268 8573 0 -1 4202560 19 935 0 0 0 0 0 0 21 0 5 0 617162397 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 0 0 0 0
[pid=9268/tid=9281] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9281/stat : 9281 (python) S 9266 9268 8573 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 5 0 617162400 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 4 0 0 0
[pid=9268/tid=9284] ppid=9266 vsize=320100 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9284/stat : 9284 (python) S 9266 9268 8573 0 -1 4202560 24 935 0 0 0 0 0 0 22 0 5 0 617162403 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 23.05
Current children cumulated vsize (KiB) 3535968

[startup+12.7006 s]
/proc/loadavg: 9.12 9.13 7.92 10/275 9285
/proc/meminfo: memFree=28905692/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=320100 CPUtime=0.57 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 12309 935 1 0 49 8 0 0 22 0 5 0 617162333 327782400 7238 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/9268/statm: 80025 7238 1881 364 0 15934 0
[pid=9274] ppid=9268 vsize=278456 CPUtime=0.02 cores=0,2,4,6
/proc/9274/stat : 9274 (python) S 9268 9268 8573 0 -1 4202560 893 0 0 0 1 1 0 0 18 0 1 0 617162393 285138944 5572 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945935 0 0 16781312 514 16614746595602170116 0 0 17 4 0 0 0
/proc/9274/statm: 69614 5572 377 364 0 5532 0
[pid=9276] ppid=9274 vsize=1017800 CPUtime=12.05 cores=0,2,4,6
/proc/9276/stat : 9276 (gnovelty+2) R 9274 9276 9276 0 -1 4202496 436 0 0 0 1205 0 0 0 25 0 1 0 617162394 1042227200 171 33554432000 134512640 135663704 4288850800 18446744073709551615 134524534 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9276/statm: 254450 171 113 282 0 254166 0
[pid=9277] ppid=9268 vsize=289244 CPUtime=0.01 cores=0,2,4,6

################
# More data... #
################

/proc/9279/stat : 9279 (march_hi) R 9277 9279 9279 0 -1 4202496 3081 0 0 0 30298 1 0 0 25 0 1 0 617162397 13832192 2797 33554432000 4194304 4955518 140736046559728 18446744073709551615 4208710 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9279/statm: 3377 2797 106 186 0 3190 0
[pid=9277/tid=9392] ppid=9268 vsize=289244 CPUtime=0 cores=0,2,4,6
/proc/9277/task/9392/stat : 9392 (python) S 9268 9268 8573 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 617181962 296185856 5721 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 514 18446604440278878336 0 0 -1 0 0 0 0
[pid=9280] ppid=9268 vsize=299160 CPUtime=0.16 cores=0,2,4,6
/proc/9280/stat : 9280 (python) S 9268 9268 8573 0 -1 4202560 1088 0 0 0 10 6 0 0 19 0 2 0 617162399 306339840 5626 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/9280/statm: 74790 5626 400 364 0 10702 0
[pid=9282] ppid=9280 vsize=1017800 CPUtime=99.42 cores=0,2,4,6
/proc/9282/stat : 9282 (gnovelty+2) T 9280 9282 9282 0 -1 4202496 437 0 0 0 9942 0 0 0 25 0 1 0 617162400 1042227200 172 33554432000 134512640 135663704 4294379632 18446744073709551615 134544196 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/9282/statm: 254450 172 113 282 0 254166 0
[pid=9280/tid=9296] ppid=9268 vsize=299160 CPUtime=0 cores=0,2,4,6
/proc/9280/task/9296/stat : 9296 (python) S 9268 9268 8573 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 617172415 306339840 5626 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 514 18446604453469902720 0 0 -1 4 0 0 0
[pid=9283] ppid=9268 vsize=309856 CPUtime=0.57 cores=0,2,4,6
/proc/9283/stat : 9283 (python) S 9268 9268 8573 0 -1 4202560 1016 0 0 0 33 24 0 0 15 0 1 0 617162402 317292544 5724 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 15560943869511041281 0 0 17 6 0 0 0
/proc/9283/statm: 77464 5724 371 364 0 13373 0
[pid=9285] ppid=9283 vsize=13508 CPUtime=301.68 cores=0,2,4,6
/proc/9285/stat : 9285 (march_hi) R 9283 9285 9285 0 -1 4202496 3053 0 0 0 30167 1 0 0 25 0 1 0 617162403 13832192 2771 33554432000 4194304 4955518 140734350854432 18446744073709551615 4285340 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9285/statm: 3377 2771 106 186 0 3190 0
[pid=9293] ppid=9268 vsize=320112 CPUtime=0.38 cores=0,2,4,6
/proc/9293/stat : 9293 (python) S 9268 9268 8573 0 -1 4202560 1009 0 0 0 22 16 0 0 15 0 1 0 617172413 327794688 5728 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 4697768987084161283 0 0 17 2 0 0 0
/proc/9293/statm: 80028 5728 371 364 0 15934 0
[pid=9295] ppid=9293 vsize=6860 CPUtime=202.92 cores=0,2,4,6
/proc/9295/stat : 9295 (march_hi) R 9293 9295 9295 0 -1 4202496 1799 0 0 0 20286 6 0 0 25 0 1 0 617172413 7024640 1514 33554432000 4194304 4955518 140735457007168 18446744073709551615 4208620 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9295/statm: 1715 1514 106 186 0 1528 0
[pid=9297] ppid=9268 vsize=330044 CPUtime=0.36 cores=0,2,4,6
/proc/9297/stat : 9297 (python) S 9268 9268 8573 0 -1 4202560 1015 0 0 0 20 16 0 0 15 0 1 0 617172419 337965056 5638 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 8184918493087367425 0 0 17 4 0 0 0
/proc/9297/statm: 82511 5638 371 364 0 18414 0
[pid=9299] ppid=9297 vsize=6860 CPUtime=203.07 cores=0,2,4,6
/proc/9299/stat : 9299 (march_hi) R 9297 9299 9299 0 -1 4202496 1800 0 0 0 20307 0 0 0 25 0 1 0 617172419 7024640 1515 33554432000 4194304 4955518 140736555929248 18446744073709551615 4224450 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9299/statm: 1715 1515 106 186 0 1528 0
[pid=9268/tid=9275] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9275/stat : 9275 (python) S 9266 9268 8573 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 7 0 617162394 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9278] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9278/stat : 9278 (python) S 9266 9268 8573 0 -1 4202560 23 935 0 0 0 0 0 0 18 0 7 0 617162397 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 0 0 0 0
[pid=9268/tid=9281] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9281/stat : 9281 (python) S 9266 9268 8573 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 7 0 617162400 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 4 0 0 0
[pid=9268/tid=9284] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9284/stat : 9284 (python) S 9266 9268 8573 0 -1 4202560 24 935 0 0 0 0 0 0 22 0 7 0 617162403 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9294] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9294/stat : 9294 (python) S 9266 9268 8573 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 7 0 617172413 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9298] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9298/stat : 9298 (python) S 9266 9268 8573 0 -1 4202560 26 935 0 0 0 0 0 0 21 0 7 0 617172419 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1212.79
Current children cumulated vsize (KiB) 4254232

[startup+304.501 s]
/proc/loadavg: 9.96 9.42 8.34 11/254 9396
/proc/meminfo: memFree=29012040/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=340780 CPUtime=0.69 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 14637 935 1 0 61 8 0 0 18 0 7 0 617162333 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/9268/statm: 85195 7298 1886 364 0 21098 0
[pid=9274] ppid=9268 vsize=288700 CPUtime=0.16 cores=0,2,4,6
/proc/9274/stat : 9274 (python) S 9268 9268 8573 0 -1 4202560 1083 0 0 0 9 7 0 0 19 0 2 0 617162393 295628800 5610 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/9274/statm: 72175 5610 410 364 0 8093 0
[pid=9276] ppid=9274 vsize=1017800 CPUtime=99.82 cores=0,2,4,6
/proc/9276/stat : 9276 (gnovelty+2) T 9274 9276 9276 0 -1 4202496 436 0 0 0 9982 0 0 0 25 0 1 0 617162394 1042227200 171 33554432000 134512640 135663704 4288850800 18446744073709551615 134525160 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/9276/statm: 254450 171 113 282 0 254166 0
[pid=9274/tid=9292] ppid=9268 vsize=288700 CPUtime=0 cores=0,2,4,6
/proc/9274/task/9292/stat : 9292 (python) S 9268 9268 8573 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 617172410 295628800 5610 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 514 18446604442701405248 0 0 -1 4 0 0 0
[pid=9277] ppid=9268 vsize=289244 CPUtime=0.57 cores=0,2,4,6
/proc/9277/stat : 9277 (python) S 9268 9268 8573 0 -1 4202560 1162 0 0 0 33 24 0 0 15 0 2 0 617162397 296185856 5721 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/9277/statm: 72311 5721 400 364 0 8226 0
[pid=9279] ppid=9277 vsize=13508 CPUtime=303.19 cores=0,2,4,6
/proc/9279/stat : 9279 (march_hi) R 9277 9279 9279 0 -1 4202496 3085 0 0 0 30318 1 0 0 25 0 1 0 617162397 13832192 2801 33554432000 4194304 4955518 140736046559728 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9279/statm: 3377 2801 106 186 0 3190 0
[pid=9277/tid=9392] ppid=9268 vsize=289244 CPUtime=0 cores=0,2,4,6
/proc/9277/task/9392/stat : 9392 (python) S 9268 9268 8573 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 617181962 296185856 5721 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 514 18446604440278878336 0 0 -1 0 0 0 0
[pid=9280] ppid=9268 vsize=299160 CPUtime=0.16 cores=0,2,4,6
/proc/9280/stat : 9280 (python) S 9268 9268 8573 0 -1 4202560 1088 0 0 0 10 6 0 0 19 0 2 0 617162399 306339840 5626 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/9280/statm: 74790 5626 400 364 0 10702 0
[pid=9282] ppid=9280 vsize=1017800 CPUtime=99.42 cores=0,2,4,6
/proc/9282/stat : 9282 (gnovelty+2) T 9280 9282 9282 0 -1 4202496 437 0 0 0 9942 0 0 0 25 0 1 0 617162400 1042227200 172 33554432000 134512640 135663704 4294379632 18446744073709551615 134544196 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/9282/statm: 254450 172 113 282 0 254166 0
[pid=9280/tid=9296] ppid=9268 vsize=299160 CPUtime=0 cores=0,2,4,6
/proc/9280/task/9296/stat : 9296 (python) S 9268 9268 8573 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 617172415 306339840 5626 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 514 18446604453469902720 0 0 -1 4 0 0 0
[pid=9283] ppid=9268 vsize=309856 CPUtime=0.57 cores=0,2,4,6
/proc/9283/stat : 9283 (python) S 9268 9268 8573 0 -1 4202560 1016 0 0 0 33 24 0 0 15 0 1 0 617162402 317292544 5724 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 15560943869511041281 0 0 17 6 0 0 0
/proc/9283/statm: 77464 5724 371 364 0 13373 0
[pid=9285] ppid=9283 vsize=13508 CPUtime=301.88 cores=0,2,4,6
/proc/9285/stat : 9285 (march_hi) R 9283 9285 9285 0 -1 4202496 3056 0 0 0 30187 1 0 0 25 0 1 0 617162403 13832192 2774 33554432000 4194304 4955518 140734350854432 18446744073709551615 4224471 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9285/statm: 3377 2774 106 186 0 3190 0
[pid=9293] ppid=9268 vsize=320112 CPUtime=0.38 cores=0,2,4,6
/proc/9293/stat : 9293 (python) S 9268 9268 8573 0 -1 4202560 1009 0 0 0 22 16 0 0 15 0 1 0 617172413 327794688 5728 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 4697768987084161283 0 0 17 2 0 0 0
/proc/9293/statm: 80028 5728 371 364 0 15934 0
[pid=9295] ppid=9293 vsize=6860 CPUtime=203.12 cores=0,2,4,6
/proc/9295/stat : 9295 (march_hi) R 9293 9295 9295 0 -1 4202496 1799 0 0 0 20306 6 0 0 25 0 1 0 617172413 7024640 1514 33554432000 4194304 4955518 140735457007168 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9295/statm: 1715 1514 106 186 0 1528 0
[pid=9297] ppid=9268 vsize=330044 CPUtime=0.37 cores=0,2,4,6
/proc/9297/stat : 9297 (python) S 9268 9268 8573 0 -1 4202560 1018 0 0 0 21 16 0 0 16 0 1 0 617172419 337965056 5638 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 16614746595602170113 0 0 17 4 0 0 0
/proc/9297/statm: 82511 5638 371 364 0 18414 0
[pid=9299] ppid=9297 vsize=6860 CPUtime=203.26 cores=0,2,4,6
/proc/9299/stat : 9299 (march_hi) R 9297 9299 9299 0 -1 4202496 1801 0 0 0 20326 0 0 0 25 0 1 0 617172419 7024640 1516 33554432000 4194304 4955518 140736555929248 18446744073709551615 4237804 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9299/statm: 1715 1516 106 186 0 1528 0
[pid=9268/tid=9275] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9275/stat : 9275 (python) S 9266 9268 8573 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 7 0 617162394 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9278] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9278/stat : 9278 (python) S 9266 9268 8573 0 -1 4202560 23 935 0 0 0 0 0 0 18 0 7 0 617162397 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 0 0 0 0
[pid=9268/tid=9281] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9281/stat : 9281 (python) S 9266 9268 8573 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 7 0 617162400 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 4 0 0 0
[pid=9268/tid=9284] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9284/stat : 9284 (python) S 9266 9268 8573 0 -1 4202560 24 935 0 0 0 0 0 0 22 0 7 0 617162403 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9294] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9294/stat : 9294 (python) S 9266 9268 8573 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 7 0 617172413 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9298] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9298/stat : 9298 (python) S 9266 9268 8573 0 -1 4202560 26 935 0 0 0 0 0 0 21 0 7 0 617172419 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1213.59
Current children cumulated vsize (KiB) 4254232

[startup+304.601 s]
/proc/loadavg: 9.96 9.43 8.35 12/254 9396
/proc/meminfo: memFree=29011172/32951124 swapFree=67103364/67111528
[pid=9268] ppid=9266 vsize=340780 CPUtime=0.69 cores=0,2,4,6
/proc/9268/stat : 9268 (python) S 9266 9268 8573 0 -1 4202496 14637 935 1 0 61 8 0 0 18 0 7 0 617162333 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/9268/statm: 85195 7298 1886 364 0 21098 0
[pid=9274] ppid=9268 vsize=288700 CPUtime=0.16 cores=0,2,4,6
/proc/9274/stat : 9274 (python) S 9268 9268 8573 0 -1 4202560 1083 0 0 0 9 7 0 0 19 0 2 0 617162393 295628800 5610 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/9274/statm: 72175 5610 410 364 0 8093 0
[pid=9276] ppid=9274 vsize=1017800 CPUtime=99.82 cores=0,2,4,6
/proc/9276/stat : 9276 (gnovelty+2) T 9274 9276 9276 0 -1 4202496 436 0 0 0 9982 0 0 0 25 0 1 0 617162394 1042227200 171 33554432000 134512640 135663704 4288850800 18446744073709551615 134525160 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/9276/statm: 254450 171 113 282 0 254166 0
[pid=9274/tid=9292] ppid=9268 vsize=288700 CPUtime=0 cores=0,2,4,6
/proc/9274/task/9292/stat : 9292 (python) S 9268 9268 8573 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 617172410 295628800 5610 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 514 18446604442701405248 0 0 -1 4 0 0 0
[pid=9277] ppid=9268 vsize=289244 CPUtime=0.57 cores=0,2,4,6
/proc/9277/stat : 9277 (python) S 9268 9268 8573 0 -1 4202560 1162 0 0 0 33 24 0 0 15 0 2 0 617162397 296185856 5721 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/9277/statm: 72311 5721 400 364 0 8226 0
[pid=9279] ppid=9277 vsize=13508 CPUtime=303.3 cores=0,2,4,6
/proc/9279/stat : 9279 (march_hi) R 9277 9279 9279 0 -1 4202496 3087 0 0 0 30329 1 0 0 25 0 1 0 617162397 13832192 2803 33554432000 4194304 4955518 140736046559728 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9279/statm: 3377 2803 106 186 0 3190 0
[pid=9277/tid=9392] ppid=9268 vsize=289244 CPUtime=0 cores=0,2,4,6
/proc/9277/task/9392/stat : 9392 (python) S 9268 9268 8573 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 617181962 296185856 5721 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 514 18446604440278878336 0 0 -1 0 0 0 0
[pid=9280] ppid=9268 vsize=299160 CPUtime=0.16 cores=0,2,4,6
/proc/9280/stat : 9280 (python) S 9268 9268 8573 0 -1 4202560 1088 0 0 0 10 6 0 0 19 0 2 0 617162399 306339840 5626 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/9280/statm: 74790 5626 400 364 0 10702 0
[pid=9282] ppid=9280 vsize=1017800 CPUtime=99.42 cores=0,2,4,6
/proc/9282/stat : 9282 (gnovelty+2) T 9280 9282 9282 0 -1 4202496 437 0 0 0 9942 0 0 0 25 0 1 0 617162400 1042227200 172 33554432000 134512640 135663704 4294379632 18446744073709551615 134544196 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/9282/statm: 254450 172 113 282 0 254166 0
[pid=9280/tid=9296] ppid=9268 vsize=299160 CPUtime=0 cores=0,2,4,6
/proc/9280/task/9296/stat : 9296 (python) S 9268 9268 8573 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 617172415 306339840 5626 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 514 18446604453469902720 0 0 -1 4 0 0 0
[pid=9283] ppid=9268 vsize=309856 CPUtime=0.57 cores=0,2,4,6
/proc/9283/stat : 9283 (python) S 9268 9268 8573 0 -1 4202560 1016 0 0 0 33 24 0 0 15 0 1 0 617162402 317292544 5724 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 15560943869511041281 0 0 17 6 0 0 0
/proc/9283/statm: 77464 5724 371 364 0 13373 0
[pid=9285] ppid=9283 vsize=13508 CPUtime=301.98 cores=0,2,4,6
/proc/9285/stat : 9285 (march_hi) R 9283 9285 9285 0 -1 4202496 3058 0 0 0 30197 1 0 0 25 0 1 0 617162403 13832192 2776 33554432000 4194304 4955518 140734350854432 18446744073709551615 4208624 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9285/statm: 3377 2776 106 186 0 3190 0
[pid=9293] ppid=9268 vsize=320112 CPUtime=0.38 cores=0,2,4,6
/proc/9293/stat : 9293 (python) S 9268 9268 8573 0 -1 4202560 1009 0 0 0 22 16 0 0 15 0 1 0 617172413 327794688 5728 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 4697768987084161283 0 0 17 2 0 0 0
/proc/9293/statm: 80028 5728 371 364 0 15934 0
[pid=9295] ppid=9293 vsize=6860 CPUtime=203.23 cores=0,2,4,6
/proc/9295/stat : 9295 (march_hi) R 9293 9295 9295 0 -1 4202496 1800 0 0 0 20317 6 0 0 25 0 1 0 617172413 7024640 1515 33554432000 4194304 4955518 140735457007168 18446744073709551615 4235624 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9295/statm: 1715 1515 106 186 0 1528 0
[pid=9297] ppid=9268 vsize=330044 CPUtime=0.37 cores=0,2,4,6
/proc/9297/stat : 9297 (python) S 9268 9268 8573 0 -1 4202560 1018 0 0 0 21 16 0 0 16 0 1 0 617172419 337965056 5638 33554432000 4194304 5683644 140737453393616 18446744073709551615 224284945990 0 0 16781312 514 16614746595602170113 0 0 17 4 0 0 0
/proc/9297/statm: 82511 5638 371 364 0 18414 0
[pid=9299] ppid=9297 vsize=6860 CPUtime=203.36 cores=0,2,4,6
/proc/9299/stat : 9299 (march_hi) R 9297 9299 9299 0 -1 4202496 1801 0 0 0 20336 0 0 0 25 0 1 0 617172419 7024640 1516 33554432000 4194304 4955518 140736555929248 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9299/statm: 1715 1516 106 186 0 1528 0
[pid=9268/tid=9275] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9275/stat : 9275 (python) S 9266 9268 8573 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 7 0 617162394 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9278] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9278/stat : 9278 (python) S 9266 9268 8573 0 -1 4202560 23 935 0 0 0 0 0 0 18 0 7 0 617162397 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 0 0 0 0
[pid=9268/tid=9281] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9281/stat : 9281 (python) S 9266 9268 8573 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 7 0 617162400 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 4 0 0 0
[pid=9268/tid=9284] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9284/stat : 9284 (python) S 9266 9268 8573 0 -1 4202560 24 935 0 0 0 0 0 0 22 0 7 0 617162403 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9294] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9294/stat : 9294 (python) S 9266 9268 8573 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 7 0 617172413 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
[pid=9268/tid=9298] ppid=9266 vsize=340780 CPUtime=0 cores=0,2,4,6
/proc/9268/task/9298/stat : 9298 (python) S 9266 9268 8573 0 -1 4202560 26 935 0 0 0 0 0 0 21 0 7 0 617172419 348958720 7298 33554432000 4194304 5683644 140737453393616 18446744073709551615 224296749489 0 0 16781312 2 18446604453899925376 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1214.01
Current children cumulated vsize (KiB) 4254232

Child status: 0
Real time (s): 304.7
CPU time (s): 1214.44
CPU user time (s): 1213.28
CPU system time (s): 1.16082
CPU usage (%): 398.57
Max. virtual memory (cumulated for all children) (KiB): 4254232

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1213.28
system time used= 1.16082
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36861
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4220
involuntary context switches= 11920

runsolver used 0.707892 second user time and 1.51277 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-01 19:01:57
IDJOB=3317387
IDBENCH=82852
IDSOLVER=1705
FILE ID=node118/3317387-1304269316
RUNJOBID= node118-1304267284-8591
PBS_JOBID= 13173961
Free space on /tmp= 72152 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v100-c2130-S2051088205-036.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317387-1304269316/watcher-3317387-1304269316 -o /tmp/evaluation-result-3317387-1304269316/solver-3317387-1304269316 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317387-1304269316.cnf -seed 1899396134 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 901aadbc76f4961d582bc9856b3c63b3
RANDOM SEED=1899396134

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28946540 kB
Buffers:        469716 kB
Cached:        1773788 kB
SwapCached:       2844 kB
Active:        1647456 kB
Inactive:      1975364 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28946540 kB
SwapTotal:    67111528 kB
SwapFree:     67103364 kB
Dirty:           31868 kB
Writeback:           0 kB
AnonPages:     1378392 kB
Mapped:          22220 kB
Slab:           298208 kB
PageTables:      22996 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 20521712 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72116 MiB
End job on node118 at 2011-05-01 19:07:01