Trace number 3378509

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 1661.3 529.549

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S1445862528-059.UNKNOWN.cnf
MD5SUM9e4f1914facdb4a8b3ffdd1de343beff
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark368.429
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data 

0.33/0.64	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.33/0.64	c INFO: solving HOME/instance-3378509-1305465981.cnf
0.33/0.64	c INFO: computing task features
0.33/0.67	c INFO: computed variable-clause graph statistics
0.33/0.67	c INFO: computed clause balance statistics
0.50/0.86	c INFO: computed variable balance statistics
0.60/0.94	c INFO: computed small-clause counts
0.60/0.94	c INFO: computed Horn-clause counts
0.60/0.94	c INFO: computed variable graph statistics
0.60/0.94	c INFO: collected features for HOME/instance-3378509-1305465981.cnf in 0.31 s
0.60/0.95	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.55)
0.60/0.96	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.10)
0.60/0.97	c INFO: running adaptg2wsat2009++@0 for 97 with 1199 remaining (b = 0.05)
0.60/0.98	c INFO: running adaptg2wsat2009++@0 for 97 with 1199 remaining (b = 0.03)
341.32/101.23	c INFO: running adaptg2wsat2009++@0 for 97 with 1099 remaining (b = 0.03)
341.32/101.24	c INFO: running march_hi@0 for 485 with 1099 remaining (b = 0.12)
377.16/113.30	c INFO: running gnovelty+2@0 for 97 with 1087 remaining (b = 0.02)
628.96/197.49	c INFO: running march_hi@0 for 485 with 1003 remaining (b = 0.11)
664.14/207.53	c INFO: running march_hi@0 for 485 with 993 remaining (b = 0.09)
754.54/237.64	c INFO: running FH@0 for 97 with 962 remaining (b = 0.02)
1163.80/374.02	c INFO: running march_hi@0 for 485 with 826 remaining (b = 0.08)
1660.96/529.52	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378509-1305465981/watcher-3378509-1305465981 -o /tmp/evaluation-result-3378509-1305465981/solver-3378509-1305465981 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378509-1305465981.cnf -seed 2084053933 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.43 9.26 8.64 7/387 2210
/proc/meminfo: memFree=22706364/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=15384 CPUtime=0 cores=0,2,4,6
/proc/2210/stat : 2210 (python) R 2208 2210 1220 0 -1 4202496 740 0 0 0 0 0 0 0 25 0 1 0 639013485 15753216 629 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261310445 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/2210/statm: 3846 644 322 364 0 333 0

[startup+0.0695431 s]
/proc/loadavg: 9.43 9.26 8.64 7/387 2210
/proc/meminfo: memFree=22706364/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=36512 CPUtime=0.03 cores=0,2,4,6
/proc/2210/stat : 2210 (python) S 2208 2210 1220 0 -1 4202496 1611 0 0 0 3 0 0 0 25 0 1 0 639013485 37388288 1444 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261614592 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/2210/statm: 9128 1444 452 364 0 945 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 36512

[startup+0.100537 s]
/proc/loadavg: 9.43 9.26 8.64 7/387 2210
/proc/meminfo: memFree=22706364/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=93964 CPUtime=0.05 cores=0,2,4,6
/proc/2210/stat : 2210 (python) R 2208 2210 1220 0 -1 4202496 2692 0 0 0 4 1 0 0 25 0 1 0 639013485 96219136 2407 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261614592 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/2210/statm: 23491 2407 764 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93964

[startup+0.300535 s]
/proc/loadavg: 9.43 9.26 8.64 7/387 2210
/proc/meminfo: memFree=22706364/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=135752 CPUtime=0.15 cores=0,2,4,6
/proc/2210/stat : 2210 (python) S 2208 2210 1220 0 -1 4202496 5962 935 1 0 12 3 0 0 17 0 1 0 639013485 139010048 4151 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261612549 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/2210/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 135752

[startup+0.700472 s]
/proc/loadavg: 9.43 9.26 8.64 7/387 2210
/proc/meminfo: memFree=22706364/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=279556 CPUtime=0.4 cores=0,2,4,6
/proc/2210/stat : 2210 (python) R 2208 2210 1220 0 -1 4202496 9752 935 1 0 33 7 0 0 16 0 1 0 639013485 286265344 7273 33554432000 4194304 5683644 140736465734016 18446744073709551615 4620059 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/2210/statm: 69889 7273 1826 364 0 5813 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 279556

[startup+1.50129 s]
/proc/loadavg: 9.43 9.26 8.64 11/400 2227
/proc/meminfo: memFree=22667944/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=320248 CPUtime=0.69 cores=0,2,4,6
/proc/2210/stat : 2210 (python) S 2208 2210 1220 0 -1 4202496 12587 935 1 0 61 8 0 0 22 0 5 0 639013485 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/2210/statm: 80062 7252 1875 364 0 15971 0
[pid=2216] ppid=2210 vsize=278704 CPUtime=0 cores=0,2,4,6
/proc/2216/stat : 2216 (python) S 2210 2210 1220 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 639013581 285392896 5614 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636623 0 0 16781312 514 4483901605975949311 0 0 17 0 0 0 0
/proc/2216/statm: 69676 5614 354 364 0 5594 0
[pid=2218] ppid=2216 vsize=1017932 CPUtime=0.52 cores=0,2,4,6
/proc/2218/stat : 2218 (gnovelty+2) R 2216 2218 2218 0 -1 4202496 512 0 0 0 52 0 0 0 20 0 1 0 639013582 1042362368 247 33554432000 134512640 135663704 4291278000 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2218/statm: 254483 247 113 282 0 254199 0
[pid=2219] ppid=2210 vsize=289356 CPUtime=0 cores=0,2,4,6
/proc/2219/stat : 2219 (python) S 2210 2210 1220 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 639013582 296300544 5696 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 4246256186405421055 0 0 17 2 0 0 0
/proc/2219/statm: 72339 5696 348 364 0 8254 0
[pid=2221] ppid=2219 vsize=1017932 CPUtime=0.52 cores=0,2,4,6
/proc/2221/stat : 2221 (gnovelty+2) R 2219 2221 2221 0 -1 4202496 511 0 0 0 52 0 0 0 20 0 1 0 639013582 1042362368 248 33554432000 134512640 135663704 4292555072 18446744073709551615 134525247 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2221/statm: 254483 248 113 282 0 254199 0
[pid=2222] ppid=2210 vsize=299140 CPUtime=0 cores=0,2,4,6
/proc/2222/stat : 2222 (python) S 2210 2210 1220 0 -1 4202560 715 0 0 0 0 0 0 0 20 0 1 0 639013583 306319360 5593 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 4428961758715052031 0 0 17 0 0 0 0
/proc/2222/statm: 74785 5593 344 364 0 10697 0
[pid=2226] ppid=2222 vsize=416652 CPUtime=0.5 cores=0,2,4,6
/proc/2226/stat : 2226 (adaptg2wsat2009) R 2222 2226 2226 0 -1 4202496 564 0 0 0 50 0 0 0 23 0 1 0 639013584 426651648 303 33554432000 134512640 135107411 4293256592 18446744073709551615 134523229 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2226/statm: 104163 303 49 146 0 103039 0
[pid=2224] ppid=2210 vsize=310004 CPUtime=0 cores=0,2,4,6
/proc/2224/stat : 2224 (python) S 2210 2210 1220 0 -1 4202560 721 0 0 0 0 0 0 0 22 0 1 0 639013584 317444096 5717 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 9910242177701642239 0 0 17 0 0 0 0
/proc/2224/statm: 77501 5717 344 364 0 13410 0
[pid=2227] ppid=2224 vsize=416652 CPUtime=0.27 cores=0,2,4,6
/proc/2227/stat : 2227 (adaptg2wsat2009) R 2224 2227 2227 0 -1 4202496 563 0 0 0 27 0 0 0 25 0 1 0 639013585 426651648 302 33554432000 134512640 135107411 4293302064 18446744073709551615 134523314 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2227/statm: 104163 302 49 146 0 103039 0
[pid=2210/tid=2217] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2217/stat : 2217 (python) S 2208 2210 1220 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 5 0 639013581 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2220] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2220/stat : 2220 (python) S 2208 2210 1220 0 -1 4202560 23 935 0 0 0 0 0 0 19 0 5 0 639013582 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2223] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2223/stat : 2223 (python) S 2208 2210 1220 0 -1 4202560 38 935 0 0 0 0 0 0 21 0 5 0 639013583 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2225] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2225/stat : 2225 (python) S 2208 2210 1220 0 -1 4202560 18 935 0 0 0 0 0 0 23 0 5 0 639013584 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.5
Current children cumulated vsize (KiB) 4366620

[startup+3.10101 s]
/proc/loadavg: 9.47 9.27 8.64 10/400 2227
/proc/meminfo: memFree=22664476/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=320248 CPUtime=0.69 cores=0,2,4,6
/proc/2210/stat : 2210 (python) S 2208 2210 1220 0 -1 4202496 12587 935 1 0 61 8 0 0 22 0 5 0 639013485 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/2210/statm: 80062 7252 1875 364 0 15971 0
[pid=2216] ppid=2210 vsize=278704 CPUtime=0 cores=0,2,4,6
/proc/2216/stat : 2216 (python) S 2210 2210 1220 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 639013581 285392896 5614 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636623 0 0 16781312 514 4483901605975916804 0 0 17 0 0 0 0
/proc/2216/statm: 69676 5614 354 364 0 5594 0
[pid=2218] ppid=2216 vsize=1017932 CPUtime=2.11 cores=0,2,4,6
/proc/2218/stat : 2218 (gnovelty+2) R 2216 2218 2218 0 -1 4202496 512 0 0 0 211 0 0 0 25 0 1 0 639013582 1042362368 247 33554432000 134512640 135663704 4291278000 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2218/statm: 254483 247 113 282 0 254199 0
[pid=2219] ppid=2210 vsize=289356 CPUtime=0 cores=0,2,4,6
/proc/2219/stat : 2219 (python) S 2210 2210 1220 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 639013582 296300544 5696 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 4246256186405388547 0 0 17 2 0 0 0
/proc/2219/statm: 72339 5696 348 364 0 8254 0
[pid=2221] ppid=2219 vsize=1017932 CPUtime=2.12 cores=0,2,4,6
/proc/2221/stat : 2221 (gnovelty+2) R 2219 2221 2221 0 -1 4202496 511 0 0 0 212 0 0 0 25 0 1 0 639013582 1042362368 248 33554432000 134512640 135663704 4292555072 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2221/statm: 254483 248 113 282 0 254199 0
[pid=2222] ppid=2210 vsize=299140 CPUtime=0 cores=0,2,4,6
/proc/2222/stat : 2222 (python) S 2210 2210 1220 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 639013583 306319360 5597 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 4428961758715019521 0 0 17 0 0 0 0
/proc/2222/statm: 74785 5597 348 364 0 10697 0
[pid=2226] ppid=2222 vsize=416788 CPUtime=2.1 cores=0,2,4,6
/proc/2226/stat : 2226 (adaptg2wsat2009) R 2222 2226 2226 0 -1 4202496 624 0 0 0 210 0 0 0 25 0 1 0 639013584 426790912 363 33554432000 134512640 135107411 4293256592 18446744073709551615 134531724 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2226/statm: 104197 363 59 146 0 103073 0
[pid=2224] ppid=2210 vsize=310004 CPUtime=0 cores=0,2,4,6
/proc/2224/stat : 2224 (python) S 2210 2210 1220 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 639013584 317444096 5721 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 9910242177701609731 0 0 17 0 0 0 0
/proc/2224/statm: 77501 5721 348 364 0 13410 0
[pid=2227] ppid=2224 vsize=416788 CPUtime=1.07 cores=0,2,4,6
/proc/2227/stat : 2227 (adaptg2wsat2009) R 2224 2227 2227 0 -1 4202496 625 0 0 0 107 0 0 0 25 0 1 0 639013585 426790912 364 33554432000 134512640 135107411 4293302064 18446744073709551615 134531411 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2227/statm: 104197 364 59 146 0 103073 0
[pid=2210/tid=2217] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2217/stat : 2217 (python) S 2208 2210 1220 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 5 0 639013581 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2220] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2220/stat : 2220 (python) S 2208 2210 1220 0 -1 4202560 23 935 0 0 0 0 0 0 19 0 5 0 639013582 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2223] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2223/stat : 2223 (python) S 2208 2210 1220 0 -1 4202560 38 935 0 0 0 0 0 0 21 0 5 0 639013583 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2225] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2225/stat : 2225 (python) S 2208 2210 1220 0 -1 4202560 18 935 0 0 0 0 0 0 23 0 5 0 639013584 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 8.09
Current children cumulated vsize (KiB) 4366892

[startup+6.30044 s]
/proc/loadavg: 9.47 9.27 8.64 10/400 2227
/proc/meminfo: memFree=22662128/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=320248 CPUtime=0.69 cores=0,2,4,6
/proc/2210/stat : 2210 (python) S 2208 2210 1220 0 -1 4202496 12587 935 1 0 61 8 0 0 22 0 5 0 639013485 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/2210/statm: 80062 7252 1875 364 0 15971 0
[pid=2216] ppid=2210 vsize=278704 CPUtime=0.01 cores=0,2,4,6
/proc/2216/stat : 2216 (python) S 2210 2210 1220 0 -1 4202560 889 0 0 0 0 1 0 0 18 0 1 0 639013581 285392896 5637 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636623 0 0 16781312 514 4483901605975916804 0 0 17 0 0 0 0
/proc/2216/statm: 69676 5637 377 364 0 5594 0
[pid=2218] ppid=2216 vsize=1017932 CPUtime=5.27 cores=0,2,4,6
/proc/2218/stat : 2218 (gnovelty+2) R 2216 2218 2218 0 -1 4202496 512 0 0 0 527 0 0 0 25 0 1 0 639013582 1042362368 247 33554432000 134512640 135663704 4291278000 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2218/statm: 254483 247 113 282 0 254199 0
[pid=2219] ppid=2210 vsize=289356 CPUtime=0 cores=0,2,4,6
/proc/2219/stat : 2219 (python) S 2210 2210 1220 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 1 0 639013582 296300544 5718 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 4246256186405388547 0 0 17 2 0 0 0
/proc/2219/statm: 72339 5718 370 364 0 8254 0
[pid=2221] ppid=2219 vsize=1017932 CPUtime=5.3 cores=0,2,4,6
/proc/2221/stat : 2221 (gnovelty+2) R 2219 2221 2221 0 -1 4202496 511 0 0 0 530 0 0 0 25 0 1 0 639013582 1042362368 248 33554432000 134512640 135663704 4292555072 18446744073709551615 134525229 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2221/statm: 254483 248 113 282 0 254199 0
[pid=2222] ppid=2210 vsize=299140 CPUtime=0.01 cores=0,2,4,6
/proc/2222/stat : 2222 (python) S 2210 2210 1220 0 -1 4202560 899 0 0 0 0 1 0 0 18 0 1 0 639013583 306319360 5620 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 4428961758715019521 0 0 17 0 0 0 0
/proc/2222/statm: 74785 5620 371 364 0 10697 0
[pid=2226] ppid=2222 vsize=416788 CPUtime=5.25 cores=0,2,4,6
/proc/2226/stat : 2226 (adaptg2wsat2009) R 2222 2226 2226 0 -1 4202496 624 0 0 0 525 0 0 0 25 0 1 0 639013584 426790912 363 33554432000 134512640 135107411 4293256592 18446744073709551615 134532347 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2226/statm: 104197 363 59 146 0 103073 0
[pid=2224] ppid=2210 vsize=310004 CPUtime=0.01 cores=0,2,4,6
/proc/2224/stat : 2224 (python) S 2210 2210 1220 0 -1 4202560 901 0 0 0 0 1 0 0 18 0 1 0 639013584 317444096 5743 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 9910242177701609731 0 0 17 0 0 0 0
/proc/2224/statm: 77501 5743 370 364 0 13410 0
[pid=2227] ppid=2224 vsize=416788 CPUtime=2.67 cores=0,2,4,6
/proc/2227/stat : 2227 (adaptg2wsat2009) R 2224 2227 2227 0 -1 4202496 625 0 0 0 267 0 0 0 25 0 1 0 639013585 426790912 364 33554432000 134512640 135107411 4293302064 18446744073709551615 134532024 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2227/statm: 104197 364 59 146 0 103073 0
[pid=2210/tid=2217] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2217/stat : 2217 (python) S 2208 2210 1220 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 5 0 639013581 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2220] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2220/stat : 2220 (python) S 2208 2210 1220 0 -1 4202560 23 935 0 0 0 0 0 0 19 0 5 0 639013582 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2223] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2223/stat : 2223 (python) S 2208 2210 1220 0 -1 4202560 38 935 0 0 0 0 0 0 21 0 5 0 639013583 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2225] ppid=2208 vsize=320248 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2225/stat : 2225 (python) S 2208 2210 1220 0 -1 4202560 18 935 0 0 0 0 0 0 23 0 5 0 639013584 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 19.21
Current children cumulated vsize (KiB) 4366892

[startup+12.7013 s]
/proc/loadavg: 9.40 9.26 8.65 10/400 2227
/proc/meminfo: memFree=22660264/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=320248 CPUtime=0.69 cores=0,2,4,6
/proc/2210/stat : 2210 (python) S 2208 2210 1220 0 -1 4202496 12587 935 1 0 61 8 0 0 22 0 5 0 639013485 327933952 7252 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/2210/statm: 80062 7252 1875 364 0 15971 0
[pid=2216] ppid=2210 vsize=278704 CPUtime=0.02 cores=0,2,4,6
/proc/2216/stat : 2216 (python) S 2210 2210 1220 0 -1 4202560 895 0 0 0 1 1 0 0 18 0 1 0 639013581 285392896 5637 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636623 0 0 16781312 514 16933235531750277380 0 0 17 0 0 0 0
/proc/2216/statm: 69676 5637 377 364 0 5594 0
[pid=2218] ppid=2216 vsize=1017932 CPUtime=11.59 cores=0,2,4,6
/proc/2218/stat : 2218 (gnovelty+2) R 2216 2218 2218 0 -1 4202496 512 0 0 0 1159 0 0 0 25 0 1 0 639013582 1042362368 247 33554432000 134512640 135663704 4291278000 18446744073709551615 134525541 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2218/statm: 254483 247 113 282 0 254199 0
[pid=2219] ppid=2210 vsize=289356 CPUtime=0.02 cores=0,2,4,6

################
# More data... #
################

/proc/2385/statm: 0 0 0 0 0 0 0
[pid=2387] ppid=2210 vsize=340876 CPUtime=0.33 cores=0,2,4,6
/proc/2387/stat : 2387 (python) S 2210 2210 1220 0 -1 4202560 1108 0 0 0 19 14 0 0 19 0 2 0 639024816 349057024 5812 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2387/statm: 85219 5812 400 364 0 21119 0
[pid=2389] ppid=2387 vsize=1017932 CPUtime=102.23 cores=0,2,4,6
/proc/2389/stat : 2389 (gnovelty+2) T 2387 2389 2389 0 -1 4202496 509 0 0 0 10223 0 0 0 25 0 1 0 639024817 1042362368 247 33554432000 134512640 135663704 4290130176 18446744073709551615 134525271 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/2389/statm: 254483 247 113 282 0 254199 0
[pid=2387/tid=2410] ppid=2210 vsize=340876 CPUtime=0 cores=0,2,4,6
/proc/2387/task/2410/stat : 2410 (python) S 2210 2210 1220 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 639037249 349057024 5812 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 514 18446604445909461056 0 0 -1 2 0 0 0
[pid=2401] ppid=2210 vsize=351132 CPUtime=1.02 cores=0,2,4,6
/proc/2401/stat : 2401 (python) S 2210 2210 1220 0 -1 4202560 1045 0 0 0 57 45 0 0 15 0 1 0 639033235 359559168 5792 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 1721610913020084481 0 0 17 0 0 0 0
/proc/2401/statm: 87783 5792 377 364 0 23680 0
[pid=2403] ppid=2401 vsize=3084 CPUtime=279.99 cores=0,2,4,6
/proc/2403/stat : 2403 (march_hi) R 2401 2403 2403 0 -1 4202496 1451 0 0 0 27998 1 0 0 25 0 1 0 639033236 3158016 552 33554432000 4194304 4955518 140734259804384 18446744073709551615 4297337 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2403/statm: 771 552 106 186 0 584 0
[pid=2406] ppid=2210 vsize=361028 CPUtime=0.99 cores=0,2,4,6
/proc/2406/stat : 2406 (python) S 2210 2210 1220 0 -1 4202560 1044 0 0 0 51 48 0 0 15 0 1 0 639034239 369692672 5706 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 5969741212700082433 0 0 17 2 0 0 0
/proc/2406/statm: 90257 5706 377 364 0 26151 0
[pid=2408] ppid=2406 vsize=2856 CPUtime=207.19 cores=0,2,4,6
/proc/2408/stat : 2408 (march_hi) R 2406 2408 2408 0 -1 4202496 1412 0 0 0 20719 0 0 0 25 0 1 0 639034239 2924544 515 33554432000 4194304 4955518 140733645316992 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2408/statm: 714 515 106 186 0 527 0
[pid=2411] ppid=2210 vsize=371720 CPUtime=0.37 cores=0,2,4,6
/proc/2411/stat : 2411 (python) S 2210 2210 1220 0 -1 4202560 1122 0 0 0 22 15 0 0 19 0 2 0 639037250 380641280 5843 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2411/statm: 92930 5843 400 364 0 28821 0
[pid=2413] ppid=2411 vsize=246936 CPUtime=98.68 cores=0,2,4,6
/proc/2413/stat : 2413 (FH) T 2411 2413 2413 0 -1 4202496 593 0 0 0 9868 0 0 0 25 0 1 0 639037250 252862464 326 33554432000 134512640 134936988 4294928864 18446744073709551615 134553304 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/2413/statm: 61734 326 41 104 0 61238 0
[pid=2411/tid=2417] ppid=2210 vsize=371720 CPUtime=0 cores=0,2,4,6
/proc/2411/task/2417/stat : 2417 (python) S 2210 2210 1220 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 639050887 380641280 5843 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 514 18446604453905600640 0 0 -1 2 0 0 0
[pid=2418] ppid=2210 vsize=382200 CPUtime=0.47 cores=0,2,4,6
/proc/2418/stat : 2418 (python) S 2210 2210 1220 0 -1 4202560 999 0 0 0 24 23 0 0 15 0 1 0 639050888 391372800 5873 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 14019815595462066434 0 0 17 6 0 0 0
/proc/2418/statm: 95550 5873 371 364 0 31438 0
[pid=2420] ppid=2418 vsize=2624 CPUtime=96.36 cores=0,2,4,6
/proc/2420/stat : 2420 (march_hi) R 2418 2420 2420 0 -1 4202496 1288 0 0 0 9636 0 0 0 25 0 1 0 639050888 2686976 432 33554432000 4194304 4955518 140735133422016 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2420/statm: 656 432 106 186 0 469 0
[pid=2210/tid=2217] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2217/stat : 2217 (python) S 2208 2210 1220 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 12 0 639013581 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2220] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2220/stat : 2220 (python) S 2208 2210 1220 0 -1 4202560 23 935 0 0 0 0 0 0 19 0 12 0 639013582 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2223] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2223/stat : 2223 (python) S 2208 2210 1220 0 -1 4202560 38 935 0 0 0 0 0 0 21 0 12 0 639013583 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2225] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2225/stat : 2225 (python) S 2208 2210 1220 0 -1 4202560 18 935 0 0 0 0 0 0 23 0 12 0 639013584 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2381] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2381/stat : 2381 (python) S 2208 2210 1220 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 12 0 639023609 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2383] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2383/stat : 2383 (python) S 2208 2210 1220 0 -1 4202560 19 935 0 0 0 0 0 0 22 0 12 0 639023611 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2388] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2388/stat : 2388 (python) S 2208 2210 1220 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 12 0 639024817 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2402] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2402/stat : 2402 (python) S 2208 2210 1220 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 12 0 639033235 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2407] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2407/stat : 2407 (python) S 2208 2210 1220 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 12 0 639034239 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2412] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2412/stat : 2412 (python) S 2208 2210 1220 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 12 0 639037250 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2419] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2419/stat : 2419 (python) S 2208 2210 1220 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 12 0 639050888 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1659.61
Current children cumulated vsize (KiB) 8596848

[startup+529.502 s]
/proc/loadavg: 9.15 9.16 8.84 11/423 2429
/proc/meminfo: memFree=22466432/32951124 swapFree=67057896/67111528
[pid=2210] ppid=2208 vsize=392444 CPUtime=0.77 cores=0,2,4,6
/proc/2210/stat : 2210 (python) S 2208 2210 1220 0 -1 4202496 18517 935 1 0 67 10 0 0 19 0 12 0 639013485 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2210/statm: 98111 7396 1890 364 0 33999 0
[pid=2216] ppid=2210 vsize=288948 CPUtime=0.27 cores=0,2,4,6
/proc/2216/stat : 2216 (python) S 2210 2210 1220 0 -1 4202560 1164 0 0 0 15 12 0 0 19 0 2 0 639013581 295882752 5681 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/2216/statm: 72237 5681 416 364 0 8155 0
[pid=2218] ppid=2216 vsize=1017932 CPUtime=99.05 cores=0,2,4,6
/proc/2218/stat : 2218 (gnovelty+2) T 2216 2218 2218 0 -1 4202496 512 0 0 0 9905 0 0 0 25 0 1 0 639013582 1042362368 247 33554432000 134512640 135663704 4291278000 18446744073709551615 134524916 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/2218/statm: 254483 247 113 282 0 254199 0
[pid=2216/tid=2379] ppid=2210 vsize=288948 CPUtime=0 cores=0,2,4,6
/proc/2216/task/2379/stat : 2379 (python) S 2210 2210 1220 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 639023608 295882752 5681 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 514 18446604453956682944 0 0 -1 0 0 0 0
[pid=2219] ppid=2210 vsize=289356 CPUtime=0.25 cores=0,2,4,6
/proc/2219/stat : 2219 (python) S 2210 2210 1220 0 -1 4202560 1086 0 0 0 13 12 0 0 19 0 2 0 639013582 296300544 5749 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2219/statm: 72339 5749 400 364 0 8254 0
[pid=2221] ppid=2219 vsize=1017932 CPUtime=99.98 cores=0,2,4,6
/proc/2221/stat : 2221 (gnovelty+2) T 2219 2221 2221 0 -1 4202496 511 0 0 0 9997 1 0 0 25 0 1 0 639013582 1042362368 248 33554432000 134512640 135663704 4292555072 18446744073709551615 134546949 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/2221/statm: 254483 248 113 282 0 254199 0
[pid=2219/tid=2378] ppid=2210 vsize=289356 CPUtime=0 cores=0,2,4,6
/proc/2219/task/2378/stat : 2378 (python) S 2210 2210 1220 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 639023608 296300544 5749 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 514 18446604449606384512 0 0 -1 6 0 0 0
[pid=2222] ppid=2210 vsize=299140 CPUtime=0.3 cores=0,2,4,6
/proc/2222/stat : 2222 (python) S 2210 2210 1220 0 -1 4202560 1089 0 0 0 16 14 0 0 19 0 2 0 639013583 306319360 5650 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/2222/statm: 74785 5650 400 364 0 10697 0
[pid=2226] ppid=2222 vsize=416788 CPUtime=102.55 cores=0,2,4,6
/proc/2226/stat : 2226 (adaptg2wsat2009) T 2222 2226 2226 0 -1 4202496 624 0 0 0 10253 2 0 0 25 0 1 0 639013584 426790912 363 33554432000 134512640 135107411 4293256592 18446744073709551615 134532242 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/2226/statm: 104197 363 59 146 0 103073 0
[pid=2222/tid=2386] ppid=2210 vsize=299140 CPUtime=0 cores=0,2,4,6
/proc/2222/task/2386/stat : 2386 (python) S 2210 2210 1220 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 639024815 306319360 5650 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 514 18446604453943891264 0 0 -1 0 0 0 0
[pid=2224] ppid=2210 vsize=310004 CPUtime=0.52 cores=0,2,4,6
/proc/2224/stat : 2224 (python) S 2210 2210 1220 0 -1 4202560 1116 0 0 0 27 25 0 0 19 0 2 0 639013584 317444096 5774 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/2224/statm: 77501 5774 400 364 0 13410 0
[pid=2227] ppid=2224 vsize=416788 CPUtime=97.98 cores=0,2,4,6
/proc/2227/stat : 2227 (adaptg2wsat2009) T 2224 2227 2227 0 -1 4202496 625 0 0 0 9797 1 0 0 25 0 1 0 639013585 426790912 364 33554432000 134512640 135107411 4293302064 18446744073709551615 134538035 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/2227/statm: 104197 364 59 146 0 103073 0
[pid=2224/tid=2400] ppid=2210 vsize=310004 CPUtime=0 cores=0,2,4,6
/proc/2224/task/2400/stat : 2400 (python) S 2210 2210 1220 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 639033234 317444096 5774 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 514 18446604442335199424 0 0 -1 0 0 0 0
[pid=2380] ppid=2210 vsize=320260 CPUtime=0.28 cores=0,2,4,6
/proc/2380/stat : 2380 (python) S 2210 2210 1220 0 -1 4202560 1096 0 0 0 16 12 0 0 19 0 2 0 639023609 327946240 5778 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/2380/statm: 80065 5778 400 364 0 15971 0
[pid=2384] ppid=2380 vsize=416788 CPUtime=97.89 cores=0,2,4,6
/proc/2384/stat : 2384 (adaptg2wsat2009) T 2380 2384 2384 0 -1 4202496 626 0 0 0 9789 0 0 0 25 0 1 0 639023611 426790912 363 33554432000 134512640 135107411 4287525504 18446744073709551615 134531830 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/2384/statm: 104197 363 59 146 0 103073 0
[pid=2380/tid=2405] ppid=2210 vsize=320260 CPUtime=0 cores=0,2,4,6
/proc/2380/task/2405/stat : 2405 (python) S 2210 2210 1220 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 639034238 327946240 5778 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 514 18446604448187902656 0 0 -1 4 0 0 0
[pid=2382] ppid=2210 vsize=330080 CPUtime=3.48 cores=0,2,4,6
/proc/2382/stat : 2382 (python) S 2210 2210 1220 0 -1 4202560 1014 0 0 0 254 94 0 0 18 0 1 0 639023610 338001920 5664 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273446719 0 0 16781312 514 0 0 0 17 4 0 0 0
/proc/2382/statm: 82520 5664 372 364 0 18423 0
[pid=2385] ppid=2382 vsize=0 CPUtime=369.04 cores=0,2,4,6
/proc/2385/stat : 2385 (march_hi) R 2382 2385 2385 0 -1 4202500 1502 0 0 0 36904 0 0 0 25 0 1 0 639023611 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/2385/statm: 0 0 0 0 0 0 0
[pid=2387] ppid=2210 vsize=340876 CPUtime=0.33 cores=0,2,4,6
/proc/2387/stat : 2387 (python) S 2210 2210 1220 0 -1 4202560 1108 0 0 0 19 14 0 0 19 0 2 0 639024816 349057024 5812 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2387/statm: 85219 5812 400 364 0 21119 0
[pid=2389] ppid=2387 vsize=1017932 CPUtime=102.23 cores=0,2,4,6
/proc/2389/stat : 2389 (gnovelty+2) T 2387 2389 2389 0 -1 4202496 509 0 0 0 10223 0 0 0 25 0 1 0 639024817 1042362368 247 33554432000 134512640 135663704 4290130176 18446744073709551615 134525271 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/2389/statm: 254483 247 113 282 0 254199 0
[pid=2387/tid=2410] ppid=2210 vsize=340876 CPUtime=0 cores=0,2,4,6
/proc/2387/task/2410/stat : 2410 (python) S 2210 2210 1220 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 639037249 349057024 5812 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 514 18446604445909461056 0 0 -1 2 0 0 0
[pid=2401] ppid=2210 vsize=351132 CPUtime=1.02 cores=0,2,4,6
/proc/2401/stat : 2401 (python) S 2210 2210 1220 0 -1 4202560 1045 0 0 0 57 45 0 0 15 0 1 0 639033235 359559168 5792 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 1721610913020084481 0 0 17 0 0 0 0
/proc/2401/statm: 87783 5792 377 364 0 23680 0
[pid=2403] ppid=2401 vsize=3084 CPUtime=280.38 cores=0,2,4,6
/proc/2403/stat : 2403 (march_hi) R 2401 2403 2403 0 -1 4202496 1451 0 0 0 28037 1 0 0 25 0 1 0 639033236 3158016 552 33554432000 4194304 4955518 140734259804384 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2403/statm: 771 552 106 186 0 584 0
[pid=2406] ppid=2210 vsize=361028 CPUtime=0.99 cores=0,2,4,6
/proc/2406/stat : 2406 (python) S 2210 2210 1220 0 -1 4202560 1044 0 0 0 51 48 0 0 15 0 1 0 639034239 369692672 5706 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 5969741212700082433 0 0 17 2 0 0 0
/proc/2406/statm: 90257 5706 377 364 0 26151 0
[pid=2408] ppid=2406 vsize=2856 CPUtime=207.58 cores=0,2,4,6
/proc/2408/stat : 2408 (march_hi) R 2406 2408 2408 0 -1 4202496 1412 0 0 0 20758 0 0 0 25 0 1 0 639034239 2924544 515 33554432000 4194304 4955518 140733645316992 18446744073709551615 4285625 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2408/statm: 714 515 106 186 0 527 0
[pid=2411] ppid=2210 vsize=371720 CPUtime=0.37 cores=0,2,4,6
/proc/2411/stat : 2411 (python) S 2210 2210 1220 0 -1 4202560 1122 0 0 0 22 15 0 0 19 0 2 0 639037250 380641280 5843 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2411/statm: 92930 5843 400 364 0 28821 0
[pid=2413] ppid=2411 vsize=246936 CPUtime=98.68 cores=0,2,4,6
/proc/2413/stat : 2413 (FH) T 2411 2413 2413 0 -1 4202496 593 0 0 0 9868 0 0 0 25 0 1 0 639037250 252862464 326 33554432000 134512640 134936988 4294928864 18446744073709551615 134553304 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/2413/statm: 61734 326 41 104 0 61238 0
[pid=2411/tid=2417] ppid=2210 vsize=371720 CPUtime=0 cores=0,2,4,6
/proc/2411/task/2417/stat : 2417 (python) S 2210 2210 1220 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 639050887 380641280 5843 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 514 18446604453905600640 0 0 -1 2 0 0 0
[pid=2418] ppid=2210 vsize=382200 CPUtime=0.47 cores=0,2,4,6
/proc/2418/stat : 2418 (python) S 2210 2210 1220 0 -1 4202560 999 0 0 0 24 23 0 0 15 0 1 0 639050888 391372800 5873 33554432000 4194304 5683644 140736465734016 18446744073709551615 254261636678 0 0 16781312 514 14019815595462066434 0 0 17 6 0 0 0
/proc/2418/statm: 95550 5873 371 364 0 31438 0
[pid=2420] ppid=2418 vsize=2624 CPUtime=96.55 cores=0,2,4,6
/proc/2420/stat : 2420 (march_hi) R 2418 2420 2420 0 -1 4202496 1288 0 0 0 9655 0 0 0 25 0 1 0 639050888 2686976 432 33554432000 4194304 4955518 140735133422016 18446744073709551615 4237772 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2420/statm: 656 432 106 186 0 469 0
[pid=2210/tid=2217] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2217/stat : 2217 (python) S 2208 2210 1220 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 12 0 639013581 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2220] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2220/stat : 2220 (python) S 2208 2210 1220 0 -1 4202560 23 935 0 0 0 0 0 0 19 0 12 0 639013582 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2223] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2223/stat : 2223 (python) S 2208 2210 1220 0 -1 4202560 38 935 0 0 0 0 0 0 21 0 12 0 639013583 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2225] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2225/stat : 2225 (python) S 2208 2210 1220 0 -1 4202560 18 935 0 0 0 0 0 0 23 0 12 0 639013584 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 0 0 0 0
[pid=2210/tid=2381] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2381/stat : 2381 (python) S 2208 2210 1220 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 12 0 639023609 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2383] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2383/stat : 2383 (python) S 2208 2210 1220 0 -1 4202560 19 935 0 0 0 0 0 0 22 0 12 0 639023611 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2388] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2388/stat : 2388 (python) S 2208 2210 1220 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 12 0 639024817 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2402] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2402/stat : 2402 (python) S 2208 2210 1220 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 12 0 639033235 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2407] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2407/stat : 2407 (python) S 2208 2210 1220 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 12 0 639034239 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2412] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2412/stat : 2412 (python) S 2208 2210 1220 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 12 0 639037250 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
[pid=2210/tid=2419] ppid=2208 vsize=392444 CPUtime=0 cores=0,2,4,6
/proc/2210/task/2419/stat : 2419 (python) S 2208 2210 1220 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 12 0 639050888 401862656 7396 33554432000 4194304 5683644 140736465734016 18446744073709551615 254273440177 0 0 16781312 2 18446604445909460160 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1660.96
Current children cumulated vsize (KiB) 8596848

Child status: 0
Real time (s): 529.549
CPU time (s): 1661.3
CPU user time (s): 1657.86
CPU system time (s): 3.43848
CPU usage (%): 313.72
Max. virtual memory (cumulated for all children) (KiB): 8600276

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1657.86
system time used= 3.43848
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 46000
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6900
involuntary context switches= 14191

runsolver used 2.85057 second user time and 6.62199 second system time

The end

Launcher Data 

Begin job on node140 at 2011-05-15 15:26:21
IDJOB=3378509
IDBENCH=82918
IDSOLVER=1859
FILE ID=node140/3378509-1305465981
RUNJOBID= node140-1305463229-1238
PBS_JOBID= 13324987
Free space on /tmp= 73436 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S1445862528-059.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378509-1305465981/watcher-3378509-1305465981 -o /tmp/evaluation-result-3378509-1305465981/solver-3378509-1305465981 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378509-1305465981.cnf -seed 2084053933 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9e4f1914facdb4a8b3ffdd1de343beff
RANDOM SEED=2084053933

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22706768 kB
Buffers:        320852 kB
Cached:        4423728 kB
SwapCached:       8088 kB
Active:        6733232 kB
Inactive:      3175700 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22706768 kB
SwapTotal:    67111528 kB
SwapFree:     67057896 kB
Dirty:           31904 kB
Writeback:           0 kB
AnonPages:     5161152 kB
Mapped:          34896 kB
Slab:           228932 kB
PageTables:      41112 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 86740344 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73404 MiB
End job on node140 at 2011-05-15 15:35:11