Trace number 3385768

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 3068.88 492.662

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S113771637-026.UNKNOWN.cnf
MD5SUM7f4758baa378252dd3709cff507a5405
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark368.443
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data 

0.34/0.65	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.65	c INFO: solving HOME/instance-3385768-1305573560.cnf
0.34/0.65	c INFO: computing task features
0.34/0.69	c INFO: computed variable-clause graph statistics
0.34/0.69	c INFO: computed clause balance statistics
0.51/0.88	c INFO: computed variable balance statistics
0.61/0.95	c INFO: computed small-clause counts
0.61/0.95	c INFO: computed Horn-clause counts
0.61/0.96	c INFO: computed variable graph statistics
0.61/0.96	c INFO: collected features for HOME/instance-3385768-1305573560.cnf in 0.31 s
0.61/0.99	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.55)
0.72/1.02	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.10)
0.72/1.05	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.05)
0.72/1.08	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.03)
1.04/1.11	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.03)
1.04/1.14	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.02)
1.04/1.18	c INFO: running FH@0 for 97 with 4999 remaining (b = 0.02)
1.04/1.21	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.01)
700.26/101.31	c INFO: running march_hi@0 for 2134 with 4899 remaining (b = 0.31)
701.03/101.35	c INFO: running march_hi@0 for 2134 with 4899 remaining (b = 0.29)
701.43/101.47	c INFO: running march_hi@0 for 388 with 4899 remaining (b = 0.11)
702.23/101.61	c INFO: running march_hi@0 for 388 with 4899 remaining (b = 0.09)
726.03/105.59	c INFO: running adaptg2wsat2009++@0 for 97 with 4895 remaining (b = 0.01)
772.70/113.38	c INFO: running adaptg2wsat2009++@0 for 97 with 4887 remaining (b = 0.01)
954.50/143.78	c INFO: running adaptg2wsat2009++@0 for 97 with 4856 remaining (b = 0.01)
1116.00/170.72	c INFO: running adaptg2wsat2009++@100 for 97 with 4829 remaining (b = 0.01)
1536.54/241.09	c INFO: running FH@0 for 97 with 4759 remaining (b = 0.01)
1750.54/276.86	c INFO: running march_hi@0 for 2134 with 4723 remaining (b = 0.25)
1806.16/286.14	c INFO: running march_hi@0 for 485 with 4714 remaining (b = 0.09)
2225.12/356.29	c INFO: running march_hi@0 for 388 with 4644 remaining (b = 0.06)
2705.67/436.68	c INFO: running march_hi@0 for 388 with 4564 remaining (b = 0.05)
3068.33/492.63	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385768-1305573560/watcher-3385768-1305573560 -o /tmp/evaluation-result-3385768-1305573560/solver-3385768-1305573560 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385768-1305573560.cnf -seed 1513261905 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.99 10.63 10.61 3/375 16982
/proc/meminfo: memFree=19094404/32951124 swapFree=63485424/67111528
[pid=16982] ppid=16980 vsize=15764 CPUtime=0 cores=0-7
/proc/16982/stat : 16982 (python) S 16980 16982 15751 0 -1 4202496 845 0 0 0 0 0 0 0 22 0 1 0 649771942 16142336 728 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816234496 0 2147483391 16781312 2 18446744071699207358 0 0 17 5 0 0 0
/proc/16982/statm: 3941 728 334 364 0 428 0

[startup+0.109954 s]
/proc/loadavg: 9.99 10.63 10.61 3/375 16982
/proc/meminfo: memFree=19094404/32951124 swapFree=63485424/67111528
[pid=16982] ppid=16980 vsize=99344 CPUtime=0.06 cores=0-7
/proc/16982/stat : 16982 (python) R 16980 16982 15751 0 -1 4202496 2856 0 0 0 5 1 0 0 17 0 1 0 649771942 101728256 2557 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816234496 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/16982/statm: 24836 2557 818 364 0 1687 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 99344

[startup+0.200951 s]
/proc/loadavg: 9.99 10.63 10.61 3/375 16982
/proc/meminfo: memFree=19094404/32951124 swapFree=63485424/67111528
[pid=16982] ppid=16980 vsize=124236 CPUtime=0.11 cores=0-7
/proc/16982/stat : 16982 (python) S 16980 16982 15751 0 -1 4202496 4313 0 1 0 8 3 0 0 17 0 1 0 649771942 127217664 3880 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816236288 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/16982/statm: 31059 3880 997 364 0 2870 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 124236

[startup+0.300916 s]
/proc/loadavg: 9.99 10.63 10.61 3/375 16982
/proc/meminfo: memFree=19094404/32951124 swapFree=63485424/67111528
[pid=16982] ppid=16980 vsize=135748 CPUtime=0.17 cores=0-7
/proc/16982/stat : 16982 (python) S 16980 16982 15751 0 -1 4202496 5964 936 1 0 13 4 0 0 17 0 1 0 649771942 139005952 4151 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816232453 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 0
/proc/16982/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135748

[startup+0.704875 s]
/proc/loadavg: 9.99 10.63 10.61 3/375 16982
/proc/meminfo: memFree=19094404/32951124 swapFree=63485424/67111528
[pid=16982] ppid=16980 vsize=279552 CPUtime=0.42 cores=0-7
/proc/16982/stat : 16982 (python) R 16980 16982 15751 0 -1 4202496 9751 936 1 0 32 10 0 0 15 0 1 0 649771942 286261248 7273 33554432000 4194304 5683644 140733802829120 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/16982/statm: 69888 7273 1826 364 0 5812 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 279552

[startup+1.50065 s]
/proc/loadavg: 9.99 10.63 10.61 8/388 16999
/proc/meminfo: memFree=19053504/32951124 swapFree=63485424/67111528
[pid=16982] ppid=16980 vsize=361336 CPUtime=0.92 cores=0-7
/proc/16982/stat : 16982 (python) S 16980 16982 15751 0 -1 4202496 16217 936 1 0 80 12 0 0 25 0 9 0 649771942 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/16982/statm: 90334 7301 1891 364 0 26231 0
[pid=16988] ppid=16982 vsize=278700 CPUtime=0 cores=0-7
/proc/16988/stat : 16988 (python) S 16982 16982 15751 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 649772041 285388800 5614 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256527 0 0 16781312 514 16633090302139170815 0 0 17 0 0 0 0
/proc/16988/statm: 69675 5614 354 364 0 5593 0
[pid=16990] ppid=16988 vsize=1017932 CPUtime=0.49 cores=0-7
/proc/16990/stat : 16990 (gnovelty+2) R 16988 16990 16990 0 -1 4202496 514 0 0 0 49 0 0 0 20 0 1 0 649772042 1042362368 248 33554432000 134512640 135663704 4288031024 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/16990/statm: 254483 248 113 282 0 254199 0
[pid=16991] ppid=16982 vsize=289352 CPUtime=0 cores=0-7
/proc/16991/stat : 16991 (python) S 16982 16982 15751 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 649772044 296296448 5696 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 15129915245335674879 0 0 17 5 0 0 0
/proc/16991/statm: 72338 5696 348 364 0 8253 0
[pid=16993] ppid=16991 vsize=1017932 CPUtime=0.46 cores=0-7
/proc/16993/stat : 16993 (gnovelty+2) R 16991 16993 16993 0 -1 4202496 509 0 0 0 46 0 0 0 20 0 1 0 649772044 1042362368 248 33554432000 134512640 135663704 4286781296 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/16993/statm: 254483 248 113 282 0 254199 0
[pid=16994] ppid=16982 vsize=299296 CPUtime=0 cores=0-7
/proc/16994/stat : 16994 (python) S 16982 16982 15751 0 -1 4202560 718 0 0 0 0 0 0 0 20 0 1 0 649772047 306479104 5606 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 2298217075736313855 0 0 17 0 0 0 0
/proc/16994/statm: 74824 5606 344 364 0 10736 0
[pid=16996] ppid=16994 vsize=416652 CPUtime=0.43 cores=0-7
/proc/16996/stat : 16996 (adaptg2wsat2009) R 16994 16996 16996 0 -1 4202496 572 0 0 0 43 0 0 0 23 0 1 0 649772047 426651648 302 33554432000 134512640 135107411 4293561776 18446744073709551615 134523261 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16996/statm: 104163 302 49 146 0 103039 0
[pid=16997] ppid=16982 vsize=310000 CPUtime=0 cores=0-7
/proc/16997/stat : 16997 (python) S 16982 16982 15751 0 -1 4202560 734 0 0 0 0 0 0 0 19 0 1 0 649772050 317440000 5717 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 2779671777062682623 0 0 17 5 0 0 0
/proc/16997/statm: 77500 5717 344 364 0 13409 0
[pid=16999] ppid=16997 vsize=416652 CPUtime=0.39 cores=0-7
/proc/16999/stat : 16999 (adaptg2wsat2009) R 16997 16999 16999 0 -1 4202496 571 0 0 0 39 0 0 0 21 0 1 0 649772051 426651648 304 33554432000 134512640 135107411 4289315680 18446744073709551615 134523331 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/16999/statm: 104163 304 49 146 0 103039 0
[pid=16982/tid=16989] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/16989/stat : 16989 (python) S 16980 16982 15751 0 -1 4202560 26 936 0 0 0 0 0 0 17 0 9 0 649772041 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 1 0 0 0
[pid=16982/tid=16992] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/16992/stat : 16992 (python) S 16980 16982 15751 0 -1 4202560 21 936 0 0 0 0 0 0 19 0 9 0 649772044 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=16995] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/16995/stat : 16995 (python) S 16980 16982 15751 0 -1 4202560 22 936 0 0 0 0 0 0 20 0 9 0 649772047 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 5 0 0 0
[pid=16982/tid=16998] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/16998/stat : 16998 (python) S 16980 16982 15751 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 9 0 649772050 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.69
Current children cumulated vsize (KiB) 4407852

[startup+3.10135 s]
/proc/loadavg: 9.99 10.63 10.61 11/400 17011
/proc/meminfo: memFree=19032080/32951124 swapFree=63485424/67111528
[pid=16982] ppid=16980 vsize=361336 CPUtime=0.92 cores=0-7
/proc/16982/stat : 16982 (python) S 16980 16982 15751 0 -1 4202496 16217 936 1 0 80 12 0 0 25 0 9 0 649771942 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/16982/statm: 90334 7301 1891 364 0 26231 0
[pid=16988] ppid=16982 vsize=278700 CPUtime=0 cores=0-7
/proc/16988/stat : 16988 (python) S 16982 16982 15751 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 649772041 285388800 5614 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256527 0 0 16781312 514 16633090302139138309 0 0 17 0 0 0 0
/proc/16988/statm: 69675 5614 354 364 0 5593 0
[pid=16990] ppid=16988 vsize=1017932 CPUtime=2.09 cores=0-7
/proc/16990/stat : 16990 (gnovelty+2) R 16988 16990 16990 0 -1 4202496 514 0 0 0 209 0 0 0 25 0 1 0 649772042 1042362368 248 33554432000 134512640 135663704 4288031024 18446744073709551615 134545529 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/16990/statm: 254483 248 113 282 0 254199 0
[pid=16991] ppid=16982 vsize=289352 CPUtime=0 cores=0-7
/proc/16991/stat : 16991 (python) S 16982 16982 15751 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 649772044 296296448 5696 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 15129915245335642373 0 0 17 5 0 0 0
/proc/16991/statm: 72338 5696 348 364 0 8253 0
[pid=16993] ppid=16991 vsize=1017932 CPUtime=2.06 cores=0-7
/proc/16993/stat : 16993 (gnovelty+2) R 16991 16993 16993 0 -1 4202496 509 0 0 0 206 0 0 0 25 0 1 0 649772044 1042362368 248 33554432000 134512640 135663704 4286781296 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/16993/statm: 254483 248 113 282 0 254199 0
[pid=16994] ppid=16982 vsize=299296 CPUtime=0 cores=0-7
/proc/16994/stat : 16994 (python) S 16982 16982 15751 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 649772047 306479104 5610 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 2298217075736281351 0 0 17 0 0 0 0
/proc/16994/statm: 74824 5610 348 364 0 10736 0
[pid=16996] ppid=16994 vsize=416788 CPUtime=2.03 cores=0-7
/proc/16996/stat : 16996 (adaptg2wsat2009) R 16994 16996 16996 0 -1 4202496 632 0 0 0 203 0 0 0 25 0 1 0 649772047 426790912 362 33554432000 134512640 135107411 4293561776 18446744073709551615 134531779 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/16996/statm: 104197 362 59 146 0 103073 0
[pid=16997] ppid=16982 vsize=310000 CPUtime=0 cores=0-7
/proc/16997/stat : 16997 (python) S 16982 16982 15751 0 -1 4202560 752 0 0 0 0 0 0 0 18 0 1 0 649772050 317440000 5721 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 2779671777062650116 0 0 17 5 0 0 0
/proc/16997/statm: 77500 5721 348 364 0 13409 0
[pid=16999] ppid=16997 vsize=416788 CPUtime=1.99 cores=0-7
/proc/16999/stat : 16999 (adaptg2wsat2009) R 16997 16999 16999 0 -1 4202496 632 0 0 0 199 0 0 0 25 0 1 0 649772051 426790912 365 33554432000 134512640 135107411 4289315680 18446744073709551615 134531797 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/16999/statm: 104197 365 59 146 0 103073 0
[pid=17000] ppid=16982 vsize=320256 CPUtime=0 cores=0-7
/proc/17000/stat : 17000 (python) S 16982 16982 15751 0 -1 4202560 755 0 0 0 0 0 0 0 18 0 1 0 649772053 327942144 5742 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 7263145393842552831 0 0 17 1 0 0 0
/proc/17000/statm: 80064 5742 348 364 0 15970 0
[pid=17002] ppid=17000 vsize=416788 CPUtime=1.97 cores=0-7
/proc/17002/stat : 17002 (adaptg2wsat2009) R 17000 17002 17002 0 -1 4202496 631 0 0 0 197 0 0 0 25 0 1 0 649772054 426790912 364 33554432000 134512640 135107411 4289312480 18446744073709551615 134531248 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17002/statm: 104197 364 59 146 0 103073 0
[pid=17003] ppid=16982 vsize=330512 CPUtime=0 cores=0-7
/proc/17003/stat : 17003 (python) S 16982 16982 15751 0 -1 4202560 761 0 0 0 0 0 0 0 18 0 1 0 649772056 338444288 5746 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 16633082605557743879 0 0 17 7 0 0 0
/proc/17003/statm: 82628 5746 348 364 0 18531 0
[pid=17007] ppid=17003 vsize=1017932 CPUtime=0.98 cores=0-7
/proc/17007/stat : 17007 (gnovelty+2) R 17003 17007 17007 0 -1 4202496 513 0 0 0 98 0 0 0 25 0 1 0 649772060 1042362368 247 33554432000 134512640 135663704 4292934976 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17007/statm: 254483 247 113 282 0 254199 0
[pid=17005] ppid=16982 vsize=340228 CPUtime=0 cores=0-7
/proc/17005/stat : 17005 (python) S 16982 16982 15751 0 -1 4202560 762 0 0 0 0 0 0 0 18 0 1 0 649772060 348393472 5630 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 5872452025827983359 0 0 17 0 0 0 0
/proc/17005/statm: 85057 5630 348 364 0 20957 0
[pid=17011] ppid=17005 vsize=245448 CPUtime=0.88 cores=0-7
/proc/17011/stat : 17011 (FH) R 17005 17011 17011 0 -1 4202496 521 0 0 0 88 0 0 0 25 0 1 0 649772066 251338752 256 33554432000 134512640 134936988 4293015840 18446744073709551615 134523665 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/17011/statm: 61362 256 37 104 0 60866 0
[pid=17008] ppid=16982 vsize=351092 CPUtime=0 cores=0-7
/proc/17008/stat : 17008 (python) S 16982 16982 15751 0 -1 4202560 808 0 0 0 0 0 0 0 18 0 1 0 649772063 359518208 5760 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 14316657071804645375 0 0 17 7 0 0 0
/proc/17008/statm: 87773 5760 354 364 0 23670 0
[pid=17010] ppid=17008 vsize=416788 CPUtime=1.86 cores=0-7
/proc/17010/stat : 17010 (adaptg2wsat2009) R 17008 17010 17010 0 -1 4202496 640 0 0 0 186 0 0 0 25 0 1 0 649772063 426790912 363 33554432000 134512640 135107411 4287625952 18446744073709551615 134532371 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/17010/statm: 104197 363 59 146 0 103073 0
[pid=16982/tid=16989] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/16989/stat : 16989 (python) S 16980 16982 15751 0 -1 4202560 26 936 0 0 0 0 0 0 17 0 9 0 649772041 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 1 0 0 0
[pid=16982/tid=16992] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/16992/stat : 16992 (python) S 16980 16982 15751 0 -1 4202560 21 936 0 0 0 0 0 0 19 0 9 0 649772044 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=16995] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/16995/stat : 16995 (python) S 16980 16982 15751 0 -1 4202560 22 936 0 0 0 0 0 0 20 0 9 0 649772047 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 5 0 0 0
[pid=16982/tid=16998] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/16998/stat : 16998 (python) S 16980 16982 15751 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 9 0 649772050 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 5 0 0 0
[pid=16982/tid=17001] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/17001/stat : 17001 (python) S 16980 16982 15751 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 9 0 649772053 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 1 0 0 0
[pid=16982/tid=17004] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/17004/stat : 17004 (python) S 16980 16982 15751 0 -1 4202560 40 936 0 0 0 0 0 0 22 0 9 0 649772057 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17006] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/17006/stat : 17006 (python) S 16980 16982 15751 0 -1 4202560 20 936 0 0 0 0 0 0 23 0 9 0 649772060 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17009] ppid=16980 vsize=361336 CPUtime=0 cores=0-7
/proc/16982/task/17009/stat : 17009 (python) S 16980 16982 15751 0 -1 4202560 31 936 0 0 0 0 0 0 25 0 9 0 649772063 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 14.78
Current children cumulated vsize (KiB) 7847168

[startup+6.30176 s]
/proc/loadavg: 9.99 10.62 10.60 11/400 17011
/proc/meminfo: memFree=19029600/32951124 swapFree=63485424/67111528
[pid=16982] ppid=16980 vsize=361336 CPUtime=0.92 cores=0-7
/proc/16982/stat : 16982 (python) S 16980 16982 15751 0 -1 4202496 16217 936 1 0 80 12 0 0 25 0 9 0 649771942 370008064 7301 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/16982/statm: 90334 7301 1891 364 0 26231 0
[pid=16988] ppid=16982 vsize=278700 CPUtime=0 cores=0-7
/proc/16988/stat : 16988 (python) S 16982 16982 15751 0 -1 4202560 893 0 0 0 0 0 0 0 18 0 1 0 649772041 285388800 5637 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256527 0 0 16781312 514 16633090302139138309 0 0 17 0 0 0 0
/proc/16988/statm: 69675 5637 377 364 0 5593 0
[pid=16990] ppid=16988 vsize=1017932 CPUtime=5.29 cores=0-7
/proc/16990/stat : 16990 (gnovelty+2) R 16988 16990 16990 0 -1 4202496 514 0 0 0 529 0 0 0 25 0 1 0 649772042 1042362368 248 33554432000 134512640 135663704 4288031024 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/16990/statm: 254483 248 113 282 0 254199 0
[pid=16991] ppid=16982 vsize=289352 CPUtime=0.01 cores=0-7
/proc/16991/stat : 16991 (python) S 16982 16982 15751 0 -1 4202560 902 0 0 0 0 1 0 0 18 0 1 0 649772044 296296448 5718 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 15129915245335642373 0 0 17 5 0 0 0
/proc/16991/statm: 72338 5718 370 364 0 8253 0
[pid=16993] ppid=16991 vsize=1017932 CPUtime=5.23 cores=0-7
/proc/16993/stat : 16993 (gnovelty+2) R 16991 16993 16993 0 -1 4202496 509 0 0 0 523 0 0 0 25 0 1 0 649772044 1042362368 248 33554432000 134512640 135663704 4286781296 18446744073709551615 134525260 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/16993/statm: 254483 248 113 282 0 254199 0
[pid=16994] ppid=16982 vsize=299296 CPUtime=0.01 cores=0-7
/proc/16994/stat : 16994 (python) S 16982 16982 15751 0 -1 4202560 889 0 0 0 0 1 0 0 18 0 1 0 649772047 306479104 5633 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 2298217075736281351 0 0 17 0 0 0 0
/proc/16994/statm: 74824 5633 371 364 0 10736 0
[pid=16996] ppid=16994 vsize=416788 CPUtime=5.22 cores=0-7

################
# More data... #
################

/proc/16982/task/17047/stat : 17047 (python) S 16980 16982 15751 0 -1 4202560 35 936 0 0 0 0 0 0 19 0 18 0 649800556 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 2 0 0 0
[pid=16982/tid=17054] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17054/stat : 17054 (python) S 16980 16982 15751 0 -1 4202560 33 936 0 0 0 0 0 0 19 0 18 0 649807571 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17061] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17061/stat : 17061 (python) S 16980 16982 15751 0 -1 4202560 26 936 0 0 0 0 0 0 19 0 18 0 649815610 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3067.04
Current children cumulated vsize (KiB) 12696832

[startup+492.602 s]
/proc/loadavg: 10.30 10.35 10.44 12/436 17063
/proc/meminfo: memFree=18914956/32951124 swapFree=63485424/67111528
[pid=16982] ppid=16980 vsize=519316 CPUtime=1.44 cores=0-7
/proc/16982/stat : 16982 (python) S 16980 16982 15751 0 -1 4202496 24408 936 1 0 129 15 0 0 19 0 18 0 649771942 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/16982/statm: 129829 7581 1910 364 0 65699 0
[pid=16988] ppid=16982 vsize=288944 CPUtime=0.28 cores=0-7
/proc/16988/stat : 16988 (python) S 16982 16982 15751 0 -1 4202560 1083 0 0 0 17 11 0 0 19 0 2 0 649772041 295878656 5675 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/16988/statm: 72236 5675 410 364 0 8154 0
[pid=16990] ppid=16988 vsize=1017932 CPUtime=100.28 cores=0-7
/proc/16990/stat : 16990 (gnovelty+2) T 16988 16990 16990 0 -1 4202496 514 0 0 0 10028 0 0 0 25 0 1 0 649772042 1042362368 248 33554432000 134512640 135663704 4288031024 18446744073709551615 135007701 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/16990/statm: 254483 248 113 282 0 254199 0
[pid=16988/tid=17015] ppid=16982 vsize=288944 CPUtime=0 cores=0-7
/proc/16988/task/17015/stat : 17015 (python) S 16982 16982 15751 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 649782070 295878656 5675 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 514 18446604461080353664 0 0 -1 0 0 0 0
[pid=16991] ppid=16982 vsize=354888 CPUtime=0.32 cores=0-7
/proc/16991/stat : 16991 (python) S 16982 16982 15751 0 -1 4202560 1091 0 0 0 15 17 0 0 19 0 2 0 649772044 363405312 5750 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/16991/statm: 88722 5750 400 364 0 24637 0
[pid=16993] ppid=16991 vsize=1017932 CPUtime=100.54 cores=0-7
/proc/16993/stat : 16993 (gnovelty+2) T 16991 16993 16993 0 -1 4202496 509 0 0 0 10054 0 0 0 25 0 1 0 649772044 1042362368 248 33554432000 134512640 135663704 4286781296 18446744073709551615 134545619 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/16993/statm: 254483 248 113 282 0 254199 0
[pid=16991/tid=17032] ppid=16982 vsize=354888 CPUtime=0 cores=0-7
/proc/16991/task/17032/stat : 17032 (python) S 16982 16982 15751 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 649783276 363405312 5750 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 514 18446604465025335744 0 0 -1 0 0 0 0
[pid=16994] ppid=16982 vsize=299296 CPUtime=0.81 cores=0-7
/proc/16994/stat : 16994 (python) S 16982 16982 15751 0 -1 4202560 1142 0 0 0 44 37 0 0 18 0 2 0 649772047 306479104 5663 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/16994/statm: 74824 5663 400 364 0 10736 0
[pid=16996] ppid=16994 vsize=416788 CPUtime=196.16 cores=0-7
/proc/16996/stat : 16996 (adaptg2wsat2009) T 16994 16996 16996 0 -1 4202496 632 0 0 0 19615 1 0 0 25 0 1 0 649772047 426790912 362 33554432000 134512640 135107411 4293561776 18446744073709551615 134532128 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/16996/statm: 104197 362 59 146 0 103073 0
[pid=16994/tid=17019] ppid=16982 vsize=299296 CPUtime=0 cores=0-7
/proc/16994/task/17019/stat : 17019 (python) S 16982 16982 15751 0 -1 4202560 50 0 0 0 0 0 0 0 18 0 2 0 649782074 306479104 5663 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 514 18446604466332690496 0 0 -1 0 0 0 0
[pid=16997] ppid=16982 vsize=375536 CPUtime=0.76 cores=0-7
/proc/16997/stat : 16997 (python) S 16982 16982 15751 0 -1 4202560 1137 0 0 0 41 35 0 0 18 0 2 0 649772050 384548864 5782 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/16997/statm: 93884 5782 400 364 0 29793 0
[pid=16999] ppid=16997 vsize=416788 CPUtime=199.72 cores=0-7
/proc/16999/stat : 16999 (adaptg2wsat2009) T 16997 16999 16999 0 -1 4202496 632 0 0 0 19971 1 0 0 25 0 1 0 649772051 426790912 365 33554432000 134512640 135107411 4289315680 18446744073709551615 134531942 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/16999/statm: 104197 365 59 146 0 103073 0
[pid=16997/tid=17021] ppid=16982 vsize=375536 CPUtime=0 cores=0-7
/proc/16997/task/17021/stat : 17021 (python) S 16982 16982 15751 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 649782078 384548864 5782 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 514 18446604466444787904 0 0 -1 2 0 0 0
[pid=17000] ppid=16982 vsize=320256 CPUtime=0.56 cores=0-7
/proc/17000/stat : 17000 (python) S 16982 16982 15751 0 -1 4202560 1157 0 0 0 31 25 0 0 18 0 2 0 649772053 327942144 5795 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/17000/statm: 80064 5795 400 364 0 15970 0
[pid=17002] ppid=17000 vsize=416788 CPUtime=196.06 cores=0-7
/proc/17002/stat : 17002 (adaptg2wsat2009) T 17000 17002 17002 0 -1 4202496 631 0 0 0 19603 3 0 0 25 0 1 0 649772054 426790912 364 33554432000 134512640 135107411 4289312480 18446744073709551615 134532277 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/17002/statm: 104197 364 59 146 0 103073 0
[pid=17000/tid=17024] ppid=16982 vsize=320256 CPUtime=0 cores=0-7
/proc/17000/task/17024/stat : 17024 (python) S 16982 16982 15751 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 649782080 327942144 5795 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 514 18446604463193710656 0 0 -1 0 0 0 0
[pid=17003] ppid=16982 vsize=396048 CPUtime=0.49 cores=0-7
/proc/17003/stat : 17003 (python) S 16982 16982 15751 0 -1 4202560 1155 0 0 0 25 24 0 0 19 0 2 0 649772056 405553152 5800 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17003/statm: 99012 5800 400 364 0 34915 0
[pid=17007] ppid=17003 vsize=1017932 CPUtime=99.39 cores=0-7
/proc/17007/stat : 17007 (gnovelty+2) T 17003 17007 17007 0 -1 4202496 513 0 0 0 9939 0 0 0 25 0 1 0 649772060 1042362368 247 33554432000 134512640 135663704 4292934976 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/17007/statm: 254483 247 113 282 0 254199 0
[pid=17003/tid=17036] ppid=16982 vsize=396048 CPUtime=0 cores=0-7
/proc/17003/task/17036/stat : 17036 (python) S 16982 16982 15751 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 649789010 405553152 5800 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 514 18446604461080351872 0 0 -1 0 0 0 0
[pid=17005] ppid=16982 vsize=405764 CPUtime=0.4 cores=0-7
/proc/17005/stat : 17005 (python) S 16982 16982 15751 0 -1 4202560 1135 0 0 0 22 18 0 0 19 0 2 0 649772060 415502336 5684 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/17005/statm: 101441 5684 400 364 0 37341 0
[pid=17011] ppid=17005 vsize=246936 CPUtime=99.86 cores=0-7
/proc/17011/stat : 17011 (FH) T 17005 17011 17011 0 -1 4202496 593 0 0 0 9986 0 0 0 25 0 1 0 649772066 252862464 326 33554432000 134512640 134936988 4293015840 18446744073709551615 134552080 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/17011/statm: 61734 326 41 104 0 61238 0
[pid=17005/tid=17034] ppid=16982 vsize=405764 CPUtime=0 cores=0-7
/proc/17005/task/17034/stat : 17034 (python) S 16982 16982 15751 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 649786316 415502336 5684 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 514 18446604467164881920 0 0 -1 7 0 0 0
[pid=17008] ppid=16982 vsize=416628 CPUtime=0.85 cores=0-7
/proc/17008/stat : 17008 (python) S 16982 16982 15751 0 -1 4202560 1194 0 0 0 44 41 0 0 18 0 2 0 649772063 426627072 5821 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17008/statm: 104157 5821 406 364 0 40054 0
[pid=17010] ppid=17008 vsize=416788 CPUtime=195.39 cores=0-7
/proc/17010/stat : 17010 (adaptg2wsat2009) T 17008 17010 17010 0 -1 4202496 640 0 0 0 19539 0 0 0 25 0 1 0 649772063 426790912 363 33554432000 134512640 135107411 4287625952 18446744073709551615 134532224 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/17010/statm: 104197 363 59 146 0 103073 0
[pid=17008/tid=17031] ppid=16982 vsize=416628 CPUtime=0 cores=0-7
/proc/17008/task/17031/stat : 17031 (python) S 16982 16982 15751 0 -1 4202560 53 0 0 0 0 0 0 0 18 0 2 0 649782497 426627072 5821 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 514 18446604464835984320 0 0 -1 0 0 0 0
[pid=17016] ppid=16982 vsize=361348 CPUtime=1.24 cores=0-7
/proc/17016/stat : 17016 (python) S 16982 16982 15751 0 -1 4202560 1054 0 0 0 67 57 0 0 15 0 1 0 649782073 370020352 5797 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 12129244933919834376 0 0 17 2 0 0 0
/proc/17016/statm: 90337 5797 371 364 0 26231 0
[pid=17018] ppid=17016 vsize=4152 CPUtime=359.1 cores=0-7
/proc/17018/stat : 17018 (march_hi) R 17016 17018 17018 0 -1 4202496 1678 0 0 0 35910 0 0 0 25 0 1 0 649782073 4251648 820 33554432000 4194304 4955518 140736908232976 18446744073709551615 4224468 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17018/statm: 1038 820 106 186 0 851 0
[pid=17020] ppid=16982 vsize=371744 CPUtime=1.22 cores=0-7
/proc/17020/stat : 17020 (python) S 16982 16982 15751 0 -1 4202560 1046 0 0 0 68 54 0 0 15 0 1 0 649782077 380665856 5820 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 7372643282951569668 0 0 17 3 0 0 0
/proc/17020/statm: 92936 5820 371 364 0 28827 0
[pid=17023] ppid=17020 vsize=3640 CPUtime=238.41 cores=0-7
/proc/17023/stat : 17023 (march_hi) R 17020 17023 17023 0 -1 4202496 1530 0 0 0 23841 0 0 0 25 0 1 0 649782078 3727360 673 33554432000 4194304 4955518 140735037670688 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/17023/statm: 910 673 106 186 0 723 0
[pid=17025] ppid=16982 vsize=447536 CPUtime=3.4 cores=0-7
/proc/17025/stat : 17025 (python) R 16982 16982 15751 0 -1 4202560 871 0 0 0 251 89 0 0 18 0 1 0 649782089 458276864 5997 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/17025/statm: 111884 5997 371 364 0 47772 0
[pid=17027] ppid=17025 vsize=0 CPUtime=370.19 cores=0-7
/proc/17027/stat : 17027 (march_hi) R 17025 17027 17027 0 -1 4202500 1693 0 0 0 37019 0 0 0 25 0 1 0 649782091 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/17027/statm: 0 0 0 0 0 0 0
[pid=17028] ppid=16982 vsize=457792 CPUtime=1.24 cores=0-7
/proc/17028/stat : 17028 (python) S 16982 16982 15751 0 -1 4202560 866 0 0 0 65 59 0 0 15 0 1 0 649782103 468779008 6012 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 10551779999596118277 0 0 17 7 0 0 0
/proc/17028/statm: 114448 6012 371 364 0 50333 0
[pid=17030] ppid=17028 vsize=4152 CPUtime=333.66 cores=0-7
/proc/17030/stat : 17030 (march_hi) R 17028 17030 17030 0 -1 4202496 1629 0 0 0 33366 0 0 0 25 0 1 0 649782110 4251648 777 33554432000 4194304 4955518 140736146921840 18446744073709551615 4224450 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/17030/statm: 1038 777 106 186 0 851 0
[pid=17038] ppid=16982 vsize=468048 CPUtime=0.56 cores=0-7
/proc/17038/stat : 17038 (python) S 16982 16982 15751 0 -1 4202560 1213 0 0 0 30 26 0 0 19 0 2 0 649796051 479281152 5977 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/17038/statm: 117012 5977 400 364 0 52894 0
[pid=17040] ppid=17038 vsize=246936 CPUtime=97.57 cores=0-7
/proc/17040/stat : 17040 (FH) T 17038 17040 17040 0 -1 4202496 600 0 0 0 9757 0 0 0 25 0 1 0 649796051 252862464 326 33554432000 134512640 134936988 4290350512 18446744073709551615 134552113 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/17040/statm: 61734 326 41 104 0 61238 0
[pid=17038/tid=17059] ppid=16982 vsize=468048 CPUtime=0 cores=0-7
/proc/17038/task/17059/stat : 17059 (python) S 16982 16982 15751 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 649815606 479281152 5977 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 514 18446604460749504576 0 0 -1 0 0 0 0
[pid=17042] ppid=16982 vsize=478304 CPUtime=0.69 cores=0-7
/proc/17042/stat : 17042 (python) S 16982 16982 15751 0 -1 4202560 882 0 0 0 35 34 0 0 15 0 1 0 649799628 489783296 6071 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 16066068199997701 0 0 17 0 0 0 0
/proc/17042/statm: 119576 6071 371 364 0 55455 0
[pid=17044] ppid=17042 vsize=3300 CPUtime=166.02 cores=0-7
/proc/17044/stat : 17044 (march_hi) R 17042 17044 17044 0 -1 4202496 1460 0 0 0 16601 1 0 0 25 0 1 0 649799629 3379200 604 33554432000 4194304 4955518 140733967918096 18446744073709551615 4297540 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17044/statm: 825 604 106 186 0 638 0
[pid=17046] ppid=16982 vsize=488560 CPUtime=0.69 cores=0-7
/proc/17046/stat : 17046 (python) S 16982 16982 15751 0 -1 4202560 982 0 0 0 36 33 0 0 15 0 1 0 649800556 500285440 6101 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 17536612332996624647 0 0 17 1 0 0 0
/proc/17046/statm: 122140 6101 380 364 0 58016 0
[pid=17048] ppid=17046 vsize=3640 CPUtime=205.11 cores=0-7
/proc/17048/stat : 17048 (march_hi) R 17046 17048 17048 0 -1 4202496 1497 0 0 0 20511 0 0 0 25 0 1 0 649800556 3727360 640 33554432000 4194304 4955518 140735846950640 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17048/statm: 910 640 106 186 0 723 0
[pid=17053] ppid=16982 vsize=498816 CPUtime=0.44 cores=0-7
/proc/17053/stat : 17053 (python) S 16982 16982 15751 0 -1 4202560 966 0 0 0 22 22 0 0 15 0 1 0 649807571 510787584 6111 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 10966722493779247364 0 0 17 2 0 0 0
/proc/17053/statm: 124704 6111 380 364 0 60577 0
[pid=17055] ppid=17053 vsize=2616 CPUtime=67.37 cores=0-7
/proc/17055/stat : 17055 (march_hi) R 17053 17055 17055 0 -1 4202496 1300 0 0 0 6737 0 0 0 25 0 1 0 649807571 2678784 442 33554432000 4194304 4955518 140733884942416 18446744073709551615 4285655 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/17055/statm: 654 442 106 186 0 467 0
[pid=17060] ppid=16982 vsize=509072 CPUtime=0.17 cores=0-7
/proc/17060/stat : 17060 (python) S 16982 16982 15751 0 -1 4202560 1026 0 0 0 9 8 0 0 15 0 1 0 649815610 521289728 6040 33554432000 4194304 5683644 140733802829120 18446744073709551615 220816256582 0 0 16781312 514 2886754588881289478 0 0 17 2 0 0 0
/proc/17060/statm: 127268 6040 373 364 0 63138 0
[pid=17062] ppid=17060 vsize=2616 CPUtime=27.94 cores=0-7
/proc/17062/stat : 17062 (march_hi) R 17060 17062 17062 0 -1 4202496 1276 0 0 0 2794 0 0 0 25 0 1 0 649815611 2678784 410 33554432000 4194304 4955518 140737107175520 18446744073709551615 4297550 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/17062/statm: 654 410 106 186 0 467 0
[pid=16982/tid=16989] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/16989/stat : 16989 (python) S 16980 16982 15751 0 -1 4202560 26 936 0 0 0 0 0 0 17 0 18 0 649772041 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 1 0 0 0
[pid=16982/tid=16992] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/16992/stat : 16992 (python) S 16980 16982 15751 0 -1 4202560 21 936 0 0 0 0 0 0 19 0 18 0 649772044 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=16995] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/16995/stat : 16995 (python) S 16980 16982 15751 0 -1 4202560 26 936 0 0 0 0 0 0 18 0 18 0 649772047 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 5 0 0 0
[pid=16982/tid=16998] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/16998/stat : 16998 (python) S 16980 16982 15751 0 -1 4202560 30 936 0 0 0 0 0 0 18 0 18 0 649772050 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 5 0 0 0
[pid=16982/tid=17001] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17001/stat : 17001 (python) S 16980 16982 15751 0 -1 4202560 32 936 0 0 0 0 0 0 18 0 18 0 649772053 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 1 0 0 0
[pid=16982/tid=17004] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17004/stat : 17004 (python) S 16980 16982 15751 0 -1 4202560 40 936 0 0 0 0 0 0 22 0 18 0 649772057 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17006] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17006/stat : 17006 (python) S 16980 16982 15751 0 -1 4202560 20 936 0 0 0 0 0 0 23 0 18 0 649772060 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17009] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17009/stat : 17009 (python) S 16980 16982 15751 0 -1 4202560 35 936 0 0 0 0 0 0 18 0 18 0 649772063 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17017] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17017/stat : 17017 (python) S 16980 16982 15751 0 -1 4202560 31 936 0 0 0 0 0 0 19 0 18 0 649782073 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17022] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17022/stat : 17022 (python) S 16980 16982 15751 0 -1 4202560 28 936 0 0 0 0 0 0 19 0 18 0 649782078 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 4 0 0 0
[pid=16982/tid=17026] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17026/stat : 17026 (python) S 16980 16982 15751 0 -1 4202560 86 936 0 0 0 0 0 0 20 0 18 0 649782089 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17029] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17029/stat : 17029 (python) S 16980 16982 15751 0 -1 4202560 33 936 0 0 0 0 0 0 21 0 18 0 649782103 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17039] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17039/stat : 17039 (python) S 16980 16982 15751 0 -1 4202560 26 936 0 0 0 0 0 0 19 0 18 0 649796051 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 2 0 0 0
[pid=16982/tid=17043] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17043/stat : 17043 (python) S 16980 16982 15751 0 -1 4202560 105 936 0 0 0 0 0 0 19 0 18 0 649799628 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 2 0 0 0
[pid=16982/tid=17047] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17047/stat : 17047 (python) S 16980 16982 15751 0 -1 4202560 35 936 0 0 0 0 0 0 19 0 18 0 649800556 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 2 0 0 0
[pid=16982/tid=17054] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17054/stat : 17054 (python) S 16980 16982 15751 0 -1 4202560 33 936 0 0 0 0 0 0 19 0 18 0 649807571 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 7 0 0 0
[pid=16982/tid=17061] ppid=16980 vsize=519316 CPUtime=0 cores=0-7
/proc/16982/task/17061/stat : 17061 (python) S 16980 16982 15751 0 -1 4202560 26 936 0 0 0 0 0 0 19 0 18 0 649815610 531779584 7581 33554432000 4194304 5683644 140733802829120 18446744073709551615 220828060081 0 0 16781312 2 18446604471137113920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3068.33
Current children cumulated vsize (KiB) 12696832

Child status: 0
Real time (s): 492.662
CPU time (s): 3068.88
CPU user time (s): 3062.56
CPU system time (s): 6.31604
CPU usage (%): 622.917
Max. virtual memory (cumulated for all children) (KiB): 12701748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3062.56
system time used= 6.31604
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 66106
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9869
involuntary context switches= 26847

runsolver used 3.05754 second user time and 6.98094 second system time

The end

Launcher Data 

Begin job on node147 at 2011-05-16 21:19:20
IDJOB=3385768
IDBENCH=83033
IDSOLVER=1870
FILE ID=node147/3385768-1305573560
RUNJOBID= node147-1305564960-15765
PBS_JOBID= 13350103
Free space on /tmp= 73120 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S113771637-026.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385768-1305573560/watcher-3385768-1305573560 -o /tmp/evaluation-result-3385768-1305573560/solver-3385768-1305573560 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385768-1305573560.cnf -seed 1513261905 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7f4758baa378252dd3709cff507a5405
RANDOM SEED=1513261905

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19094816 kB
Buffers:        328340 kB
Cached:        5514484 kB
SwapCached:      13132 kB
Active:        7133428 kB
Inactive:      6450708 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19094816 kB
SwapTotal:    67111528 kB
SwapFree:     63485424 kB
Dirty:           31984 kB
Writeback:           0 kB
AnonPages:     7736596 kB
Mapped:          22272 kB
Slab:           155192 kB
PageTables:      45948 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 88770776 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73092 MiB
End job on node147 at 2011-05-16 21:27:33