Trace number 3378397

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 3157.38 797.539

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v90-c8010-S775210372-041.UNKNOWN.cnf
MD5SUM3ecea073a44f0b1adf464774647edbfb
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables90
Number of clauses8010
Sum of the clauses size56070
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58010

Solver Data 

0.68/2.81	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.68/2.81	c INFO: solving HOME/instance-3378397-1305465319.cnf
0.68/2.81	c INFO: computing task features
0.68/2.87	c INFO: computed variable-clause graph statistics
0.68/2.87	c INFO: computed clause balance statistics
0.97/3.16	c INFO: computed variable balance statistics
1.09/3.27	c INFO: computed small-clause counts
1.09/3.27	c INFO: computed Horn-clause counts
1.09/3.28	c INFO: computed variable graph statistics
1.09/3.28	c INFO: collected features for HOME/instance-3378397-1305465319.cnf in 0.45 s
1.09/3.30	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.46)
1.16/3.31	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.11)
1.16/3.32	c INFO: running adaptg2wsat2009++@0 for 97 with 1199 remaining (b = 0.06)
1.16/3.34	c INFO: running adaptg2wsat2009++@0 for 97 with 1199 remaining (b = 0.05)
396.08/102.62	c INFO: running adaptg2wsat2009++@0 for 97 with 1100 remaining (b = 0.04)
400.05/103.62	c INFO: running gnovelty+2@0 for 97 with 1099 remaining (b = 0.03)
400.05/103.65	c INFO: running FH@0 for 97 with 1099 remaining (b = 0.02)
400.34/103.71	c INFO: running adaptg2wsat2009++@0 for 97 with 1099 remaining (b = 0.02)
795.72/202.93	c INFO: running adaptg2wsat2009++@0 for 97 with 999 remaining (b = 0.02)
795.72/202.96	c INFO: running hybridGM3@0 for 194 with 999 remaining (b = 0.03)
799.67/203.97	c INFO: running FH@0 for 97 with 998 remaining (b = 0.01)
800.04/204.02	c INFO: running hybridGM3@0 for 194 with 998 remaining (b = 0.02)
1194.38/303.27	c INFO: running gnovelty+2@0 for 97 with 899 remaining (b = 0.01)
1194.79/303.32	c INFO: running adaptg2wsat2009++@0 for 97 with 899 remaining (b = 0.01)
1577.62/399.60	c INFO: running hybridGM3@99 for 97 with 803 remaining (b = 0.01)
1581.59/400.64	c INFO: running hybridGM3@0 for 194 with 802 remaining (b = 0.02)
1596.69/404.48	c INFO: running adaptg2wsat2009++@99 for 97 with 798 remaining (b = 0.01)
1605.39/406.67	c INFO: running hybridGM3@99 for 97 with 796 remaining (b = 0.01)
1980.30/500.92	c INFO: running march_hi@0 for 388 with 701 remaining (b = 0.04)
1983.46/501.80	c INFO: running FH@0 for 97 with 701 remaining (b = 0.01)
1984.16/501.97	c INFO: running hybridGM3@0 for 194 with 700 remaining (b = 0.02)
2382.33/602.12	c INFO: running adaptg2wsat2009++@98 for 97 with 600 remaining (b = 0.01)
2383.13/602.31	c INFO: running hybridGM3@100 for 97 with 600 remaining (b = 0.01)
2765.83/698.75	c INFO: running hybridGM3@99 for 97 with 504 remaining (b = 0.01)
2768.62/699.45	c INFO: running adaptg2wsat2009++@99 for 97 with 503 remaining (b = 0.01)
2785.28/703.64	c INFO: running hybridGM3@297 for 97 with 499 remaining (b = 0.01)
3144.24/794.14	c INFO: running march_hi@0 for 408 with 408 remaining (b = 0.03)
3154.50/796.77	c INFO: running gnovelty+2@0 for 97 with 406 remaining (b = 0.01)
3157.38/797.51	c INFO: running hybridGM3@0 for 194 with 405 remaining (b = 0.02)
3157.38/797.53	c INFO: running TNM@0 for 97 with 405 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378397-1305465319/watcher-3378397-1305465319 -o /tmp/evaluation-result-3378397-1305465319/solver-3378397-1305465319 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378397-1305465319.cnf -seed 2051470122 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.44 2/394 8658
/proc/meminfo: memFree=23931092/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=14252 CPUtime=0 cores=0,2,4,6
/proc/8658/stat : 8658 (python) D 8656 8658 8625 0 -1 4194304 193 0 3 0 0 0 0 0 21 0 1 0 658130577 14594048 133 33554432000 4194304 5683644 140736906949136 18446744073709551615 5051632 0 0 4096 0 18446744071562234166 0 0 17 4 0 0 0
/proc/8658/statm: 3563 133 105 364 0 50 0

[startup+0.029033 s]
/proc/loadavg: 0.00 0.00 0.44 2/394 8658
/proc/meminfo: memFree=23931092/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/8658/stat : 8658 (python) S 8656 8658 8625 0 -1 4202496 720 0 6 0 0 0 0 0 17 0 1 0 658130577 15548416 617 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970546021 0 2147483391 16781312 2 18446744071699109054 0 0 17 6 0 0 1
/proc/8658/statm: 3796 617 322 364 0 283 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15184

[startup+0.100965 s]
/proc/loadavg: 0.00 0.00 0.44 2/394 8658
/proc/meminfo: memFree=23931092/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=16536 CPUtime=0.01 cores=0,2,4,6
/proc/8658/stat : 8658 (python) S 8656 8658 8625 0 -1 4202496 1177 0 6 0 1 0 0 0 17 0 1 0 658130577 16932864 1046 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970548224 0 2147483391 16781312 2 18446744071699109054 0 0 17 6 0 0 2
/proc/8658/statm: 4134 1046 417 364 0 621 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16536

[startup+0.300957 s]
/proc/loadavg: 0.00 0.00 0.44 2/394 8658
/proc/meminfo: memFree=23931092/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=43620 CPUtime=0.08 cores=0,2,4,6
/proc/8658/stat : 8658 (python) D 8656 8658 8625 0 -1 4202496 1862 0 16 0 6 2 0 0 16 0 1 0 658130577 44666880 1654 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970548224 0 0 16781312 2 0 0 0 17 6 0 0 4
/proc/8658/statm: 10905 1654 467 364 0 1170 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 43620

[startup+0.700867 s]
/proc/loadavg: 0.00 0.00 0.44 2/394 8658
/proc/meminfo: memFree=23931092/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=107300 CPUtime=0.17 cores=0,2,4,6
/proc/8658/stat : 8658 (python) D 8656 8658 8625 0 -1 4202496 3292 0 32 0 13 4 0 0 15 0 1 0 658130577 109875200 2988 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970550016 0 0 16781312 2 18446744071562234166 0 0 17 6 0 0 10
/proc/8658/statm: 26825 2988 871 364 0 2056 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 107300

[startup+1.50075 s]
/proc/loadavg: 0.08 0.02 0.45 1/403 8668
/proc/meminfo: memFree=23876116/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=135748 CPUtime=0.39 cores=0,2,4,6
/proc/8658/stat : 8658 (python) R 8656 8658 8625 0 -1 4202496 5923 923 41 9 28 11 0 0 17 0 1 0 658130577 139005952 4151 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970546181 0 2147483391 16781312 2 0 0 0 17 6 0 0 17
/proc/8658/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 135748

[startup+3.10038 s]
/proc/loadavg: 0.08 0.02 0.45 2/399 8672
/proc/meminfo: memFree=23849532/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=280236 CPUtime=0.97 cores=0,2,4,6
/proc/8658/stat : 8658 (python) R 8656 8658 8625 0 -1 4202496 9886 923 108 9 78 19 0 0 16 0 1 0 658130577 286961664 7444 33554432000 4194304 5683644 140736906949136 18446744073709551615 47180985844948 0 0 16781312 2 0 0 0 17 6 0 0 75
/proc/8658/statm: 70059 7444 1826 364 0 5983 0
Current children cumulated CPU time (s) 0.97
Current children cumulated vsize (KiB) 280236
heavy processes:

[startup+6.30083 s]
/proc/loadavg: 0.55 0.12 0.48 7/411 8728
/proc/meminfo: memFree=23808432/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=320748 CPUtime=1.19 cores=0,2,4,6
/proc/8658/stat : 8658 (python) S 8656 8658 8625 0 -1 4202496 12823 923 108 9 99 20 0 0 20 0 5 0 658130577 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 75
/proc/8658/statm: 80187 7378 1875 364 0 16096 0
[pid=8686] ppid=8658 vsize=279416 CPUtime=0 cores=0,2,4,6
/proc/8686/stat : 8686 (python) S 8658 8658 8625 0 -1 4202560 724 0 0 0 0 0 0 0 18 0 1 0 658130907 286121984 5793 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570255 0 0 16781312 514 9449576492477415683 0 0 17 6 0 0 0
/proc/8686/statm: 69854 5793 354 364 0 5772 0
[pid=8688] ppid=8686 vsize=1018088 CPUtime=2.98 cores=0,2,4,6
/proc/8688/stat : 8688 (gnovelty+2) R 8686 8688 8688 0 -1 4202496 564 0 0 0 298 0 0 0 25 0 1 0 658130908 1042522112 305 33554432000 134512640 135663704 4289989392 18446744073709551615 134524916 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8688/statm: 254522 305 113 282 0 254238 0
[pid=8689] ppid=8658 vsize=289992 CPUtime=0 cores=0,2,4,6
/proc/8689/stat : 8689 (python) S 8658 8658 8625 0 -1 4202560 729 0 0 0 0 0 0 0 18 0 1 0 658130908 296951808 5839 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 13095723076438425857 0 0 17 2 0 0 0
/proc/8689/statm: 72498 5839 348 364 0 8413 0
[pid=8693] ppid=8689 vsize=1018088 CPUtime=2.93 cores=0,2,4,6
/proc/8693/stat : 8693 (gnovelty+2) R 8689 8693 8693 0 -1 4202496 569 0 0 0 291 2 0 0 25 0 1 0 658130910 1042522112 306 33554432000 134512640 135663704 4288164528 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8693/statm: 254522 306 113 282 0 254238 0
[pid=8691] ppid=8658 vsize=300248 CPUtime=0 cores=0,2,4,6
/proc/8691/stat : 8691 (python) S 8658 8658 8625 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 658130909 307453952 5843 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 6154142231939744001 0 0 17 2 0 0 0
/proc/8691/statm: 75062 5843 348 364 0 10974 0
[pid=8695] ppid=8691 vsize=417192 CPUtime=2.09 cores=0,2,4,6
/proc/8695/stat : 8695 (adaptg2wsat2009) R 8691 8695 8695 0 -1 4202496 760 0 0 0 200 9 0 0 25 0 1 0 658130911 427204608 496 33554432000 134512640 135107411 4291078688 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8695/statm: 104298 496 59 146 0 103174 0
[pid=8694] ppid=8658 vsize=310504 CPUtime=0.03 cores=0,2,4,6
/proc/8694/stat : 8694 (python) S 8658 8658 8625 0 -1 4202560 745 0 0 0 2 1 0 0 18 0 1 0 658130911 317956096 5847 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 15313141436401025283 0 0 17 4 0 0 0
/proc/8694/statm: 77626 5847 348 364 0 13535 0
[pid=8697] ppid=8694 vsize=417192 CPUtime=2.95 cores=0,2,4,6
/proc/8697/stat : 8697 (adaptg2wsat2009) R 8694 8697 8697 0 -1 4202496 758 0 0 0 295 0 0 0 25 0 1 0 658130911 427204608 495 33554432000 134512640 135107411 4291803984 18446744073709551615 134531856 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8697/statm: 104298 495 59 146 0 103174 0
[pid=8658/tid=8687] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8687/stat : 8687 (python) S 8656 8658 8625 0 -1 4202560 25 923 0 9 0 0 0 0 18 0 5 0 658130908 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8690] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8690/stat : 8690 (python) S 8656 8658 8625 0 -1 4202560 39 923 0 9 0 0 0 0 19 0 5 0 658130909 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 2 0 0 0
[pid=8658/tid=8692] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8692/stat : 8692 (python) S 8656 8658 8625 0 -1 4202560 18 923 0 9 0 0 0 0 17 0 5 0 658130910 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 2 0 0 0
[pid=8658/tid=8696] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8696/stat : 8696 (python) S 8656 8658 8625 0 -1 4202560 31 923 0 9 0 0 0 0 20 0 5 0 658130911 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.17
Current children cumulated vsize (KiB) 4371468

[startup+12.7007 s]
/proc/loadavg: 1.31 0.28 0.53 9/423 8740
/proc/meminfo: memFree=23786496/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=320748 CPUtime=1.19 cores=0,2,4,6
/proc/8658/stat : 8658 (python) S 8656 8658 8625 0 -1 4202496 12823 923 108 9 99 20 0 0 20 0 5 0 658130577 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 75
/proc/8658/statm: 80187 7378 1875 364 0 16096 0
[pid=8686] ppid=8658 vsize=279416 CPUtime=0 cores=0,2,4,6
/proc/8686/stat : 8686 (python) S 8658 8658 8625 0 -1 4202560 890 0 0 0 0 0 0 0 18 0 1 0 658130907 286121984 5816 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570255 0 0 16781312 514 9449576492477415683 0 0 17 6 0 0 0
/proc/8686/statm: 69854 5816 377 364 0 5772 0
[pid=8688] ppid=8686 vsize=1018088 CPUtime=9.38 cores=0,2,4,6
/proc/8688/stat : 8688 (gnovelty+2) R 8686 8688 8688 0 -1 4202496 564 0 0 0 938 0 0 0 25 0 1 0 658130908 1042522112 305 33554432000 134512640 135663704 4289989392 18446744073709551615 134525260 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8688/statm: 254522 305 113 282 0 254238 0
[pid=8689] ppid=8658 vsize=289992 CPUtime=0 cores=0,2,4,6
/proc/8689/stat : 8689 (python) S 8658 8658 8625 0 -1 4202560 891 0 0 0 0 0 0 0 18 0 1 0 658130908 296951808 5862 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 13095723076438425857 0 0 17 2 0 0 0
/proc/8689/statm: 72498 5862 371 364 0 8413 0
[pid=8693] ppid=8689 vsize=1018088 CPUtime=9.23 cores=0,2,4,6
/proc/8693/stat : 8693 (gnovelty+2) R 8689 8693 8693 0 -1 4202496 569 0 0 0 921 2 0 0 25 0 1 0 658130910 1042522112 306 33554432000 134512640 135663704 4288164528 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8693/statm: 254522 306 113 282 0 254238 0
[pid=8691] ppid=8658 vsize=300248 CPUtime=0.01 cores=0,2,4,6
/proc/8691/stat : 8691 (python) S 8658 8658 8625 0 -1 4202560 904 0 0 0 0 1 0 0 18 0 1 0 658130909 307453952 5866 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 6154142231939744001 0 0 17 2 0 0 0
/proc/8691/statm: 75062 5866 371 364 0 10974 0
[pid=8695] ppid=8691 vsize=417192 CPUtime=8.48 cores=0,2,4,6
/proc/8695/stat : 8695 (adaptg2wsat2009) R 8691 8695 8695 0 -1 4202496 760 0 0 0 839 9 0 0 25 0 1 0 658130911 427204608 496 33554432000 134512640 135107411 4291078688 18446744073709551615 134532242 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8695/statm: 104298 496 59 146 0 103174 0
[pid=8694] ppid=8658 vsize=310504 CPUtime=0.05 cores=0,2,4,6
/proc/8694/stat : 8694 (python) S 8658 8658 8625 0 -1 4202560 910 0 0 0 3 2 0 0 18 0 1 0 658130911 317956096 5870 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 15313141436401025283 0 0 17 4 0 0 0
/proc/8694/statm: 77626 5870 371 364 0 13535 0
[pid=8697] ppid=8694 vsize=417192 CPUtime=9.32 cores=0,2,4,6
/proc/8697/stat : 8697 (adaptg2wsat2009) R 8694 8697 8697 0 -1 4202496 758 0 0 0 932 0 0 0 25 0 1 0 658130911 427204608 495 33554432000 134512640 135107411 4291803984 18446744073709551615 134531718 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8697/statm: 104298 495 59 146 0 103174 0
[pid=8658/tid=8687] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8687/stat : 8687 (python) S 8656 8658 8625 0 -1 4202560 25 923 0 9 0 0 0 0 18 0 5 0 658130908 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8690] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8690/stat : 8690 (python) S 8656 8658 8625 0 -1 4202560 39 923 0 9 0 0 0 0 19 0 5 0 658130909 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 2 0 0 0
[pid=8658/tid=8692] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8692/stat : 8692 (python) S 8656 8658 8625 0 -1 4202560 18 923 0 9 0 0 0 0 17 0 5 0 658130910 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 2 0 0 0
[pid=8658/tid=8696] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8696/stat : 8696 (python) S 8656 8658 8625 0 -1 4202560 31 923 0 9 0 0 0 0 20 0 5 0 658130911 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37.66
Current children cumulated vsize (KiB) 4371468

[startup+25.5005 s]
/proc/loadavg: 3.01 0.71 0.66 9/423 8740
/proc/meminfo: memFree=23787572/32951132 swapFree=67093844/67111528
[pid=8658] ppid=8656 vsize=320748 CPUtime=1.19 cores=0,2,4,6
/proc/8658/stat : 8658 (python) S 8656 8658 8625 0 -1 4202496 12823 923 108 9 99 20 0 0 20 0 5 0 658130577 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 75
/proc/8658/statm: 80187 7378 1875 364 0 16096 0
[pid=8686] ppid=8658 vsize=279416 CPUtime=0.06 cores=0,2,4,6
/proc/8686/stat : 8686 (python) S 8658 8658 8625 0 -1 4202560 899 0 0 0 3 3 0 0 18 0 1 0 658130907 286121984 5816 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570255 0 0 16781312 514 4059924695330291971 0 0 17 6 0 0 0
/proc/8686/statm: 69854 5816 377 364 0 5772 0
[pid=8688] ppid=8686 vsize=1018088 CPUtime=22.18 cores=0,2,4,6
/proc/8688/stat : 8688 (gnovelty+2) R 8686 8688 8688 0 -1 4202496 564 0 0 0 2218 0 0 0 25 0 1 0 658130908 1042522112 305 33554432000 134512640 135663704 4289989392 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8688/statm: 254522 305 113 282 0 254238 0
[pid=8689] ppid=8658 vsize=289992 CPUtime=0.06 cores=0,2,4,6
/proc/8689/stat : 8689 (python) S 8658 8658 8625 0 -1 4202560 899 0 0 0 3 3 0 0 18 0 1 0 658130908 296951808 5862 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 4059924695330291969 0 0 17 2 0 0 0
/proc/8689/statm: 72498 5862 371 364 0 8413 0
[pid=8693] ppid=8689 vsize=1018088 CPUtime=21.81 cores=0,2,4,6
/proc/8693/stat : 8693 (gnovelty+2) R 8689 8693 8693 0 -1 4202496 569 0 0 0 2179 2 0 0 25 0 1 0 658130910 1042522112 306 33554432000 134512640 135663704 4288164528 18446744073709551615 134524734 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8693/statm: 254522 306 113 282 0 254238 0
[pid=8691] ppid=8658 vsize=300248 CPUtime=0.06 cores=0,2,4,6
/proc/8691/stat : 8691 (python) S 8658 8658 8625 0 -1 4202560 912 0 0 0 3 3 0 0 18 0 1 0 658130909 307453952 5866 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 4059924695330291969 0 0 17 2 0 0 0
/proc/8691/statm: 75062 5866 371 364 0 10974 0
[pid=8695] ppid=8691 vsize=417192 CPUtime=21.22 cores=0,2,4,6
/proc/8695/stat : 8695 (adaptg2wsat2009) R 8691 8695 8695 0 -1 4202496 760 0 0 0 2113 9 0 0 25 0 1 0 658130911 427204608 496 33554432000 134512640 135107411 4291078688 18446744073709551615 134532291 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8695/statm: 104298 496 59 146 0 103174 0
[pid=8694] ppid=8658 vsize=310504 CPUtime=0.09 cores=0,2,4,6
/proc/8694/stat : 8694 (python) S 8658 8658 8625 0 -1 4202560 918 0 0 0 5 4 0 0 18 0 1 0 658130911 317956096 5870 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 4059924695330291971 0 0 17 4 0 0 0
/proc/8694/statm: 77626 5870 371 364 0 13535 0
[pid=8697] ppid=8694 vsize=417192 CPUtime=22.01 cores=0,2,4,6
/proc/8697/stat : 8697 (adaptg2wsat2009) R 8694 8697 8697 0 -1 4202496 758 0 0 0 2201 0 0 0 25 0 1 0 658130911 427204608 495 33554432000 134512640 135107411 4291803984 18446744073709551615 134531508 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8697/statm: 104298 495 59 146 0 103174 0
[pid=8658/tid=8687] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8687/stat : 8687 (python) S 8656 8658 8625 0 -1 4202560 25 923 0 9 0 0 0 0 18 0 5 0 658130908 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8690] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8690/stat : 8690 (python) S 8656 8658 8625 0 -1 4202560 39 923 0 9 0 0 0 0 19 0 5 0 658130909 328445952 7378 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 2 0 0 0
[pid=8658/tid=8692] ppid=8656 vsize=320748 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=8746] ppid=8744 vsize=417192 CPUtime=196.96 cores=0,2,4,6
/proc/8746/stat : 8746 (adaptg2wsat2009) T 8744 8746 8746 0 -1 4202496 760 0 0 0 19695 1 0 0 25 0 1 0 658140839 427204608 497 33554432000 134512640 135107411 4292440640 18446744073709551615 134531656 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8746/statm: 104298 497 59 146 0 103174 0
[pid=8744/tid=8778] ppid=8658 vsize=320760 CPUtime=0 cores=0,2,4,6
/proc/8744/task/8778/stat : 8778 (python) S 8658 8658 8625 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 658150869 328458240 5904 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604440278878272 0 0 -1 2 0 0 0
[pid=8748] ppid=8658 vsize=331016 CPUtime=0.3 cores=0,2,4,6
/proc/8748/stat : 8748 (python) S 8658 8658 8625 0 -1 4202560 1098 0 0 0 14 16 0 0 18 0 2 0 658140939 338960384 5908 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/8748/statm: 82754 5908 400 364 0 18657 0
[pid=8750] ppid=8748 vsize=1018088 CPUtime=99.23 cores=0,2,4,6
/proc/8750/stat : 8750 (gnovelty+2) T 8748 8750 8750 0 -1 4202496 565 0 0 0 9919 4 0 0 25 0 1 0 658140940 1042522112 305 33554432000 134512640 135663704 4287435536 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8750/statm: 254522 305 113 282 0 254238 0
[pid=8748/tid=8781] ppid=8658 vsize=331016 CPUtime=0 cores=0,2,4,6
/proc/8748/task/8781/stat : 8781 (python) S 8658 8658 8625 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 658150872 338960384 5908 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604441761101120 0 0 -1 2 0 0 0
[pid=8752] ppid=8658 vsize=341272 CPUtime=0.29 cores=0,2,4,6
/proc/8752/stat : 8752 (python) S 8658 8658 8625 0 -1 4202560 1104 0 0 0 16 13 0 0 19 0 2 0 658140942 349462528 5912 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/8752/statm: 85318 5912 400 364 0 21218 0
[pid=8754] ppid=8752 vsize=247352 CPUtime=99.38 cores=0,2,4,6
/proc/8754/stat : 8754 (FH) T 8752 8754 8754 0 -1 4202496 706 0 0 0 9938 0 0 0 25 0 1 0 658140942 253288448 443 33554432000 134512640 134936988 4291640000 18446744073709551615 134553427 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8754/statm: 61838 443 41 104 0 61342 0
[pid=8752/tid=8786] ppid=8658 vsize=341272 CPUtime=0 cores=0,2,4,6
/proc/8752/task/8786/stat : 8786 (python) S 8658 8658 8625 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 658150973 349462528 5912 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604451365010176 0 0 -1 0 0 0 0
[pid=8756] ppid=8658 vsize=351528 CPUtime=0.63 cores=0,2,4,6
/proc/8756/stat : 8756 (python) S 8658 8658 8625 0 -1 4202560 1178 0 0 0 32 31 0 0 18 0 2 0 658140948 359964672 5922 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8756/statm: 87882 5922 406 364 0 23779 0
[pid=8758] ppid=8756 vsize=417192 CPUtime=195.91 cores=0,2,4,6
/proc/8758/stat : 8758 (adaptg2wsat2009) T 8756 8758 8758 0 -1 4202496 766 0 0 0 19590 1 0 0 25 0 1 0 658140948 427204608 497 33554432000 134512640 135107411 4293235408 18446744073709551615 134531739 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8758/statm: 104298 497 59 146 0 103174 0
[pid=8756/tid=8790] ppid=8658 vsize=351528 CPUtime=0 cores=0,2,4,6
/proc/8756/task/8790/stat : 8790 (python) S 8658 8658 8625 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 658150977 359964672 5922 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604450573819968 0 0 -1 4 0 0 0
[pid=8779] ppid=8658 vsize=361784 CPUtime=0.31 cores=0,2,4,6
/proc/8779/stat : 8779 (python) S 8658 8658 8625 0 -1 4202560 1146 0 0 0 16 15 0 0 19 0 2 0 658150870 370466816 5926 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/8779/statm: 90446 5926 406 364 0 26340 0
[pid=8782] ppid=8779 vsize=417192 CPUtime=99.91 cores=0,2,4,6
/proc/8782/stat : 8782 (adaptg2wsat2009) T 8779 8782 8782 0 -1 4202496 765 0 0 0 9988 3 0 0 25 0 1 0 658150872 427204608 496 33554432000 134512640 135107411 4289181424 18446744073709551615 134531792 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8782/statm: 104298 496 59 146 0 103174 0
[pid=8779/tid=8809] ppid=8658 vsize=361784 CPUtime=0 cores=0,2,4,6
/proc/8779/task/8809/stat : 8809 (python) S 8658 8658 8625 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 658160903 370466816 5926 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604447589459968 0 0 -1 2 0 0 0
[pid=8783] ppid=8658 vsize=372040 CPUtime=0.94 cores=0,2,4,6
/proc/8783/stat : 8783 (python) S 8658 8658 8625 0 -1 4202560 1170 0 0 0 49 45 0 0 18 0 2 0 658150873 380968960 5924 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8783/statm: 93010 5924 400 364 0 28901 0
[pid=8785] ppid=8783 vsize=268420 CPUtime=296.52 cores=0,2,4,6
/proc/8785/stat : 8785 (hybridGM3) T 8783 8785 8785 0 -1 4202496 4936 0 0 0 29645 7 0 0 25 0 1 0 658150873 274862080 4671 33554432000 134512640 135204385 4287902288 18446744073709551615 134537403 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8785/statm: 67105 4671 64 169 0 66935 0
[pid=8783/tid=8820] ppid=8658 vsize=372040 CPUtime=0 cores=0,2,4,6
/proc/8783/task/8820/stat : 8820 (python) S 8658 8658 8625 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 658170536 380968960 5924 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604447589459072 0 0 -1 4 0 0 0
[pid=8787] ppid=8658 vsize=382296 CPUtime=0.32 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8658 8658 8625 0 -1 4202560 1129 0 0 0 16 16 0 0 19 0 2 0 658150974 391471104 5928 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/8787/statm: 95574 5928 400 364 0 31462 0
[pid=8789] ppid=8787 vsize=247344 CPUtime=99.3 cores=0,2,4,6
/proc/8789/stat : 8789 (FH) T 8787 8789 8789 0 -1 4202496 710 0 0 0 9930 0 0 0 25 0 1 0 658150974 253280256 443 33554432000 134512640 134936988 4292579232 18446744073709551615 134553523 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8789/statm: 61836 443 41 104 0 61340 0
[pid=8787/tid=8812] ppid=8658 vsize=382296 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8812/stat : 8812 (python) S 8658 8658 8625 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 658160907 391471104 5928 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604448569676160 0 0 -1 2 0 0 0
[pid=8791] ppid=8658 vsize=392552 CPUtime=0.94 cores=0,2,4,6
/proc/8791/stat : 8791 (python) S 8658 8658 8625 0 -1 4202560 1171 0 0 0 51 43 0 0 18 0 2 0 658150979 401973248 5962 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8791/statm: 98138 5962 400 364 0 34023 0
[pid=8793] ppid=8791 vsize=268424 CPUtime=293.15 cores=0,2,4,6
/proc/8793/stat : 8793 (hybridGM3) T 8791 8793 8793 0 -1 4202496 4939 0 0 0 29315 0 0 0 25 0 1 0 658150979 274866176 4672 33554432000 134512640 135204385 4291321584 18446744073709551615 134536993 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8793/statm: 67106 4672 64 169 0 66936 0
[pid=8791/tid=8830] ppid=8658 vsize=392552 CPUtime=0 cores=0,2,4,6
/proc/8791/task/8830/stat : 8830 (python) S 8658 8658 8625 0 -1 4202560 52 0 0 0 0 0 0 0 18 0 2 0 658171243 401973248 5962 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604445730719744 0 0 -1 4 0 0 0
[pid=8810] ppid=8658 vsize=402808 CPUtime=0.31 cores=0,2,4,6
/proc/8810/stat : 8810 (python) S 8658 8658 8625 0 -1 4202560 1137 0 0 0 16 15 0 0 19 0 2 0 658160904 412475392 5966 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/8810/statm: 100702 5966 400 364 0 36584 0
[pid=8813] ppid=8810 vsize=1018088 CPUtime=100.51 cores=0,2,4,6
/proc/8813/stat : 8813 (gnovelty+2) T 8810 8813 8813 0 -1 4202496 570 0 0 0 10051 0 0 0 25 0 1 0 658160907 1042522112 305 33554432000 134512640 135663704 4290903600 18446744073709551615 134544196 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8813/statm: 254522 305 113 282 0 254238 0
[pid=8810/tid=8825] ppid=8658 vsize=402808 CPUtime=0 cores=0,2,4,6
/proc/8810/task/8825/stat : 8825 (python) S 8658 8658 8625 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 658171023 412475392 5966 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604442585998528 0 0 -1 0 0 0 0
[pid=8821] ppid=8658 vsize=413348 CPUtime=1.27 cores=0,2,4,6
/proc/8821/stat : 8821 (python) S 8658 8658 8625 0 -1 4202560 1187 0 0 0 73 54 0 0 18 0 2 0 658170641 423268352 6011 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8821/statm: 103337 6011 400 364 0 39216 0
[pid=8823] ppid=8821 vsize=268428 CPUtime=385.98 cores=0,2,4,6
/proc/8823/stat : 8823 (hybridGM3) R 8821 8823 8823 0 -1 4202496 4942 0 0 0 38596 2 0 0 25 0 1 0 658170641 274870272 4673 33554432000 134512640 135204385 4289378336 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8823/statm: 67107 4673 64 169 0 66937 0
[pid=8821/tid=8846] ppid=8658 vsize=413348 CPUtime=0 cores=0,2,4,6
/proc/8821/task/8846/stat : 8846 (python) S 8658 8658 8625 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 658190807 423268352 6011 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604443476005824 0 0 -1 4 0 0 0
[pid=8833] ppid=8658 vsize=423604 CPUtime=1.01 cores=0,2,4,6
/proc/8833/stat : 8833 (python) S 8658 8658 8625 0 -1 4202560 1079 0 0 0 55 46 0 0 15 0 1 0 658180669 433770496 6011 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 4059924695330291969 0 0 17 4 0 0 0
/proc/8833/statm: 105901 6011 378 364 0 41777 0
[pid=8835] ppid=8833 vsize=43172 CPUtime=293.77 cores=0,2,4,6
/proc/8835/stat : 8835 (march_hi) R 8833 8835 8835 0 -1 4202496 10596 0 0 0 29376 1 0 0 25 0 1 0 658180670 44208128 9203 33554432000 4194304 4955518 140736978482608 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8835/statm: 10793 9203 106 186 0 10606 0
[pid=8836] ppid=8658 vsize=433860 CPUtime=0.31 cores=0,2,4,6
/proc/8836/stat : 8836 (python) S 8658 8658 8625 0 -1 4202560 1193 0 0 0 17 14 0 0 19 0 2 0 658180757 444272640 6045 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/8836/statm: 108465 6045 407 364 0 44338 0
[pid=8838] ppid=8836 vsize=247348 CPUtime=99.67 cores=0,2,4,6
/proc/8838/stat : 8838 (FH) T 8836 8838 8838 0 -1 4202496 721 0 0 0 9965 2 0 0 25 0 1 0 658180757 253284352 443 33554432000 134512640 134936988 4288814032 18446744073709551615 134553523 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8838/statm: 61837 443 41 104 0 61341 0
[pid=8836/tid=8845] ppid=8658 vsize=433860 CPUtime=0 cores=0,2,4,6
/proc/8836/task/8845/stat : 8845 (python) S 8658 8658 8625 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 658190788 444272640 6045 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604449244476736 0 0 -1 0 0 0 0
[pid=8839] ppid=8658 vsize=444116 CPUtime=0.94 cores=0,2,4,6
/proc/8839/stat : 8839 (python) S 8658 8658 8625 0 -1 4202560 1219 0 0 0 53 41 0 0 18 0 2 0 658180774 454774784 6049 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/8839/statm: 111029 6049 407 364 0 46899 0
[pid=8841] ppid=8839 vsize=268420 CPUtime=291.82 cores=0,2,4,6
/proc/8841/stat : 8841 (hybridGM3) T 8839 8841 8841 0 -1 4202496 4950 0 0 0 29172 10 0 0 25 0 1 0 658180775 274862080 4671 33554432000 134512640 135204385 4286676992 18446744073709551615 134536744 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8841/statm: 67105 4671 64 169 0 66935 0
[pid=8839/tid=8850] ppid=8658 vsize=444116 CPUtime=0 cores=0,2,4,6
/proc/8839/task/8850/stat : 8850 (python) S 8658 8658 8625 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 658200451 454774784 6049 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 514 18446604443476004928 0 0 -1 0 0 0 0
[pid=8856] ppid=8658 vsize=454568 CPUtime=0 cores=0,2,4,6
/proc/8856/stat : 8856 (python) S 8658 8658 8625 0 -1 4202560 854 0 0 0 0 0 0 0 15 0 1 0 658209991 465477632 6024 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 979634078317773059 0 0 17 6 0 0 0
/proc/8856/statm: 113642 6024 349 364 0 49509 0
[pid=8858] ppid=8856 vsize=3764 CPUtime=3.15 cores=0,2,4,6
/proc/8858/stat : 8858 (march_hi) R 8856 8858 8858 0 -1 4202496 2047 0 0 0 315 0 0 0 25 0 1 0 658209991 3854336 657 33554432000 4194304 4955518 140733465562032 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8858/statm: 941 657 106 186 0 754 0
[pid=8860] ppid=8658 vsize=464824 CPUtime=0 cores=0,2,4,6
/proc/8860/stat : 8860 (python) S 8658 8658 8625 0 -1 4202560 850 0 0 0 0 0 0 0 19 0 1 0 658210254 475979776 6028 33554432000 4194304 5683644 140736906949136 18446744073709551615 242970570310 0 0 16781312 514 2565375861297512447 0 0 17 6 0 0 0
/proc/8860/statm: 116206 6028 349 364 0 52070 0
[pid=8862] ppid=8860 vsize=1018088 CPUtime=0.65 cores=0,2,4,6
/proc/8862/stat : 8862 (gnovelty+2) R 8860 8862 8862 0 -1 4202496 581 0 0 0 65 0 0 0 22 0 1 0 658210254 1042522112 305 33554432000 134512640 135663704 4287544800 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8862/statm: 254522 305 113 282 0 254238 0
[pid=8658/tid=8687] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8687/stat : 8687 (python) S 8656 8658 8625 0 -1 4202560 25 923 0 9 0 0 0 0 18 0 20 0 658130908 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8690] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8690/stat : 8690 (python) S 8656 8658 8625 0 -1 4202560 39 923 0 9 0 0 0 0 19 0 20 0 658130909 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 2 0 0 0
[pid=8658/tid=8692] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8692/stat : 8692 (python) S 8656 8658 8625 0 -1 4202560 23 923 0 9 0 0 0 0 15 0 20 0 658130910 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 2 0 0 0
[pid=8658/tid=8696] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8696/stat : 8696 (python) S 8656 8658 8625 0 -1 4202560 37 923 0 9 0 0 0 0 18 0 20 0 658130911 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8745] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8745/stat : 8745 (python) S 8656 8658 8625 0 -1 4202560 36 923 0 9 0 0 0 0 18 0 20 0 658140839 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8749] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8749/stat : 8749 (python) S 8656 8658 8625 0 -1 4202560 27 923 0 9 0 0 0 0 20 0 20 0 658140940 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8753] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8753/stat : 8753 (python) S 8656 8658 8625 0 -1 4202560 30 923 0 9 0 0 0 0 21 0 20 0 658140942 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8757] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8757/stat : 8757 (python) S 8656 8658 8625 0 -1 4202560 30 923 0 9 0 0 0 0 18 0 20 0 658140948 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8780] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8780/stat : 8780 (python) S 8656 8658 8625 0 -1 4202560 21 923 0 9 0 0 0 0 20 0 20 0 658150870 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8784] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8784/stat : 8784 (python) S 8656 8658 8625 0 -1 4202560 33 923 0 9 0 0 0 0 18 0 20 0 658150873 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8788] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8788/stat : 8788 (python) S 8656 8658 8625 0 -1 4202560 27 923 0 9 0 0 0 0 20 0 20 0 658150974 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8792] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8792/stat : 8792 (python) S 8656 8658 8625 0 -1 4202560 32 923 0 9 0 0 0 0 18 0 20 0 658150979 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8811] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8811/stat : 8811 (python) S 8656 8658 8625 0 -1 4202560 24 923 0 9 0 0 0 0 20 0 20 0 658160904 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 4 0 0 0
[pid=8658/tid=8822] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8822/stat : 8822 (python) S 8656 8658 8625 0 -1 4202560 35 923 0 9 0 0 0 0 18 0 20 0 658170641 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 6 0 0 0
[pid=8658/tid=8834] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8834/stat : 8834 (python) S 8656 8658 8625 0 -1 4202560 31 923 0 9 0 0 0 0 20 0 20 0 658180669 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 0 0 0 0
[pid=8658/tid=8837] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8837/stat : 8837 (python) S 8656 8658 8625 0 -1 4202560 28 923 0 9 0 0 0 0 20 0 20 0 658180757 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 0 0 0 0
[pid=8658/tid=8840] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8840/stat : 8840 (python) S 8656 8658 8625 0 -1 4202560 25 923 0 9 0 0 0 0 18 0 20 0 658180775 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 0 0 0 0
[pid=8658/tid=8857] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8857/stat : 8857 (python) S 8656 8658 8625 0 -1 4202560 26 923 0 9 0 0 0 0 20 0 20 0 658209991 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 6 0 0 0
[pid=8658/tid=8861] ppid=8656 vsize=475068 CPUtime=0 cores=0,2,4,6
/proc/8658/task/8861/stat : 8861 (python) S 8656 8658 8625 0 -1 4202560 26 923 0 9 0 0 0 0 20 0 20 0 658210254 486469632 7597 33554432000 4194304 5683644 140736906949136 18446744073709551615 242982373809 0 0 16781312 2 18446604450658281280 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3157.38
Current children cumulated vsize (KiB) 16594920

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8658 and gives
#  childrusage.ru_utime.tv_sec=690
#  childrusage.ru_utime.tv_usec=652004
#  childrusage.ru_stime.tv_sec=5
#  childrusage.ru_stime.tv_usec=29235
# CPU time returned by wait4() is 695.681
# while last known CPU time is 3157.38
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 797.539
CPU time (s): 3157.38
CPU user time (s): 3152.09
CPU system time (s): 5.29
CPU usage (%): 395.89
Max. virtual memory (cumulated for all children) (KiB): 16594920

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 690.652
system time used= 5.02923
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 69905
page faults= 117
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 27432
involuntary context switches= 6794

runsolver used 6.26405 second user time and 12.2171 second system time

The end

Launcher Data 

Begin job on node128 at 2011-05-15 15:15:19
IDJOB=3378397
IDBENCH=82806
IDSOLVER=1859
FILE ID=node128/3378397-1305465319
RUNJOBID= node128-1305465319-8643
PBS_JOBID= 13325053
Free space on /tmp= 73620 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v90-c8010-S775210372-041.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378397-1305465319/watcher-3378397-1305465319 -o /tmp/evaluation-result-3378397-1305465319/solver-3378397-1305465319 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378397-1305465319.cnf -seed 2051470122 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3ecea073a44f0b1adf464774647edbfb
RANDOM SEED=2051470122

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      23933116 kB
Buffers:        283524 kB
Cached:        3185160 kB
SwapCached:       1440 kB
Active:        6547580 kB
Inactive:      2176880 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      23933116 kB
SwapTotal:    67111528 kB
SwapFree:     67093844 kB
Dirty:           46984 kB
Writeback:           0 kB
AnonPages:     5253980 kB
Mapped:          31580 kB
Slab:           189724 kB
PageTables:      38204 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 100669152 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73556 MiB
End job on node128 at 2011-05-15 15:28:39