Trace number 3386810

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (TO) 5000.06 4983.9

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v80-c7120-S199880667-010.UNKNOWN.cnf
MD5SUM3919f50518b71f2cf8a267b92efd9aeb
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables80
Number of clauses7120
Sum of the clauses size49840
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 57120

Solver Data 

0.37/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.67	c INFO: solving HOME/instance-3386810-1305593070.cnf
0.37/0.67	c INFO: computing task features
0.45/0.72	c INFO: computed variable-clause graph statistics
0.45/0.72	c INFO: computed clause balance statistics
0.64/0.97	c INFO: computed variable balance statistics
0.75/1.07	c INFO: computed small-clause counts
0.75/1.07	c INFO: computed Horn-clause counts
0.75/1.08	c INFO: computed variable graph statistics
0.75/1.08	c INFO: collected features for HOME/instance-3386810-1305593070.cnf in 0.41 s
0.86/1.11	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.49)
99.43/99.48	c INFO: running gnovelty+2@0 for 97 with 4901 remaining (b = 0.10)
200.14/199.84	c INFO: running adaptg2wsat2009++@0 for 97 with 4800 remaining (b = 0.06)
299.76/299.19	c INFO: running adaptg2wsat2009++@0 for 97 with 4701 remaining (b = 0.04)
399.42/398.55	c INFO: running adaptg2wsat2009++@0 for 97 with 4602 remaining (b = 0.03)
500.13/498.91	c INFO: running gnovelty+2@0 for 97 with 4501 remaining (b = 0.03)
600.71/599.27	c INFO: running FH@0 for 97 with 4401 remaining (b = 0.02)
701.37/699.62	c INFO: running adaptg2wsat2009++@0 for 97 with 4301 remaining (b = 0.02)
801.09/799.01	c INFO: running adaptg2wsat2009++@0 for 97 with 4201 remaining (b = 0.02)
900.81/898.41	c INFO: running hybridGM3@0 for 194 with 4102 remaining (b = 0.03)
1096.08/1093.15	c INFO: running FH@0 for 97 with 3907 remaining (b = 0.01)
1195.80/1192.53	c INFO: running march_hi@0 for 485 with 3808 remaining (b = 0.06)
1683.12/1678.17	c INFO: running march_hi@485 for 97 with 3322 remaining (b = 0.02)
1781.07/1775.79	c INFO: running march_hi@583 for 97 with 3225 remaining (b = 0.02)
1881.73/1876.01	c INFO: running march_hi@683 for 97 with 3125 remaining (b = 0.01)
1976.88/1970.84	c INFO: running march_hi@778 for 194 with 3030 remaining (b = 0.02)
2171.22/2164.60	c INFO: running gnovelty+2@0 for 97 with 2836 remaining (b = 0.01)
2270.92/2263.98	c INFO: running march_hi@0 for 388 with 2737 remaining (b = 0.05)
2665.73/2657.68	c INFO: running march_hi@393 for 97 with 2343 remaining (b = 0.02)
2759.33/2751.01	c INFO: running march_hi@486 for 194 with 2250 remaining (b = 0.03)
2956.92/2947.89	c INFO: running march_hi@971 for 388 with 2053 remaining (b = 0.05)
3347.86/3337.35	c INFO: running march_hi@1361 for 776 with 1664 remaining (b = 0.10)
4126.07/4112.91	c INFO: running march_hi@2136 for 97 with 888 remaining (b = 0.02)
4226.65/4213.04	c INFO: running march_hi@2236 for 582 with 788 remaining (b = 0.07)
4810.31/4794.76	c INFO: running march_hi@2818 for 97 with 206 remaining (b = 0.02)
4905.64/4889.70	c INFO: running march_hi@683 for 111 with 111 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386810-1305593070/watcher-3386810-1305593070 -o /tmp/evaluation-result-3386810-1305593070/solver-3386810-1305593070 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386810-1305593070.cnf -seed 647316550 -budget 5000 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.02 3.04 3.00 3/447 8780
/proc/meminfo: memFree=22481736/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=15776 CPUtime=0 cores=0,2,4,6
/proc/8780/stat : 8780 (python) R 8778 8780 7922 0 -1 4202496 863 0 0 0 0 0 0 0 17 0 1 0 749537742 16154624 745 33554432000 4194304 5683644 140737348710016 18446744073709551615 4851904 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/8780/statm: 3944 747 341 364 0 431 0

[startup+0.0738501 s]
/proc/loadavg: 3.02 3.04 3.00 3/447 8780
/proc/meminfo: memFree=22481736/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=38904 CPUtime=0.03 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 1658 0 0 0 3 0 0 0 17 0 1 0 749537742 39837696 1486 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895488512 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/8780/statm: 9726 1486 455 364 0 1026 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 38904

[startup+0.101227 s]
/proc/loadavg: 3.02 3.04 3.00 3/447 8780
/proc/meminfo: memFree=22481736/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=89768 CPUtime=0.05 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 2672 0 0 0 4 1 0 0 17 0 1 0 749537742 91922432 2388 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895488512 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/8780/statm: 22442 2388 750 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 89768

[startup+0.300945 s]
/proc/loadavg: 3.02 3.04 3.00 3/447 8780
/proc/meminfo: memFree=22481736/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=135752 CPUtime=0.18 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 5972 934 1 0 14 4 0 0 17 0 1 0 749537742 139010048 4150 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895486469 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/8780/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.705797 s]
/proc/loadavg: 3.02 3.04 3.00 3/447 8780
/proc/meminfo: memFree=22481736/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=279620 CPUtime=0.45 cores=0,2,4,6
/proc/8780/stat : 8780 (python) R 8778 8780 7922 0 -1 4202496 9563 934 1 0 34 11 0 0 16 0 1 0 749537742 286330880 7236 33554432000 4194304 5683644 140737348710016 18446744073709551615 4299184 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/8780/statm: 69905 7236 1761 364 0 5829 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 279620

[startup+1.50065 s]
/proc/loadavg: 3.02 3.04 3.00 4/448 8785
/proc/meminfo: memFree=22458292/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=290220 CPUtime=0.86 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 10116 934 1 0 75 11 0 0 19 0 2 0 749537742 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8780/statm: 72555 7428 1877 364 0 8473 0
Current children cumulated CPU time (s) 0.86
Current children cumulated vsize (KiB) 290220

[startup+3.10035 s]
/proc/loadavg: 3.02 3.04 3.00 4/451 8788
/proc/meminfo: memFree=22454656/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=290220 CPUtime=0.86 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 10116 934 1 0 75 11 0 0 19 0 2 0 749537742 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8780/statm: 72555 7428 1877 364 0 8473 0
[pid=8786] ppid=8780 vsize=279976 CPUtime=0 cores=0,2,4,6
/proc/8786/stat : 8786 (python) S 8780 8780 7922 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 749537854 286695424 5901 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895510543 0 0 16781312 514 11882255589658558722 0 0 17 6 0 0 0
/proc/8786/statm: 69994 5901 354 364 0 5912 0
[pid=8788] ppid=8786 vsize=1018084 CPUtime=1.98 cores=0,2,4,6
/proc/8788/stat : 8788 (gnovelty+2) R 8786 8788 8788 0 -1 4202496 551 0 0 0 198 0 0 0 25 0 1 0 749537854 1042518016 288 33554432000 134512640 135663704 4294031152 18446744073709551615 134525302 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8788/statm: 254521 288 113 282 0 254237 0
[pid=8780/tid=8787] ppid=8778 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8787/stat : 8787 (python) S 8778 8780 7922 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 2 0 749537854 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 1588280

[startup+6.30076 s]
/proc/loadavg: 3.02 3.04 3.00 4/451 8788
/proc/meminfo: memFree=22453108/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=290220 CPUtime=0.86 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 10116 934 1 0 75 11 0 0 19 0 2 0 749537742 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8780/statm: 72555 7428 1877 364 0 8473 0
[pid=8786] ppid=8780 vsize=279976 CPUtime=0.01 cores=0,2,4,6
/proc/8786/stat : 8786 (python) S 8780 8780 7922 0 -1 4202560 893 0 0 0 0 1 0 0 18 0 1 0 749537854 286695424 5924 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895510543 0 0 16781312 514 11882255589658558722 0 0 17 6 0 0 0
/proc/8786/statm: 69994 5924 377 364 0 5912 0
[pid=8788] ppid=8786 vsize=1018084 CPUtime=5.18 cores=0,2,4,6
/proc/8788/stat : 8788 (gnovelty+2) R 8786 8788 8788 0 -1 4202496 551 0 0 0 518 0 0 0 25 0 1 0 749537854 1042518016 288 33554432000 134512640 135663704 4294031152 18446744073709551615 134544212 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8788/statm: 254521 288 113 282 0 254237 0
[pid=8780/tid=8787] ppid=8778 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8787/stat : 8787 (python) S 8778 8780 7922 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 2 0 749537854 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6.05
Current children cumulated vsize (KiB) 1588280

[startup+12.7006 s]
/proc/loadavg: 3.02 3.04 3.00 4/451 8788
/proc/meminfo: memFree=22451352/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=290220 CPUtime=0.86 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 10116 934 1 0 75 11 0 0 19 0 2 0 749537742 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8780/statm: 72555 7428 1877 364 0 8473 0
[pid=8786] ppid=8780 vsize=279976 CPUtime=0.03 cores=0,2,4,6
/proc/8786/stat : 8786 (python) S 8780 8780 7922 0 -1 4202560 898 0 0 0 1 2 0 0 18 0 1 0 749537854 286695424 5924 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895510543 0 0 16781312 514 1831733595316650242 0 0 17 6 0 0 0
/proc/8786/statm: 69994 5924 377 364 0 5912 0
[pid=8788] ppid=8786 vsize=1018084 CPUtime=11.58 cores=0,2,4,6
/proc/8788/stat : 8788 (gnovelty+2) R 8786 8788 8788 0 -1 4202496 551 0 0 0 1158 0 0 0 25 0 1 0 749537854 1042518016 288 33554432000 134512640 135663704 4294031152 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8788/statm: 254521 288 113 282 0 254237 0
[pid=8780/tid=8787] ppid=8778 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8787/stat : 8787 (python) S 8778 8780 7922 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 2 0 749537854 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.47
Current children cumulated vsize (KiB) 1588280

[startup+25.5011 s]
/proc/loadavg: 3.01 3.03 3.00 4/451 8788
/proc/meminfo: memFree=22450112/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=290220 CPUtime=0.86 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 10116 934 1 0 75 11 0 0 19 0 2 0 749537742 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8780/statm: 72555 7428 1877 364 0 8473 0
[pid=8786] ppid=8780 vsize=279976 CPUtime=0.07 cores=0,2,4,6
/proc/8786/stat : 8786 (python) S 8780 8780 7922 0 -1 4202560 903 0 0 0 3 4 0 0 18 0 1 0 749537854 286695424 5924 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895510543 0 0 16781312 514 1831733595316650242 0 0 17 6 0 0 0
/proc/8786/statm: 69994 5924 377 364 0 5912 0
[pid=8788] ppid=8786 vsize=1018084 CPUtime=24.38 cores=0,2,4,6
/proc/8788/stat : 8788 (gnovelty+2) R 8786 8788 8788 0 -1 4202496 551 0 0 0 2438 0 0 0 25 0 1 0 749537854 1042518016 288 33554432000 134512640 135663704 4294031152 18446744073709551615 134524874 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8788/statm: 254521 288 113 282 0 254237 0
[pid=8780/tid=8787] ppid=8778 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8787/stat : 8787 (python) S 8778 8780 7922 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 2 0 749537854 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.31
Current children cumulated vsize (KiB) 1588280

[startup+51.1003 s]
/proc/loadavg: 3.01 3.03 3.00 4/451 8789
/proc/meminfo: memFree=22445348/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=290220 CPUtime=0.86 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 10116 934 1 0 75 11 0 0 19 0 2 0 749537742 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8780/statm: 72555 7428 1877 364 0 8473 0
[pid=8786] ppid=8780 vsize=279976 CPUtime=0.14 cores=0,2,4,6
/proc/8786/stat : 8786 (python) S 8780 8780 7922 0 -1 4202560 912 0 0 0 8 6 0 0 18 0 1 0 749537854 286695424 5924 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895510543 0 0 16781312 514 1831733595316650242 0 0 17 6 0 0 0
/proc/8786/statm: 69994 5924 377 364 0 5912 0
[pid=8788] ppid=8786 vsize=1018084 CPUtime=49.98 cores=0,2,4,6
/proc/8788/stat : 8788 (gnovelty+2) R 8786 8788 8788 0 -1 4202496 551 0 0 0 4998 0 0 0 25 0 1 0 749537854 1042518016 288 33554432000 134512640 135663704 4294031152 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8788/statm: 254521 288 113 282 0 254237 0
[pid=8780/tid=8787] ppid=8778 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8787/stat : 8787 (python) S 8778 8780 7922 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 2 0 749537854 297185280 7428 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.98
Current children cumulated vsize (KiB) 1588280

[startup+102.316 s]
/proc/loadavg: 3.00 3.02 3.00 4/458 8797
/proc/meminfo: memFree=22433240/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=300476 CPUtime=0.89 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 10986 934 1 0 77 12 0 0 20 0 3 0 749537742 307687424 7435 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8780/statm: 75119 7435 1880 364 0 11034 0
[pid=8786] ppid=8780 vsize=290220 CPUtime=0.31 cores=0,2,4,6
/proc/8786/stat : 8786 (python) S 8780 8780 7922 0 -1 4202560 1087 0 0 0 18 13 0 0 19 0 2 0 749537854 297185280 5962 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8786/statm: 72555 5962 410 364 0 8473 0
[pid=8788] ppid=8786 vsize=1018084 CPUtime=98.32 cores=0,2,4,6
/proc/8788/stat : 8788 (gnovelty+2) T 8786 8788 8788 0 -1 4202496 551 0 0 0 9832 0 0 0 25 0 1 0 749537854 1042518016 288 33554432000 134512640 135663704 4294031152 18446744073709551615 134524553 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8788/statm: 254521 288 113 282 0 254237 0
[pid=8786/tid=8794] ppid=8780 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/8786/task/8794/stat : 8794 (python) S 8780 8780 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749547688 297185280 5962 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604447089311872 0 0 -1 6 0 0 0
[pid=8795] ppid=8780 vsize=290232 CPUtime=0 cores=0,2,4,6
/proc/8795/stat : 8795 (python) S 8780 8780 7922 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 749547690 297197568 5899 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895510598 0 0 16781312 514 9170090257423499524 0 0 17 2 0 0 0
/proc/8795/statm: 72558 5899 348 364 0 8473 0
[pid=8797] ppid=8795 vsize=1018084 CPUtime=2.82 cores=0,2,4,6
/proc/8797/stat : 8797 (gnovelty+2) R 8795 8797 8797 0 -1 4202496 549 0 0 0 282 0 0 0 25 0 1 0 749547691 1042518016 286 33554432000 134512640 135663704 4287270928 18446744073709551615 134524551 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8797/statm: 254521 286 113 282 0 254237 0
[pid=8780/tid=8787] ppid=8778 vsize=300476 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8787/stat : 8787 (python) S 8778 8780 7922 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 3 0 749537854 307687424 7435 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 2 0 0 0
[pid=8780/tid=8796] ppid=8778 vsize=300476 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8796/stat : 8796 (python) S 8778 8780 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 3 0 749547691 307687424 7435 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 102.34
Current children cumulated vsize (KiB) 2917096

[startup+162.3 s]
/proc/loadavg: 3.00 3.02 3.00 4/458 8799
/proc/meminfo: memFree=22430836/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=300476 CPUtime=0.89 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 10986 934 1 0 77 12 0 0 20 0 3 0 749537742 307687424 7435 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8780/statm: 75119 7435 1880 364 0 11034 0
[pid=8786] ppid=8780 vsize=290220 CPUtime=0.31 cores=0,2,4,6
/proc/8786/stat : 8786 (python) S 8780 8780 7922 0 -1 4202560 1087 0 0 0 18 13 0 0 19 0 2 0 749537854 297185280 5962 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8786/statm: 72555 5962 410 364 0 8473 0
[pid=8788] ppid=8786 vsize=1018084 CPUtime=98.32 cores=0,2,4,6
/proc/8788/stat : 8788 (gnovelty+2) T 8786 8788 8788 0 -1 4202496 551 0 0 0 9832 0 0 0 25 0 1 0 749537854 1042518016 288 33554432000 134512640 135663704 4294031152 18446744073709551615 134524553 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8788/statm: 254521 288 113 282 0 254237 0
[pid=8786/tid=8794] ppid=8780 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/8786/task/8794/stat : 8794 (python) S 8780 8780 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749547688 297185280 5962 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604447089311872 0 0 -1 6 0 0 0
[pid=8795] ppid=8780 vsize=290232 CPUtime=0.18 cores=0,2,4,6

################
# More data... #
################


Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4983.8 s]
/proc/loadavg: 2.04 2.03 2.20 3/482 9603
/proc/meminfo: memFree=22002240/32950928 swapFree=60044328/67111528
[pid=8780] ppid=8778 vsize=423548 CPUtime=1.54 cores=0,2,4,6
/proc/8780/stat : 8780 (python) S 8778 8780 7922 0 -1 4202496 23467 934 1 0 140 14 0 0 18 0 15 0 749537742 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/8780/statm: 105887 7527 1904 364 0 41766 0
[pid=8786] ppid=8780 vsize=290220 CPUtime=0.31 cores=0,2,4,6
/proc/8786/stat : 8786 (python) S 8780 8780 7922 0 -1 4202560 1087 0 0 0 18 13 0 0 19 0 2 0 749537854 297185280 5962 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8786/statm: 72555 5962 410 364 0 8473 0
[pid=8788] ppid=8786 vsize=1018084 CPUtime=98.32 cores=0,2,4,6
/proc/8788/stat : 8788 (gnovelty+2) T 8786 8788 8788 0 -1 4202496 551 0 0 0 9832 0 0 0 25 0 1 0 749537854 1042518016 288 33554432000 134512640 135663704 4294031152 18446744073709551615 134524553 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8788/statm: 254521 288 113 282 0 254237 0
[pid=8786/tid=8794] ppid=8780 vsize=290220 CPUtime=0 cores=0,2,4,6
/proc/8786/task/8794/stat : 8794 (python) S 8780 8780 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749547688 297185280 5962 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604447089311872 0 0 -1 6 0 0 0
[pid=8795] ppid=8780 vsize=290232 CPUtime=0.32 cores=0,2,4,6
/proc/8795/stat : 8795 (python) S 8780 8780 7922 0 -1 4202560 1090 0 0 0 17 15 0 0 19 0 2 0 749547690 297197568 5952 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8795/statm: 72558 5952 400 364 0 8473 0
[pid=8797] ppid=8795 vsize=1018084 CPUtime=100.33 cores=0,2,4,6
/proc/8797/stat : 8797 (gnovelty+2) T 8795 8797 8797 0 -1 4202496 549 0 0 0 10033 0 0 0 25 0 1 0 749547691 1042518016 286 33554432000 134512640 135663704 4287270928 18446744073709551615 134545631 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8797/statm: 254521 286 113 282 0 254237 0
[pid=8795/tid=8801] ppid=8780 vsize=290232 CPUtime=0 cores=0,2,4,6
/proc/8795/task/8801/stat : 8801 (python) S 8780 8780 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749557724 297197568 5952 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604446457836672 0 0 -1 6 0 0 0
[pid=8802] ppid=8780 vsize=300488 CPUtime=0.31 cores=0,2,4,6
/proc/8802/stat : 8802 (python) S 8780 8780 7922 0 -1 4202560 1091 0 0 0 18 13 0 0 19 0 2 0 749557727 307699712 5956 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8802/statm: 75122 5956 400 364 0 11034 0
[pid=8804] ppid=8802 vsize=417056 CPUtime=99.31 cores=0,2,4,6
/proc/8804/stat : 8804 (adaptg2wsat2009) T 8802 8804 8804 0 -1 4202496 716 0 0 0 9931 0 0 0 25 0 1 0 749557727 427065344 449 33554432000 134512640 135107411 4289268624 18446744073709551615 134531731 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8804/statm: 104264 449 59 146 0 103140 0
[pid=8802/tid=8808] ppid=8780 vsize=300488 CPUtime=0 cores=0,2,4,6
/proc/8802/task/8808/stat : 8808 (python) S 8780 8780 7922 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749567659 307699712 5956 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604442958803392 0 0 -1 4 0 0 0
[pid=8809] ppid=8780 vsize=310744 CPUtime=0.32 cores=0,2,4,6
/proc/8809/stat : 8809 (python) S 8780 8780 7922 0 -1 4202560 1119 0 0 0 18 14 0 0 19 0 2 0 749567662 318201856 5960 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8809/statm: 77686 5960 400 364 0 13595 0
[pid=8811] ppid=8809 vsize=417056 CPUtime=99.29 cores=0,2,4,6
/proc/8811/stat : 8811 (adaptg2wsat2009) T 8809 8811 8811 0 -1 4202496 715 0 0 0 9929 0 0 0 25 0 1 0 749567662 427065344 451 33554432000 134512640 135107411 4291872576 18446744073709551615 134532376 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/8811/statm: 104264 451 59 146 0 103140 0
[pid=8809/tid=8814] ppid=8780 vsize=310744 CPUtime=0 cores=0,2,4,6
/proc/8809/task/8814/stat : 8814 (python) S 8780 8780 7922 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749577595 318201856 5960 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604452398618752 0 0 -1 6 0 0 0
[pid=8815] ppid=8780 vsize=321000 CPUtime=0.32 cores=0,2,4,6
/proc/8815/stat : 8815 (python) S 8780 8780 7922 0 -1 4202560 1114 0 0 0 18 14 0 0 19 0 2 0 749577598 328704000 5964 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8815/statm: 80250 5964 400 364 0 16156 0
[pid=8817] ppid=8815 vsize=417056 CPUtime=100.29 cores=0,2,4,6
/proc/8817/stat : 8817 (adaptg2wsat2009) T 8815 8817 8817 0 -1 4202496 719 0 0 0 10029 0 0 0 25 0 1 0 749577599 427065344 450 33554432000 134512640 135107411 4287732592 18446744073709551615 134532277 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8817/statm: 104264 450 59 146 0 103140 0
[pid=8815/tid=8821] ppid=8780 vsize=321000 CPUtime=0 cores=0,2,4,6
/proc/8815/task/8821/stat : 8821 (python) S 8780 8780 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749587630 328704000 5964 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604448523412416 0 0 -1 6 0 0 0
[pid=8822] ppid=8780 vsize=331256 CPUtime=0.32 cores=0,2,4,6
/proc/8822/stat : 8822 (python) S 8780 8780 7922 0 -1 4202560 1115 0 0 0 19 13 0 0 19 0 2 0 749587634 339206144 5968 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8822/statm: 82814 5968 400 364 0 18717 0
[pid=8824] ppid=8822 vsize=1018084 CPUtime=100.32 cores=0,2,4,6
/proc/8824/stat : 8824 (gnovelty+2) T 8822 8824 8824 0 -1 4202496 552 0 0 0 10032 0 0 0 25 0 1 0 749587634 1042518016 286 33554432000 134512640 135663704 4289314272 18446744073709551615 134524894 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8824/statm: 254521 286 113 282 0 254237 0
[pid=8822/tid=8828] ppid=8780 vsize=331256 CPUtime=0 cores=0,2,4,6
/proc/8822/task/8828/stat : 8828 (python) S 8780 8780 7922 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749597667 339206144 5968 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604440957051328 0 0 -1 6 0 0 0
[pid=8829] ppid=8780 vsize=341512 CPUtime=0.32 cores=0,2,4,6
/proc/8829/stat : 8829 (python) S 8780 8780 7922 0 -1 4202560 1167 0 0 0 19 13 0 0 19 0 2 0 749597670 349708288 5978 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8829/statm: 85378 5978 406 364 0 21278 0
[pid=8831] ppid=8829 vsize=247236 CPUtime=100.21 cores=0,2,4,6
/proc/8831/stat : 8831 (FH) T 8829 8831 8831 0 -1 4202496 671 0 0 0 10021 0 0 0 25 0 1 0 749597671 253169664 405 33554432000 134512640 134936988 4294695424 18446744073709551615 134553267 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8831/statm: 61809 405 41 104 0 61313 0
[pid=8829/tid=8835] ppid=8780 vsize=341512 CPUtime=0 cores=0,2,4,6
/proc/8829/task/8835/stat : 8835 (python) S 8780 8780 7922 0 -1 4202560 94 0 0 0 0 0 0 0 19 0 2 0 749607701 349708288 5978 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604449069672256 0 0 -1 6 0 0 0
[pid=8836] ppid=8780 vsize=351768 CPUtime=0.33 cores=0,2,4,6
/proc/8836/stat : 8836 (python) S 8780 8780 7922 0 -1 4202560 1160 0 0 0 18 15 0 0 19 0 2 0 749607705 360210432 5982 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8836/statm: 87942 5982 406 364 0 23839 0
[pid=8838] ppid=8836 vsize=417056 CPUtime=99.35 cores=0,2,4,6
/proc/8838/stat : 8838 (adaptg2wsat2009) T 8836 8838 8838 0 -1 4202496 722 0 0 0 9935 0 0 0 25 0 1 0 749607705 427065344 449 33554432000 134512640 135107411 4293208368 18446744073709551615 134532128 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8838/statm: 104264 449 59 146 0 103140 0
[pid=8836/tid=8842] ppid=8780 vsize=351768 CPUtime=0 cores=0,2,4,6
/proc/8836/task/8842/stat : 8842 (python) S 8780 8780 7922 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 749617640 360210432 5982 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604453749196928 0 0 -1 6 0 0 0
[pid=8843] ppid=8780 vsize=362024 CPUtime=0.33 cores=0,2,4,6
/proc/8843/stat : 8843 (python) S 8780 8780 7922 0 -1 4202560 1136 0 0 0 18 15 0 0 19 0 2 0 749617644 370712576 5980 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8843/statm: 90506 5980 400 364 0 26400 0
[pid=8845] ppid=8843 vsize=417056 CPUtime=99.35 cores=0,2,4,6
/proc/8845/stat : 8845 (adaptg2wsat2009) T 8843 8845 8845 0 -1 4202496 725 0 0 0 9935 0 0 0 25 0 1 0 749617644 427065344 450 33554432000 134512640 135107411 4290979584 18446744073709551615 134532291 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8845/statm: 104264 450 59 146 0 103140 0
[pid=8843/tid=8852] ppid=8780 vsize=362024 CPUtime=0 cores=0,2,4,6
/proc/8843/task/8852/stat : 8852 (python) S 8780 8780 7922 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 749627580 370712576 5980 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604444657018752 0 0 -1 6 0 0 0
[pid=8853] ppid=8780 vsize=372280 CPUtime=0.65 cores=0,2,4,6
/proc/8853/stat : 8853 (python) S 8780 8780 7922 0 -1 4202560 1137 0 0 0 36 29 0 0 19 0 2 0 749627583 381214720 5984 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8853/statm: 93070 5984 400 364 0 28961 0
[pid=8855] ppid=8853 vsize=268424 CPUtime=194.63 cores=0,2,4,6
/proc/8855/stat : 8855 (hybridGM3) T 8853 8855 8855 0 -1 4202496 4919 0 0 0 19463 0 0 0 25 0 1 0 749627584 274866176 4649 33554432000 134512640 135204385 4290583840 18446744073709551615 134536999 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8855/statm: 67106 4649 64 169 0 66936 0
[pid=8853/tid=8870] ppid=8780 vsize=372280 CPUtime=0 cores=0,2,4,6
/proc/8853/task/8870/stat : 8870 (python) S 8780 8780 7922 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 749647054 381214720 5984 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604453906826240 0 0 -1 6 0 0 0
[pid=8871] ppid=8780 vsize=382536 CPUtime=0.33 cores=0,2,4,6
/proc/8871/stat : 8871 (python) S 8780 8780 7922 0 -1 4202560 1134 0 0 0 18 15 0 0 19 0 2 0 749647057 391716864 5988 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8871/statm: 95634 5988 400 364 0 31522 0
[pid=8873] ppid=8871 vsize=247236 CPUtime=99.33 cores=0,2,4,6
/proc/8873/stat : 8873 (FH) T 8871 8873 8873 0 -1 4202496 675 0 0 0 9933 0 0 0 25 0 1 0 749647058 253169664 406 33554432000 134512640 134936988 4288281840 18446744073709551615 134553480 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8873/statm: 61809 406 41 104 0 61313 0
[pid=8871/tid=8877] ppid=8780 vsize=382536 CPUtime=0 cores=0,2,4,6
/proc/8871/task/8877/stat : 8877 (python) S 8780 8780 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749656992 391716864 5988 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604445921304896 0 0 -1 6 0 0 0
[pid=8878] ppid=8780 vsize=392792 CPUtime=10.15 cores=0,2,4,6
/proc/8878/stat : 8878 (python) S 8780 8780 7922 0 -1 4202560 1186 0 0 0 568 447 0 0 15 0 2 0 749656995 402219008 5992 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8878/statm: 98198 5992 400 364 0 34083 0
[pid=8880] ppid=8878 vsize=309712 CPUtime=2913.76 cores=0,2,4,6
/proc/8880/stat : 8880 (march_hi) T 8878 8880 8880 0 -1 4202496 72228 0 0 0 291361 15 0 0 25 0 1 0 749656996 317145088 71132 33554432000 4194304 4955518 140735213351536 18446744073709551615 4297472 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8880/statm: 77428 71132 106 186 0 77241 0
[pid=8878/tid=8899] ppid=8780 vsize=392792 CPUtime=0 cores=0,2,4,6
/proc/8878/task/8899/stat : 8899 (python) S 8780 8780 7922 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 749705557 402219008 5992 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604447995599680 0 0 -1 4 0 0 0
[pid=8912] ppid=8780 vsize=403048 CPUtime=0.33 cores=0,2,4,6
/proc/8912/stat : 8912 (python) S 8780 8780 7922 0 -1 4202560 1136 0 0 0 18 15 0 0 19 0 2 0 749754203 412721152 6011 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8912/statm: 100762 6011 400 364 0 36644 0
[pid=8914] ppid=8912 vsize=1018084 CPUtime=99.32 cores=0,2,4,6
/proc/8914/stat : 8914 (gnovelty+2) T 8912 8914 8914 0 -1 4202496 556 0 0 0 9931 1 0 0 25 0 1 0 749754203 1042518016 288 33554432000 134512640 135663704 4291987056 18446744073709551615 134524534 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8914/statm: 254521 288 113 282 0 254237 0
[pid=8912/tid=8953] ppid=8780 vsize=403048 CPUtime=0 cores=0,2,4,6
/proc/8912/task/8953/stat : 8953 (python) S 8780 8780 7922 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749764138 412721152 6011 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604441896240384 0 0 -1 6 0 0 0
[pid=8954] ppid=8780 vsize=413304 CPUtime=2.69 cores=0,2,4,6
/proc/8954/stat : 8954 (python) S 8780 8780 7922 0 -1 4202560 1183 0 0 0 151 118 0 0 15 0 2 0 749764141 423223296 6015 33554432000 4194304 5683644 140737348710016 18446744073709551615 231895510598 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8954/statm: 103326 6015 400 364 0 39205 0
[pid=8956] ppid=8954 vsize=93560 CPUtime=777.68 cores=0,2,4,6
/proc/8956/stat : 8956 (march_hi) R 8954 8956 8956 0 -1 4202496 21564 0 0 0 77764 4 0 0 25 0 1 0 749764141 95805440 20474 33554432000 4194304 4955518 140736459014816 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8956/statm: 23390 20474 106 186 0 23203 0
[pid=8954/tid=9019] ppid=8780 vsize=413304 CPUtime=0 cores=0,2,4,6
/proc/8954/task/9019/stat : 9019 (python) S 8780 8780 7922 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 749803508 423223296 6015 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 514 18446604445921305792 0 0 -1 6 0 0 0
[pid=8780/tid=8787] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8787/stat : 8787 (python) S 8778 8780 7922 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 15 0 749537854 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 2 0 0 0
[pid=8780/tid=8796] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8796/stat : 8796 (python) S 8778 8780 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 15 0 749547691 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 2 0 0 0
[pid=8780/tid=8803] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8803/stat : 8803 (python) S 8778 8780 7922 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 15 0 749557727 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 6 0 0 0
[pid=8780/tid=8810] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8810/stat : 8810 (python) S 8778 8780 7922 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 15 0 749567662 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8816] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8816/stat : 8816 (python) S 8778 8780 7922 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 15 0 749577598 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8823] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8823/stat : 8823 (python) S 8778 8780 7922 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 15 0 749587634 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8830] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8830/stat : 8830 (python) S 8778 8780 7922 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 15 0 749597670 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8837] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8837/stat : 8837 (python) S 8778 8780 7922 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 15 0 749607705 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8844] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8844/stat : 8844 (python) S 8778 8780 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 15 0 749617644 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8854] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8854/stat : 8854 (python) S 8778 8780 7922 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 15 0 749627584 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8872] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8872/stat : 8872 (python) S 8778 8780 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 15 0 749647058 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8879] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8879/stat : 8879 (python) S 8778 8780 7922 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 15 0 749656995 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8913] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8913/stat : 8913 (python) S 8778 8780 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 15 0 749754203 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
[pid=8780/tid=8955] ppid=8778 vsize=423548 CPUtime=0 cores=0,2,4,6
/proc/8780/task/8955/stat : 8955 (python) S 8778 8780 7922 0 -1 4202560 25 934 0 0 0 0 0 0 18 0 15 0 749764141 433713152 7527 33554432000 4194304 5683644 140737348710016 18446744073709551615 231907314097 0 0 16781312 2 18446604448310066176 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5000.06
Current children cumulated vsize (KiB) 12610536

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8780 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=412785
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=148977
# CPU time returned by wait4() is 1.56176
# while last known CPU time is 5000.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4983.9
CPU time (s): 5000.06
CPU user time (s): 4992.23
CPU system time (s): 7.83
CPU usage (%): 100.324
Max. virtual memory (cumulated for all children) (KiB): 12610540

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.41278
system time used= 0.148977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 24412
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2932
involuntary context switches= 45

runsolver used 36.4285 second user time and 74.9416 second system time

The end

Launcher Data 

Begin job on node114 at 2011-05-17 02:44:30
IDJOB=3386810
IDBENCH=82875
IDSOLVER=1872
FILE ID=node114/3386810-1305593070
RUNJOBID= node114-1305586148-7940
PBS_JOBID= 13350364
Free space on /tmp= 72884 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v80-c7120-S199880667-010.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386810-1305593070/watcher-3386810-1305593070 -o /tmp/evaluation-result-3386810-1305593070/solver-3386810-1305593070 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386810-1305593070.cnf -seed 647316550 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3919f50518b71f2cf8a267b92efd9aeb
RANDOM SEED=647316550

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      22481900 kB
Buffers:         87648 kB
Cached:         597940 kB
SwapCached:      48552 kB
Active:        2002384 kB
Inactive:      8253820 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      22481900 kB
SwapTotal:    67111528 kB
SwapFree:     60044328 kB
Dirty:           31868 kB
Writeback:           0 kB
AnonPages:     9528320 kB
Mapped:          31960 kB
Slab:            81744 kB
PageTables:      64232 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 101355612 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73236 MiB
End job on node114 at 2011-05-17 04:07:37