Trace number 3386667

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (TO) 5000.09 4982.02

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v80-c7120-S1901567697-013.UNKNOWN.cnf
MD5SUM6416f44b34786f590ff716f4b8e2cf7c
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables80
Number of clauses7120
Sum of the clauses size49840
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 57120

Solver Data 

0.35/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.68	c INFO: solving HOME/instance-3386667-1305590188.cnf
0.35/0.68	c INFO: computing task features
0.44/0.73	c INFO: computed variable-clause graph statistics
0.44/0.73	c INFO: computed clause balance statistics
0.64/0.98	c INFO: computed variable balance statistics
0.75/1.09	c INFO: computed small-clause counts
0.75/1.09	c INFO: computed Horn-clause counts
0.75/1.09	c INFO: computed variable graph statistics
0.75/1.09	c INFO: collected features for HOME/instance-3386667-1305590188.cnf in 0.41 s
0.85/1.12	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.49)
101.43/101.49	c INFO: running gnovelty+2@0 for 97 with 4899 remaining (b = 0.10)
201.15/200.88	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.06)
300.89/300.27	c INFO: running adaptg2wsat2009++@0 for 97 with 4700 remaining (b = 0.04)
401.63/400.65	c INFO: running adaptg2wsat2009++@0 for 97 with 4600 remaining (b = 0.03)
502.39/501.03	c INFO: running gnovelty+2@0 for 97 with 4499 remaining (b = 0.03)
603.13/601.43	c INFO: running FH@0 for 97 with 4399 remaining (b = 0.02)
702.88/700.84	c INFO: running adaptg2wsat2009++@0 for 97 with 4300 remaining (b = 0.02)
803.52/801.22	c INFO: running adaptg2wsat2009++@0 for 97 with 4199 remaining (b = 0.01)
904.26/901.62	c INFO: running hybridGM3@0 for 194 with 4099 remaining (b = 0.03)
1101.71/1098.47	c INFO: running FH@0 for 97 with 3902 remaining (b = 0.01)
1200.49/1196.89	c INFO: running march_hi@0 for 485 with 3804 remaining (b = 0.06)
1690.09/1684.52	c INFO: running march_hi@487 for 194 with 3316 remaining (b = 0.04)
1883.11/1876.83	c INFO: running march_hi@679 for 97 with 3124 remaining (b = 0.01)
1980.88/1974.26	c INFO: running march_hi@777 for 194 with 3026 remaining (b = 0.02)
2176.13/2168.77	c INFO: running march_hi@0 for 388 with 2832 remaining (b = 0.05)
2565.78/2556.99	c INFO: running march_hi@388 for 97 with 2444 remaining (b = 0.02)
2668.48/2659.29	c INFO: running march_hi@490 for 194 with 2341 remaining (b = 0.03)
2861.00/2851.11	c INFO: running hybridGM3@0 for 194 with 2150 remaining (b = 0.02)
3061.02/3050.26	c INFO: running march_hi@971 for 388 with 1951 remaining (b = 0.04)
3450.07/3437.88	c INFO: running march_hi@1359 for 776 with 1563 remaining (b = 0.10)
4232.40/4217.26	c INFO: running march_hi@2138 for 97 with 784 remaining (b = 0.02)
4326.18/4310.63	c INFO: running march_hi@2232 for 582 with 690 remaining (b = 0.07)
4915.44/4897.61	c INFO: running march_hi@2818 for 103 with 103 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386667-1305590188/watcher-3386667-1305590188 -o /tmp/evaluation-result-3386667-1305590188/solver-3386667-1305590188 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386667-1305590188.cnf -seed 1813626938 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.07 3.06 3.01 3/471 6774
/proc/meminfo: memFree=18455684/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=15780 CPUtime=0 cores=1,3,5,7
/proc/6774/stat : 6774 (python) R 6772 6774 6320 0 -1 4202496 903 0 0 0 0 0 0 0 17 0 1 0 670618465 16158720 784 33554432000 4194304 5683644 140733623899840 18446744073709551615 210647142245 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/6774/statm: 3945 784 346 364 0 432 0

[startup+0.074349 s]
/proc/loadavg: 3.07 3.06 3.01 3/471 6774
/proc/meminfo: memFree=18455684/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=36840 CPUtime=0.04 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 1622 0 0 0 3 1 0 0 17 0 1 0 670618465 37724160 1452 33554432000 4194304 5683644 140733623899840 18446744073709551615 210642222727 0 2147483391 16781312 2 18446744071699109054 0 0 17 5 0 0 0
/proc/6774/statm: 9210 1452 452 364 0 1027 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 36840

[startup+0.100318 s]
/proc/loadavg: 3.07 3.06 3.01 3/471 6774
/proc/meminfo: memFree=18455684/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=85628 CPUtime=0.06 cores=1,3,5,7
/proc/6774/stat : 6774 (python) R 6772 6774 6320 0 -1 4202496 2629 0 0 0 4 2 0 0 17 0 1 0 670618465 87683072 2349 33554432000 4194304 5683644 140733623899840 18446744073709551615 210646777932 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/6774/statm: 21407 2349 713 364 0 1624 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85628

[startup+0.300336 s]
/proc/loadavg: 3.07 3.06 3.01 3/471 6774
/proc/meminfo: memFree=18455684/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=135752 CPUtime=0.19 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 5976 931 1 0 13 6 0 0 17 0 1 0 670618465 139010048 4149 33554432000 4194304 5683644 140733623899840 18446744073709551615 210647142405 0 2147483391 16781312 2 18446744071699109054 0 0 17 5 0 0 0
/proc/6774/statm: 33938 4149 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.700247 s]
/proc/loadavg: 3.07 3.06 3.01 3/471 6774
/proc/meminfo: memFree=18455684/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=278632 CPUtime=0.44 cores=1,3,5,7
/proc/6774/stat : 6774 (python) R 6772 6774 6320 0 -1 4202496 9333 931 1 0 31 13 0 0 15 0 1 0 670618465 285319168 7000 33554432000 4194304 5683644 140733623899840 18446744073709551615 210646812184 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/6774/statm: 69658 7000 1761 364 0 5582 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 278632

[startup+1.50105 s]
/proc/loadavg: 3.07 3.06 3.01 4/472 6779
/proc/meminfo: memFree=18431240/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=290220 CPUtime=0.86 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 10121 931 1 0 73 13 0 0 17 0 2 0 670618465 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6774/statm: 72555 7427 1877 364 0 8473 0
Current children cumulated CPU time (s) 0.86
Current children cumulated vsize (KiB) 290220

[startup+3.10081 s]
/proc/loadavg: 3.07 3.06 3.01 4/475 6782
/proc/meminfo: memFree=18427372/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=290220 CPUtime=0.86 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 10121 931 1 0 73 13 0 0 17 0 2 0 670618465 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6774/statm: 72555 7427 1877 364 0 8473 0
[pid=6780] ppid=6774 vsize=279976 CPUtime=0 cores=1,3,5,7
/proc/6780/stat : 6780 (python) S 6774 6774 6320 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 670618578 286695424 5900 33554432000 4194304 5683644 140733623899840 18446744073709551615 210647166479 0 0 16781312 514 8401977206695231749 0 0 17 5 0 0 0
/proc/6780/statm: 69994 5900 354 364 0 5912 0
[pid=6782] ppid=6780 vsize=1018084 CPUtime=1.96 cores=1,3,5,7
/proc/6782/stat : 6782 (gnovelty+2) R 6780 6782 6782 0 -1 4202496 551 0 0 0 196 0 0 0 25 0 1 0 670618578 1042518016 287 33554432000 134512640 135663704 4292687152 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6782/statm: 254521 287 113 282 0 254237 0
[pid=6774/tid=6781] ppid=6772 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6781/stat : 6781 (python) S 6772 6774 6320 0 -1 4202560 31 931 0 0 0 0 0 0 18 0 2 0 670618578 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 1588280

[startup+6.30028 s]
/proc/loadavg: 3.06 3.06 3.01 4/475 6782
/proc/meminfo: memFree=18426044/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=290220 CPUtime=0.86 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 10121 931 1 0 73 13 0 0 17 0 2 0 670618465 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6774/statm: 72555 7427 1877 364 0 8473 0
[pid=6780] ppid=6774 vsize=279976 CPUtime=0.02 cores=1,3,5,7
/proc/6780/stat : 6780 (python) S 6774 6774 6320 0 -1 4202560 892 0 0 0 1 1 0 0 18 0 1 0 670618578 286695424 5923 33554432000 4194304 5683644 140733623899840 18446744073709551615 210647166479 0 0 16781312 514 8401977206695231749 0 0 17 7 0 0 0
/proc/6780/statm: 69994 5923 377 364 0 5912 0
[pid=6782] ppid=6780 vsize=1018084 CPUtime=5.16 cores=1,3,5,7
/proc/6782/stat : 6782 (gnovelty+2) R 6780 6782 6782 0 -1 4202496 551 0 0 0 516 0 0 0 25 0 1 0 670618578 1042518016 287 33554432000 134512640 135663704 4292687152 18446744073709551615 134525688 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6782/statm: 254521 287 113 282 0 254237 0
[pid=6774/tid=6781] ppid=6772 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6781/stat : 6781 (python) S 6772 6774 6320 0 -1 4202560 31 931 0 0 0 0 0 0 18 0 2 0 670618578 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.04
Current children cumulated vsize (KiB) 1588280

[startup+12.7002 s]
/proc/loadavg: 3.22 3.09 3.02 4/479 6787
/proc/meminfo: memFree=18419288/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=290220 CPUtime=0.86 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 10121 931 1 0 73 13 0 0 17 0 2 0 670618465 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6774/statm: 72555 7427 1877 364 0 8473 0
[pid=6780] ppid=6774 vsize=279976 CPUtime=0.03 cores=1,3,5,7
/proc/6780/stat : 6780 (python) S 6774 6774 6320 0 -1 4202560 895 0 0 0 2 1 0 0 18 0 1 0 670618578 286695424 5923 33554432000 4194304 5683644 140733623899840 18446744073709551615 210647166479 0 0 16781312 514 4408461085242261765 0 0 17 7 0 0 0
/proc/6780/statm: 69994 5923 377 364 0 5912 0
[pid=6782] ppid=6780 vsize=1018084 CPUtime=11.56 cores=1,3,5,7
/proc/6782/stat : 6782 (gnovelty+2) R 6780 6782 6782 0 -1 4202496 551 0 0 0 1156 0 0 0 25 0 1 0 670618578 1042518016 287 33554432000 134512640 135663704 4292687152 18446744073709551615 134525323 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6782/statm: 254521 287 113 282 0 254237 0
[pid=6774/tid=6781] ppid=6772 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6781/stat : 6781 (python) S 6772 6774 6320 0 -1 4202560 31 931 0 0 0 0 0 0 18 0 2 0 670618578 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.45
Current children cumulated vsize (KiB) 1588280

[startup+25.5011 s]
/proc/loadavg: 3.17 3.08 3.02 4/479 6787
/proc/meminfo: memFree=18420680/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=290220 CPUtime=0.86 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 10121 931 1 0 73 13 0 0 17 0 2 0 670618465 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6774/statm: 72555 7427 1877 364 0 8473 0
[pid=6780] ppid=6774 vsize=279976 CPUtime=0.08 cores=1,3,5,7
/proc/6780/stat : 6780 (python) S 6774 6774 6320 0 -1 4202560 900 0 0 0 5 3 0 0 18 0 1 0 670618578 286695424 5923 33554432000 4194304 5683644 140733623899840 18446744073709551615 210647166479 0 0 16781312 514 4408461085242261765 0 0 17 7 0 0 0
/proc/6780/statm: 69994 5923 377 364 0 5912 0
[pid=6782] ppid=6780 vsize=1018084 CPUtime=24.36 cores=1,3,5,7
/proc/6782/stat : 6782 (gnovelty+2) R 6780 6782 6782 0 -1 4202496 551 0 0 0 2436 0 0 0 25 0 1 0 670618578 1042518016 287 33554432000 134512640 135663704 4292687152 18446744073709551615 134524919 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6782/statm: 254521 287 113 282 0 254237 0
[pid=6774/tid=6781] ppid=6772 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6781/stat : 6781 (python) S 6772 6774 6320 0 -1 4202560 31 931 0 0 0 0 0 0 18 0 2 0 670618578 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.3
Current children cumulated vsize (KiB) 1588280

[startup+51.1008 s]
/proc/loadavg: 3.11 3.08 3.01 4/479 6787
/proc/meminfo: memFree=18420424/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=290220 CPUtime=0.86 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 10121 931 1 0 73 13 0 0 17 0 2 0 670618465 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6774/statm: 72555 7427 1877 364 0 8473 0
[pid=6780] ppid=6774 vsize=279976 CPUtime=0.15 cores=1,3,5,7
/proc/6780/stat : 6780 (python) S 6774 6774 6320 0 -1 4202560 909 0 0 0 8 7 0 0 18 0 1 0 670618578 286695424 5923 33554432000 4194304 5683644 140733623899840 18446744073709551615 210647166479 0 0 16781312 514 4408461085242261765 0 0 17 7 0 0 0
/proc/6780/statm: 69994 5923 377 364 0 5912 0
[pid=6782] ppid=6780 vsize=1018084 CPUtime=49.95 cores=1,3,5,7
/proc/6782/stat : 6782 (gnovelty+2) R 6780 6782 6782 0 -1 4202496 551 0 0 0 4995 0 0 0 25 0 1 0 670618578 1042518016 287 33554432000 134512640 135663704 4292687152 18446744073709551615 134525309 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6782/statm: 254521 287 113 282 0 254237 0
[pid=6774/tid=6781] ppid=6772 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6781/stat : 6781 (python) S 6772 6774 6320 0 -1 4202560 31 931 0 0 0 0 0 0 18 0 2 0 670618578 297185280 7427 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 1588280

[startup+102.318 s]
/proc/loadavg: 3.10 3.08 3.01 4/483 6793
/proc/meminfo: memFree=18416052/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=300476 CPUtime=0.89 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 11002 931 1 0 76 13 0 0 19 0 3 0 670618465 307687424 7434 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6774/statm: 75119 7434 1880 364 0 11034 0
[pid=6780] ppid=6774 vsize=290220 CPUtime=0.33 cores=1,3,5,7
/proc/6780/stat : 6780 (python) S 6774 6774 6320 0 -1 4202560 1083 0 0 0 16 17 0 0 19 0 2 0 670618578 297185280 5961 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6780/statm: 72555 5961 410 364 0 8473 0
[pid=6782] ppid=6780 vsize=1018084 CPUtime=100.32 cores=1,3,5,7
/proc/6782/stat : 6782 (gnovelty+2) T 6780 6782 6782 0 -1 4202496 551 0 0 0 10032 0 0 0 25 0 1 0 670618578 1042518016 287 33554432000 134512640 135663704 4292687152 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6782/statm: 254521 287 113 282 0 254237 0
[pid=6780/tid=6790] ppid=6774 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/6780/task/6790/stat : 6790 (python) S 6774 6774 6320 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670628612 297185280 5961 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604463458865600 0 0 -1 7 0 0 0
[pid=6791] ppid=6774 vsize=290232 CPUtime=0 cores=1,3,5,7
/proc/6791/stat : 6791 (python) S 6774 6774 6320 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 670628615 297197568 5898 33554432000 4194304 5683644 140733623899840 18446744073709551615 210647166534 0 0 16781312 514 17975250677147893759 0 0 17 5 0 0 0
/proc/6791/statm: 72558 5898 348 364 0 8473 0
[pid=6793] ppid=6791 vsize=1018084 CPUtime=0.81 cores=1,3,5,7
/proc/6793/stat : 6793 (gnovelty+2) R 6791 6793 6793 0 -1 4202496 552 0 0 0 81 0 0 0 21 0 1 0 670628616 1042518016 288 33554432000 134512640 135663704 4291454480 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6793/statm: 254521 288 113 282 0 254237 0
[pid=6774/tid=6781] ppid=6772 vsize=300476 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6781/stat : 6781 (python) S 6772 6774 6320 0 -1 4202560 31 931 0 0 0 0 0 0 18 0 3 0 670618578 307687424 7434 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
[pid=6774/tid=6792] ppid=6772 vsize=300476 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6792/stat : 6792 (python) S 6772 6774 6320 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 3 0 670628615 307687424 7434 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.35
Current children cumulated vsize (KiB) 2917096

[startup+162.301 s]
/proc/loadavg: 3.12 3.09 3.02 4/487 6799
/proc/meminfo: memFree=18402484/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=300476 CPUtime=0.89 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 11002 931 1 0 76 13 0 0 19 0 3 0 670618465 307687424 7434 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6774/statm: 75119 7434 1880 364 0 11034 0
[pid=6780] ppid=6774 vsize=290220 CPUtime=0.33 cores=1,3,5,7
/proc/6780/stat : 6780 (python) S 6774 6774 6320 0 -1 4202560 1083 0 0 0 16 17 0 0 19 0 2 0 670618578 297185280 5961 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6780/statm: 72555 5961 410 364 0 8473 0
[pid=6782] ppid=6780 vsize=1018084 CPUtime=100.32 cores=1,3,5,7
/proc/6782/stat : 6782 (gnovelty+2) T 6780 6782 6782 0 -1 4202496 551 0 0 0 10032 0 0 0 25 0 1 0 670618578 1042518016 287 33554432000 134512640 135663704 4292687152 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6782/statm: 254521 287 113 282 0 254237 0
[pid=6780/tid=6790] ppid=6774 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/6780/task/6790/stat : 6790 (python) S 6774 6774 6320 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670628612 297185280 5961 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604463458865600 0 0 -1 7 0 0 0
[pid=6791] ppid=6774 vsize=290232 CPUtime=0.19 cores=1,3,5,7

################
# More data... #
################

Current children cumulated CPU time (s) 5000.09
Current children cumulated vsize (KiB) 11860748

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4981.92 s]
/proc/loadavg: 3.27 3.13 3.04 4/565 7218
/proc/meminfo: memFree=17666812/32951132 swapFree=64496000/67111528
[pid=6774] ppid=6772 vsize=423960 CPUtime=1.5 cores=1,3,5,7
/proc/6774/stat : 6774 (python) S 6772 6774 6320 0 -1 4202496 23605 931 1 0 134 16 0 0 18 0 15 0 670618465 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6774/statm: 105990 7609 1904 364 0 41869 0
[pid=6780] ppid=6774 vsize=290220 CPUtime=0.33 cores=1,3,5,7
/proc/6780/stat : 6780 (python) S 6774 6774 6320 0 -1 4202560 1083 0 0 0 16 17 0 0 19 0 2 0 670618578 297185280 5961 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6780/statm: 72555 5961 410 364 0 8473 0
[pid=6782] ppid=6780 vsize=1018084 CPUtime=100.32 cores=1,3,5,7
/proc/6782/stat : 6782 (gnovelty+2) T 6780 6782 6782 0 -1 4202496 551 0 0 0 10032 0 0 0 25 0 1 0 670618578 1042518016 287 33554432000 134512640 135663704 4292687152 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6782/statm: 254521 287 113 282 0 254237 0
[pid=6780/tid=6790] ppid=6774 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/6780/task/6790/stat : 6790 (python) S 6774 6774 6320 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670628612 297185280 5961 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604463458865600 0 0 -1 7 0 0 0
[pid=6791] ppid=6774 vsize=290232 CPUtime=0.34 cores=1,3,5,7
/proc/6791/stat : 6791 (python) S 6774 6774 6320 0 -1 4202560 1091 0 0 0 16 18 0 0 19 0 2 0 670628615 297197568 5951 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6791/statm: 72558 5951 400 364 0 8473 0
[pid=6793] ppid=6791 vsize=1018084 CPUtime=99.34 cores=1,3,5,7
/proc/6793/stat : 6793 (gnovelty+2) T 6791 6793 6793 0 -1 4202496 552 0 0 0 9934 0 0 0 25 0 1 0 670628616 1042518016 288 33554432000 134512640 135663704 4291454480 18446744073709551615 134524945 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6793/statm: 254521 288 113 282 0 254237 0
[pid=6791/tid=6800] ppid=6774 vsize=290232 CPUtime=0 cores=1,3,5,7
/proc/6791/task/6800/stat : 6800 (python) S 6774 6774 6320 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670638551 297197568 5951 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604465687817024 0 0 -1 7 0 0 0
[pid=6801] ppid=6774 vsize=300488 CPUtime=0.35 cores=1,3,5,7
/proc/6801/stat : 6801 (python) S 6774 6774 6320 0 -1 4202560 1093 0 0 0 18 17 0 0 19 0 2 0 670638554 307699712 5955 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6801/statm: 75122 5955 400 364 0 11034 0
[pid=6803] ppid=6801 vsize=417056 CPUtime=99.34 cores=1,3,5,7
/proc/6803/stat : 6803 (adaptg2wsat2009) T 6801 6803 6803 0 -1 4202496 717 0 0 0 9934 0 0 0 25 0 1 0 670638554 427065344 452 33554432000 134512640 135107411 4287472192 18446744073709551615 134532121 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6803/statm: 104264 452 59 146 0 103140 0
[pid=6801/tid=6820] ppid=6774 vsize=300488 CPUtime=0 cores=1,3,5,7
/proc/6801/task/6820/stat : 6820 (python) S 6774 6774 6320 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670648489 307699712 5955 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604463458867392 0 0 -1 3 0 0 0
[pid=6821] ppid=6774 vsize=310744 CPUtime=0.35 cores=1,3,5,7
/proc/6821/stat : 6821 (python) S 6774 6774 6320 0 -1 4202560 1114 0 0 0 19 16 0 0 19 0 2 0 670648492 318201856 5959 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6821/statm: 77686 5959 400 364 0 13595 0
[pid=6823] ppid=6821 vsize=417056 CPUtime=100.34 cores=1,3,5,7
/proc/6823/stat : 6823 (adaptg2wsat2009) T 6821 6823 6823 0 -1 4202496 718 0 0 0 10034 0 0 0 25 0 1 0 670648493 427065344 450 33554432000 134512640 135107411 4287511360 18446744073709551615 134532318 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/6823/statm: 104264 450 59 146 0 103140 0
[pid=6821/tid=6828] ppid=6774 vsize=310744 CPUtime=0 cores=1,3,5,7
/proc/6821/task/6828/stat : 6828 (python) S 6774 6774 6320 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 670658527 318201856 5959 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604470807781504 0 0 -1 7 0 0 0
[pid=6829] ppid=6774 vsize=321000 CPUtime=0.35 cores=1,3,5,7
/proc/6829/stat : 6829 (python) S 6774 6774 6320 0 -1 4202560 1099 0 0 0 18 17 0 0 19 0 2 0 670658531 328704000 5963 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6829/statm: 80250 5963 400 364 0 16156 0
[pid=6831] ppid=6829 vsize=417056 CPUtime=100.34 cores=1,3,5,7
/proc/6831/stat : 6831 (adaptg2wsat2009) T 6829 6831 6831 0 -1 4202496 721 0 0 0 10034 0 0 0 25 0 1 0 670658531 427065344 451 33554432000 134512640 135107411 4293719360 18446744073709551615 134532277 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/6831/statm: 104264 451 59 146 0 103140 0
[pid=6829/tid=6837] ppid=6774 vsize=321000 CPUtime=0 cores=1,3,5,7
/proc/6829/task/6837/stat : 6837 (python) S 6774 6774 6320 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 670668565 328704000 5963 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604454836302976 0 0 -1 7 0 0 0
[pid=6838] ppid=6774 vsize=331256 CPUtime=0.36 cores=1,3,5,7
/proc/6838/stat : 6838 (python) S 6774 6774 6320 0 -1 4202560 1125 0 0 0 18 18 0 0 18 0 2 0 670668569 339206144 5967 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6838/statm: 82814 5967 400 364 0 18717 0
[pid=6840] ppid=6838 vsize=1018084 CPUtime=100.35 cores=1,3,5,7
/proc/6840/stat : 6840 (gnovelty+2) T 6838 6840 6840 0 -1 4202496 555 0 0 0 10035 0 0 0 25 0 1 0 670668569 1042518016 287 33554432000 134512640 135663704 4294393184 18446744073709551615 134525286 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/6840/statm: 254521 287 113 282 0 254237 0
[pid=6838/tid=6855] ppid=6774 vsize=331256 CPUtime=0 cores=1,3,5,7
/proc/6838/task/6855/stat : 6855 (python) S 6774 6774 6320 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670678606 339206144 5967 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604466124284288 0 0 -1 7 0 0 0
[pid=6856] ppid=6774 vsize=341512 CPUtime=0.35 cores=1,3,5,7
/proc/6856/stat : 6856 (python) S 6774 6774 6320 0 -1 4202560 1158 0 0 0 18 17 0 0 19 0 2 0 670678609 349708288 5977 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6856/statm: 85378 5977 406 364 0 21278 0
[pid=6858] ppid=6856 vsize=247236 CPUtime=99.36 cores=1,3,5,7
/proc/6858/stat : 6858 (FH) T 6856 6858 6858 0 -1 4202496 675 0 0 0 9936 0 0 0 25 0 1 0 670678609 253169664 406 33554432000 134512640 134936988 4294522304 18446744073709551615 134553554 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/6858/statm: 61809 406 41 104 0 61313 0
[pid=6856/tid=6862] ppid=6774 vsize=341512 CPUtime=0 cores=1,3,5,7
/proc/6856/task/6862/stat : 6862 (python) S 6774 6774 6320 0 -1 4202560 102 0 0 0 0 0 0 0 19 0 2 0 670688546 349708288 5977 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604466419337408 0 0 -1 7 0 0 0
[pid=6863] ppid=6774 vsize=351768 CPUtime=0.36 cores=1,3,5,7
/proc/6863/stat : 6863 (python) S 6774 6774 6320 0 -1 4202560 1154 0 0 0 19 17 0 0 19 0 2 0 670688549 360210432 5981 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/6863/statm: 87942 5981 406 364 0 23839 0
[pid=6865] ppid=6863 vsize=417056 CPUtime=100.23 cores=1,3,5,7
/proc/6865/stat : 6865 (adaptg2wsat2009) T 6863 6865 6865 0 -1 4202496 725 0 0 0 10023 0 0 0 25 0 1 0 670688550 427065344 450 33554432000 134512640 135107411 4291105664 18446744073709551615 134532277 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/6865/statm: 104264 450 59 146 0 103140 0
[pid=6863/tid=6872] ppid=6774 vsize=351768 CPUtime=0 cores=1,3,5,7
/proc/6863/task/6872/stat : 6872 (python) S 6774 6774 6320 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670698584 360210432 5981 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604462433604608 0 0 -1 5 0 0 0
[pid=6873] ppid=6774 vsize=362024 CPUtime=0.36 cores=1,3,5,7
/proc/6873/stat : 6873 (python) S 6774 6774 6320 0 -1 4202560 1129 0 0 0 17 19 0 0 19 0 2 0 670698588 370712576 5979 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6873/statm: 90506 5979 400 364 0 26400 0
[pid=6875] ppid=6873 vsize=417056 CPUtime=100.35 cores=1,3,5,7
/proc/6875/stat : 6875 (adaptg2wsat2009) T 6873 6875 6875 0 -1 4202496 722 0 0 0 10035 0 0 0 25 0 1 0 670698588 427065344 450 33554432000 134512640 135107411 4288691488 18446744073709551615 134539283 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/6875/statm: 104264 450 59 146 0 103140 0
[pid=6873/tid=6883] ppid=6774 vsize=362024 CPUtime=0 cores=1,3,5,7
/proc/6873/task/6883/stat : 6883 (python) S 6774 6774 6320 0 -1 4202560 52 0 0 0 0 0 0 0 19 0 2 0 670708624 370712576 5979 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604457751646656 0 0 -1 7 0 0 0
[pid=6884] ppid=6774 vsize=372280 CPUtime=0.74 cores=1,3,5,7
/proc/6884/stat : 6884 (python) S 6774 6774 6320 0 -1 4202560 1150 0 0 0 40 34 0 0 19 0 2 0 670708628 381214720 5983 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6884/statm: 93070 5983 400 364 0 28961 0
[pid=6886] ppid=6884 vsize=268424 CPUtime=196.75 cores=1,3,5,7
/proc/6886/stat : 6886 (hybridGM3) T 6884 6886 6886 0 -1 4202496 4921 0 0 0 19675 0 0 0 25 0 1 0 670708628 274866176 4649 33554432000 134512640 135204385 4289235872 18446744073709551615 134537292 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6886/statm: 67106 4649 64 169 0 66936 0
[pid=6884/tid=6896] ppid=6774 vsize=372280 CPUtime=0 cores=1,3,5,7
/proc/6884/task/6896/stat : 6896 (python) S 6774 6774 6320 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670728310 381214720 5983 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604457751649344 0 0 -1 3 0 0 0
[pid=6897] ppid=6774 vsize=382536 CPUtime=0.37 cores=1,3,5,7
/proc/6897/stat : 6897 (python) S 6774 6774 6320 0 -1 4202560 1115 0 0 0 17 20 0 0 19 0 2 0 670728313 391716864 5987 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6897/statm: 95634 5987 400 364 0 31522 0
[pid=6899] ppid=6897 vsize=247232 CPUtime=98.37 cores=1,3,5,7
/proc/6899/stat : 6899 (FH) T 6897 6899 6899 0 -1 4202496 675 0 0 0 9837 0 0 0 25 0 1 0 670728314 253165568 405 33554432000 134512640 134936988 4294650656 18446744073709551615 134553238 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/6899/statm: 61808 405 41 104 0 61312 0
[pid=6897/tid=6907] ppid=6774 vsize=382536 CPUtime=0 cores=1,3,5,7
/proc/6897/task/6907/stat : 6907 (python) S 6774 6774 6320 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670738152 391716864 5987 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604462433605504 0 0 -1 7 0 0 0
[pid=6908] ppid=6774 vsize=392792 CPUtime=11.07 cores=1,3,5,7
/proc/6908/stat : 6908 (python) S 6774 6774 6320 0 -1 4202560 1183 0 0 0 610 497 0 0 15 0 2 0 670738155 402219008 5991 33554432000 4194304 5683644 140733623899840 18446744073709551615 210647166534 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6908/statm: 98198 5991 400 364 0 34083 0
[pid=6910] ppid=6908 vsize=309416 CPUtime=2903.41 cores=1,3,5,7
/proc/6910/stat : 6910 (march_hi) R 6908 6910 6910 0 -1 4202496 72703 0 0 0 290328 13 0 0 25 0 1 0 670738156 316841984 71244 33554432000 4194304 4955518 140733927416112 18446744073709551615 4285685 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6910/statm: 77354 71244 106 186 0 77167 0
[pid=6908/tid=6928] ppid=6774 vsize=392792 CPUtime=0 cores=1,3,5,7
/proc/6908/task/6928/stat : 6928 (python) S 6774 6774 6320 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 670786915 402219008 5991 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604462433606400 0 0 -1 5 0 0 0
[pid=6942] ppid=6774 vsize=403048 CPUtime=2.65 cores=1,3,5,7
/proc/6942/stat : 6942 (python) S 6774 6774 6320 0 -1 4202560 1179 0 0 0 139 126 0 0 15 0 2 0 670835343 412721152 6011 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6942/statm: 100762 6011 400 364 0 36644 0
[pid=6944] ppid=6942 vsize=93320 CPUtime=682.19 cores=1,3,5,7
/proc/6944/stat : 6944 (march_hi) T 6942 6944 6944 0 -1 4202496 19802 0 0 0 68215 4 0 0 25 0 1 0 670835343 95559680 18344 33554432000 4194304 4955518 140736300016320 18446744073709551615 4235606 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6944/statm: 23330 18344 106 186 0 23143 0
[pid=6942/tid=6955] ppid=6774 vsize=403048 CPUtime=0 cores=1,3,5,7
/proc/6942/task/6955/stat : 6955 (python) S 6774 6774 6320 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 670874162 412721152 6011 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604456911074624 0 0 -1 7 0 0 0
[pid=6964] ppid=6774 vsize=413304 CPUtime=0.86 cores=1,3,5,7
/proc/6964/stat : 6964 (python) S 6774 6774 6320 0 -1 4202560 1159 0 0 0 44 42 0 0 19 0 2 0 670903577 423223296 6017 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6964/statm: 103326 6017 400 364 0 39205 0
[pid=6966] ppid=6964 vsize=268424 CPUtime=199.06 cores=1,3,5,7
/proc/6966/stat : 6966 (hybridGM3) T 6964 6966 6966 0 -1 4202496 4921 0 0 0 19906 0 0 0 25 0 1 0 670903578 274866176 4651 33554432000 134512640 135204385 4293588464 18446744073709551615 134537292 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/6966/statm: 67106 4651 64 169 0 66936 0
[pid=6964/tid=7117] ppid=6774 vsize=413304 CPUtime=0 cores=1,3,5,7
/proc/6964/task/7117/stat : 7117 (python) S 6774 6774 6320 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 670923490 423223296 6017 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 514 18446604456911075520 0 0 -1 7 0 0 0
[pid=6774/tid=6781] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6781/stat : 6781 (python) S 6772 6774 6320 0 -1 4202560 31 931 0 0 0 0 0 0 18 0 15 0 670618578 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
[pid=6774/tid=6792] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6792/stat : 6792 (python) S 6772 6774 6320 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 15 0 670628615 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
[pid=6774/tid=6802] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6802/stat : 6802 (python) S 6772 6774 6320 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 15 0 670638554 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 7 0 0 0
[pid=6774/tid=6822] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6822/stat : 6822 (python) S 6772 6774 6320 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 15 0 670648493 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 3 0 0 0
[pid=6774/tid=6830] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6830/stat : 6830 (python) S 6772 6774 6320 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 15 0 670658531 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 3 0 0 0
[pid=6774/tid=6839] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6839/stat : 6839 (python) S 6772 6774 6320 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 15 0 670668569 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 3 0 0 0
[pid=6774/tid=6857] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6857/stat : 6857 (python) S 6772 6774 6320 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 15 0 670678609 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
[pid=6774/tid=6864] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6864/stat : 6864 (python) S 6772 6774 6320 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 15 0 670688550 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 7 0 0 0
[pid=6774/tid=6874] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6874/stat : 6874 (python) S 6772 6774 6320 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 15 0 670698588 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
[pid=6774/tid=6885] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6885/stat : 6885 (python) S 6772 6774 6320 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 15 0 670708628 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 7 0 0 0
[pid=6774/tid=6898] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6898/stat : 6898 (python) S 6772 6774 6320 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 15 0 670728313 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 3 0 0 0
[pid=6774/tid=6909] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6909/stat : 6909 (python) S 6772 6774 6320 0 -1 4202560 32 931 0 0 0 0 0 0 15 0 15 0 670738155 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 7 0 0 0
[pid=6774/tid=6943] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6943/stat : 6943 (python) S 6772 6774 6320 0 -1 4202560 33 931 0 0 0 0 0 0 18 0 15 0 670835343 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
[pid=6774/tid=6965] ppid=6772 vsize=423960 CPUtime=0 cores=1,3,5,7
/proc/6774/task/6965/stat : 6965 (python) S 6772 6774 6320 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 15 0 670903577 434135040 7609 33554432000 4194304 5683644 140733623899840 18446744073709551615 210658970033 0 0 16781312 2 18446604469935028160 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5000.09
Current children cumulated vsize (KiB) 11860748

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6774 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=342795
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=166974
# CPU time returned by wait4() is 1.50977
# while last known CPU time is 5000.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4982.02
CPU time (s): 5000.09
CPU user time (s): 4991.01
CPU system time (s): 9.08
CPU usage (%): 100.363
Max. virtual memory (cumulated for all children) (KiB): 11860752

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.34279
system time used= 0.166974
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 24546
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2937
involuntary context switches= 35

runsolver used 37.6933 second user time and 81.8895 second system time

The end

Launcher Data 

Begin job on node129 at 2011-05-17 01:56:28
IDJOB=3386667
IDBENCH=82732
IDSOLVER=1872
FILE ID=node129/3386667-1305590188
RUNJOBID= node129-1305586145-6339
PBS_JOBID= 13350349
Free space on /tmp= 73236 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v80-c7120-S1901567697-013.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386667-1305590188/watcher-3386667-1305590188 -o /tmp/evaluation-result-3386667-1305590188/solver-3386667-1305590188 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386667-1305590188.cnf -seed 1813626938 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6416f44b34786f590ff716f4b8e2cf7c
RANDOM SEED=1813626938

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      18455964 kB
Buffers:        296592 kB
Cached:        7102232 kB
SwapCached:      52664 kB
Active:        5236512 kB
Inactive:      8989872 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      18455964 kB
SwapTotal:    67111528 kB
SwapFree:     64496000 kB
Dirty:           31736 kB
Writeback:           0 kB
AnonPages:     6784016 kB
Mapped:          30844 kB
Slab:           144072 kB
PageTables:      56512 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 128737432 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73192 MiB
End job on node129 at 2011-05-17 03:19:32