Trace number 3386949

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (TO) 5000.06 4983.97

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S788239782-034.UNKNOWN.cnf
MD5SUMea72de9bc2f16b1185170420c6413a72
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.32/0.45	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.45	c INFO: solving HOME/instance-3386949-1305595044.cnf
0.32/0.45	c INFO: computing task features
0.32/0.47	c INFO: computed variable-clause graph statistics
0.32/0.47	c INFO: computed clause balance statistics
0.41/0.55	c INFO: computed variable balance statistics
0.41/0.60	c INFO: computed small-clause counts
0.41/0.60	c INFO: computed Horn-clause counts
0.51/0.60	c INFO: computed variable graph statistics
0.51/0.60	c INFO: collected features for HOME/instance-3386949-1305595044.cnf in 0.15 s
0.51/0.63	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.63)
100.10/100.00	c INFO: running gnovelty+2@0 for 97 with 4900 remaining (b = 0.08)
199.79/199.35	c INFO: running march_hi@0 for 485 with 4801 remaining (b = 0.29)
689.11/687.05	c INFO: running march_hi@487 for 194 with 4313 remaining (b = 0.16)
881.77/879.02	c INFO: running march_hi@679 for 97 with 4121 remaining (b = 0.06)
983.56/980.57	c INFO: running march_hi@0 for 388 with 4020 remaining (b = 0.23)
1374.18/1369.82	c INFO: running march_hi@389 for 97 with 3630 remaining (b = 0.08)
1473.51/1468.80	c INFO: running march_hi@488 for 194 with 3531 remaining (b = 0.13)
1666.11/1660.91	c INFO: running march_hi@0 for 388 with 3339 remaining (b = 0.21)
2056.83/2050.22	c INFO: running march_hi@389 for 97 with 2950 remaining (b = 0.07)
2156.63/2149.76	c INFO: running march_hi@488 for 97 with 2850 remaining (b = 0.05)
2253.37/2246.17	c INFO: running march_hi@585 for 97 with 2754 remaining (b = 0.06)
2350.50/2342.95	c INFO: running march_hi@0 for 388 with 2657 remaining (b = 0.18)
2740.91/2732.31	c INFO: running march_hi@388 for 97 with 2268 remaining (b = 0.05)
2841.14/2832.39	c INFO: running march_hi@0 for 388 with 2168 remaining (b = 0.16)
3236.14/3225.96	c INFO: running march_hi@393 for 97 with 1775 remaining (b = 0.04)
3329.88/3319.32	c INFO: running adaptg2wsat2009++@0 for 97 with 1681 remaining (b = 0.03)
3429.48/3418.69	c INFO: running march_hi@781 for 1358 with 1582 remaining (b = 0.38)
4790.55/4775.10	c INFO: running march_hi@2137 for 97 with 226 remaining (b = 0.11)
4890.38/4874.53	c INFO: running march_hi@488 for 126 with 126 remaining (b = 0.04)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386949-1305595044/watcher-3386949-1305595044 -o /tmp/evaluation-result-3386949-1305595044/solver-3386949-1305595044 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386949-1305595044.cnf -seed 1265068383 -budget 5000 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.08 4.08 4.02 4/449 7985
/proc/meminfo: memFree=12585532/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=16240 CPUtime=0 cores=0,2,4,6
/proc/7985/stat : 7985 (python) R 7983 7985 7023 0 -1 4202496 1035 0 0 0 0 0 0 0 25 0 1 0 671102314 16629760 908 33554432000 4194304 5683644 140734432818016 18446744073709551615 255376962245 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/7985/statm: 4060 908 380 364 0 547 0

[startup+0.0221731 s]
/proc/loadavg: 4.08 4.08 4.02 4/449 7985
/proc/meminfo: memFree=12585532/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=16396 CPUtime=0.01 cores=0,2,4,6
/proc/7985/stat : 7985 (python) R 7983 7985 7023 0 -1 4202496 1149 0 0 0 1 0 0 0 25 0 1 0 671102314 16789504 1016 33554432000 4194304 5683644 140734432818016 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/7985/statm: 4099 1016 413 364 0 586 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16396

[startup+0.100223 s]
/proc/loadavg: 4.08 4.08 4.02 4/449 7985
/proc/meminfo: memFree=12585532/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=104616 CPUtime=0.07 cores=0,2,4,6
/proc/7985/stat : 7985 (python) R 7983 7985 7023 0 -1 4202496 3138 0 0 0 6 1 0 0 17 0 1 0 671102314 107126784 2818 33554432000 4194304 5683644 140734432818016 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/7985/statm: 26154 2822 847 364 0 1902 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104616

[startup+0.300172 s]
/proc/loadavg: 4.08 4.08 4.02 4/449 7985
/proc/meminfo: memFree=12585532/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=198916 CPUtime=0.23 cores=0,2,4,6
/proc/7985/stat : 7985 (python) R 7983 7985 7023 0 -1 4202496 7027 935 1 0 17 6 0 0 17 0 1 0 671102314 203689984 5053 33554432000 4194304 5683644 140734432818016 18446744073709551615 47833130668386 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/7985/statm: 49729 5053 1466 364 0 3756 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 198916

[startup+0.70105 s]
/proc/loadavg: 4.08 4.08 4.02 4/449 7985
/proc/meminfo: memFree=12585532/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=288828 CPUtime=0.55 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 9901 935 1 0 46 9 0 0 20 0 2 0 671102314 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 72207 7083 1875 364 0 8125 0
Current children cumulated CPU time (s) 0.55
Current children cumulated vsize (KiB) 288828

[startup+1.50096 s]
/proc/loadavg: 4.08 4.08 4.02 5/453 7993
/proc/meminfo: memFree=12560036/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=288828 CPUtime=0.55 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 9901 935 1 0 46 9 0 0 20 0 2 0 671102314 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 72207 7083 1875 364 0 8125 0
[pid=7991] ppid=7985 vsize=278584 CPUtime=0 cores=0,2,4,6
/proc/7991/stat : 7991 (python) S 7985 7985 7023 0 -1 4202560 741 0 0 0 0 0 0 0 19 0 1 0 671102378 285270016 5558 33554432000 4194304 5683644 140734432818016 18446744073709551615 255377321487 0 0 16781312 514 15050525558007922687 0 0 17 4 0 0 0
/proc/7991/statm: 69646 5558 354 364 0 5564 0
[pid=7993] ppid=7991 vsize=1017940 CPUtime=0.86 cores=0,2,4,6
/proc/7993/stat : 7993 (gnovelty+2) R 7991 7993 7993 0 -1 4202496 452 0 0 0 86 0 0 0 23 0 1 0 671102378 1042370560 191 33554432000 134512640 135663704 4289419856 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7993/statm: 254485 191 113 282 0 254201 0
[pid=7985/tid=7992] ppid=7983 vsize=288828 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7992/stat : 7992 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 2 0 671102378 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 1585352

[startup+3.10061 s]
/proc/loadavg: 4.08 4.08 4.02 5/453 7993
/proc/meminfo: memFree=12558176/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=288828 CPUtime=0.55 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 9901 935 1 0 46 9 0 0 20 0 2 0 671102314 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 72207 7083 1875 364 0 8125 0
[pid=7991] ppid=7985 vsize=278584 CPUtime=0 cores=0,2,4,6
/proc/7991/stat : 7991 (python) S 7985 7985 7023 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 671102378 285270016 5558 33554432000 4194304 5683644 140734432818016 18446744073709551615 255377321487 0 0 16781312 514 15050525558007890178 0 0 17 4 0 0 0
/proc/7991/statm: 69646 5558 354 364 0 5564 0
[pid=7993] ppid=7991 vsize=1017940 CPUtime=2.45 cores=0,2,4,6
/proc/7993/stat : 7993 (gnovelty+2) R 7991 7993 7993 0 -1 4202496 452 0 0 0 245 0 0 0 25 0 1 0 671102378 1042370560 191 33554432000 134512640 135663704 4289419856 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7993/statm: 254485 191 113 282 0 254201 0
[pid=7985/tid=7992] ppid=7983 vsize=288828 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7992/stat : 7992 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 2 0 671102378 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 1585352

[startup+6.30105 s]
/proc/loadavg: 4.07 4.07 4.02 5/453 7993
/proc/meminfo: memFree=12558812/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=288828 CPUtime=0.55 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 9901 935 1 0 46 9 0 0 20 0 2 0 671102314 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 72207 7083 1875 364 0 8125 0
[pid=7991] ppid=7985 vsize=278584 CPUtime=0.01 cores=0,2,4,6
/proc/7991/stat : 7991 (python) S 7985 7985 7023 0 -1 4202560 888 0 0 0 0 1 0 0 18 0 1 0 671102378 285270016 5581 33554432000 4194304 5683644 140734432818016 18446744073709551615 255377321487 0 0 16781312 514 15050525558007890178 0 0 17 4 0 0 0
/proc/7991/statm: 69646 5581 377 364 0 5564 0
[pid=7993] ppid=7991 vsize=1017940 CPUtime=5.65 cores=0,2,4,6
/proc/7993/stat : 7993 (gnovelty+2) R 7991 7993 7993 0 -1 4202496 452 0 0 0 565 0 0 0 25 0 1 0 671102378 1042370560 191 33554432000 134512640 135663704 4289419856 18446744073709551615 134525691 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7993/statm: 254485 191 113 282 0 254201 0
[pid=7985/tid=7992] ppid=7983 vsize=288828 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7992/stat : 7992 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 2 0 671102378 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 1585352

[startup+12.7009 s]
/proc/loadavg: 4.06 4.07 4.02 5/453 7994
/proc/meminfo: memFree=12557636/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=288828 CPUtime=0.55 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 9901 935 1 0 46 9 0 0 20 0 2 0 671102314 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 72207 7083 1875 364 0 8125 0
[pid=7991] ppid=7985 vsize=278584 CPUtime=0.03 cores=0,2,4,6
/proc/7991/stat : 7991 (python) S 7985 7985 7023 0 -1 4202560 896 0 0 0 1 2 0 0 18 0 1 0 671102378 285270016 5581 33554432000 4194304 5683644 140734432818016 18446744073709551615 255377321487 0 0 16781312 514 1096468179590283522 0 0 17 4 0 0 0
/proc/7991/statm: 69646 5581 377 364 0 5564 0
[pid=7993] ppid=7991 vsize=1017940 CPUtime=12.05 cores=0,2,4,6
/proc/7993/stat : 7993 (gnovelty+2) R 7991 7993 7993 0 -1 4202496 452 0 0 0 1205 0 0 0 25 0 1 0 671102378 1042370560 191 33554432000 134512640 135663704 4289419856 18446744073709551615 134545644 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7993/statm: 254485 191 113 282 0 254201 0
[pid=7985/tid=7992] ppid=7983 vsize=288828 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7992/stat : 7992 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 2 0 671102378 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.63
Current children cumulated vsize (KiB) 1585352

[startup+25.5005 s]
/proc/loadavg: 4.05 4.07 4.01 5/453 7994
/proc/meminfo: memFree=12556752/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=288828 CPUtime=0.55 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 9901 935 1 0 46 9 0 0 20 0 2 0 671102314 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 72207 7083 1875 364 0 8125 0
[pid=7991] ppid=7985 vsize=278584 CPUtime=0.07 cores=0,2,4,6
/proc/7991/stat : 7991 (python) S 7985 7985 7023 0 -1 4202560 902 0 0 0 4 3 0 0 18 0 1 0 671102378 285270016 5581 33554432000 4194304 5683644 140734432818016 18446744073709551615 255377321487 0 0 16781312 514 1096468179590283522 0 0 17 6 0 0 0
/proc/7991/statm: 69646 5581 377 364 0 5564 0
[pid=7993] ppid=7991 vsize=1017940 CPUtime=24.85 cores=0,2,4,6
/proc/7993/stat : 7993 (gnovelty+2) R 7991 7993 7993 0 -1 4202496 452 0 0 0 2485 0 0 0 25 0 1 0 671102378 1042370560 191 33554432000 134512640 135663704 4289419856 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7993/statm: 254485 191 113 282 0 254201 0
[pid=7985/tid=7992] ppid=7983 vsize=288828 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7992/stat : 7992 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 2 0 671102378 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 1585352

[startup+51.1008 s]
/proc/loadavg: 4.03 4.06 4.01 5/453 7995
/proc/meminfo: memFree=12554492/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=288828 CPUtime=0.55 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 9901 935 1 0 46 9 0 0 20 0 2 0 671102314 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 72207 7083 1875 364 0 8125 0
[pid=7991] ppid=7985 vsize=278584 CPUtime=0.14 cores=0,2,4,6
/proc/7991/stat : 7991 (python) S 7985 7985 7023 0 -1 4202560 910 0 0 0 7 7 0 0 18 0 1 0 671102378 285270016 5581 33554432000 4194304 5683644 140734432818016 18446744073709551615 255377321487 0 0 16781312 514 1096468179590283522 0 0 17 6 0 0 0
/proc/7991/statm: 69646 5581 377 364 0 5564 0
[pid=7993] ppid=7991 vsize=1017940 CPUtime=50.45 cores=0,2,4,6
/proc/7993/stat : 7993 (gnovelty+2) R 7991 7993 7993 0 -1 4202496 452 0 0 0 5045 0 0 0 25 0 1 0 671102378 1042370560 191 33554432000 134512640 135663704 4289419856 18446744073709551615 134545635 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7993/statm: 254485 191 113 282 0 254201 0
[pid=7985/tid=7992] ppid=7983 vsize=288828 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7992/stat : 7992 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 2 0 671102378 295759872 7083 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 51.14
Current children cumulated vsize (KiB) 1585352

[startup+102.316 s]
/proc/loadavg: 4.06 4.06 4.01 5/457 8000
/proc/meminfo: memFree=12544576/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=365068 CPUtime=0.58 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 10731 935 1 0 49 9 0 0 18 0 3 0 671102314 373829632 7216 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 91267 7216 1878 364 0 27182 0
[pid=7991] ppid=7985 vsize=288828 CPUtime=0.31 cores=0,2,4,6
/proc/7991/stat : 7991 (python) S 7985 7985 7023 0 -1 4202560 1084 0 0 0 17 14 0 0 19 0 2 0 671102378 295759872 5619 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7991/statm: 72207 5619 410 364 0 8125 0
[pid=7993] ppid=7991 vsize=1017940 CPUtime=99.32 cores=0,2,4,6
/proc/7993/stat : 7993 (gnovelty+2) T 7991 7993 7993 0 -1 4202496 452 0 0 0 9932 0 0 0 25 0 1 0 671102378 1042370560 191 33554432000 134512640 135663704 4289419856 18446744073709551615 134525258 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7993/statm: 254485 191 113 282 0 254201 0
[pid=7991/tid=7997] ppid=7985 vsize=288828 CPUtime=0 cores=0,2,4,6
/proc/7991/task/7997/stat : 7997 (python) S 7985 7985 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 671112311 295759872 5619 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604443532014912 0 0 -1 6 0 0 0
[pid=7998] ppid=7985 vsize=289288 CPUtime=0 cores=0,2,4,6
/proc/7998/stat : 7998 (python) S 7985 7985 7023 0 -1 4202560 747 0 0 0 0 0 0 0 18 0 1 0 671112314 296230912 5680 33554432000 4194304 5683644 140734432818016 18446744073709551615 255377321542 0 0 16781312 514 16846897210107855104 0 0 17 4 0 0 0
/proc/7998/statm: 72322 5680 348 364 0 8237 0
[pid=8000] ppid=7998 vsize=1017940 CPUtime=2.3 cores=0,2,4,6
/proc/8000/stat : 8000 (gnovelty+2) R 7998 8000 8000 0 -1 4202496 456 0 0 0 230 0 0 0 25 0 1 0 671112315 1042370560 192 33554432000 134512640 135663704 4289795856 18446744073709551615 134525302 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8000/statm: 254485 192 113 282 0 254201 0
[pid=7985/tid=7992] ppid=7983 vsize=365068 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7992/stat : 7992 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 3 0 671102378 373829632 7216 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
[pid=7985/tid=7999] ppid=7983 vsize=365068 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7999/stat : 7999 (python) S 7983 7985 7023 0 -1 4202560 20 935 0 0 0 0 0 0 20 0 3 0 671112315 373829632 7216 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 102.51
Current children cumulated vsize (KiB) 2979064

[startup+162.301 s]
/proc/loadavg: 4.02 4.05 4.01 5/457 8002
/proc/meminfo: memFree=12536856/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=365068 CPUtime=0.58 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 10731 935 1 0 49 9 0 0 18 0 3 0 671102314 373829632 7216 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 91267 7216 1878 364 0 27182 0
[pid=7991] ppid=7985 vsize=288828 CPUtime=0.31 cores=0,2,4,6

################
# More data... #
################

/proc/8007/stat : 8007 (march_hi) T 8005 8007 8007 0 -1 4202496 97699 0 0 0 223681 21 0 0 25 0 1 0 671122250 492359680 97414 33554432000 4194304 4955518 140733679607424 18446744073709551615 4297477 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8007/statm: 120205 97414 106 186 0 120018 0
[pid=8005/tid=8021] ppid=7985 vsize=364764 CPUtime=0 cores=0,2,4,6
/proc/8005/task/8021/stat : 8021 (python) S 7985 7985 7023 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 671171017 373518336 5660 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604452160834496 0 0 -1 6 0 0 0
[pid=8063] ppid=7985 vsize=375560 CPUtime=2.23 cores=0,2,4,6
/proc/8063/stat : 8063 (python) S 7985 7985 7023 0 -1 4202560 1176 0 0 0 118 105 0 0 15 0 2 0 671200372 384573440 5804 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8063/statm: 93890 5804 400 364 0 29799 0
[pid=8065] ppid=8063 vsize=142376 CPUtime=680.27 cores=0,2,4,6
/proc/8065/stat : 8065 (march_hi) T 8063 8065 8065 0 -1 4202496 32737 0 0 0 68020 7 0 0 25 0 1 0 671200373 145793024 32451 33554432000 4194304 4955518 140735300123760 18446744073709551615 4313980 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8065/statm: 35594 32451 106 186 0 35407 0
[pid=8063/tid=8093] ppid=7985 vsize=375560 CPUtime=0 cores=0,2,4,6
/proc/8063/task/8093/stat : 8093 (python) S 7985 7985 7023 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 671239294 384573440 5804 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604435954264832 0 0 -1 6 0 0 0
[pid=8114] ppid=7985 vsize=385964 CPUtime=2.28 cores=0,2,4,6
/proc/8114/stat : 8114 (python) S 7985 7985 7023 0 -1 4202560 1174 0 0 0 126 102 0 0 15 0 2 0 671268406 395227136 5823 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8114/statm: 96491 5823 400 364 0 32397 0
[pid=8116] ppid=8114 vsize=142376 CPUtime=681.97 cores=0,2,4,6
/proc/8116/stat : 8116 (march_hi) T 8114 8116 8116 0 -1 4202496 33072 0 0 0 68191 6 0 0 25 0 1 0 671268406 145793024 32784 33554432000 4194304 4955518 140737407473776 18446744073709551615 4224532 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8116/statm: 35594 32784 106 186 0 35407 0
[pid=8114/tid=8135] ppid=7985 vsize=385964 CPUtime=0 cores=0,2,4,6
/proc/8114/task/8135/stat : 8135 (python) S 7985 7985 7023 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 671307335 395227136 5823 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604450049689472 0 0 -1 6 0 0 0
[pid=8145] ppid=7985 vsize=396208 CPUtime=2.05 cores=0,2,4,6
/proc/8145/stat : 8145 (python) S 7985 7985 7023 0 -1 4202560 1179 0 0 0 115 90 0 0 15 0 2 0 671336610 405716992 5824 33554432000 4194304 5683644 140734432818016 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8145/statm: 99052 5824 400 364 0 34955 0
[pid=8147] ppid=8145 vsize=142376 CPUtime=598.24 cores=0,2,4,6
/proc/8147/stat : 8147 (march_hi) R 8145 8147 8147 0 -1 4202496 28925 0 0 0 59817 7 0 0 25 0 1 0 671336610 145793024 28636 33554432000 4194304 4955518 140735754920016 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8147/statm: 35594 28636 106 186 0 35407 0
[pid=8145/tid=8642] ppid=7985 vsize=396208 CPUtime=0 cores=0,2,4,6
/proc/8145/task/8642/stat : 8642 (python) S 7985 7985 7023 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 671375544 405716992 5824 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604453841394560 0 0 -1 4 0 0 0
[pid=8653] ppid=7985 vsize=405928 CPUtime=1.72 cores=0,2,4,6
/proc/8653/stat : 8653 (python) S 7985 7985 7023 0 -1 4202560 1179 0 0 0 94 78 0 0 15 0 2 0 671385554 415670272 5726 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8653/statm: 101482 5726 400 364 0 37382 0
[pid=8655] ppid=8653 vsize=138452 CPUtime=486.9 cores=0,2,4,6
/proc/8655/stat : 8655 (march_hi) T 8653 8655 8655 0 -1 4202496 23631 0 0 0 48685 5 0 0 25 0 1 0 671385554 141774848 23347 33554432000 4194304 4955518 140733695710864 18446744073709551615 4297483 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8655/statm: 34613 23347 106 186 0 34426 0
[pid=8653/tid=8670] ppid=7985 vsize=405928 CPUtime=0 cores=0,2,4,6
/proc/8653/task/8670/stat : 8670 (python) S 7985 7985 7023 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 671424909 415670272 5726 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604453855270848 0 0 -1 6 0 0 0
[pid=8675] ppid=7985 vsize=416724 CPUtime=0.33 cores=0,2,4,6
/proc/8675/stat : 8675 (python) S 7985 7985 7023 0 -1 4202560 1156 0 0 0 18 15 0 0 19 0 2 0 671434247 426725376 5869 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8675/statm: 104181 5869 406 364 0 40078 0
[pid=8677] ppid=8675 vsize=416280 CPUtime=99.34 cores=0,2,4,6
/proc/8677/stat : 8677 (adaptg2wsat2009) T 8675 8677 8677 0 -1 4202496 527 0 0 0 9934 0 0 0 25 0 1 0 671434247 426270720 254 33554432000 134512640 135107411 4294308464 18446744073709551615 134531435 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8677/statm: 104070 254 59 146 0 102946 0
[pid=8675/tid=8680] ppid=7985 vsize=416724 CPUtime=0 cores=0,2,4,6
/proc/8675/task/8680/stat : 8680 (python) S 7985 7985 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 671444182 426725376 5869 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604444321700928 0 0 -1 6 0 0 0
[pid=7985/tid=7992] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7992/stat : 7992 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 9 0 671102378 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
[pid=7985/tid=7999] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7999/stat : 7999 (python) S 7983 7985 7023 0 -1 4202560 20 935 0 0 0 0 0 0 20 0 9 0 671112315 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 2 0 0 0
[pid=7985/tid=8006] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8006/stat : 8006 (python) S 7983 7985 7023 0 -1 4202560 30 935 0 0 0 0 0 0 15 0 9 0 671122250 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 6 0 0 0
[pid=7985/tid=8064] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8064/stat : 8064 (python) S 7983 7985 7023 0 -1 4202560 23 935 0 0 0 0 0 0 18 0 9 0 671200372 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
[pid=7985/tid=8115] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8115/stat : 8115 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 9 0 671268406 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 2 0 0 0
[pid=7985/tid=8146] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8146/stat : 8146 (python) S 7983 7985 7023 0 -1 4202560 32 935 0 0 0 0 0 0 18 0 9 0 671336610 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
[pid=7985/tid=8654] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8654/stat : 8654 (python) S 7983 7985 7023 0 -1 4202560 30 935 0 0 0 0 0 0 18 0 9 0 671385554 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
[pid=7985/tid=8676] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8676/stat : 8676 (python) S 7983 7985 7023 0 -1 4202560 29 935 0 0 0 0 0 0 20 0 9 0 671434247 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5000.06
Current children cumulated vsize (KiB) 6849032

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4983.9 s]
/proc/loadavg: 4.00 4.03 4.00 5/510 8730
/proc/meminfo: memFree=11880776/32951124 swapFree=63308196/67111528
[pid=7985] ppid=7983 vsize=427208 CPUtime=0.92 cores=0,2,4,6
/proc/7985/stat : 7985 (python) S 7983 7985 7023 0 -1 4202496 17289 935 1 0 81 11 0 0 18 0 9 0 671102314 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/7985/statm: 106802 7386 1890 364 0 42699 0
[pid=7991] ppid=7985 vsize=288828 CPUtime=0.31 cores=0,2,4,6
/proc/7991/stat : 7991 (python) S 7985 7985 7023 0 -1 4202560 1084 0 0 0 17 14 0 0 19 0 2 0 671102378 295759872 5619 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7991/statm: 72207 5619 410 364 0 8125 0
[pid=7993] ppid=7991 vsize=1017940 CPUtime=99.32 cores=0,2,4,6
/proc/7993/stat : 7993 (gnovelty+2) T 7991 7993 7993 0 -1 4202496 452 0 0 0 9932 0 0 0 25 0 1 0 671102378 1042370560 191 33554432000 134512640 135663704 4289419856 18446744073709551615 134525258 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7993/statm: 254485 191 113 282 0 254201 0
[pid=7991/tid=7997] ppid=7985 vsize=288828 CPUtime=0 cores=0,2,4,6
/proc/7991/task/7997/stat : 7997 (python) S 7985 7985 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 671112311 295759872 5619 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604443532014912 0 0 -1 6 0 0 0
[pid=7998] ppid=7985 vsize=289288 CPUtime=0.31 cores=0,2,4,6
/proc/7998/stat : 7998 (python) S 7985 7985 7023 0 -1 4202560 1090 0 0 0 19 12 0 0 19 0 2 0 671112314 296230912 5733 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/7998/statm: 72322 5733 400 364 0 8237 0
[pid=8000] ppid=7998 vsize=1017940 CPUtime=99.31 cores=0,2,4,6
/proc/8000/stat : 8000 (gnovelty+2) T 7998 8000 8000 0 -1 4202496 456 0 0 0 9931 0 0 0 25 0 1 0 671112315 1042370560 192 33554432000 134512640 135663704 4289795856 18446744073709551615 134525286 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8000/statm: 254485 192 113 282 0 254201 0
[pid=7998/tid=8004] ppid=7985 vsize=289288 CPUtime=0 cores=0,2,4,6
/proc/7998/task/8004/stat : 8004 (python) S 7985 7985 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 671122247 296230912 5733 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604452540199872 0 0 -1 2 0 0 0
[pid=8005] ppid=7985 vsize=364764 CPUtime=7.54 cores=0,2,4,6
/proc/8005/stat : 8005 (python) S 7985 7985 7023 0 -1 4202560 1167 0 0 0 406 348 0 0 15 0 2 0 671122250 373518336 5660 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8005/statm: 91191 5660 400 364 0 27103 0
[pid=8007] ppid=8005 vsize=480820 CPUtime=2237.02 cores=0,2,4,6
/proc/8007/stat : 8007 (march_hi) T 8005 8007 8007 0 -1 4202496 97699 0 0 0 223681 21 0 0 25 0 1 0 671122250 492359680 97414 33554432000 4194304 4955518 140733679607424 18446744073709551615 4297477 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8007/statm: 120205 97414 106 186 0 120018 0
[pid=8005/tid=8021] ppid=7985 vsize=364764 CPUtime=0 cores=0,2,4,6
/proc/8005/task/8021/stat : 8021 (python) S 7985 7985 7023 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 671171017 373518336 5660 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604452160834496 0 0 -1 6 0 0 0
[pid=8063] ppid=7985 vsize=375560 CPUtime=2.23 cores=0,2,4,6
/proc/8063/stat : 8063 (python) S 7985 7985 7023 0 -1 4202560 1176 0 0 0 118 105 0 0 15 0 2 0 671200372 384573440 5804 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8063/statm: 93890 5804 400 364 0 29799 0
[pid=8065] ppid=8063 vsize=142376 CPUtime=680.27 cores=0,2,4,6
/proc/8065/stat : 8065 (march_hi) T 8063 8065 8065 0 -1 4202496 32737 0 0 0 68020 7 0 0 25 0 1 0 671200373 145793024 32451 33554432000 4194304 4955518 140735300123760 18446744073709551615 4313980 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8065/statm: 35594 32451 106 186 0 35407 0
[pid=8063/tid=8093] ppid=7985 vsize=375560 CPUtime=0 cores=0,2,4,6
/proc/8063/task/8093/stat : 8093 (python) S 7985 7985 7023 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 671239294 384573440 5804 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604435954264832 0 0 -1 6 0 0 0
[pid=8114] ppid=7985 vsize=385964 CPUtime=2.28 cores=0,2,4,6
/proc/8114/stat : 8114 (python) S 7985 7985 7023 0 -1 4202560 1174 0 0 0 126 102 0 0 15 0 2 0 671268406 395227136 5823 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8114/statm: 96491 5823 400 364 0 32397 0
[pid=8116] ppid=8114 vsize=142376 CPUtime=681.97 cores=0,2,4,6
/proc/8116/stat : 8116 (march_hi) T 8114 8116 8116 0 -1 4202496 33072 0 0 0 68191 6 0 0 25 0 1 0 671268406 145793024 32784 33554432000 4194304 4955518 140737407473776 18446744073709551615 4224532 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8116/statm: 35594 32784 106 186 0 35407 0
[pid=8114/tid=8135] ppid=7985 vsize=385964 CPUtime=0 cores=0,2,4,6
/proc/8114/task/8135/stat : 8135 (python) S 7985 7985 7023 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 671307335 395227136 5823 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604450049689472 0 0 -1 6 0 0 0
[pid=8145] ppid=7985 vsize=396208 CPUtime=2.05 cores=0,2,4,6
/proc/8145/stat : 8145 (python) S 7985 7985 7023 0 -1 4202560 1179 0 0 0 115 90 0 0 15 0 2 0 671336610 405716992 5824 33554432000 4194304 5683644 140734432818016 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8145/statm: 99052 5824 400 364 0 34955 0
[pid=8147] ppid=8145 vsize=142376 CPUtime=598.24 cores=0,2,4,6
/proc/8147/stat : 8147 (march_hi) R 8145 8147 8147 0 -1 4202496 28925 0 0 0 59817 7 0 0 25 0 1 0 671336610 145793024 28636 33554432000 4194304 4955518 140735754920016 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8147/statm: 35594 28636 106 186 0 35407 0
[pid=8145/tid=8642] ppid=7985 vsize=396208 CPUtime=0 cores=0,2,4,6
/proc/8145/task/8642/stat : 8642 (python) S 7985 7985 7023 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 671375544 405716992 5824 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604453841394560 0 0 -1 4 0 0 0
[pid=8653] ppid=7985 vsize=405928 CPUtime=1.72 cores=0,2,4,6
/proc/8653/stat : 8653 (python) S 7985 7985 7023 0 -1 4202560 1179 0 0 0 94 78 0 0 15 0 2 0 671385554 415670272 5726 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8653/statm: 101482 5726 400 364 0 37382 0
[pid=8655] ppid=8653 vsize=138452 CPUtime=486.9 cores=0,2,4,6
/proc/8655/stat : 8655 (march_hi) T 8653 8655 8655 0 -1 4202496 23631 0 0 0 48685 5 0 0 25 0 1 0 671385554 141774848 23347 33554432000 4194304 4955518 140733695710864 18446744073709551615 4297483 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8655/statm: 34613 23347 106 186 0 34426 0
[pid=8653/tid=8670] ppid=7985 vsize=405928 CPUtime=0 cores=0,2,4,6
/proc/8653/task/8670/stat : 8670 (python) S 7985 7985 7023 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 671424909 415670272 5726 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604453855270848 0 0 -1 6 0 0 0
[pid=8675] ppid=7985 vsize=416724 CPUtime=0.33 cores=0,2,4,6
/proc/8675/stat : 8675 (python) S 7985 7985 7023 0 -1 4202560 1156 0 0 0 18 15 0 0 19 0 2 0 671434247 426725376 5869 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8675/statm: 104181 5869 406 364 0 40078 0
[pid=8677] ppid=8675 vsize=416280 CPUtime=99.34 cores=0,2,4,6
/proc/8677/stat : 8677 (adaptg2wsat2009) T 8675 8677 8677 0 -1 4202496 527 0 0 0 9934 0 0 0 25 0 1 0 671434247 426270720 254 33554432000 134512640 135107411 4294308464 18446744073709551615 134531435 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8677/statm: 104070 254 59 146 0 102946 0
[pid=8675/tid=8680] ppid=7985 vsize=416724 CPUtime=0 cores=0,2,4,6
/proc/8675/task/8680/stat : 8680 (python) S 7985 7985 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 671444182 426725376 5869 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 514 18446604444321700928 0 0 -1 6 0 0 0
[pid=7985/tid=7992] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7992/stat : 7992 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 9 0 671102378 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
[pid=7985/tid=7999] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/7999/stat : 7999 (python) S 7983 7985 7023 0 -1 4202560 20 935 0 0 0 0 0 0 20 0 9 0 671112315 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 2 0 0 0
[pid=7985/tid=8006] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8006/stat : 8006 (python) S 7983 7985 7023 0 -1 4202560 30 935 0 0 0 0 0 0 15 0 9 0 671122250 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 6 0 0 0
[pid=7985/tid=8064] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8064/stat : 8064 (python) S 7983 7985 7023 0 -1 4202560 23 935 0 0 0 0 0 0 18 0 9 0 671200372 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
[pid=7985/tid=8115] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8115/stat : 8115 (python) S 7983 7985 7023 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 9 0 671268406 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 2 0 0 0
[pid=7985/tid=8146] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8146/stat : 8146 (python) S 7983 7985 7023 0 -1 4202560 32 935 0 0 0 0 0 0 18 0 9 0 671336610 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
[pid=7985/tid=8654] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8654/stat : 8654 (python) S 7983 7985 7023 0 -1 4202560 30 935 0 0 0 0 0 0 18 0 9 0 671385554 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
[pid=7985/tid=8676] ppid=7983 vsize=427208 CPUtime=0 cores=0,2,4,6
/proc/7985/task/8676/stat : 8676 (python) S 7983 7985 7023 0 -1 4202560 29 935 0 0 0 0 0 0 20 0 9 0 671434247 437460992 7386 33554432000 4194304 5683644 140734432818016 18446744073709551615 255389125041 0 0 16781312 2 18446604452540201664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5000.06
Current children cumulated vsize (KiB) 6849032

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7985 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=820875
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=121981
# CPU time returned by wait4() is 0.942856
# while last known CPU time is 5000.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4983.97
CPU time (s): 5000.06
CPU user time (s): 4991.85
CPU system time (s): 8.21
CPU usage (%): 100.323
Max. virtual memory (cumulated for all children) (KiB): 6849032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.820875
system time used= 0.121981
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18228
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1056
involuntary context switches= 29

runsolver used 29.3305 second user time and 57.1923 second system time

The end

Launcher Data 

Begin job on node135 at 2011-05-17 03:17:24
IDJOB=3386949
IDBENCH=83014
IDSOLVER=1872
FILE ID=node135/3386949-1305595044
RUNJOBID= node135-1305586144-7041
PBS_JOBID= 13350343
Free space on /tmp= 73460 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S788239782-034.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386949-1305595044/watcher-3386949-1305595044 -o /tmp/evaluation-result-3386949-1305595044/solver-3386949-1305595044 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386949-1305595044.cnf -seed 1265068383 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ea72de9bc2f16b1185170420c6413a72
RANDOM SEED=1265068383

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12585812 kB
Buffers:        329892 kB
Cached:        6551612 kB
SwapCached:      18100 kB
Active:       11507280 kB
Inactive:      8572068 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12585812 kB
SwapTotal:    67111528 kB
SwapFree:     63308196 kB
Dirty:           32492 kB
Writeback:           0 kB
AnonPages:    13185164 kB
Mapped:          30492 kB
Slab:           150480 kB
PageTables:      68672 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 117755932 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73656 MiB
End job on node135 at 2011-05-17 04:40:30