Trace number 3317927

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4712.67 1300.11

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E00N23.cnf
MD5SUM1a1f0dddf727883e0973677dd00e9269
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables15364
Number of clauses2210893
Sum of the clauses size20370578
Maximum clause length105
Minimum clause length1
Number of clauses of size 128
Number of clauses of size 241189
Number of clauses of size 336730
Number of clauses of size 432798
Number of clauses of size 5188784
Number of clauses of size over 51911364

Solver Data 

0.30/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.30/0.47	c INFO: solving HOME/instance-3317927-1304270802.cnf
0.30/0.47	c INFO: computing task features
20.49/20.67	c INFO: computed variable-clause graph statistics
20.98/21.16	c INFO: computed clause balance statistics
122.38/122.57	c INFO: computed variable balance statistics
153.08/153.20	c INFO: computed small-clause counts
153.19/153.36	c INFO: computed Horn-clause counts
158.49/158.64	c INFO: computed variable graph statistics
158.49/158.66	c INFO: collected features for HOME/instance-3317927-1304270802.cnf in 157.51 s
158.49/158.69	c INFO: running lingeling-276@0 for 97 with 4641 remaining (b = 0.25)
158.59/158.73	c INFO: running cryptominisat-2.9.0@0 for 485 with 4641 remaining (b = 0.19)
158.59/158.77	c INFO: running SApperloT@0 for 97 with 4641 remaining (b = 0.03)
158.68/158.80	c INFO: running lingeling-276@0 for 291 with 4641 remaining (b = 0.10)
554.55/257.97	c INFO: running lingeling-276@0 for 1261 with 4542 remaining (b = 0.28)
558.09/258.88	c INFO: running cryptominisat-2.9.0@0 for 1649 with 4541 remaining (b = 0.32)
1346.48/456.28	c INFO: running lingeling-276@0 for 1164 with 4344 remaining (b = 0.22)
2115.52/648.86	c INFO: running precosat-570@0 for 388 with 4151 remaining (b = 0.17)
3690.49/1043.46	c INFO: running lingeling-276@0 for 97 with 3757 remaining (b = 0.08)
4089.64/1143.68	c INFO: running SApperloT@0 for 97 with 3656 remaining (b = 0.01)
4489.18/1243.90	c INFO: running cryptominisat-2.9.0@0 for 97 with 3556 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317927-1304270802/watcher-3317927-1304270802 -o /tmp/evaluation-result-3317927-1304270802/solver-3317927-1304270802 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317927-1304270802.cnf -seed 816578095 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.42 7.67 6.41 6/207 1580
/proc/meminfo: memFree=20848900/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 679 0 0 0 0 0 0 0 23 0 1 0 538680995 15548416 573 33554432000 4194304 5683644 140733853998016 18446744073709551615 5145920 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 3796 577 321 364 0 283 0

[startup+0.080894 s]
/proc/loadavg: 7.42 7.67 6.41 6/207 1580
/proc/meminfo: memFree=20848900/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=85624 CPUtime=0.05 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 2629 0 0 0 4 1 0 0 18 0 1 0 538680995 87678976 2348 33554432000 4194304 5683644 140733853998016 18446744073709551615 5009114 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 21406 2348 713 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85624

[startup+0.10084 s]
/proc/loadavg: 7.42 7.67 6.41 6/207 1580
/proc/meminfo: memFree=20848900/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=104228 CPUtime=0.07 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 3055 0 0 0 5 2 0 0 17 0 1 0 538680995 106729472 2738 33554432000 4194304 5683644 140733853998016 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 26057 2741 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104228

[startup+0.300804 s]
/proc/loadavg: 7.42 7.67 6.41 6/207 1580
/proc/meminfo: memFree=20848900/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=168676 CPUtime=0.22 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 6722 936 1 0 18 4 0 0 18 0 1 0 538680995 172724224 4797 33554432000 4194304 5683644 140733853998016 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 42169 4797 1331 364 0 3454 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 168676

[startup+0.700767 s]
/proc/loadavg: 7.42 7.67 6.41 6/207 1580
/proc/meminfo: memFree=20848900/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=398580 CPUtime=0.58 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 39265 936 1 0 46 12 0 0 19 0 1 0 538680995 408145920 36942 33554432000 4194304 5683644 140733853998016 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 99645 36942 1761 364 0 35569 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 398580

[startup+1.50062 s]
/proc/loadavg: 7.42 7.67 6.41 6/208 1585
/proc/meminfo: memFree=20696000/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=418636 CPUtime=1.38 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 44020 936 1 0 125 13 0 0 20 0 1 0 538680995 428683264 41697 33554432000 4194304 5683644 140733853998016 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 104659 41697 1761 364 0 40583 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 418636

[startup+3.10032 s]
/proc/loadavg: 7.47 7.67 6.42 6/208 1585
/proc/meminfo: memFree=20626684/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=489768 CPUtime=2.98 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 61543 936 1 0 283 15 0 0 25 0 1 0 538680995 501522432 59221 33554432000 4194304 5683644 140733853998016 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 122442 59222 1761 364 0 58366 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 489768

[startup+6.30673 s]
/proc/loadavg: 7.47 7.67 6.42 6/208 1585
/proc/meminfo: memFree=20428292/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=696484 CPUtime=6.18 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 110955 936 1 0 596 22 0 0 25 0 1 0 538680995 713199616 108632 33554432000 4194304 5683644 140733853998016 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 174121 108632 1761 364 0 110045 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 696484

[startup+12.7005 s]
/proc/loadavg: 7.27 7.63 6.41 6/208 1585
/proc/meminfo: memFree=20091016/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=1090636 CPUtime=12.58 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 208115 936 1 0 1222 36 0 0 25 0 1 0 538680995 1116811264 205792 33554432000 4194304 5683644 140733853998016 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 272659 205792 1761 364 0 208583 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 1090636

[startup+25.5002 s]
/proc/loadavg: 6.77 7.50 6.39 6/208 1586
/proc/meminfo: memFree=19739208/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=1378080 CPUtime=25.38 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 484585 936 1 0 2467 71 0 0 25 0 1 0 538680995 1411153920 281936 33554432000 4194304 5683644 140733853998016 18446744073709551615 46919816839210 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 344520 281936 1826 364 0 280444 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 1378080

[startup+51.1004 s]
/proc/loadavg: 6.16 7.30 6.35 6/208 1586
/proc/meminfo: memFree=19731912/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=1378080 CPUtime=50.98 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 484585 936 1 0 5027 71 0 0 25 0 1 0 538680995 1411153920 281936 33554432000 4194304 5683644 140733853998016 18446744073709551615 46919816903217 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 344520 281936 1826 364 0 280444 0
Current children cumulated CPU time (s) 50.98
Current children cumulated vsize (KiB) 1378080

[startup+102.301 s]
/proc/loadavg: 5.56 6.96 6.28 6/208 1588
/proc/meminfo: memFree=19716108/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=1378080 CPUtime=102.18 cores=0,2,4,6
/proc/1580/stat : 1580 (python) R 1578 1580 788 0 -1 4202496 484585 936 1 0 10147 71 0 0 25 0 1 0 538680995 1411153920 281936 33554432000 4194304 5683644 140733853998016 18446744073709551615 46919819368751 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1580/statm: 344520 281936 1826 364 0 280444 0
Current children cumulated CPU time (s) 102.18
Current children cumulated vsize (KiB) 1378080

[startup+162.301 s]
/proc/loadavg: 5.25 6.61 6.20 9/221 1602
/proc/meminfo: memFree=19417380/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=859468 CPUtime=158.71 cores=0,2,4,6
/proc/1580/stat : 1580 (python) S 1578 1580 788 0 -1 4202496 504563 936 1 0 15788 83 0 0 20 0 5 0 538680995 880095232 142095 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1580/statm: 214867 142095 1881 364 0 150776 0
[pid=1591] ppid=1580 vsize=818456 CPUtime=0.01 cores=0,2,4,6
/proc/1591/stat : 1591 (python) S 1580 1580 788 0 -1 4202560 817 0 0 0 0 1 0 0 18 0 1 0 538696865 838098944 140556 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965263 0 0 16781312 514 4149287507172753668 0 0 17 2 0 0 0
/proc/1591/statm: 204614 140556 358 364 0 140532 0
[pid=1593] ppid=1591 vsize=223216 CPUtime=3.56 cores=0,2,4,6
/proc/1593/stat : 1593 (lingeling) R 1591 1593 1593 0 -1 4202496 68966 0 0 0 343 13 0 0 25 0 1 0 538696867 228573184 54956 33554432000 4194304 4352236 140735524656336 18446744073709551615 4255693 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/1593/statm: 55804 54956 117 39 0 54884 0
[pid=1594] ppid=1580 vsize=828712 CPUtime=0.01 cores=0,2,4,6
/proc/1594/stat : 1594 (python) S 1580 1580 788 0 -1 4202560 751 0 0 0 0 1 0 0 15 0 1 0 538696869 848601088 140549 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 629338194923487231 0 0 17 0 0 0 0
/proc/1594/statm: 207178 140549 347 364 0 143093 0
[pid=1596] ppid=1594 vsize=303664 CPUtime=3.53 cores=0,2,4,6
/proc/1596/stat : 1596 (cryptominisat-2) R 1594 1596 1596 0 -1 4202496 52357 0 0 0 342 11 0 0 25 0 1 0 538696870 310951936 51835 33554432000 4194304 4677096 140736887624816 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1596/statm: 75916 51835 361 118 0 70875 0
[pid=1597] ppid=1580 vsize=838968 CPUtime=0.01 cores=0,2,4,6
/proc/1597/stat : 1597 (python) S 1580 1580 788 0 -1 4202560 743 0 0 0 0 1 0 0 18 0 1 0 538696872 859103232 140553 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 11394595519582929154 0 0 17 6 0 0 0
/proc/1597/statm: 209742 140553 347 364 0 145654 0
[pid=1599] ppid=1597 vsize=214452 CPUtime=3.47 cores=0,2,4,6
/proc/1599/stat : 1599 (SApperloT-base) R 1597 1599 1599 0 -1 4202496 51880 0 0 0 334 13 0 0 25 0 1 0 538696874 219598848 47629 33554432000 134512640 135674940 4289754576 18446744073709551615 134564660 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1599/statm: 53613 47629 99 284 0 53327 0
[pid=1600] ppid=1580 vsize=849224 CPUtime=0.01 cores=0,2,4,6
/proc/1600/stat : 1600 (python) S 1580 1580 788 0 -1 4202560 755 0 0 0 0 1 0 0 18 0 1 0 538696876 869605376 140557 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 629326650051363073 0 0 17 0 0 0 0
/proc/1600/statm: 212306 140557 347 364 0 148215 0
[pid=1602] ppid=1600 vsize=223048 CPUtime=3.45 cores=0,2,4,6
/proc/1602/stat : 1602 (lingeling) R 1600 1602 1602 0 -1 4202496 68778 0 0 0 332 13 0 0 25 0 1 0 538696878 228401152 54946 33554432000 4194304 4352236 140737086362976 18446744073709551615 4247664 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/1602/statm: 55762 54946 117 39 0 54842 0
[pid=1580/tid=1592] ppid=1578 vsize=859468 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1592/stat : 1592 (python) S 1578 1580 788 0 -1 4202560 24 936 0 0 0 0 0 0 25 0 5 0 538696866 880095232 142095 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 4 0 0 0
[pid=1580/tid=1595] ppid=1578 vsize=859468 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1595/stat : 1595 (python) S 1578 1580 788 0 -1 4202560 21 936 0 0 0 0 0 0 20 0 5 0 538696870 880095232 142095 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 4 0 0 0
[pid=1580/tid=1598] ppid=1578 vsize=859468 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1598/stat : 1598 (python) S 1578 1580 788 0 -1 4202560 25 936 0 0 0 0 0 0 22 0 5 0 538696874 880095232 142095 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 6 0 0 0
[pid=1580/tid=1601] ppid=1578 vsize=859468 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1601/stat : 1601 (python) S 1578 1580 788 0 -1 4202560 31 936 0 0 0 0 0 0 20 0 5 0 538696878 880095232 142095 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 172.76
Current children cumulated vsize (KiB) 5159208

[startup+222.302 s]
/proc/loadavg: 7.23 6.92 6.33 9/221 1604
/proc/meminfo: memFree=18800448/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=859468 CPUtime=158.71 cores=0,2,4,6
/proc/1580/stat : 1580 (python) S 1578 1580 788 0 -1 4202496 504563 936 1 0 15788 83 0 0 20 0 5 0 538680995 880095232 142095 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1580/statm: 214867 142095 1881 364 0 150776 0
[pid=1591] ppid=1580 vsize=818456 CPUtime=0.09 cores=0,2,4,6
/proc/1591/stat : 1591 (python) S 1580 1580 788 0 -1 4202560 1018 0 0 0 5 4 0 0 18 0 1 0 538696865 838098944 140579 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965263 0 0 16781312 514 6626695007954764036 0 0 17 2 0 0 0
/proc/1591/statm: 204614 140579 381 364 0 140532 0
[pid=1593] ppid=1591 vsize=236924 CPUtime=63.39 cores=0,2,4,6
/proc/1593/stat : 1593 (lingeling) R 1591 1593 1593 0 -1 4202496 138266 0 0 0 6316 23 0 0 25 0 1 0 538696867 242610176 58395 33554432000 4194304 4352236 140735524656336 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/1593/statm: 59231 58395 129 39 0 58311 0
[pid=1594] ppid=1580 vsize=828712 CPUtime=0.1 cores=0,2,4,6
/proc/1594/stat : 1594 (python) S 1580 1580 788 0 -1 4202560 931 0 0 0 5 5 0 0 15 0 1 0 538696869 848601088 140572 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 6626695007954764036 0 0 17 0 0 0 0
/proc/1594/statm: 207178 140572 370 364 0 143093 0
[pid=1596] ppid=1594 vsize=871148 CPUtime=63.53 cores=0,2,4,6
/proc/1596/stat : 1596 (cryptominisat-2) R 1594 1596 1596 0 -1 4202496 185408 0 0 0 6324 29 0 0 25 0 1 0 538696870 892055552 184886 33554432000 4194304 4677096 140736887624816 18446744073709551615 4502837 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1596/statm: 217787 184886 378 118 0 212746 0
[pid=1597] ppid=1580 vsize=838968 CPUtime=0.09 cores=0,2,4,6
/proc/1597/stat : 1597 (python) S 1580 1580 788 0 -1 4202560 951 0 0 0 4 5 0 0 18 0 1 0 538696872 859103232 140576 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 6626695007954764034 0 0 17 6 0 0 0
/proc/1597/statm: 209742 140576 370 364 0 145654 0
[pid=1599] ppid=1597 vsize=266704 CPUtime=62.99 cores=0,2,4,6
/proc/1599/stat : 1599 (SApperloT-base) R 1597 1599 1599 0 -1 4202496 63074 0 0 0 6283 16 0 0 25 0 1 0 538696874 273104896 58823 33554432000 134512640 135674940 4289754576 18446744073709551615 134567915 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1599/statm: 66676 58823 100 284 0 66390 0
[pid=1600] ppid=1580 vsize=849224 CPUtime=0.09 cores=0,2,4,6
/proc/1600/stat : 1600 (python) S 1580 1580 788 0 -1 4202560 958 0 0 0 4 5 0 0 18 0 1 0 538696876 869605376 140580 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 6626695007954764033 0 0 17 0 0 0 0
/proc/1600/statm: 212306 140580 370 364 0 148215 0
[pid=1602] ppid=1600 vsize=236336 CPUtime=63.38 cores=0,2,4,6
/proc/1602/stat : 1602 (lingeling) R 1600 1602 1602 0 -1 4202496 138129 0 0 0 6315 23 0 0 25 0 1 0 538696878 242008064 58248 33554432000 4194304 4352236 140737086362976 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/1602/statm: 59084 58248 129 39 0 58164 0
[pid=1580/tid=1592] ppid=1578 vsize=859468 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1592/stat : 1592 (python) S 1578 1580 788 0 -1 4202560 24 936 0 0 0 0 0 0 25 0 5 0 538696866 880095232 142095 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 4 0 0 0

################
# More data... #
################

/proc/1648/stat : 1648 (cryptominisat-2) R 1646 1648 1648 0 -1 4202496 219573 0 0 0 98043 38 0 0 25 0 1 0 538706886 921735168 188373 33554432000 4194304 4677096 140735300907568 18446744073709551615 4462632 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1648/statm: 225033 188373 388 118 0 219992 0
[pid=1683] ppid=1580 vsize=879992 CPUtime=0.6 cores=0,2,4,6
/proc/1683/stat : 1683 (python) S 1580 1580 788 0 -1 4202560 1159 0 0 0 31 29 0 0 19 0 2 0 538745882 901111808 140622 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1683/statm: 219998 140622 399 364 0 155898 0
[pid=1685] ppid=1683 vsize=373796 CPUtime=393.35 cores=0,2,4,6
/proc/1685/stat : 1685 (precosat) T 1683 1685 1685 0 -1 4202496 612173 0 0 0 39236 99 0 0 25 0 1 0 538745884 382767104 93321 33554432000 4194304 4890832 140736576892912 18446744073709551615 4238607 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/1685/statm: 93449 93321 86 171 0 93276 0
[pid=1683/tid=1705] ppid=1580 vsize=879992 CPUtime=0 cores=0,2,4,6
/proc/1683/task/1705/stat : 1705 (python) S 1580 1580 788 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538785339 901111808 140622 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 514 18446604453882605760 0 0 -1 0 0 0 0
[pid=1706] ppid=1580 vsize=890248 CPUtime=0.16 cores=0,2,4,6
/proc/1706/stat : 1706 (python) S 1580 1580 788 0 -1 4202560 1173 0 0 0 9 7 0 0 19 0 2 0 538785341 911613952 140632 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1706/statm: 222562 140632 405 364 0 158459 0
[pid=1708] ppid=1706 vsize=239200 CPUtime=98.5 cores=0,2,4,6
/proc/1708/stat : 1708 (lingeling) T 1706 1708 1708 0 -1 4202496 138844 0 0 0 9823 27 0 0 25 0 1 0 538785344 244940800 58964 33554432000 4194304 4352236 140734955666640 18446744073709551615 4235610 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/1708/statm: 59800 58964 129 39 0 58880 0
[pid=1706/tid=1715] ppid=1580 vsize=890248 CPUtime=0 cores=0,2,4,6
/proc/1706/task/1715/stat : 1715 (python) S 1580 1580 788 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538795361 911613952 140632 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 514 18446604453874162688 0 0 -1 0 0 0 0
[pid=1716] ppid=1580 vsize=900504 CPUtime=0.16 cores=0,2,4,6
/proc/1716/stat : 1716 (python) S 1580 1580 788 0 -1 4202560 968 0 0 0 8 8 0 0 18 0 1 0 538795364 922116096 140600 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 6626695007954764033 0 0 17 0 0 0 0
/proc/1716/statm: 225126 140600 370 364 0 161020 0
[pid=1718] ppid=1716 vsize=282292 CPUtime=98.27 cores=0,2,4,6
/proc/1718/stat : 1718 (SApperloT-base) R 1716 1718 1718 0 -1 4202496 66757 0 0 0 9806 21 0 0 25 0 1 0 538795366 289067008 62372 33554432000 134512640 135674940 4294588912 18446744073709551615 134564568 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1718/statm: 70573 62372 100 284 0 70287 0
[pid=1580/tid=1592] ppid=1578 vsize=910748 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1592/stat : 1592 (python) S 1578 1580 788 0 -1 4202560 29 936 0 0 0 0 0 0 18 0 10 0 538696866 932605952 142126 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 4 0 0 0
[pid=1580/tid=1595] ppid=1578 vsize=910748 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1595/stat : 1595 (python) S 1578 1580 788 0 -1 4202560 21 936 0 0 0 0 0 0 20 0 10 0 538696870 932605952 142126 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 4 0 0 0
[pid=1580/tid=1598] ppid=1578 vsize=910748 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1598/stat : 1598 (python) S 1578 1580 788 0 -1 4202560 25 936 0 0 0 0 0 0 22 0 10 0 538696874 932605952 142126 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 6 0 0 0
[pid=1580/tid=1601] ppid=1578 vsize=910748 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1601/stat : 1601 (python) S 1578 1580 788 0 -1 4202560 31 936 0 0 0 0 0 0 20 0 10 0 538696878 932605952 142126 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1643] ppid=1578 vsize=910748 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1643/stat : 1643 (python) S 1578 1580 788 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 10 0 538706795 932605952 142126 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1647] ppid=1578 vsize=910748 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1647/stat : 1647 (python) S 1578 1580 788 0 -1 4202560 32 936 0 0 0 0 0 0 20 0 10 0 538706886 932605952 142126 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1684] ppid=1578 vsize=910748 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1684/stat : 1684 (python) S 1578 1580 788 0 -1 4202560 33 936 0 0 0 0 0 0 20 0 10 0 538745884 932605952 142126 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1707] ppid=1578 vsize=910748 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1707/stat : 1707 (python) S 1578 1580 788 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 10 0 538785344 932605952 142126 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1717] ppid=1578 vsize=910748 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1717/stat : 1717 (python) S 1578 1580 788 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 10 0 538795366 932605952 142126 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4482.79
Current children cumulated vsize (KiB) 12461192



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 8.15 8.03 7.35 10/259 1728
/proc/meminfo: memFree=9394408/32951124 swapFree=67111524/67111528
[pid=1580] ppid=1578 vsize=921004 CPUtime=159 cores=0,2,4,6
/proc/1580/stat : 1580 (python) S 1578 1580 788 0 -1 4202496 509517 936 1 0 15805 95 0 0 19 0 11 0 538680995 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1580/statm: 230251 142132 1894 364 0 166142 0
[pid=1591] ppid=1580 vsize=828700 CPUtime=1.4 cores=0,2,4,6
/proc/1591/stat : 1591 (python) S 1580 1580 788 0 -1 4202560 1225 0 0 0 78 62 0 0 18 0 2 0 538696865 848588800 140618 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1591/statm: 207175 140618 415 364 0 143093 0
[pid=1593] ppid=1591 vsize=378660 CPUtime=936.77 cores=0,2,4,6
/proc/1593/stat : 1593 (lingeling) R 1591 1593 1593 0 -1 4202496 240469 0 0 0 93633 44 0 0 25 0 1 0 538696867 387747840 93829 33554432000 4194304 4352236 140735524656336 18446744073709551615 4245509 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/1593/statm: 94665 93829 129 39 0 93745 0
[pid=1591/tid=1645] ppid=1580 vsize=828700 CPUtime=0 cores=0,2,4,6
/proc/1591/task/1645/stat : 1645 (python) S 1580 1580 788 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538706881 848588800 140618 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 514 18446604453878774528 0 0 -1 2 0 0 0
[pid=1594] ppid=1580 vsize=828712 CPUtime=0.73 cores=0,2,4,6
/proc/1594/stat : 1594 (python) S 1580 1580 788 0 -1 4202560 1124 0 0 0 38 35 0 0 16 0 2 0 538696869 848601088 140602 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1594/statm: 207178 140602 399 364 0 143093 0
[pid=1596] ppid=1594 vsize=871148 CPUtime=490.08 cores=0,2,4,6
/proc/1596/stat : 1596 (cryptominisat-2) T 1594 1596 1596 0 -1 4202496 185408 0 0 0 48977 31 0 0 25 0 1 0 538696870 892055552 184886 33554432000 4194304 4677096 140736887624816 18446744073709551615 4502824 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/1596/statm: 217787 184886 378 118 0 212746 0
[pid=1594/tid=1682] ppid=1580 vsize=828712 CPUtime=0 cores=0,2,4,6
/proc/1594/task/1682/stat : 1682 (python) S 1580 1580 788 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 538745879 848601088 140602 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 514 18446604453059222464 0 0 -1 0 0 0 0
[pid=1597] ppid=1580 vsize=838968 CPUtime=0.15 cores=0,2,4,6
/proc/1597/stat : 1597 (python) S 1580 1580 788 0 -1 4202560 1118 0 0 0 7 8 0 0 19 0 2 0 538696872 859103232 140606 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/1597/statm: 209742 140606 399 364 0 145654 0
[pid=1599] ppid=1597 vsize=278452 CPUtime=98.36 cores=0,2,4,6
/proc/1599/stat : 1599 (SApperloT-base) T 1597 1599 1599 0 -1 4202496 65446 0 0 0 9819 17 0 0 25 0 1 0 538696874 285134848 61195 33554432000 134512640 135674940 4289754576 18446744073709551615 134564660 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/1599/statm: 69613 61195 100 284 0 69327 0
[pid=1597/tid=1641] ppid=1580 vsize=838968 CPUtime=0 cores=0,2,4,6
/proc/1597/task/1641/stat : 1641 (python) S 1580 1580 788 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 538706790 859103232 140606 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 514 18446604451270736960 0 0 -1 6 0 0 0
[pid=1600] ppid=1580 vsize=849224 CPUtime=0.44 cores=0,2,4,6
/proc/1600/stat : 1600 (python) S 1580 1580 788 0 -1 4202560 1157 0 0 0 24 20 0 0 19 0 2 0 538696876 869605376 140610 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1600/statm: 212306 140610 399 364 0 148215 0
[pid=1602] ppid=1600 vsize=244744 CPUtime=296.4 cores=0,2,4,6
/proc/1602/stat : 1602 (lingeling) T 1600 1602 1602 0 -1 4202496 173324 0 0 0 29609 31 0 0 25 0 1 0 538696878 250617856 60350 33554432000 4194304 4352236 140737086362976 18446744073709551615 4329265 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/1602/statm: 61186 60350 129 39 0 60266 0
[pid=1600/tid=1666] ppid=1580 vsize=849224 CPUtime=0 cores=0,2,4,6
/proc/1600/task/1666/stat : 1666 (python) S 1580 1580 788 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538726621 869605376 140610 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 514 18446604453059219776 0 0 -1 0 0 0 0
[pid=1642] ppid=1580 vsize=859480 CPUtime=1.55 cores=0,2,4,6
/proc/1642/stat : 1642 (python) S 1580 1580 788 0 -1 4202560 1004 0 0 0 88 67 0 0 18 0 1 0 538706793 880107520 140584 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 6626695007954764035 0 0 17 0 0 0 0
/proc/1642/statm: 214870 140584 370 364 0 150776 0
[pid=1644] ppid=1642 vsize=236456 CPUtime=1040.14 cores=0,2,4,6
/proc/1644/stat : 1644 (lingeling) R 1642 1644 1644 0 -1 4202496 229024 0 0 0 103972 42 0 0 25 0 1 0 538706796 242130944 58279 33554432000 4194304 4352236 140733278645552 18446744073709551615 4267956 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/1644/statm: 59114 58279 129 39 0 58194 0
[pid=1646] ppid=1580 vsize=869736 CPUtime=1.56 cores=0,2,4,6
/proc/1646/stat : 1646 (python) S 1580 1580 788 0 -1 4202560 1010 0 0 0 82 74 0 0 15 0 1 0 538706884 890609664 140588 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 6626695007954764034 0 0 17 2 0 0 0
/proc/1646/statm: 217434 140588 370 364 0 153337 0
[pid=1648] ppid=1646 vsize=922764 CPUtime=1038.33 cores=0,2,4,6
/proc/1648/stat : 1648 (cryptominisat-2) R 1646 1648 1648 0 -1 4202496 224152 0 0 0 103795 38 0 0 25 0 1 0 538706886 944910336 192952 33554432000 4194304 4677096 140735300907568 18446744073709551615 4502837 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1648/statm: 230691 192952 500 118 0 225650 0
[pid=1683] ppid=1580 vsize=879992 CPUtime=0.6 cores=0,2,4,6
/proc/1683/stat : 1683 (python) S 1580 1580 788 0 -1 4202560 1159 0 0 0 31 29 0 0 19 0 2 0 538745882 901111808 140622 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1683/statm: 219998 140622 399 364 0 155898 0
[pid=1685] ppid=1683 vsize=373796 CPUtime=393.35 cores=0,2,4,6
/proc/1685/stat : 1685 (precosat) T 1683 1685 1685 0 -1 4202496 612173 0 0 0 39236 99 0 0 25 0 1 0 538745884 382767104 93321 33554432000 4194304 4890832 140736576892912 18446744073709551615 4238607 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/1685/statm: 93449 93321 86 171 0 93276 0
[pid=1683/tid=1705] ppid=1580 vsize=879992 CPUtime=0 cores=0,2,4,6
/proc/1683/task/1705/stat : 1705 (python) S 1580 1580 788 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538785339 901111808 140622 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 514 18446604453882605760 0 0 -1 0 0 0 0
[pid=1706] ppid=1580 vsize=890248 CPUtime=0.16 cores=0,2,4,6
/proc/1706/stat : 1706 (python) S 1580 1580 788 0 -1 4202560 1173 0 0 0 9 7 0 0 19 0 2 0 538785341 911613952 140632 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1706/statm: 222562 140632 405 364 0 158459 0
[pid=1708] ppid=1706 vsize=239200 CPUtime=98.5 cores=0,2,4,6
/proc/1708/stat : 1708 (lingeling) T 1706 1708 1708 0 -1 4202496 138844 0 0 0 9823 27 0 0 25 0 1 0 538785344 244940800 58964 33554432000 4194304 4352236 140734955666640 18446744073709551615 4235610 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/1708/statm: 59800 58964 129 39 0 58880 0
[pid=1706/tid=1715] ppid=1580 vsize=890248 CPUtime=0 cores=0,2,4,6
/proc/1706/task/1715/stat : 1715 (python) S 1580 1580 788 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538795361 911613952 140632 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 514 18446604453874162688 0 0 -1 0 0 0 0
[pid=1716] ppid=1580 vsize=900504 CPUtime=0.17 cores=0,2,4,6
/proc/1716/stat : 1716 (python) S 1580 1580 788 0 -1 4202560 1127 0 0 0 8 9 0 0 19 0 2 0 538795364 922116096 140630 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1716/statm: 225126 140630 399 364 0 161020 0
[pid=1718] ppid=1716 vsize=282292 CPUtime=99.84 cores=0,2,4,6
/proc/1718/stat : 1718 (SApperloT-base) T 1716 1718 1718 0 -1 4202496 66759 0 0 0 9963 21 0 0 25 0 1 0 538795366 289067008 62374 33554432000 134512640 135674940 4294588912 18446744073709551615 134564660 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/1718/statm: 70573 62374 100 284 0 70287 0
[pid=1716/tid=1723] ppid=1580 vsize=900504 CPUtime=0 cores=0,2,4,6
/proc/1716/task/1723/stat : 1723 (python) S 1580 1580 788 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538805383 922116096 140630 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 514 18446604453856447488 0 0 -1 0 0 0 0
[pid=1724] ppid=1580 vsize=910760 CPUtime=0.09 cores=0,2,4,6
/proc/1724/stat : 1724 (python) S 1580 1580 788 0 -1 4202560 964 0 0 0 4 5 0 0 15 0 1 0 538805386 932618240 140604 33554432000 4194304 5683644 140733853998016 18446744073709551615 244446965318 0 0 16781312 514 6626695007954764034 0 0 17 6 0 0 0
/proc/1724/statm: 227690 140604 370 364 0 163581 0
[pid=1726] ppid=1724 vsize=871144 CPUtime=55.05 cores=0,2,4,6
/proc/1726/stat : 1726 (cryptominisat-2) R 1724 1726 1726 0 -1 4202496 185411 0 0 0 5475 30 0 0 25 0 1 0 538805388 892051456 184886 33554432000 4194304 4677096 140735220294896 18446744073709551615 4502837 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/1726/statm: 217786 184886 378 118 0 212745 0
[pid=1580/tid=1592] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1592/stat : 1592 (python) S 1578 1580 788 0 -1 4202560 29 936 0 0 0 0 0 0 18 0 11 0 538696866 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 4 0 0 0
[pid=1580/tid=1595] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1595/stat : 1595 (python) S 1578 1580 788 0 -1 4202560 21 936 0 0 0 0 0 0 20 0 11 0 538696870 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 4 0 0 0
[pid=1580/tid=1598] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1598/stat : 1598 (python) S 1578 1580 788 0 -1 4202560 25 936 0 0 0 0 0 0 22 0 11 0 538696874 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 6 0 0 0
[pid=1580/tid=1601] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1601/stat : 1601 (python) S 1578 1580 788 0 -1 4202560 31 936 0 0 0 0 0 0 20 0 11 0 538696878 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1643] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1643/stat : 1643 (python) S 1578 1580 788 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 11 0 538706795 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1647] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1647/stat : 1647 (python) S 1578 1580 788 0 -1 4202560 32 936 0 0 0 0 0 0 20 0 11 0 538706886 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1684] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1684/stat : 1684 (python) S 1578 1580 788 0 -1 4202560 33 936 0 0 0 0 0 0 20 0 11 0 538745884 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1707] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1707/stat : 1707 (python) S 1578 1580 788 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 11 0 538785344 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1717] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1717/stat : 1717 (python) S 1578 1580 788 0 -1 4202560 24 936 0 0 0 0 0 0 20 0 11 0 538795366 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
[pid=1580/tid=1725] ppid=1578 vsize=921004 CPUtime=0 cores=0,2,4,6
/proc/1580/task/1725/stat : 1725 (python) S 1578 1580 788 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 11 0 538805388 943108096 142132 33554432000 4194304 5683644 140733853998016 18446744073709551615 244458768817 0 0 16781312 2 18446604453985321024 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4712.67
Current children cumulated vsize (KiB) 14275984

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1580 and gives
#  childrusage.ru_utime.tv_sec=158
#  childrusage.ru_utime.tv_usec=53972
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=992849
# CPU time returned by wait4() is 159.047
# while last known CPU time is 4712.67
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.11
CPU time (s): 4712.67
CPU user time (s): 4704.76
CPU system time (s): 7.91
CPU usage (%): 362.483
Max. virtual memory (cumulated for all children) (KiB): 14275988

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 158.054
system time used= 0.992849
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 510461
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1073
involuntary context switches= 1866

runsolver used 3.70044 second user time and 8.04378 second system time

The end

Launcher Data 

Begin job on node105 at 2011-05-01 19:26:45
IDJOB=3317927
IDBENCH=83466
IDSOLVER=1706
FILE ID=node105/3317927-1304270802
RUNJOBID= node105-1304267294-806
PBS_JOBID= 13173973
Free space on /tmp= 73276 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E00N23.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317927-1304270802/watcher-3317927-1304270802 -o /tmp/evaluation-result-3317927-1304270802/solver-3317927-1304270802 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317927-1304270802.cnf -seed 816578095 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1a1f0dddf727883e0973677dd00e9269
RANDOM SEED=816578095

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20848932 kB
Buffers:       2191248 kB
Cached:        6646156 kB
SwapCached:          4 kB
Active:        3673764 kB
Inactive:      7856340 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20848932 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:          145996 kB
Writeback:           0 kB
AnonPages:     2692264 kB
Mapped:          23184 kB
Slab:           497604 kB
PageTables:      15804 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  3772152 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73168 MiB
End job on node105 at 2011-05-01 19:48:28