Trace number 3498283

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (TO) 5000.03 5014.85

General information on the benchmark

Nameibm-2002-30r-k85.cnf
MD5SUMc08fe2d9c476652207ada677b7ca59f9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark39.8859
Satisfiable
(Un)Satisfiability was proved
Number of variables181484
Number of clauses890298
Sum of the clauses size2338581
Maximum clause length19
Minimum clause length1
Number of clauses of size 1771
Number of clauses of size 2667172
Number of clauses of size 3144951
Number of clauses of size 424791
Number of clauses of size 511035
Number of clauses of size over 541578

Solver Data 

0.61/21.83	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.61/21.83	c INFO: solving HOME/instance-3498283-1307953118.cnf
0.61/21.83	c INFO: computing task features
3.57/24.81	c INFO: computed variable-clause graph statistics
3.67/24.92	c INFO: computed clause balance statistics
17.37/38.63	c INFO: computed variable balance statistics
27.27/48.51	c INFO: computed small-clause counts
27.37/48.69	c INFO: computed Horn-clause counts
65.48/86.75	c INFO: computed variable graph statistics
65.48/86.75	c INFO: collected features for HOME/instance-3498283-1307953118.cnf in 64.83 s
65.48/86.79	c INFO: running lingeling-276@0 for 97 with 4935 remaining (b = 0.22)
165.76/186.93	c INFO: running cryptominisat-2.9.0@0 for 485 with 4835 remaining (b = 0.19)
656.51/677.16	c INFO: running lingeling-276@100 for 485 with 4345 remaining (b = 0.19)
1144.58/1164.67	c INFO: running lingeling-276@0 for 97 with 3857 remaining (b = 0.17)
1244.89/1264.82	c INFO: running precosat-570@0 for 194 with 3757 remaining (b = 0.06)
1441.29/1461.05	c INFO: running precosat-570@196 for 97 with 3561 remaining (b = 0.03)
1536.50/1556.17	c INFO: running lingeling-276@587 for 679 with 3466 remaining (b = 0.18)
2217.02/2235.88	c INFO: running cryptominisat-2.9.0@489 for 1164 with 2786 remaining (b = 0.32)
3379.00/3396.17	c INFO: running cryptominisat-2.9.0@1649 for 97 with 1627 remaining (b = 0.04)
3477.74/3494.73	c INFO: running cryptominisat-2.9.0@1747 for 194 with 1528 remaining (b = 0.08)
3675.82/3692.51	c INFO: running cryptominisat-2.9.0@0 for 1330 with 1330 remaining (b = 0.29)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /var/tmp/evaluation-result-3498283-1307953118/watcher-3498283-1307953118 -o /var/tmp/evaluation-result-3498283-1307953118/solver-3498283-1307953118 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498283-1307953118.cnf -seed 320810650 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.07 0.02 0.00 2/176 28326
/proc/meminfo: memFree=3008544/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=11804 CPUtime=0 cores=1,3,5,7
/proc/28326/stat : 28326 (runsolver) S 28322 28326 28281 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 1 0 906911060 12087296 50 33554432000 4194304 5436572 140734095305792 18446744073709551615 4883175 0 2147483391 4096 24578 18446744071699968823 0 0 17 1 0 0 0
/proc/28326/statm: 2951 50 31 304 0 2643 0

[startup+0.0249019 s]
/proc/loadavg: 0.07 0.02 0.00 2/176 28326
/proc/meminfo: memFree=3008544/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=11804 CPUtime=0 cores=1,3,5,7
/proc/28326/stat : 28326 (runsolver) S 28322 28326 28281 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 1 0 906911060 12087296 50 33554432000 4194304 5436572 140734095305792 18446744073709551615 4883175 0 2147483391 4096 24578 18446744071699968823 0 0 17 1 0 0 0
/proc/28326/statm: 2951 50 31 304 0 2643 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 11804

[startup+0.100875 s]
/proc/loadavg: 0.07 0.02 0.00 2/176 28326
/proc/meminfo: memFree=3008544/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=6240 CPUtime=0 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4194304 98 0 2 0 0 0 0 0 17 0 1 0 906911060 6389760 51 33554432000 4194304 5683644 140736910253184 18446744073709551615 210199723655 0 2147483391 4096 0 18446744071699207358 0 0 17 3 0 0 2
/proc/28326/statm: 1560 51 40 364 0 42 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 6240

[startup+0.300844 s]
/proc/loadavg: 0.07 0.02 0.00 2/176 28326
/proc/meminfo: memFree=3008544/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=15080 CPUtime=0 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 611 0 7 0 0 0 0 0 16 0 1 0 906911060 15441920 513 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 3 0 0 7
/proc/28326/statm: 3770 513 300 364 0 257 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15080

[startup+0.700785 s]
/proc/loadavg: 0.07 0.02 0.00 2/176 28326
/proc/meminfo: memFree=3008544/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=15188 CPUtime=0 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 722 0 7 0 0 0 0 0 16 0 1 0 906911060 15552512 617 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204643252 0 2147483391 16781312 2 18446744071699953811 0 0 17 3 0 0 11
/proc/28326/statm: 3797 617 322 364 0 284 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15188

[startup+1.50064 s]
/proc/loadavg: 0.07 0.02 0.00 2/178 28328
/proc/meminfo: memFree=3002328/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=15904 CPUtime=0 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 938 0 7 0 0 0 0 0 15 0 1 0 906911060 16285696 820 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204643173 0 2147483391 16781312 2 18446744071699207358 0 0 17 3 0 0 18
/proc/28326/statm: 3976 820 357 364 0 463 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15904

[startup+3.10037 s]
/proc/loadavg: 0.07 0.02 0.00 3/178 28328
/proc/meminfo: memFree=2998860/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=16392 CPUtime=0.02 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 1115 0 7 0 1 1 0 0 15 0 1 0 906911060 16785408 988 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 42
/proc/28326/statm: 4098 988 413 364 0 585 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 16392
heavy processes:

[startup+6.30083 s]
/proc/loadavg: 0.15 0.03 0.01 2/178 28328
/proc/meminfo: memFree=2998280/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=29788 CPUtime=0.05 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 1437 0 11 0 3 2 0 0 16 0 1 0 906911060 30502912 1288 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 63
/proc/28326/statm: 7447 1288 443 364 0 817 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 29788
heavy processes:

[startup+12.7007 s]
/proc/loadavg: 0.21 0.05 0.01 3/178 28329
/proc/meminfo: memFree=2984076/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=107292 CPUtime=0.16 cores=1,3,5,7
/proc/28326/stat : 28326 (python) D 28322 28326 28281 0 -1 4202496 3306 0 34 0 8 8 0 0 16 0 1 0 906911060 109867008 2999 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204645376 0 0 16781312 2 0 0 0 17 7 0 0 97
/proc/28326/statm: 26823 2999 871 364 0 2054 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 107292
heavy processes:

[startup+25.5006 s]
/proc/loadavg: 0.54 0.13 0.04 4/178 28337
/proc/meminfo: memFree=2559792/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=471940 CPUtime=4.27 cores=1,3,5,7
/proc/28326/stat : 28326 (python) R 28322 28326 28281 0 -1 4202496 79729 926 112 8 392 35 0 0 21 0 1 0 906911060 483266560 55370 33554432000 4194304 5683644 140736910253184 18446744073709551615 4620239 0 0 16781312 2 0 0 0 17 1 0 0 311
/proc/28326/statm: 117985 55370 1826 364 0 53909 0
Current children cumulated CPU time (s) 4.27
Current children cumulated vsize (KiB) 471940
heavy processes:

[startup+51.1003 s]
/proc/loadavg: 1.04 0.28 0.09 4/178 28337
/proc/meminfo: memFree=2553220/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=471940 CPUtime=29.87 cores=1,3,5,7
/proc/28326/stat : 28326 (python) R 28322 28326 28281 0 -1 4202496 79736 926 112 8 2952 35 0 0 25 0 1 0 906911060 483266560 55377 33554432000 4194304 5683644 140736910253184 18446744073709551615 47094531049612 0 0 16781312 2 0 0 0 17 1 0 0 311
/proc/28326/statm: 117985 55377 1833 364 0 53909 0
Current children cumulated CPU time (s) 29.87
Current children cumulated vsize (KiB) 471940
heavy processes:

[startup+102.307 s]
/proc/loadavg: 1.65 0.55 0.19 4/181 28342
/proc/meminfo: memFree=2494800/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=467308 CPUtime=65.57 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 80116 926 112 8 6520 37 0 0 19 0 2 0 906911060 478523392 51698 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 311
/proc/28326/statm: 116827 51698 1875 364 0 52745 0
[pid=28340] ppid=28326 vsize=457064 CPUtime=0.01 cores=1,3,5,7
/proc/28340/stat : 28340 (python) S 28326 28326 28281 0 -1 4202560 974 0 0 0 0 1 0 0 18 0 1 0 906919740 468033536 50200 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204667407 0 0 16781312 514 703071715265052936 0 0 17 3 0 0 0
/proc/28340/statm: 114266 50200 381 364 0 50184 0
[pid=28342] ppid=28340 vsize=74836 CPUtime=15.49 cores=1,3,5,7
/proc/28342/stat : 28342 (lingeling) R 28340 28342 28342 0 -1 4202496 27733 0 0 0 1545 4 0 0 25 0 1 0 906919741 76632064 17879 33554432000 4194304 4352236 140734533797648 18446744073709551615 4327902 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/28342/statm: 18709 17879 129 39 0 17789 0
[pid=28326/tid=28341] ppid=28322 vsize=467308 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28341/stat : 28341 (python) S 28322 28326 28281 0 -1 4202560 28 926 0 8 0 0 0 0 19 0 2 0 906919741 478523392 51698 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 81.07
Current children cumulated vsize (KiB) 999208
heavy processes:

[startup+162.301 s]
/proc/loadavg: 1.87 0.81 0.30 4/184 28347
/proc/meminfo: memFree=2453648/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=467308 CPUtime=65.57 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 80116 926 112 8 6520 37 0 0 19 0 2 0 906911060 478523392 51698 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 311
/proc/28326/statm: 116827 51698 1875 364 0 52745 0
[pid=28340] ppid=28326 vsize=457064 CPUtime=0.08 cores=1,3,5,7
/proc/28340/stat : 28340 (python) S 28326 28326 28281 0 -1 4202560 999 0 0 0 3 5 0 0 18 0 1 0 906919740 468033536 50200 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204667407 0 0 16781312 514 703071715265052936 0 0 17 3 0 0 0
/proc/28340/statm: 114266 50200 381 364 0 50184 0
[pid=28342] ppid=28340 vsize=74708 CPUtime=75.48 cores=1,3,5,7
/proc/28342/stat : 28342 (lingeling) R 28340 28342 28342 0 -1 4202496 29588 0 0 0 7544 4 0 0 25 0 1 0 906919741 76500992 17847 33554432000 4194304 4352236 140734533797648 18446744073709551615 4234517 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/28342/statm: 18677 17847 129 39 0 17757 0
[pid=28326/tid=28341] ppid=28322 vsize=467308 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28341/stat : 28341 (python) S 28322 28326 28281 0 -1 4202560 28 926 0 8 0 0 0 0 19 0 2 0 906919741 478523392 51698 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 141.13
Current children cumulated vsize (KiB) 999080

[startup+222.3 s]
/proc/loadavg: 1.95 1.03 0.41 3/185 28395
/proc/meminfo: memFree=1756304/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=477564 CPUtime=65.59 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 80881 926 112 8 6522 37 0 0 20 0 3 0 906911060 489025536 51705 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 311
/proc/28326/statm: 119391 51705 1878 364 0 55306 0
[pid=28340] ppid=28326 vsize=467308 CPUtime=0.12 cores=1,3,5,7
/proc/28340/stat : 28340 (python) S 28326 28326 28281 0 -1 4202560 1171 0 0 0 5 7 0 0 19 0 2 0 906919740 478523392 50238 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/28340/statm: 116827 50238 414 364 0 52745 0
[pid=28342] ppid=28340 vsize=74672 CPUtime=100.09 cores=1,3,5,7
/proc/28342/stat : 28342 (lingeling) T 28340 28342 28342 0 -1 4202496 29588 0 0 0 10005 4 0 0 25 0 1 0 906919741 76464128 17838 33554432000 4194304 4352236 140734533797648 18446744073709551615 4270293 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/28342/statm: 18668 17838 129 39 0 17748 0
[pid=28340/tid=28348] ppid=28326 vsize=467308 CPUtime=0 cores=1,3,5,7
/proc/28340/task/28348/stat : 28348 (python) S 28326 28326 28281 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 906929752 478523392 50238 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604465607405632 0 0 -1 3 0 0 0
[pid=28349] ppid=28326 vsize=467320 CPUtime=0.04 cores=1,3,5,7
/proc/28349/stat : 28349 (python) S 28326 28326 28281 0 -1 4202560 915 0 0 0 2 2 0 0 15 0 1 0 906929754 478535680 50193 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204667462 0 0 16781312 514 4415168110466662664 0 0 17 3 0 0 0
/proc/28349/statm: 116830 50193 370 364 0 52745 0
[pid=28351] ppid=28349 vsize=515836 CPUtime=35.26 cores=1,3,5,7
/proc/28351/stat : 28351 (cryptominisat-2) R 28349 28351 28351 0 -1 4202496 138991 0 1 0 3508 18 0 0 25 0 1 0 906929755 528216064 116815 33554432000 4194304 4677096 140735100550624 18446744073709551615 4569186 0 0 16781312 2 0 0 0 17 1 0 0 8
/proc/28351/statm: 128959 116815 395 118 0 123918 0
[pid=28326/tid=28341] ppid=28322 vsize=477564 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28341/stat : 28341 (python) S 28322 28326 28281 0 -1 4202560 28 926 0 8 0 0 0 0 19 0 3 0 906919741 489025536 51705 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 1 0 0 0
[pid=28326/tid=28350] ppid=28322 vsize=477564 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28350/stat : 28350 (python) S 28322 28326 28281 0 -1 4202560 30 926 0 8 0 0 0 0 20 0 3 0 906929755 489025536 51705 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 201.1
Current children cumulated vsize (KiB) 2002700

[startup+282.301 s]
/proc/loadavg: 1.98 1.20 0.50 3/185 28397
/proc/meminfo: memFree=1693536/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=477564 CPUtime=65.59 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 80881 926 112 8 6522 37 0 0 20 0 3 0 906911060 489025536 51705 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 311
/proc/28326/statm: 119391 51705 1878 364 0 55306 0
[pid=28340] ppid=28326 vsize=467308 CPUtime=0.12 cores=1,3,5,7
/proc/28340/stat : 28340 (python) S 28326 28326 28281 0 -1 4202560 1171 0 0 0 5 7 0 0 19 0 2 0 906919740 478523392 50238 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/28340/statm: 116827 50238 414 364 0 52745 0
[pid=28342] ppid=28340 vsize=74672 CPUtime=100.09 cores=1,3,5,7
/proc/28342/stat : 28342 (lingeling) T 28340 28342 28342 0 -1 4202496 29588 0 0 0 10005 4 0 0 25 0 1 0 906919741 76464128 17838 33554432000 4194304 4352236 140734533797648 18446744073709551615 4270293 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/28342/statm: 18668 17838 129 39 0 17748 0
[pid=28340/tid=28348] ppid=28326 vsize=467308 CPUtime=0 cores=1,3,5,7
/proc/28340/task/28348/stat : 28348 (python) S 28326 28326 28281 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 906929752 478523392 50238 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604465607405632 0 0 -1 3 0 0 0
[pid=28349] ppid=28326 vsize=467320 CPUtime=0.13 cores=1,3,5,7

################
# More data... #
################

/proc/28522/stat : 28522 (python) S 28326 28326 28281 0 -1 4202560 1101 0 0 0 6 6 0 0 19 0 2 0 907027528 489037824 50227 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28522/statm: 119394 50227 399 364 0 55306 0
[pid=28524] ppid=28522 vsize=76676 CPUtime=100.09 cores=1,3,5,7
/proc/28524/stat : 28524 (lingeling) T 28522 28524 28524 0 -1 4202496 30090 0 0 0 10006 3 0 0 25 0 1 0 907027529 78516224 18339 33554432000 4194304 4352236 140733622209680 18446744073709551615 4329328 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/28524/statm: 19169 18339 129 39 0 18249 0
[pid=28522/tid=28528] ppid=28326 vsize=477576 CPUtime=0 cores=1,3,5,7
/proc/28522/task/28528/stat : 28528 (python) S 28326 28326 28281 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 907037540 489037824 50227 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604471126690496 0 0 -1 3 0 0 0
[pid=28529] ppid=28326 vsize=487832 CPUtime=0.35 cores=1,3,5,7
/proc/28529/stat : 28529 (python) S 28326 28326 28281 0 -1 4202560 1157 0 0 0 18 17 0 0 18 0 2 0 907037542 499539968 50231 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28529/statm: 121958 50231 399 364 0 57867 0
[pid=28531] ppid=28529 vsize=210300 CPUtime=291.28 cores=1,3,5,7
/proc/28531/stat : 28531 (precosat) T 28529 28531 28531 0 -1 4202496 53653 0 0 0 29122 6 0 0 25 0 1 0 907037543 215347200 50556 33554432000 4194304 4890832 140733740117424 18446744073709551615 4238692 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/28531/statm: 52575 50556 86 171 0 52402 0
[pid=28529/tid=28537] ppid=28326 vsize=487832 CPUtime=0 cores=1,3,5,7
/proc/28529/task/28537/stat : 28537 (python) S 28326 28326 28281 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 907057164 499539968 50231 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604465607406528 0 0 -1 3 0 0 0
[pid=28617] ppid=28326 vsize=498088 CPUtime=1.75 cores=1,3,5,7
/proc/28617/stat : 28617 (python) S 28326 28326 28281 0 -1 4202560 1029 0 0 0 95 80 0 0 15 0 1 0 907280312 510042112 50206 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204667462 0 0 16781312 514 5625668839996883207 0 0 17 5 0 0 0
/proc/28617/statm: 124522 50206 371 364 0 60428 0
[pid=28619] ppid=28617 vsize=673456 CPUtime=1209.79 cores=1,3,5,7
/proc/28619/stat : 28619 (cryptominisat-2) R 28617 28619 28619 0 -1 4202496 355557 0 0 0 120905 74 0 0 25 0 1 0 907280312 689618944 155038 33554432000 4194304 4677096 140735309968704 18446744073709551615 4320231 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/28619/statm: 168364 155038 394 118 0 163323 0
[pid=28326/tid=28341] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28341/stat : 28341 (python) S 28322 28326 28281 0 -1 4202560 36 926 0 8 0 0 0 0 18 0 6 0 906919741 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 1 0 0 0
[pid=28326/tid=28350] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28350/stat : 28350 (python) S 28322 28326 28281 0 -1 4202560 35 926 0 8 0 0 0 0 18 0 6 0 906929755 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 7 0 0 0
[pid=28326/tid=28523] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28523/stat : 28523 (python) S 28322 28326 28281 0 -1 4202560 29 926 0 8 0 0 0 0 20 0 6 0 907027529 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 5 0 0 0
[pid=28326/tid=28530] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28530/stat : 28530 (python) S 28322 28326 28281 0 -1 4202560 26 926 0 8 0 0 0 0 18 0 6 0 907037543 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 5 0 0 0
[pid=28326/tid=28618] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28618/stat : 28618 (python) S 28322 28326 28281 0 -1 4202560 30 926 0 8 0 0 0 0 20 0 6 0 907280312 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4887.37
Current children cumulated vsize (KiB) 4897804

[startup+4962.3 s]
/proc/loadavg: 2.04 2.02 1.94 3/220 28665
/proc/meminfo: memFree=113824/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=508332 CPUtime=65.75 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 83426 926 112 8 6536 39 0 0 20 0 6 0 906911060 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 311
/proc/28326/statm: 127083 51723 1884 364 0 62989 0
[pid=28340] ppid=28326 vsize=467308 CPUtime=1.5 cores=1,3,5,7
/proc/28340/stat : 28340 (python) S 28326 28326 28281 0 -1 4202560 1248 0 0 0 79 71 0 0 18 0 2 0 906919740 478523392 50239 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/28340/statm: 116827 50239 415 364 0 52745 0
[pid=28342] ppid=28340 vsize=136800 CPUtime=1267.3 cores=1,3,5,7
/proc/28342/stat : 28342 (lingeling) T 28340 28342 28342 0 -1 4202496 52029 0 0 0 126724 6 0 0 25 0 1 0 906919741 140083200 33370 33554432000 4194304 4352236 140734533797648 18446744073709551615 4276757 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/28342/statm: 34200 33370 129 39 0 33280 0
[pid=28340/tid=28348] ppid=28326 vsize=467308 CPUtime=0 cores=1,3,5,7
/proc/28340/task/28348/stat : 28348 (python) S 28326 28326 28281 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 906929752 478523392 50239 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604465607405632 0 0 -1 5 0 0 0
[pid=28349] ppid=28326 vsize=467320 CPUtime=2.71 cores=1,3,5,7
/proc/28349/stat : 28349 (python) S 28326 28326 28281 0 -1 4202560 1199 0 0 0 149 122 0 0 15 0 2 0 906929754 478535680 50224 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/28349/statm: 116830 50224 400 364 0 52745 0
[pid=28351] ppid=28349 vsize=894116 CPUtime=1946.73 cores=1,3,5,7
/proc/28351/stat : 28351 (cryptominisat-2) T 28349 28351 28351 0 -1 4202496 485903 0 1 0 194567 106 0 0 25 0 1 0 906929755 915574784 176687 33554432000 4194304 4677096 140735100550624 18446744073709551615 4334818 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 8
/proc/28351/statm: 223529 176687 395 118 0 218488 0
[pid=28349/tid=28504] ppid=28326 vsize=467320 CPUtime=0 cores=1,3,5,7
/proc/28349/task/28504/stat : 28504 (python) S 28326 28326 28281 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 906978775 478535680 50224 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604467624453248 0 0 -1 3 0 0 0
[pid=28522] ppid=28326 vsize=477576 CPUtime=0.12 cores=1,3,5,7
/proc/28522/stat : 28522 (python) S 28326 28326 28281 0 -1 4202560 1101 0 0 0 6 6 0 0 19 0 2 0 907027528 489037824 50227 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28522/statm: 119394 50227 399 364 0 55306 0
[pid=28524] ppid=28522 vsize=76676 CPUtime=100.09 cores=1,3,5,7
/proc/28524/stat : 28524 (lingeling) T 28522 28524 28524 0 -1 4202496 30090 0 0 0 10006 3 0 0 25 0 1 0 907027529 78516224 18339 33554432000 4194304 4352236 140733622209680 18446744073709551615 4329328 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/28524/statm: 19169 18339 129 39 0 18249 0
[pid=28522/tid=28528] ppid=28326 vsize=477576 CPUtime=0 cores=1,3,5,7
/proc/28522/task/28528/stat : 28528 (python) S 28326 28326 28281 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 907037540 489037824 50227 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604471126690496 0 0 -1 3 0 0 0
[pid=28529] ppid=28326 vsize=487832 CPUtime=0.35 cores=1,3,5,7
/proc/28529/stat : 28529 (python) S 28326 28326 28281 0 -1 4202560 1157 0 0 0 18 17 0 0 18 0 2 0 907037542 499539968 50231 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28529/statm: 121958 50231 399 364 0 57867 0
[pid=28531] ppid=28529 vsize=210300 CPUtime=291.28 cores=1,3,5,7
/proc/28531/stat : 28531 (precosat) T 28529 28531 28531 0 -1 4202496 53653 0 0 0 29122 6 0 0 25 0 1 0 907037543 215347200 50556 33554432000 4194304 4890832 140733740117424 18446744073709551615 4238692 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/28531/statm: 52575 50556 86 171 0 52402 0
[pid=28529/tid=28537] ppid=28326 vsize=487832 CPUtime=0 cores=1,3,5,7
/proc/28529/task/28537/stat : 28537 (python) S 28326 28326 28281 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 907057164 499539968 50231 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604465607406528 0 0 -1 3 0 0 0
[pid=28617] ppid=28326 vsize=498088 CPUtime=1.83 cores=1,3,5,7
/proc/28617/stat : 28617 (python) S 28326 28326 28281 0 -1 4202560 1029 0 0 0 99 84 0 0 15 0 1 0 907280312 510042112 50206 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204667462 0 0 16781312 514 703071715265052935 0 0 17 5 0 0 0
/proc/28617/statm: 124522 50206 371 364 0 60428 0
[pid=28619] ppid=28617 vsize=673880 CPUtime=1269.78 cores=1,3,5,7
/proc/28619/stat : 28619 (cryptominisat-2) R 28617 28619 28619 0 -1 4202496 363579 0 0 0 126902 76 0 0 25 0 1 0 907280312 690053120 156149 33554432000 4194304 4677096 140735309968704 18446744073709551615 4359048 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/28619/statm: 168470 156149 394 118 0 163429 0
[pid=28326/tid=28341] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28341/stat : 28341 (python) S 28322 28326 28281 0 -1 4202560 36 926 0 8 0 0 0 0 18 0 6 0 906919741 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 1 0 0 0
[pid=28326/tid=28350] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28350/stat : 28350 (python) S 28322 28326 28281 0 -1 4202560 35 926 0 8 0 0 0 0 18 0 6 0 906929755 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 7 0 0 0
[pid=28326/tid=28523] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28523/stat : 28523 (python) S 28322 28326 28281 0 -1 4202560 29 926 0 8 0 0 0 0 20 0 6 0 907027529 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 5 0 0 0
[pid=28326/tid=28530] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28530/stat : 28530 (python) S 28322 28326 28281 0 -1 4202560 26 926 0 8 0 0 0 0 18 0 6 0 907037543 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 5 0 0 0
[pid=28326/tid=28618] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28618/stat : 28618 (python) S 28322 28326 28281 0 -1 4202560 30 926 0 8 0 0 0 0 20 0 6 0 907280312 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4947.44
Current children cumulated vsize (KiB) 4898228



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5014.8 s]
/proc/loadavg: 2.02 2.02 1.94 4/221 28667
/proc/meminfo: memFree=123908/32951124 swapFree=67054520/67111528
[pid=28326] ppid=28322 vsize=508332 CPUtime=65.75 cores=1,3,5,7
/proc/28326/stat : 28326 (python) S 28322 28326 28281 0 -1 4202496 83426 926 112 8 6536 39 0 0 20 0 6 0 906911060 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 311
/proc/28326/statm: 127083 51723 1884 364 0 62989 0
[pid=28340] ppid=28326 vsize=467308 CPUtime=1.5 cores=1,3,5,7
/proc/28340/stat : 28340 (python) S 28326 28326 28281 0 -1 4202560 1248 0 0 0 79 71 0 0 18 0 2 0 906919740 478523392 50239 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/28340/statm: 116827 50239 415 364 0 52745 0
[pid=28342] ppid=28340 vsize=136800 CPUtime=1267.3 cores=1,3,5,7
/proc/28342/stat : 28342 (lingeling) T 28340 28342 28342 0 -1 4202496 52029 0 0 0 126724 6 0 0 25 0 1 0 906919741 140083200 33370 33554432000 4194304 4352236 140734533797648 18446744073709551615 4276757 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/28342/statm: 34200 33370 129 39 0 33280 0
[pid=28340/tid=28348] ppid=28326 vsize=467308 CPUtime=0 cores=1,3,5,7
/proc/28340/task/28348/stat : 28348 (python) S 28326 28326 28281 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 906929752 478523392 50239 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604465607405632 0 0 -1 5 0 0 0
[pid=28349] ppid=28326 vsize=467320 CPUtime=2.71 cores=1,3,5,7
/proc/28349/stat : 28349 (python) S 28326 28326 28281 0 -1 4202560 1199 0 0 0 149 122 0 0 15 0 2 0 906929754 478535680 50224 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/28349/statm: 116830 50224 400 364 0 52745 0
[pid=28351] ppid=28349 vsize=894116 CPUtime=1946.73 cores=1,3,5,7
/proc/28351/stat : 28351 (cryptominisat-2) T 28349 28351 28351 0 -1 4202496 485903 0 1 0 194567 106 0 0 25 0 1 0 906929755 915574784 176687 33554432000 4194304 4677096 140735100550624 18446744073709551615 4334818 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 8
/proc/28351/statm: 223529 176687 395 118 0 218488 0
[pid=28349/tid=28504] ppid=28326 vsize=467320 CPUtime=0 cores=1,3,5,7
/proc/28349/task/28504/stat : 28504 (python) S 28326 28326 28281 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 906978775 478535680 50224 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604467624453248 0 0 -1 3 0 0 0
[pid=28522] ppid=28326 vsize=477576 CPUtime=0.12 cores=1,3,5,7
/proc/28522/stat : 28522 (python) S 28326 28326 28281 0 -1 4202560 1101 0 0 0 6 6 0 0 19 0 2 0 907027528 489037824 50227 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28522/statm: 119394 50227 399 364 0 55306 0
[pid=28524] ppid=28522 vsize=76676 CPUtime=100.09 cores=1,3,5,7
/proc/28524/stat : 28524 (lingeling) T 28522 28524 28524 0 -1 4202496 30090 0 0 0 10006 3 0 0 25 0 1 0 907027529 78516224 18339 33554432000 4194304 4352236 140733622209680 18446744073709551615 4329328 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/28524/statm: 19169 18339 129 39 0 18249 0
[pid=28522/tid=28528] ppid=28326 vsize=477576 CPUtime=0 cores=1,3,5,7
/proc/28522/task/28528/stat : 28528 (python) S 28326 28326 28281 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 907037540 489037824 50227 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604471126690496 0 0 -1 3 0 0 0
[pid=28529] ppid=28326 vsize=487832 CPUtime=0.35 cores=1,3,5,7
/proc/28529/stat : 28529 (python) S 28326 28326 28281 0 -1 4202560 1157 0 0 0 18 17 0 0 18 0 2 0 907037542 499539968 50231 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28529/statm: 121958 50231 399 364 0 57867 0
[pid=28531] ppid=28529 vsize=210300 CPUtime=291.28 cores=1,3,5,7
/proc/28531/stat : 28531 (precosat) T 28529 28531 28531 0 -1 4202496 53653 0 0 0 29122 6 0 0 25 0 1 0 907037543 215347200 50556 33554432000 4194304 4890832 140733740117424 18446744073709551615 4238692 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/28531/statm: 52575 50556 86 171 0 52402 0
[pid=28529/tid=28537] ppid=28326 vsize=487832 CPUtime=0 cores=1,3,5,7
/proc/28529/task/28537/stat : 28537 (python) S 28326 28326 28281 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 907057164 499539968 50231 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 514 18446604465607406528 0 0 -1 3 0 0 0
[pid=28617] ppid=28326 vsize=498088 CPUtime=1.9 cores=1,3,5,7
/proc/28617/stat : 28617 (python) S 28326 28326 28281 0 -1 4202560 1029 0 0 0 103 87 0 0 15 0 1 0 907280312 510042112 50206 33554432000 4194304 5683644 140736910253184 18446744073709551615 210204667462 0 0 16781312 514 703071715265052935 0 0 17 5 0 0 0
/proc/28617/statm: 124522 50206 371 364 0 60428 0
[pid=28619] ppid=28617 vsize=674788 CPUtime=1322.3 cores=1,3,5,7
/proc/28619/stat : 28619 (cryptominisat-2) R 28617 28619 28619 0 -1 4202496 375759 0 0 0 132151 79 0 0 25 0 1 0 907280312 690982912 154166 33554432000 4194304 4677096 140735309968704 18446744073709551615 4319985 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/28619/statm: 168697 154166 394 118 0 163656 0
[pid=28326/tid=28341] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28341/stat : 28341 (python) S 28322 28326 28281 0 -1 4202560 36 926 0 8 0 0 0 0 18 0 6 0 906919741 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 1 0 0 0
[pid=28326/tid=28350] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28350/stat : 28350 (python) S 28322 28326 28281 0 -1 4202560 35 926 0 8 0 0 0 0 18 0 6 0 906929755 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 7 0 0 0
[pid=28326/tid=28523] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28523/stat : 28523 (python) S 28322 28326 28281 0 -1 4202560 29 926 0 8 0 0 0 0 20 0 6 0 907027529 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 5 0 0 0
[pid=28326/tid=28530] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28530/stat : 28530 (python) S 28322 28326 28281 0 -1 4202560 26 926 0 8 0 0 0 0 18 0 6 0 907037543 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 5 0 0 0
[pid=28326/tid=28618] ppid=28322 vsize=508332 CPUtime=0 cores=1,3,5,7
/proc/28326/task/28618/stat : 28618 (python) S 28322 28326 28281 0 -1 4202560 30 926 0 8 0 0 0 0 20 0 6 0 907280312 520531968 51723 33554432000 4194304 5683644 140736910253184 18446744073709551615 210216470961 0 0 16781312 2 18446604456511813504 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5000.03
Current children cumulated vsize (KiB) 4899136

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28326 and gives
#  childrusage.ru_utime.tv_sec=65
#  childrusage.ru_utime.tv_usec=362063
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=410937
# CPU time returned by wait4() is 65.773
# while last known CPU time is 5000.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5014.85
CPU time (s): 5000.03
CPU user time (s): 4994.61
CPU system time (s): 5.42
CPU usage (%): 99.7044
Max. virtual memory (cumulated for all children) (KiB): 5035380

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 65.3621
system time used= 0.410937
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 84354
page faults= 120
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18883
involuntary context switches= 248

runsolver used 8.43472 second user time and 20.033 second system time

The end

Launcher Data 

Begin job on node130 at 2011-06-13 10:18:40
IDJOB=3498283
IDBENCH=69635
IDSOLVER=1991
FILE ID=node130/3498283-1307953118
RUNJOBID= node130-1307953118-28300
PBS_JOBID= 13559698
Free space on /var/tmp= 2880 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT_RACE08/cnf/ibm-2002-30r-k85.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /var/tmp/evaluation-result-3498283-1307953118/watcher-3498283-1307953118 -o /var/tmp/evaluation-result-3498283-1307953118/solver-3498283-1307953118 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498283-1307953118.cnf -seed 320810650 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c08fe2d9c476652207ada677b7ca59f9
RANDOM SEED=320810650

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       3008576 kB
Buffers:        111988 kB
Cached:       28881020 kB
SwapCached:      10356 kB
Active:       14248568 kB
Inactive:     14763236 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       3008576 kB
SwapTotal:    67111528 kB
SwapFree:     67054520 kB
Dirty:           97928 kB
Writeback:           0 kB
AnonPages:       16976 kB
Mapped:          12224 kB
Slab:           865352 kB
PageTables:       4620 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187932 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /var/tmp at the end= 2816 MiB
End job on node130 at 2011-06-13 11:42:22