Trace number 3380794

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-industrial (fixed)? (MO) 13660.9 1735.97

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf
MD5SUM732b9c9b0d44d6a9e75489b2f5004165
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2632.81
Satisfiable
(Un)Satisfiability was proved
Number of variables95456
Number of clauses477186
Sum of the clauses size1137161
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2470925
Number of clauses of size 31500
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 54550

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.36/0.67	c INFO: solving HOME/instance-3380794-1305492477.cnf
0.36/0.67	c INFO: computing task features
1.73/2.06	c INFO: computed variable-clause graph statistics
1.84/2.11	c INFO: computed clause balance statistics
8.73/9.06	c INFO: computed variable balance statistics
13.63/13.97	c INFO: computed small-clause counts
13.73/14.03	c INFO: computed Horn-clause counts
24.53/24.87	c INFO: computed variable graph statistics
24.53/24.87	c INFO: collected features for HOME/instance-3380794-1305492477.cnf in 24.16 s
24.53/24.90	c INFO: running SApperloT@0 for 97 with 4975 remaining (b = 0.13)
24.63/24.92	c INFO: running lingeling-276@0 for 97 with 4975 remaining (b = 0.15)
24.63/24.95	c INFO: running cryptominisat-2.9.0@0 for 582 with 4975 remaining (b = 0.25)
24.63/24.97	c INFO: running lingeling-276@0 for 485 with 4975 remaining (b = 0.22)
24.73/25.00	c INFO: running lingeling-276@0 for 1261 with 4975 remaining (b = 0.32)
24.73/25.03	c INFO: running cryptominisat-2.9.0@0 for 1649 with 4975 remaining (b = 0.39)
24.73/25.06	c INFO: running cryptominisat-2.9.0@0 for 1649 with 4975 remaining (b = 0.34)
24.73/25.09	c INFO: running precosat-570@0 for 388 with 4975 remaining (b = 0.11)
822.01/125.21	c INFO: running lingeling-276@0 for 1261 with 4875 remaining (b = 0.24)
822.01/125.24	c INFO: running cryptominisat-2.9.0@0 for 1649 with 4875 remaining (b = 0.27)
3123.68/414.16	c INFO: running lingeling-276@0 for 1164 with 4586 remaining (b = 0.18)
3930.90/515.32	c INFO: running SApperloT@0 for 97 with 4485 remaining (b = 0.02)
4730.92/615.64	c INFO: running precosat-570@99 for 291 with 4385 remaining (b = 0.10)
4745.26/617.48	c INFO: running precosat-570@0 for 291 with 4383 remaining (b = 0.09)
7090.62/911.46	c INFO: running precosat-570@686 for 97 with 4089 remaining (b = 0.04)
7129.79/916.31	c INFO: running lingeling-276@0 for 97 with 4084 remaining (b = 0.03)
7850.82/1006.75	c INFO: running precosat-570@983 for 291 with 3993 remaining (b = 0.07)
7929.78/1016.63	c INFO: running precosat-570@294 for 97 with 3984 remaining (b = 0.02)
8705.34/1113.93	c INFO: running cryptominisat-2.9.0@0 for 97 with 3886 remaining (b = 0.01)
9524.33/1216.83	c INFO: running cryptominisat-2.9.0@0 for 1843 with 3783 remaining (b = 0.24)
10175.15/1298.47	c INFO: running cryptominisat-2.9.0@99 for 1843 with 3702 remaining (b = 0.22)
10191.80/1300.56	c INFO: running precosat-570@1083 for 97 with 3700 remaining (b = 0.03)
10959.05/1396.71	c INFO: running precosat-570@391 for 1843 with 3603 remaining (b = 0.23)
10999.69/1401.85	c INFO: running precosat-570@0 for 194 with 3598 remaining (b = 0.04)
12437.61/1582.28	c INFO: running lingeling-276@487 for 776 with 3418 remaining (b = 0.11)
12566.77/1598.42	c INFO: running precosat-570@1161 for 97 with 3402 remaining (b = 0.03)
13247.18/1683.88	c INFO: running lingeling-276@0 for 1164 with 3316 remaining (b = 0.14)
13279.78/1687.95	c INFO: running cryptominisat-2.9.0@0 for 97 with 3312 remaining (b = 0.02)
13373.47/1699.73	c INFO: running precosat-570@2813 for 291 with 3300 remaining (b = 0.05)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380794-1305492477/watcher-3380794-1305492477 -o /tmp/evaluation-result-3380794-1305492477/solver-3380794-1305492477 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3380794-1305492477.cnf -seed 816016768 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.07 8.07 8.01 1/358 28444
/proc/meminfo: memFree=7734652/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=15776 CPUtime=0 cores=0-7
/proc/28444/stat : 28444 (python) S 28442 28444 28237 0 -1 4202496 903 0 0 0 0 0 0 0 22 0 1 0 660847380 16154624 784 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/28444/statm: 3944 784 346 364 0 431 0

[startup+0.0778891 s]
/proc/loadavg: 8.07 8.07 8.01 1/358 28444
/proc/meminfo: memFree=7734652/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=45816 CPUtime=0.05 cores=0-7
/proc/28444/stat : 28444 (python) R 28442 28444 28237 0 -1 4202496 1924 0 0 0 4 1 0 0 22 0 1 0 660847380 46915584 1697 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080230400 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28444/statm: 11454 1697 470 364 0 1203 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 45816

[startup+0.100908 s]
/proc/loadavg: 8.07 8.07 8.01 1/358 28444
/proc/meminfo: memFree=7734652/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=87704 CPUtime=0.05 cores=0-7
/proc/28444/stat : 28444 (python) R 28442 28444 28237 0 -1 4202496 2638 0 0 0 4 1 0 0 17 0 1 0 660847380 89808896 2354 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080230400 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28444/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 87704

[startup+0.300829 s]
/proc/loadavg: 8.07 8.07 8.01 1/358 28444
/proc/meminfo: memFree=7734652/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=135748 CPUtime=0.18 cores=0-7
/proc/28444/stat : 28444 (python) R 28442 28444 28237 0 -1 4202496 5966 935 1 0 13 5 0 0 18 0 1 0 660847380 139005952 4150 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080228357 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/28444/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700754 s]
/proc/loadavg: 8.07 8.07 8.01 1/358 28444
/proc/meminfo: memFree=7734652/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=287628 CPUtime=0.43 cores=0-7
/proc/28444/stat : 28444 (python) R 28442 28444 28237 0 -1 4202496 11555 935 1 0 31 12 0 0 17 0 1 0 660847380 294531072 9232 33554432000 4194304 5683644 140734156891936 18446744073709551615 47566734705985 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28444/statm: 71907 9232 1761 364 0 7831 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 287628

[startup+1.50062 s]
/proc/loadavg: 7.51 7.95 7.97 2/359 28449
/proc/meminfo: memFree=7684176/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=342128 CPUtime=1.23 cores=0-7
/proc/28444/stat : 28444 (python) R 28442 28444 28237 0 -1 4202496 24934 935 1 0 109 14 0 0 18 0 1 0 660847380 350339072 22611 33554432000 4194304 5683644 140734156891936 18446744073709551615 208079893189 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28444/statm: 85532 22611 1761 364 0 21456 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 342128

[startup+3.10022 s]
/proc/loadavg: 7.51 7.95 7.97 2/359 28449
/proc/meminfo: memFree=7615232/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=375624 CPUtime=2.83 cores=0-7
/proc/28444/stat : 28444 (python) R 28442 28444 28237 0 -1 4202496 44456 935 1 0 267 16 0 0 21 0 1 0 660847380 384638976 31291 33554432000 4194304 5683644 140734156891936 18446744073709551615 208079891241 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28444/statm: 93906 31291 1826 364 0 29830 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 375624

[startup+6.30061 s]
/proc/loadavg: 7.51 7.95 7.97 2/359 28449
/proc/meminfo: memFree=7614600/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=375624 CPUtime=6.03 cores=0-7
/proc/28444/stat : 28444 (python) R 28442 28444 28237 0 -1 4202496 44456 935 1 0 587 16 0 0 25 0 1 0 660847380 384638976 31291 33554432000 4194304 5683644 140734156891936 18446744073709551615 47566566710965 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28444/statm: 93906 31291 1826 364 0 29830 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 375624

[startup+12.7005 s]
/proc/loadavg: 6.51 7.72 7.89 2/359 28449
/proc/meminfo: memFree=7614620/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=375624 CPUtime=12.43 cores=0-7
/proc/28444/stat : 28444 (python) R 28442 28444 28237 0 -1 4202496 44457 935 1 0 1227 16 0 0 25 0 1 0 660847380 384638976 31292 33554432000 4194304 5683644 140734156891936 18446744073709551615 4941969 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28444/statm: 93906 31292 1827 364 0 29830 0
Current children cumulated CPU time (s) 12.43
Current children cumulated vsize (KiB) 375624

[startup+25.502 s]
/proc/loadavg: 5.66 7.50 7.82 9/383 28473
/proc/meminfo: memFree=7415164/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=515796 CPUtime=24.83 cores=0-7
/proc/28444/stat : 28444 (python) S 28442 28444 28237 0 -1 4202496 50046 935 1 0 2463 20 0 0 23 0 9 0 660847380 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/28444/statm: 128949 29636 1889 364 0 64846 0
[pid=28450] ppid=28444 vsize=368224 CPUtime=0 cores=0-7
/proc/28450/stat : 28450 (python) S 28444 28444 28237 0 -1 4202560 791 0 0 0 0 0 0 0 25 0 1 0 660849870 377061376 27960 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252431 0 0 16781312 514 13113685523023527935 0 0 17 1 0 0 0
/proc/28450/statm: 92056 27960 351 364 0 27974 0
[pid=28452] ppid=28450 vsize=15680 CPUtime=0.56 cores=0-7
/proc/28452/stat : 28452 (SApperloT-base) R 28450 28452 28452 0 -1 4202496 3505 0 0 0 55 1 0 0 25 0 1 0 660849871 16056320 3208 33554432000 134512640 135674940 4291967248 18446744073709551615 134552074 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28452/statm: 3920 3208 99 284 0 3634 0
[pid=28453] ppid=28444 vsize=378480 CPUtime=0 cores=0-7
/proc/28453/stat : 28453 (python) S 28444 28444 28237 0 -1 4202560 728 0 0 0 0 0 0 0 19 0 1 0 660849873 387563520 27956 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 13113673978151436287 0 0 17 2 0 0 0
/proc/28453/statm: 94620 27956 343 364 0 30535 0
[pid=28455] ppid=28453 vsize=14680 CPUtime=0.56 cores=0-7
/proc/28455/stat : 28455 (lingeling) R 28453 28455 28455 0 -1 4202496 3715 0 0 0 55 1 0 0 22 0 1 0 660849873 15032320 2846 33554432000 4194304 4352236 140735812028320 18446744073709551615 4234008 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/28455/statm: 3670 2846 109 39 0 2750 0
[pid=28456] ppid=28444 vsize=388736 CPUtime=0 cores=0-7
/proc/28456/stat : 28456 (python) S 28444 28444 28237 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 660849875 398065664 27964 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 15589680705414594818 0 0 17 6 0 0 0
/proc/28456/statm: 97184 27964 347 364 0 33096 0
[pid=28458] ppid=28456 vsize=75276 CPUtime=0.52 cores=0-7
/proc/28458/stat : 28458 (cryptominisat-2) R 28456 28458 28458 0 -1 4202496 13271 0 0 0 51 1 0 0 25 0 1 0 660849876 77082624 10810 33554432000 4194304 4677096 140735025421728 18446744073709551615 4238499 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/28458/statm: 18819 10810 361 118 0 13778 0
[pid=28459] ppid=28444 vsize=398992 CPUtime=0 cores=0-7
/proc/28459/stat : 28459 (python) S 28444 28444 28237 0 -1 4202560 737 0 0 0 0 0 0 0 24 0 1 0 660849878 408567808 27964 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 5071797279208243199 0 0 17 1 0 0 0
/proc/28459/statm: 99748 27964 343 364 0 35657 0
[pid=28461] ppid=28459 vsize=14680 CPUtime=0.5 cores=0-7
/proc/28461/stat : 28461 (lingeling) R 28459 28461 28461 0 -1 4202496 3718 0 0 0 50 0 0 0 25 0 1 0 660849878 15032320 2845 33554432000 4194304 4352236 140735324652384 18446744073709551615 4235610 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/28461/statm: 3670 2845 109 39 0 2750 0
[pid=28462] ppid=28444 vsize=474784 CPUtime=0 cores=0-7
/proc/28462/stat : 28462 (python) S 28444 28444 28237 0 -1 4202560 744 0 0 0 0 0 0 0 19 0 1 0 660849881 486178816 27970 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 5071793430917545983 0 0 17 1 0 0 0
/proc/28462/statm: 118696 27970 343 364 0 54602 0
[pid=28464] ppid=28462 vsize=14680 CPUtime=0.48 cores=0-7
/proc/28464/stat : 28464 (lingeling) R 28462 28464 28464 0 -1 4202496 3717 0 0 0 47 1 0 0 21 0 1 0 660849881 15032320 2846 33554432000 4194304 4352236 140733297753088 18446744073709551615 4207908 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/28464/statm: 3670 2846 109 39 0 2750 0
[pid=28465] ppid=28444 vsize=485040 CPUtime=0 cores=0-7
/proc/28465/stat : 28465 (python) S 28444 28444 28237 0 -1 4202560 779 0 0 0 0 0 0 0 20 0 1 0 660849883 496680960 27978 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 5607047605558149378 0 0 17 1 0 0 0
/proc/28465/statm: 121260 27978 347 364 0 57163 0
[pid=28467] ppid=28465 vsize=69264 CPUtime=0.43 cores=0-7
/proc/28467/stat : 28467 (cryptominisat-2) R 28465 28467 28467 0 -1 4202496 11830 0 0 0 42 1 0 0 25 0 1 0 660849884 70926336 9365 33554432000 4194304 4677096 140736185963232 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/28467/statm: 17316 9365 353 118 0 12275 0
[pid=28468] ppid=28444 vsize=495296 CPUtime=0 cores=0-7
/proc/28468/stat : 28468 (python) S 28444 28444 28237 0 -1 4202560 738 0 0 0 0 0 0 0 20 0 1 0 660849886 507183104 28099 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 5607047605558149377 0 0 17 1 0 0 0
/proc/28468/statm: 123824 28099 348 364 0 59724 0
[pid=28470] ppid=28468 vsize=69264 CPUtime=0.4 cores=0-7
/proc/28470/stat : 28470 (cryptominisat-2) R 28468 28470 28470 0 -1 4202496 11815 0 0 0 38 2 0 0 24 0 1 0 660849889 70926336 9364 33554432000 4194304 4677096 140736921033008 18446744073709551615 4320150 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/28470/statm: 17316 9364 353 118 0 12275 0
[pid=28471] ppid=28444 vsize=505552 CPUtime=0 cores=0-7
/proc/28471/stat : 28471 (python) S 28444 28444 28237 0 -1 4202560 767 0 0 0 0 0 0 0 23 0 1 0 660849889 517685248 28093 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 3189996322409152511 0 0 17 4 0 0 0
/proc/28471/statm: 126388 28093 350 364 0 62285 0
[pid=28473] ppid=28471 vsize=50084 CPUtime=0.38 cores=0-7
/proc/28473/stat : 28473 (precosat) R 28471 28473 28473 0 -1 4202496 12248 0 0 0 37 1 0 0 25 0 1 0 660849890 51286016 11983 33554432000 4194304 4890832 140735030040496 18446744073709551615 4454610 0 0 16781312 17442 0 0 0 17 4 0 0 0
/proc/28473/statm: 12521 11983 72 171 0 12348 0
[pid=28444/tid=28451] ppid=28442 vsize=515796 CPUtime=0 cores=0-7
/proc/28444/task/28451/stat : 28451 (python) S 28442 28444 28237 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 9 0 660849870 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 4 0 0 0
[pid=28444/tid=28454] ppid=28442 vsize=515796 CPUtime=0 cores=0-7
/proc/28444/task/28454/stat : 28454 (python) S 28442 28444 28237 0 -1 4202560 21 935 0 0 0 0 0 0 20 0 9 0 660849873 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 6 0 0 0
[pid=28444/tid=28457] ppid=28442 vsize=515796 CPUtime=0 cores=0-7
/proc/28444/task/28457/stat : 28457 (python) S 28442 28444 28237 0 -1 4202560 22 935 0 0 0 0 0 0 21 0 9 0 660849876 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 0 0 0 0
[pid=28444/tid=28460] ppid=28442 vsize=515796 CPUtime=0 cores=0-7
/proc/28444/task/28460/stat : 28460 (python) S 28442 28444 28237 0 -1 4202560 19 935 0 0 0 0 0 0 22 0 9 0 660849878 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 5 0 0 0
[pid=28444/tid=28463] ppid=28442 vsize=515796 CPUtime=0 cores=0-7
/proc/28444/task/28463/stat : 28463 (python) S 28442 28444 28237 0 -1 4202560 25 935 0 0 0 0 0 0 19 0 9 0 660849881 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 0 0 0 0
[pid=28444/tid=28466] ppid=28442 vsize=515796 CPUtime=0 cores=0-7
/proc/28444/task/28466/stat : 28466 (python) S 28442 28444 28237 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 9 0 660849884 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 7 0 0 0
[pid=28444/tid=28469] ppid=28442 vsize=515796 CPUtime=0 cores=0-7
/proc/28444/task/28469/stat : 28469 (python) S 28442 28444 28237 0 -1 4202560 63 935 0 0 0 0 0 0 21 0 9 0 660849886 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 4 0 0 0
[pid=28444/tid=28472] ppid=28442 vsize=515796 CPUtime=0 cores=0-7
/proc/28444/task/28472/stat : 28472 (python) S 28442 28444 28237 0 -1 4202560 35 935 0 0 0 0 0 0 23 0 9 0 660849889 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 28.66
Current children cumulated vsize (KiB) 4334508

[startup+51.1011 s]
/proc/loadavg: 6.46 7.54 7.82 9/383 28474
/proc/meminfo: memFree=5752324/32950928 swapFree=67083212/67111528
[pid=28444] ppid=28442 vsize=515796 CPUtime=24.83 cores=0-7
/proc/28444/stat : 28444 (python) S 28442 28444 28237 0 -1 4202496 50046 935 1 0 2463 20 0 0 23 0 9 0 660847380 528175104 29636 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/28444/statm: 128949 29636 1889 364 0 64846 0
[pid=28450] ppid=28444 vsize=368224 CPUtime=0.06 cores=0-7
/proc/28450/stat : 28450 (python) S 28444 28444 28237 0 -1 4202560 1002 0 0 0 3 3 0 0 18 0 1 0 660849870 377061376 27990 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252431 0 0 16781312 514 17373427210953654532 0 0 17 1 0 0 0
/proc/28450/statm: 92056 27990 381 364 0 27974 0
[pid=28452] ppid=28450 vsize=54800 CPUtime=25.77 cores=0-7
/proc/28452/stat : 28452 (SApperloT-base) R 28450 28452 28452 0 -1 4202496 13439 0 0 0 2575 2 0 0 25 0 1 0 660849871 56115200 12948 33554432000 134512640 135674940 4291967248 18446744073709551615 134552255 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28452/statm: 13700 12948 99 284 0 13414 0
[pid=28453] ppid=28444 vsize=378480 CPUtime=0.06 cores=0-7
/proc/28453/stat : 28453 (python) S 28444 28444 28237 0 -1 4202560 925 0 0 0 4 2 0 0 18 0 1 0 660849873 387563520 27983 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 17373427210953654529 0 0 17 2 0 0 0
/proc/28453/statm: 94620 27983 370 364 0 30535 0
[pid=28455] ppid=28453 vsize=40560 CPUtime=26.09 cores=0-7
/proc/28455/stat : 28455 (lingeling) R 28453 28455 28455 0 -1 4202496 13484 0 0 0 2607 2 0 0 25 0 1 0 660849873 41533440 9310 33554432000 4194304 4352236 140735812028320 18446744073709551615 4328390 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/28455/statm: 10140 9310 129 39 0 9220 0
[pid=28456] ppid=28444 vsize=388736 CPUtime=0.08 cores=0-7
/proc/28456/stat : 28456 (python) S 28444 28444 28237 0 -1 4202560 933 0 0 0 5 3 0 0 15 0 1 0 660849875 398065664 27987 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 17373427210953654530 0 0 17 6 0 0 0
/proc/28456/statm: 97184 27987 370 364 0 33096 0
[pid=28458] ppid=28456 vsize=737092 CPUtime=26.05 cores=0-7
/proc/28458/stat : 28458 (cryptominisat-2) R 28456 28458 28458 0 -1 4202496 142066 0 0 0 2589 16 0 0 25 0 1 0 660849876 754782208 134847 33554432000 4194304 4677096 140735025421728 18446744073709551615 4336237 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/28458/statm: 184273 134847 387 118 0 179232 0
[pid=28459] ppid=28444 vsize=398992 CPUtime=0.07 cores=0-7
/proc/28459/stat : 28459 (python) S 28444 28444 28237 0 -1 4202560 947 0 0 0 3 4 0 0 18 0 1 0 660849878 408567808 27991 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 17373427210953654531 0 0 17 1 0 0 0
/proc/28459/statm: 99748 27991 370 364 0 35657 0

################
# More data... #
################

/proc/28450/task/28477/stat : 28477 (python) S 28444 28444 28237 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 660859898 387551232 27643 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604438786091904 0 0 -1 0 0 0 0
[pid=28453] ppid=28444 vsize=378480 CPUtime=4.02 cores=0-7
/proc/28453/stat : 28453 (python) S 28444 28444 28237 0 -1 4202560 1143 0 0 0 210 192 0 0 18 0 2 0 660849873 387563520 27602 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/28453/statm: 94620 27602 399 364 0 30535 0
[pid=28455] ppid=28453 vsize=97220 CPUtime=1414.31 cores=0-7
/proc/28455/stat : 28455 (lingeling) R 28453 28455 28455 0 -1 4202496 211227 0 0 0 141402 29 0 0 25 0 1 0 660849873 99553280 23475 33554432000 4194304 4352236 140735812028320 18446744073709551615 4278749 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/28455/statm: 24305 23475 129 39 0 23385 0
[pid=28453/tid=28478] ppid=28444 vsize=378480 CPUtime=0 cores=0-7
/proc/28453/task/28478/stat : 28478 (python) S 28444 28444 28237 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 660859900 387563520 27602 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604438786089216 0 0 -1 1 0 0 0
[pid=28456] ppid=28444 vsize=454272 CPUtime=4.21 cores=0-7
/proc/28456/stat : 28456 (python) S 28444 28444 28237 0 -1 4202560 2272 0 13 0 240 181 0 0 15 0 2 0 660849875 465174528 27763 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 5
/proc/28456/statm: 113568 27763 400 364 0 49480 0
[pid=28458] ppid=28456 vsize=3989652 CPUtime=1105.91 cores=0-7
/proc/28458/stat : 28458 (cryptominisat-2) R 28456 28458 28458 0 -1 4202496 1271817 0 0 0 110325 266 0 0 25 0 1 0 660849876 4085403648 927821 33554432000 4194304 4677096 140735025421728 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/28458/statm: 997413 927821 393 118 0 992372 0
[pid=28456/tid=28504] ppid=28444 vsize=454272 CPUtime=0 cores=0-7
/proc/28456/task/28504/stat : 28504 (python) S 28444 28444 28237 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 660909125 465174528 27763 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604441208662976 0 0 -1 3 0 0 0
[pid=28459] ppid=28444 vsize=398992 CPUtime=1.55 cores=0-7
/proc/28459/stat : 28459 (python) S 28444 28444 28237 0 -1 4202560 1168 0 2 0 80 75 0 0 18 0 2 0 660849878 408567808 27643 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 1
/proc/28459/statm: 99748 27643 399 364 0 35657 0
[pid=28461] ppid=28459 vsize=99776 CPUtime=539.08 cores=0-7
/proc/28461/stat : 28461 (lingeling) R 28459 28461 28461 0 -1 4202496 72012 0 0 0 53893 15 0 0 25 0 1 0 660849878 102170624 24113 33554432000 4194304 4352236 140735324652384 18446744073709551615 4278597 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/28461/statm: 24944 24113 129 39 0 24024 0
[pid=28459/tid=28496] ppid=28444 vsize=398992 CPUtime=0 cores=0-7
/proc/28459/task/28496/stat : 28496 (python) S 28444 28444 28237 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 660898910 408567808 27643 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604441208661184 0 0 -1 6 0 0 0
[pid=28462] ppid=28444 vsize=474784 CPUtime=3.62 cores=0-7
/proc/28462/stat : 28462 (python) S 28444 28444 28237 0 -1 4202560 1165 0 12 0 182 180 0 0 18 0 2 0 660849881 486178816 27662 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 3
/proc/28462/statm: 118696 27662 399 364 0 54602 0
[pid=28464] ppid=28462 vsize=103792 CPUtime=1266.81 cores=0-7
/proc/28464/stat : 28464 (lingeling) T 28462 28464 28464 0 -1 4202496 200039 0 0 0 126617 64 0 0 25 0 1 0 660849881 106283008 25150 33554432000 4194304 4352236 140733297753088 18446744073709551615 4278712 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/28464/statm: 25948 25150 129 39 0 25028 0
[pid=28462/tid=28547] ppid=28444 vsize=474784 CPUtime=0 cores=0-7
/proc/28462/task/28547/stat : 28547 (python) S 28444 28444 28237 0 -1 4202560 48 0 4 0 0 0 0 0 19 0 2 0 660977224 486178816 27662 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604441208660288 0 0 -1 1 0 0 0
[pid=28465] ppid=28444 vsize=485040 CPUtime=5.84 cores=0-7
/proc/28465/stat : 28465 (python) S 28444 28444 28237 0 -1 4202560 2287 0 9 0 315 269 0 0 16 0 2 0 660849883 496680960 27820 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 1
/proc/28465/statm: 121260 27820 400 364 0 57163 0
[pid=28467] ppid=28465 vsize=4124860 CPUtime=1656.14 cores=0-7
/proc/28467/stat : 28467 (cryptominisat-2) T 28465 28467 28467 0 -1 4202496 1461741 0 0 0 165304 310 0 0 25 0 1 0 660849884 4223856640 973511 33554432000 4194304 4677096 140736185963232 18446744073709551615 4335347 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/28467/statm: 1031215 973511 393 118 0 1026174 0
[pid=28465/tid=28565] ppid=28444 vsize=485040 CPUtime=0 cores=0-7
/proc/28465/task/28565/stat : 28565 (python) S 28444 28444 28237 0 -1 4202560 49 0 3 0 0 0 0 0 17 0 2 0 661016173 496680960 27820 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604448132407616 0 0 -1 4 0 0 0
[pid=28468] ppid=28444 vsize=495296 CPUtime=5.84 cores=0-7
/proc/28468/stat : 28468 (python) S 28444 28444 28237 0 -1 4202560 1499 0 27 0 327 257 0 0 16 0 2 0 660849886 507183104 28251 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 2
/proc/28468/statm: 123824 28251 400 364 0 59724 0
[pid=28470] ppid=28468 vsize=4157272 CPUtime=1655.67 cores=0-7
/proc/28470/stat : 28470 (cryptominisat-2) T 28468 28470 28470 0 -1 4202496 1543215 0 0 0 165250 317 0 0 25 0 1 0 660849889 4257046528 979837 33554432000 4194304 4677096 140736921033008 18446744073709551615 4319729 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/28470/statm: 1039318 979837 393 118 0 1034277 0
[pid=28468/tid=28563] ppid=28444 vsize=495296 CPUtime=0 cores=0-7
/proc/28468/task/28563/stat : 28563 (python) S 28444 28444 28237 0 -1 4202560 89 0 20 0 0 0 0 0 17 0 2 0 661015755 507183104 28251 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604447159835456 0 0 -1 0 0 0 9
[pid=28471] ppid=28444 vsize=505552 CPUtime=3.35 cores=0-7
/proc/28471/stat : 28471 (python) S 28444 28444 28237 0 -1 4202560 1063 0 0 0 176 159 0 0 18 0 2 0 660849889 517685248 27863 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/28471/statm: 126388 27863 405 364 0 62285 0
[pid=28473] ppid=28471 vsize=220312 CPUtime=1169.33 cores=0-7
/proc/28473/stat : 28473 (precosat) T 28471 28473 28473 0 -1 4202496 135784 0 0 0 116891 42 0 0 25 0 1 0 660849890 225599488 54450 33554432000 4194304 4890832 140735030040496 18446744073709551615 4235810 0 0 16781312 17442 18446744071562691360 0 0 17 4 0 0 0
/proc/28473/statm: 55078 54450 86 171 0 54905 0
[pid=28471/tid=28493] ppid=28444 vsize=505552 CPUtime=0 cores=0-7
/proc/28471/task/28493/stat : 28493 (python) S 28444 28444 28237 0 -1 4202560 82 0 0 0 0 0 0 0 18 0 2 0 660888793 517685248 27863 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604453655422144 0 0 -1 5 0 0 0
[pid=28479] ppid=28444 vsize=515808 CPUtime=3.6 cores=0-7
/proc/28479/stat : 28479 (python) S 28444 28444 28237 0 -1 4202560 1028 0 10 0 186 174 0 0 18 0 2 0 660859901 528187392 28124 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 2
/proc/28479/statm: 128952 28124 399 364 0 64846 0
[pid=28481] ppid=28479 vsize=115648 CPUtime=1263.14 cores=0-7
/proc/28481/stat : 28481 (lingeling) T 28479 28481 28481 0 -1 4202496 246731 0 5 0 126235 79 0 0 25 0 1 0 660859903 118423552 28082 33554432000 4194304 4352236 140734504381632 18446744073709551615 4278664 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 4
/proc/28481/statm: 28912 28082 129 39 0 27992 0
[pid=28479/tid=28551] ppid=28444 vsize=515808 CPUtime=0 cores=0-7
/proc/28479/task/28551/stat : 28551 (python) S 28444 28444 28237 0 -1 4202560 76 0 5 0 0 0 0 0 19 0 2 0 660987046 528187392 28124 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604451025130496 0 0 -1 7 0 0 2
[pid=28482] ppid=28444 vsize=526064 CPUtime=5.78 cores=0-7
/proc/28482/stat : 28482 (python) S 28444 28444 28237 0 -1 4202560 1307 0 0 0 323 255 0 0 15 0 1 0 660859904 538689536 28532 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 17373427210953654532 0 0 17 4 0 0 0
/proc/28482/statm: 131516 28532 372 364 0 67407 0
[pid=28484] ppid=28482 vsize=4272636 CPUtime=1583.58 cores=0-7
/proc/28484/stat : 28484 (cryptominisat-2) R 28482 28484 28484 0 -1 4202496 1567904 0 5 0 157981 377 0 0 25 0 1 0 660859905 4375179264 989361 33554432000 4194304 4677096 140733816250816 18446744073709551615 208079929026 0 0 16781312 2 0 0 0 17 1 0 0 8
/proc/28484/statm: 1068159 989361 393 118 0 1063118 0
[pid=28497] ppid=28444 vsize=536320 CPUtime=0.28 cores=0-7
/proc/28497/stat : 28497 (python) S 28444 28444 28237 0 -1 4202560 1034 0 0 0 16 12 0 0 19 0 2 0 660898913 549191680 28251 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/28497/statm: 134080 28251 399 364 0 69968 0
[pid=28499] ppid=28497 vsize=105564 CPUtime=99.97 cores=0-7
/proc/28499/stat : 28499 (SApperloT-base) T 28497 28499 28499 0 -1 4202496 25930 0 0 0 9984 13 0 0 25 0 1 0 660898913 108097536 25567 33554432000 134512640 135674940 4293938672 18446744073709551615 134552255 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/28499/statm: 26391 25567 99 284 0 26105 0
[pid=28497/tid=28503] ppid=28444 vsize=536320 CPUtime=0 cores=0-7
/proc/28497/task/28503/stat : 28503 (python) S 28444 28444 28237 0 -1 4202560 75 0 0 0 0 0 0 0 19 0 2 0 660908941 549191680 28251 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604453861129088 0 0 -1 1 0 0 0
[pid=28505] ppid=28444 vsize=546576 CPUtime=2.12 cores=0-7
/proc/28505/stat : 28505 (python) S 28444 28444 28237 0 -1 4202560 1040 0 0 0 110 102 0 0 18 0 2 0 660909128 559693824 28204 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/28505/statm: 136644 28204 399 364 0 72529 0
[pid=28507] ppid=28505 vsize=187464 CPUtime=732.04 cores=0-7
/proc/28507/stat : 28507 (precosat) R 28505 28507 28507 0 -1 4202496 101933 0 0 0 73185 19 0 0 25 0 1 0 660909129 191963136 46265 33554432000 4194304 4890832 140735833469648 18446744073709551615 4293577 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/28507/statm: 46866 46265 86 171 0 46693 0
[pid=28505/tid=28525] ppid=28444 vsize=546576 CPUtime=0 cores=0-7
/proc/28505/task/28525/stat : 28525 (python) S 28444 28444 28237 0 -1 4202560 76 0 0 0 0 0 0 0 18 0 2 0 660939009 559693824 28204 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604441005401408 0 0 -1 5 0 0 0
[pid=28526] ppid=28444 vsize=556832 CPUtime=0.29 cores=0-7
/proc/28526/stat : 28526 (python) S 28444 28444 28237 0 -1 4202560 1044 0 0 0 16 13 0 0 19 0 2 0 660939012 570195968 28247 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/28526/statm: 139208 28247 399 364 0 75090 0
[pid=28528] ppid=28526 vsize=68152 CPUtime=99.64 cores=0-7
/proc/28528/stat : 28528 (lingeling) T 28526 28528 28528 0 -1 4202496 23038 0 0 0 9958 6 0 0 25 0 1 0 660939012 69787648 16208 33554432000 4194304 4352236 140735228651920 18446744073709551615 4278749 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/28528/statm: 17038 16208 129 39 0 16118 0
[pid=28526/tid=28535] ppid=28444 vsize=556832 CPUtime=0 cores=0-7
/proc/28526/task/28535/stat : 28535 (python) S 28444 28444 28237 0 -1 4202560 75 0 0 0 0 0 0 0 19 0 2 0 660949040 570195968 28247 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604442830196992 0 0 -1 5 0 0 0
[pid=28538] ppid=28444 vsize=567088 CPUtime=2.6 cores=0-7
/proc/28538/stat : 28538 (python) S 28444 28444 28237 0 -1 4202560 31451 0 0 0 157 103 0 0 15 0 2 0 660958773 580698112 28564 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28538/statm: 141772 28564 400 364 0 77651 0
[pid=28540] ppid=28538 vsize=4025904 CPUtime=528.11 cores=0-7
/proc/28540/stat : 28540 (cryptominisat-2) R 28538 28540 28540 0 -1 4202496 1123459 0 0 0 52595 216 0 0 25 0 1 0 660958774 4122525696 936137 33554432000 4194304 4677096 140735751151088 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/28540/statm: 1006476 936137 393 118 0 1001435 0
[pid=28538/tid=28544] ppid=28444 vsize=567088 CPUtime=0 cores=0-7
/proc/28538/task/28544/stat : 28544 (python) S 28444 28444 28237 0 -1 4202560 80 0 0 0 0 0 0 0 17 0 2 0 660969060 580698112 28564 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604442415396864 0 0 -1 0 0 0 0
[pid=28552] ppid=28444 vsize=577344 CPUtime=0.96 cores=0-7
/proc/28552/stat : 28552 (python) S 28444 28444 28237 0 -1 4202560 1176 0 0 0 48 48 0 0 18 0 2 0 660987566 591200256 28275 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/28552/statm: 144336 28275 406 364 0 80212 0
[pid=28554] ppid=28552 vsize=159316 CPUtime=331.69 cores=0-7
/proc/28554/stat : 28554 (precosat) R 28552 28554 28554 0 -1 4202496 106734 0 0 0 33139 30 0 0 25 0 1 0 660987567 163139584 39235 33554432000 4194304 4890832 140735818735888 18446744073709551615 4235063 0 0 16781312 17442 0 0 0 17 4 0 0 1
/proc/28554/statm: 39829 39235 86 171 0 39656 0
[pid=28552/tid=28560] ppid=28444 vsize=577344 CPUtime=0 cores=0-7
/proc/28552/task/28560/stat : 28560 (python) S 28444 28444 28237 0 -1 4202560 78 0 0 0 0 0 0 0 18 0 2 0 661007220 591200256 28275 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 514 18446604443853334464 0 0 -1 1 0 0 0
[pid=28566] ppid=28444 vsize=587600 CPUtime=0.26 cores=0-7
/proc/28566/stat : 28566 (python) S 28444 28444 28237 0 -1 4202560 1097 0 0 0 16 10 0 0 15 0 1 0 661016176 601702400 28346 33554432000 4194304 5683644 140734156891936 18446744073709551615 208080252486 0 0 16781312 514 1617407997032497410 0 0 17 7 0 0 0
/proc/28566/statm: 146900 28346 379 364 0 82773 0
[pid=28568] ppid=28566 vsize=1333888 CPUtime=46.22 cores=0-7
/proc/28568/stat : 28568 (cryptominisat-2) R 28566 28568 28568 0 -1 4202496 300579 0 0 0 4568 54 0 0 25 0 1 0 661016177 1365901312 274587 33554432000 4194304 4677096 140736790591456 18446744073709551615 4293843 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/28568/statm: 333472 274587 390 118 0 328431 0
[pid=28444/tid=28451] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28451/stat : 28451 (python) S 28442 28444 28237 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 17 0 660849870 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 4 0 0 0
[pid=28444/tid=28454] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28454/stat : 28454 (python) S 28442 28444 28237 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 17 0 660849873 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 6 0 0 0
[pid=28444/tid=28457] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28457/stat : 28457 (python) S 28442 28444 28237 0 -1 4202560 28 935 0 0 0 0 0 0 18 0 17 0 660849876 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 0 0 0 0
[pid=28444/tid=28460] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28460/stat : 28460 (python) S 28442 28444 28237 0 -1 4202560 24 935 0 0 0 0 0 0 18 0 17 0 660849878 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 5 0 0 0
[pid=28444/tid=28463] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28463/stat : 28463 (python) S 28442 28444 28237 0 -1 4202560 25 935 0 0 0 0 0 0 19 0 17 0 660849881 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 0 0 0 0
[pid=28444/tid=28466] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28466/stat : 28466 (python) S 28442 28444 28237 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 17 0 660849884 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 7 0 0 0
[pid=28444/tid=28469] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28469/stat : 28469 (python) S 28442 28444 28237 0 -1 4202560 63 935 0 0 0 0 0 0 21 0 17 0 660849886 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 4 0 0 0
[pid=28444/tid=28472] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28472/stat : 28472 (python) S 28442 28444 28237 0 -1 4202560 63 935 0 0 0 0 0 0 18 0 17 0 660849889 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 4 0 0 0
[pid=28444/tid=28480] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28480/stat : 28480 (python) S 28442 28444 28237 0 -1 4202560 37 935 0 0 0 0 0 0 19 0 17 0 660859902 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 5 0 0 0
[pid=28444/tid=28483] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28483/stat : 28483 (python) S 28442 28444 28237 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 17 0 660859905 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 4 0 0 0
[pid=28444/tid=28498] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28498/stat : 28498 (python) S 28442 28444 28237 0 -1 4202560 35 935 0 0 0 0 0 0 20 0 17 0 660898913 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 1 0 0 0
[pid=28444/tid=28506] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28506/stat : 28506 (python) S 28442 28444 28237 0 -1 4202560 48 935 0 0 0 0 0 0 18 0 17 0 660909129 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 1 0 0 0
[pid=28444/tid=28527] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28527/stat : 28527 (python) S 28442 28444 28237 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 17 0 660939012 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 1 0 0 0
[pid=28444/tid=28539] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28539/stat : 28539 (python) S 28442 28444 28237 0 -1 4202560 48 935 0 0 0 0 0 0 18 0 17 0 660958774 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 1 0 0 0
[pid=28444/tid=28553] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28553/stat : 28553 (python) S 28442 28444 28237 0 -1 4202560 51 935 0 0 0 0 0 0 18 0 17 0 660987566 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 4 0 0 0
[pid=28444/tid=28567] ppid=28442 vsize=597844 CPUtime=0 cores=0-7
/proc/28444/task/28567/stat : 28567 (python) S 28442 28444 28237 0 -1 4202560 40 935 0 0 0 0 0 0 18 0 17 0 661016176 612192256 29772 33554432000 4194304 5683644 140734156891936 18446744073709551615 208092055985 0 0 16781312 2 18446604440973228928 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 13660.9
Current children cumulated vsize (KiB) 31746292

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28444 and gives
#  childrusage.ru_utime.tv_sec=25
#  childrusage.ru_utime.tv_usec=210167
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=261960
# CPU time returned by wait4() is 25.4721
# while last known CPU time is 13660.9
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1735.97
CPU time (s): 13660.9
CPU user time (s): 13621.7
CPU system time (s): 39.15
CPU usage (%): 786.93
Max. virtual memory (cumulated for all children) (KiB): 31746292

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 25.2102
system time used= 0.26196
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 58857
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3009
involuntary context switches= 78

runsolver used 11.7362 second user time and 27.5798 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-15 22:47:57
IDJOB=3380794
IDBENCH=82390
IDSOLVER=1864
FILE ID=node127/3380794-1305492477
RUNJOBID= node127-1305487466-28251
PBS_JOBID= 13325391
Free space on /tmp= 73488 MiB

SOLVER NAME= borg-sat 11.03.02-par-industrial (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380794-1305492477/watcher-3380794-1305492477 -o /tmp/evaluation-result-3380794-1305492477/solver-3380794-1305492477 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3380794-1305492477.cnf -seed 816016768 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 732b9c9b0d44d6a9e75489b2f5004165
RANDOM SEED=816016768

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       7735180 kB
Buffers:        322740 kB
Cached:        4152536 kB
SwapCached:       1620 kB
Active:       21981080 kB
Inactive:      2879216 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       7735180 kB
SwapTotal:    67111528 kB
SwapFree:     67083212 kB
Dirty:           40004 kB
Writeback:           0 kB
AnonPages:    20383724 kB
Mapped:          29176 kB
Slab:           230456 kB
PageTables:      59436 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 63392184 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73456 MiB
End job on node127 at 2011-05-15 23:16:55