Trace number 3317871

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4215.21 1300.06

General information on the benchmark

NameSAT04/industrial/vangelder/cnf-color/
myciel6-tr.used-as.sat04-320.cnf
MD5SUM5ba57e5cfd40b4a93356dbea5162016d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark384.789
Satisfiable
(Un)Satisfiability was proved
Number of variables570
Number of clauses4625
Sum of the clauses size9615
Maximum clause length6
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 24531
Number of clauses of size 31
Number of clauses of size 41
Number of clauses of size 51
Number of clauses of size over 590

Solver Data 

0.30/0.48	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.30/0.48	c INFO: solving HOME/instance-3317871-1304271041.cnf
0.30/0.48	c INFO: computing task features
0.30/0.49	c INFO: computed variable-clause graph statistics
0.30/0.49	c INFO: computed clause balance statistics
0.39/0.54	c INFO: computed variable balance statistics
0.39/0.59	c INFO: computed small-clause counts
0.39/0.59	c INFO: computed Horn-clause counts
0.49/0.60	c INFO: computed variable graph statistics
0.49/0.60	c INFO: collected features for HOME/instance-3317871-1304271041.cnf in 0.12 s
0.49/0.62	c INFO: running lingeling-276@0 for 97 with 4799 remaining (b = 0.28)
0.49/0.64	c INFO: running cryptominisat-2.9.0@0 for 485 with 4799 remaining (b = 0.36)
0.49/0.67	c INFO: running lingeling-276@0 for 873 with 4799 remaining (b = 0.45)
0.49/0.69	c INFO: running lingeling-276@0 for 1261 with 4799 remaining (b = 0.47)
349.90/100.79	c INFO: running cryptominisat-2.9.0@0 for 485 with 4699 remaining (b = 0.26)
1717.42/492.24	c INFO: running lingeling-276@0 for 1164 with 4308 remaining (b = 0.37)
2604.63/787.54	c INFO: running SApperloT@0 for 97 with 4012 remaining (b = 0.12)
3109.78/932.11	c INFO: running precosat-570@0 for 388 with 3868 remaining (b = 0.26)
3259.07/981.84	c INFO: running lingeling-276@0 for 97 with 3818 remaining (b = 0.07)
3845.90/1177.14	c INFO: running cryptominisat-2.9.0@490 for 582 with 3623 remaining (b = 0.21)
4215.21/1300.03	c INFO: running SApperloT@0 for 97 with 3500 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317871-1304271041/watcher-3317871-1304271041 -o /tmp/evaluation-result-3317871-1304271041/solver-3317871-1304271041 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317871-1304271041.cnf -seed 966247080 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.49 8.90 8.51 6/218 6048
/proc/meminfo: memFree=27648304/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=15756 CPUtime=0 cores=1,3,5,7
/proc/6048/stat : 6048 (python) R 6046 6048 5278 0 -1 4202496 843 0 0 0 0 0 0 0 25 0 1 0 538703948 16134144 725 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089741447 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/6048/statm: 3941 727 334 364 0 428 0

[startup+0.050727 s]
/proc/loadavg: 8.49 8.90 8.51 6/218 6048
/proc/meminfo: memFree=27648304/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=29792 CPUtime=0.04 cores=1,3,5,7
/proc/6048/stat : 6048 (python) R 6046 6048 5278 0 -1 4202496 1461 0 0 0 3 1 0 0 25 0 1 0 538703948 30507008 1300 33554432000 4194304 5683644 140737410914880 18446744073709551615 4890983 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/6048/statm: 7448 1300 443 364 0 818 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29792

[startup+0.10072 s]
/proc/loadavg: 8.49 8.90 8.51 6/218 6048
/proc/meminfo: memFree=27648304/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=104616 CPUtime=0.07 cores=1,3,5,7
/proc/6048/stat : 6048 (python) R 6046 6048 5278 0 -1 4202496 3099 0 0 0 5 2 0 0 25 0 1 0 538703948 107126784 2778 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089696256 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/6048/statm: 26154 2778 847 364 0 1902 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104616

[startup+0.300686 s]
/proc/loadavg: 8.49 8.90 8.51 6/218 6048
/proc/meminfo: memFree=27648304/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=156692 CPUtime=0.22 cores=1,3,5,7
/proc/6048/stat : 6048 (python) S 6046 6048 5278 0 -1 4202496 6375 935 1 0 16 6 0 0 25 0 1 0 538703948 160452608 4500 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089696256 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 1
/proc/6048/statm: 39173 4500 1257 364 0 3281 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 156692

[startup+0.700619 s]
/proc/loadavg: 8.49 8.90 8.51 6/218 6048
/proc/meminfo: memFree=27648304/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=319940 CPUtime=0.58 cores=1,3,5,7
/proc/6048/stat : 6048 (python) R 6046 6048 5278 0 -1 4202496 12130 935 1 0 48 10 0 0 25 0 5 0 538703948 327618560 7190 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 1
/proc/6048/statm: 79985 7190 1879 364 0 15894 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 319940

[startup+1.50147 s]
/proc/loadavg: 8.49 8.90 8.51 10/231 6065
/proc/meminfo: memFree=27604916/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=319940 CPUtime=0.58 cores=1,3,5,7
/proc/6048/stat : 6048 (python) S 6046 6048 5278 0 -1 4202496 12169 935 1 0 48 10 0 0 25 0 5 0 538703948 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 1
/proc/6048/statm: 79985 7192 1881 364 0 15894 0
[pid=6054] ppid=6048 vsize=278660 CPUtime=0 cores=1,3,5,7
/proc/6054/stat : 6054 (python) S 6048 6048 5278 0 -1 4202560 787 0 0 0 0 0 0 0 25 0 1 0 538704011 285347840 5587 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718287 0 0 16781312 514 1307086233255542783 0 0 17 3 0 0 0
/proc/6054/statm: 69665 5587 352 364 0 5583 0
[pid=6056] ppid=6054 vsize=6268 CPUtime=0.87 cores=1,3,5,7
/proc/6056/stat : 6056 (lingeling) R 6054 6056 6056 0 -1 4202496 1041 0 0 0 87 0 0 0 25 0 1 0 538704011 6418432 769 33554432000 4194304 4352236 140736783525200 18446744073709551615 4328122 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/6056/statm: 1567 769 129 39 0 647 0
[pid=6057] ppid=6048 vsize=289184 CPUtime=0 cores=1,3,5,7
/proc/6057/stat : 6057 (python) S 6048 6048 5278 0 -1 4202560 751 0 0 0 0 0 0 0 19 0 1 0 538704013 296124416 5636 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 4609350660024926469 0 0 17 3 0 0 0
/proc/6057/statm: 72296 5636 348 364 0 8211 0
[pid=6059] ppid=6057 vsize=32208 CPUtime=0.84 cores=1,3,5,7
/proc/6059/stat : 6059 (cryptominisat-2) R 6057 6059 6059 0 -1 4202496 2542 0 0 0 84 0 0 0 25 0 1 0 538704013 32980992 1095 33554432000 4194304 4677096 140736548927376 18446744073709551615 4318847 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/6059/statm: 8052 1095 384 118 0 3011 0
[pid=6060] ppid=6048 vsize=299440 CPUtime=0 cores=1,3,5,7
/proc/6060/stat : 6060 (python) S 6048 6048 5278 0 -1 4202560 726 0 0 0 0 0 0 0 25 0 1 0 538704015 306626560 5647 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 15312409436534865919 0 0 17 7 0 0 0
/proc/6060/statm: 74860 5647 344 364 0 10772 0
[pid=6064] ppid=6060 vsize=5240 CPUtime=0.32 cores=1,3,5,7
/proc/6064/stat : 6064 (lingeling) R 6060 6064 6064 0 -1 4202496 755 0 0 0 32 0 0 0 25 0 1 0 538704018 5365760 480 33554432000 4194304 4352236 140737083256768 18446744073709551615 4328022 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/6064/statm: 1310 480 129 39 0 390 0
[pid=6062] ppid=6048 vsize=309696 CPUtime=0 cores=1,3,5,7
/proc/6062/stat : 6062 (python) S 6048 6048 5278 0 -1 4202560 730 0 0 0 0 0 0 0 25 0 1 0 538704018 317128704 5651 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 15312405588244168703 0 0 17 7 0 0 0
/proc/6062/statm: 77424 5651 344 364 0 13333 0
[pid=6065] ppid=6062 vsize=6144 CPUtime=0.79 cores=1,3,5,7
/proc/6065/stat : 6065 (lingeling) R 6062 6065 6065 0 -1 4202496 1020 0 0 0 79 0 0 0 25 0 1 0 538704018 6291456 738 33554432000 4194304 4352236 140734110210912 18446744073709551615 4278732 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/6065/statm: 1536 738 129 39 0 616 0
[pid=6048/tid=6055] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6055/stat : 6055 (python) S 6046 6048 5278 0 -1 4202560 26 935 0 0 0 0 0 0 25 0 5 0 538704011 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 5 0 0 0
[pid=6048/tid=6058] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6058/stat : 6058 (python) S 6046 6048 5278 0 -1 4202560 20 935 0 0 0 0 0 0 25 0 5 0 538704013 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 3 0 0 0
[pid=6048/tid=6061] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6061/stat : 6061 (python) S 6046 6048 5278 0 -1 4202560 39 935 0 0 0 0 0 0 25 0 5 0 538704016 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6063] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6063/stat : 6063 (python) S 6046 6048 5278 0 -1 4202560 18 935 0 0 0 0 0 0 25 0 5 0 538704018 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.4
Current children cumulated vsize (KiB) 1546780

[startup+3.10119 s]
/proc/loadavg: 8.49 8.90 8.51 10/231 6065
/proc/meminfo: memFree=27597228/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=319940 CPUtime=0.58 cores=1,3,5,7
/proc/6048/stat : 6048 (python) S 6046 6048 5278 0 -1 4202496 12169 935 1 0 48 10 0 0 25 0 5 0 538703948 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 1
/proc/6048/statm: 79985 7192 1881 364 0 15894 0
[pid=6054] ppid=6048 vsize=278660 CPUtime=0 cores=1,3,5,7
/proc/6054/stat : 6054 (python) S 6048 6048 5278 0 -1 4202560 811 0 0 0 0 0 0 0 18 0 1 0 538704011 285347840 5594 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718287 0 0 16781312 514 1307086233255510277 0 0 17 3 0 0 0
/proc/6054/statm: 69665 5594 359 364 0 5583 0
[pid=6056] ppid=6054 vsize=7620 CPUtime=2.47 cores=1,3,5,7
/proc/6056/stat : 6056 (lingeling) R 6054 6056 6056 0 -1 4202496 1683 0 0 0 247 0 0 0 25 0 1 0 538704011 7802880 1107 33554432000 4194304 4352236 140736783525200 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/6056/statm: 1905 1107 129 39 0 985 0
[pid=6057] ppid=6048 vsize=289184 CPUtime=0 cores=1,3,5,7
/proc/6057/stat : 6057 (python) S 6048 6048 5278 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 538704013 296124416 5636 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 5601801483394711813 0 0 17 3 0 0 0
/proc/6057/statm: 72296 5636 348 364 0 8211 0
[pid=6059] ppid=6057 vsize=41884 CPUtime=2.44 cores=1,3,5,7
/proc/6059/stat : 6059 (cryptominisat-2) R 6057 6059 6059 0 -1 4202496 5940 0 0 0 243 1 0 0 25 0 1 0 538704013 42889216 3415 33554432000 4194304 4677096 140736548927376 18446744073709551615 248089394663 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/6059/statm: 10471 3415 388 118 0 5430 0
[pid=6060] ppid=6048 vsize=299440 CPUtime=0 cores=1,3,5,7
/proc/6060/stat : 6060 (python) S 6048 6048 5278 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 538704015 306626560 5651 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 15312409436534833416 0 0 17 7 0 0 0
/proc/6060/statm: 74860 5651 348 364 0 10772 0
[pid=6064] ppid=6060 vsize=6596 CPUtime=1.12 cores=1,3,5,7
/proc/6064/stat : 6064 (lingeling) R 6060 6064 6064 0 -1 4202496 1126 0 0 0 112 0 0 0 25 0 1 0 538704018 6754304 851 33554432000 4194304 4352236 140737083256768 18446744073709551615 4328116 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/6064/statm: 1649 851 129 39 0 729 0
[pid=6062] ppid=6048 vsize=309696 CPUtime=0 cores=1,3,5,7
/proc/6062/stat : 6062 (python) S 6048 6048 5278 0 -1 4202560 748 0 0 0 0 0 0 0 18 0 1 0 538704018 317128704 5655 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 15312405588244136200 0 0 17 7 0 0 0
/proc/6062/statm: 77424 5655 348 364 0 13333 0
[pid=6065] ppid=6062 vsize=7748 CPUtime=2.38 cores=1,3,5,7
/proc/6065/stat : 6065 (lingeling) R 6062 6065 6065 0 -1 4202496 1645 0 0 0 238 0 0 0 25 0 1 0 538704018 7933952 1107 33554432000 4194304 4352236 140734110210912 18446744073709551615 4328252 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/6065/statm: 1937 1107 129 39 0 1017 0
[pid=6048/tid=6055] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6055/stat : 6055 (python) S 6046 6048 5278 0 -1 4202560 26 935 0 0 0 0 0 0 25 0 5 0 538704011 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 5 0 0 0
[pid=6048/tid=6058] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6058/stat : 6058 (python) S 6046 6048 5278 0 -1 4202560 20 935 0 0 0 0 0 0 25 0 5 0 538704013 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 3 0 0 0
[pid=6048/tid=6061] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6061/stat : 6061 (python) S 6046 6048 5278 0 -1 4202560 39 935 0 0 0 0 0 0 25 0 5 0 538704016 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6063] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6063/stat : 6063 (python) S 6046 6048 5278 0 -1 4202560 18 935 0 0 0 0 0 0 25 0 5 0 538704018 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 8.99
Current children cumulated vsize (KiB) 1560768

[startup+6.30063 s]
/proc/loadavg: 8.61 8.92 8.52 10/231 6065
/proc/meminfo: memFree=27578528/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=319940 CPUtime=0.58 cores=1,3,5,7
/proc/6048/stat : 6048 (python) S 6046 6048 5278 0 -1 4202496 12169 935 1 0 48 10 0 0 25 0 5 0 538703948 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 1
/proc/6048/statm: 79985 7192 1881 364 0 15894 0
[pid=6054] ppid=6048 vsize=278660 CPUtime=0 cores=1,3,5,7
/proc/6054/stat : 6054 (python) S 6048 6048 5278 0 -1 4202560 976 0 0 0 0 0 0 0 18 0 1 0 538704011 285347840 5616 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718287 0 0 16781312 514 1307086233255510277 0 0 17 3 0 0 0
/proc/6054/statm: 69665 5616 381 364 0 5583 0
[pid=6056] ppid=6054 vsize=7748 CPUtime=5.66 cores=1,3,5,7
/proc/6056/stat : 6056 (lingeling) R 6054 6056 6056 0 -1 4202496 2195 0 0 0 566 0 0 0 25 0 1 0 538704011 7933952 1139 33554432000 4194304 4352236 140736783525200 18446744073709551615 4328000 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/6056/statm: 1937 1139 129 39 0 1017 0
[pid=6057] ppid=6048 vsize=289184 CPUtime=0 cores=1,3,5,7
/proc/6057/stat : 6057 (python) S 6048 6048 5278 0 -1 4202560 910 0 0 0 0 0 0 0 15 0 1 0 538704013 296124416 5659 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 4609350660024926469 0 0 17 3 0 0 0
/proc/6057/statm: 72296 5659 371 364 0 8211 0
[pid=6059] ppid=6057 vsize=43520 CPUtime=5.61 cores=1,3,5,7
/proc/6059/stat : 6059 (cryptominisat-2) R 6057 6059 6059 0 -1 4202496 8727 0 0 0 560 1 0 0 25 0 1 0 538704013 44564480 3841 33554432000 4194304 4677096 140736548927376 18446744073709551615 4319968 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/6059/statm: 10880 3841 388 118 0 5839 0
[pid=6060] ppid=6048 vsize=299440 CPUtime=0 cores=1,3,5,7
/proc/6060/stat : 6060 (python) S 6048 6048 5278 0 -1 4202560 924 0 0 0 0 0 0 0 18 0 1 0 538704015 306626560 5674 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 15312409436534833416 0 0 17 7 0 0 0
/proc/6060/statm: 74860 5674 371 364 0 10772 0
[pid=6064] ppid=6060 vsize=7748 CPUtime=2.72 cores=1,3,5,7
/proc/6064/stat : 6064 (lingeling) R 6060 6064 6064 0 -1 4202496 1542 0 0 0 272 0 0 0 25 0 1 0 538704018 7933952 1139 33554432000 4194304 4352236 140737083256768 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/6064/statm: 1937 1139 129 39 0 1017 0
[pid=6062] ppid=6048 vsize=309696 CPUtime=0 cores=1,3,5,7
/proc/6062/stat : 6062 (python) S 6048 6048 5278 0 -1 4202560 929 0 0 0 0 0 0 0 18 0 1 0 538704018 317128704 5678 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 15312405588244136200 0 0 17 7 0 0 0
/proc/6062/statm: 77424 5678 371 364 0 13333 0
[pid=6065] ppid=6062 vsize=7752 CPUtime=5.54 cores=1,3,5,7
/proc/6065/stat : 6065 (lingeling) R 6062 6065 6065 0 -1 4202496 2366 0 0 0 554 0 0 0 25 0 1 0 538704018 7938048 1124 33554432000 4194304 4352236 140734110210912 18446744073709551615 4328390 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/6065/statm: 1938 1124 129 39 0 1018 0
[pid=6048/tid=6055] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6055/stat : 6055 (python) S 6046 6048 5278 0 -1 4202560 26 935 0 0 0 0 0 0 25 0 5 0 538704011 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 5 0 0 0
[pid=6048/tid=6058] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6058/stat : 6058 (python) S 6046 6048 5278 0 -1 4202560 20 935 0 0 0 0 0 0 25 0 5 0 538704013 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 3 0 0 0
[pid=6048/tid=6061] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6061/stat : 6061 (python) S 6046 6048 5278 0 -1 4202560 39 935 0 0 0 0 0 0 25 0 5 0 538704016 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6063] ppid=6046 vsize=319940 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6063/stat : 6063 (python) S 6046 6048 5278 0 -1 4202560 18 935 0 0 0 0 0 0 25 0 5 0 538704018 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 20.11
Current children cumulated vsize (KiB) 1563688

[startup+12.7015 s]
/proc/loadavg: 8.64 8.92 8.52 10/231 6065
/proc/meminfo: memFree=27561772/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=319940 CPUtime=0.58 cores=1,3,5,7
/proc/6048/stat : 6048 (python) S 6046 6048 5278 0 -1 4202496 12169 935 1 0 48 10 0 0 25 0 5 0 538703948 327618560 7192 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 1
/proc/6048/statm: 79985 7192 1881 364 0 15894 0
[pid=6054] ppid=6048 vsize=278660 CPUtime=0.01 cores=1,3,5,7
/proc/6054/stat : 6054 (python) S 6048 6048 5278 0 -1 4202560 981 0 0 0 0 1 0 0 18 0 1 0 538704011 285347840 5617 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718287 0 0 16781312 514 211968249649135877 0 0 17 3 0 0 0
/proc/6054/statm: 69665 5617 382 364 0 5583 0
[pid=6056] ppid=6054 vsize=8524 CPUtime=12.06 cores=1,3,5,7
/proc/6056/stat : 6056 (lingeling) R 6054 6056 6056 0 -1 4202496 3317 0 0 0 1206 0 0 0 25 0 1 0 538704011 8728576 1333 33554432000 4194304 4352236 140736783525200 18446744073709551615 4329000 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/6056/statm: 2131 1333 129 39 0 1211 0
[pid=6057] ppid=6048 vsize=289184 CPUtime=0.02 cores=1,3,5,7

################
# More data... #
################

[pid=6060] ppid=6048 vsize=299440 CPUtime=1.36 cores=1,3,5,7
/proc/6060/stat : 6060 (python) S 6048 6048 5278 0 -1 4202560 1144 0 0 0 69 67 0 0 19 0 2 0 538704015 306626560 5704 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6060/statm: 74860 5704 400 364 0 10772 0
[pid=6064] ppid=6060 vsize=43024 CPUtime=876.11 cores=1,3,5,7
/proc/6064/stat : 6064 (lingeling) T 6060 6064 6064 0 -1 4202496 105774 0 0 0 87595 16 0 0 25 0 1 0 538704018 44056576 9958 33554432000 4194304 4352236 140737083256768 18446744073709551615 4328385 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/6064/statm: 10756 9958 129 39 0 9836 0
[pid=6060/tid=6122] ppid=6048 vsize=299440 CPUtime=0 cores=1,3,5,7
/proc/6060/task/6122/stat : 6122 (python) S 6048 6048 5278 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 538797157 306626560 5704 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604456477891392 0 0 -1 7 0 0 0
[pid=6062] ppid=6048 vsize=309696 CPUtime=1.81 cores=1,3,5,7
/proc/6062/stat : 6062 (python) S 6048 6048 5278 0 -1 4202560 993 0 0 0 91 90 0 0 18 0 1 0 538704018 317128704 5678 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 211968249649135880 0 0 17 7 0 0 0
/proc/6062/statm: 77424 5678 371 364 0 13333 0
[pid=6065] ppid=6062 vsize=37408 CPUtime=1090.61 cores=1,3,5,7
/proc/6065/stat : 6065 (lingeling) R 6062 6065 6065 0 -1 4202496 126245 0 0 0 109046 15 0 0 25 0 1 0 538704018 38305792 8554 33554432000 4194304 4352236 140734110210912 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/6065/statm: 9352 8554 129 39 0 8432 0
[pid=6070] ppid=6048 vsize=319952 CPUtime=1.2 cores=1,3,5,7
/proc/6070/stat : 6070 (python) S 6048 6048 5278 0 -1 4202560 1172 0 0 0 59 61 0 0 15 0 2 0 538714027 327630848 5724 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6070/statm: 79988 5724 400 364 0 15894 0
[pid=6072] ppid=6070 vsize=113312 CPUtime=523.97 cores=1,3,5,7
/proc/6072/stat : 6072 (cryptominisat-2) R 6070 6072 6072 0 -1 4202496 105421 0 0 0 52354 43 0 0 25 0 1 0 538714028 116031488 20536 33554432000 4194304 4677096 140735346344000 18446744073709551615 4319550 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/6072/statm: 28328 20536 388 118 0 23287 0
[pid=6070/tid=6114] ppid=6048 vsize=319952 CPUtime=0 cores=1,3,5,7
/proc/6070/task/6114/stat : 6114 (python) S 6048 6048 5278 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 538782701 327630848 5724 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604471125858240 0 0 -1 7 0 0 0
[pid=6115] ppid=6048 vsize=330352 CPUtime=0.28 cores=1,3,5,7
/proc/6115/stat : 6115 (python) S 6048 6048 5278 0 -1 4202560 1157 0 0 0 15 13 0 0 19 0 2 0 538782703 338280448 5756 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6115/statm: 82588 5756 400 364 0 18491 0
[pid=6117] ppid=6115 vsize=9856 CPUtime=97.09 cores=1,3,5,7
/proc/6117/stat : 6117 (SApperloT-base) T 6115 6117 6117 0 -1 4202496 2366 0 0 0 9709 0 0 0 25 0 1 0 538782703 10092544 2099 33554432000 134512640 135674940 4294870208 18446744073709551615 134564854 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/6117/statm: 2464 2099 100 284 0 2178 0
[pid=6115/tid=6127] ppid=6048 vsize=330352 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6127/stat : 6127 (python) S 6048 6048 5278 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538802130 338280448 5756 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604471128545344 0 0 -1 5 0 0 0
[pid=6123] ppid=6048 vsize=340608 CPUtime=0.46 cores=1,3,5,7
/proc/6123/stat : 6123 (python) S 6048 6048 5278 0 -1 4202560 1017 0 0 0 27 19 0 0 18 0 1 0 538797160 348782592 5730 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 211968249649135877 0 0 17 7 0 0 0
/proc/6123/statm: 85152 5730 371 364 0 21052 0
[pid=6125] ppid=6123 vsize=25248 CPUtime=172.82 cores=1,3,5,7
/proc/6125/stat : 6125 (precosat) R 6123 6125 6125 0 -1 4202496 8602 0 0 0 17278 4 0 0 25 0 1 0 538797160 25853952 6185 33554432000 4194304 4890832 140736966132752 18446744073709551615 4237597 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/6125/statm: 6312 6185 86 171 0 6139 0
[pid=6128] ppid=6048 vsize=350864 CPUtime=0.29 cores=1,3,5,7
/proc/6128/stat : 6128 (python) S 6048 6048 5278 0 -1 4202560 1201 0 0 0 16 13 0 0 19 0 2 0 538802132 359284736 5783 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6128/statm: 87716 5783 406 364 0 23613 0
[pid=6130] ppid=6128 vsize=22780 CPUtime=97.6 cores=1,3,5,7
/proc/6130/stat : 6130 (lingeling) T 6128 6130 6130 0 -1 4202496 20844 0 0 0 9758 2 0 0 25 0 1 0 538802133 23326720 4881 33554432000 4194304 4352236 140736504478960 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/6130/statm: 5695 4881 129 39 0 4775 0
[pid=6128/tid=6137] ppid=6048 vsize=350864 CPUtime=0 cores=1,3,5,7
/proc/6128/task/6137/stat : 6137 (python) S 6048 6048 5278 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538821660 359284736 5783 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604471138859136 0 0 -1 7 0 0 0
[pid=6048/tid=6055] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6055/stat : 6055 (python) S 6046 6048 5278 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 9 0 538704011 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 5 0 0 0
[pid=6048/tid=6058] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6058/stat : 6058 (python) S 6046 6048 5278 0 -1 4202560 20 935 0 0 0 0 0 0 25 0 9 0 538704013 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 3 0 0 0
[pid=6048/tid=6061] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6061/stat : 6061 (python) S 6046 6048 5278 0 -1 4202560 39 935 0 0 0 0 0 0 25 0 9 0 538704016 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6063] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6063/stat : 6063 (python) S 6046 6048 5278 0 -1 4202560 18 935 0 0 0 0 0 0 25 0 9 0 538704018 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6071] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6071/stat : 6071 (python) S 6046 6048 5278 0 -1 4202560 30 935 0 0 0 0 0 0 18 0 9 0 538714027 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6116] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6116/stat : 6116 (python) S 6046 6048 5278 0 -1 4202560 29 935 0 0 0 0 0 0 20 0 9 0 538782703 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6124] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6124/stat : 6124 (python) S 6046 6048 5278 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 9 0 538797160 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6129] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6129/stat : 6129 (python) S 6046 6048 5278 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 9 0 538802133 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4041.82
Current children cumulated vsize (KiB) 3282524



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 5.01 5.41 6.75 6/223 6140
/proc/meminfo: memFree=27726360/32950928 swapFree=67111428/67111528
[pid=6048] ppid=6046 vsize=361368 CPUtime=0.72 cores=1,3,5,7
/proc/6048/stat : 6048 (python) S 6046 6048 5278 0 -1 4202496 15995 935 1 0 61 11 0 0 18 0 9 0 538703948 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 1
/proc/6048/statm: 90342 7307 1890 364 0 26239 0
[pid=6054] ppid=6048 vsize=288904 CPUtime=1.29 cores=1,3,5,7
/proc/6054/stat : 6054 (python) S 6048 6048 5278 0 -1 4202560 1209 0 0 0 65 64 0 0 18 0 2 0 538704011 295837696 5656 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/6054/statm: 72226 5656 416 364 0 8144 0
[pid=6056] ppid=6054 vsize=35140 CPUtime=713.75 cores=1,3,5,7
/proc/6056/stat : 6056 (lingeling) R 6054 6056 6056 0 -1 4202496 87835 0 0 0 71364 11 0 0 25 0 1 0 538704011 35983360 7987 33554432000 4194304 4352236 140736783525200 18446744073709551615 4328004 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/6056/statm: 8785 7987 129 39 0 7865 0
[pid=6054/tid=6069] ppid=6048 vsize=288904 CPUtime=0 cores=1,3,5,7
/proc/6054/task/6069/stat : 6069 (python) S 6048 6048 5278 0 -1 4202560 52 0 0 0 0 0 0 0 19 0 2 0 538714025 295837696 5656 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604466101924864 0 0 -1 3 0 0 0
[pid=6057] ppid=6048 vsize=289184 CPUtime=0.84 cores=1,3,5,7
/proc/6057/stat : 6057 (python) S 6048 6048 5278 0 -1 4202560 1141 0 0 0 44 40 0 0 16 0 2 0 538704013 296124416 5690 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/6057/statm: 72296 5690 401 364 0 8211 0
[pid=6059] ppid=6057 vsize=103596 CPUtime=490.57 cores=1,3,5,7
/proc/6059/stat : 6059 (cryptominisat-2) T 6057 6059 6059 0 -1 4202496 90579 0 0 0 49024 33 0 0 25 0 1 0 538704013 106082304 18951 33554432000 4194304 4677096 140736548927376 18446744073709551615 4320231 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/6059/statm: 25899 18951 388 118 0 20858 0
[pid=6057/tid=6088] ppid=6048 vsize=289184 CPUtime=0 cores=1,3,5,7
/proc/6057/task/6088/stat : 6088 (python) S 6048 6048 5278 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 538753171 296124416 5690 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604466101923968 0 0 -1 3 0 0 0
[pid=6060] ppid=6048 vsize=299440 CPUtime=1.36 cores=1,3,5,7
/proc/6060/stat : 6060 (python) S 6048 6048 5278 0 -1 4202560 1144 0 0 0 69 67 0 0 19 0 2 0 538704015 306626560 5704 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6060/statm: 74860 5704 400 364 0 10772 0
[pid=6064] ppid=6060 vsize=43024 CPUtime=876.11 cores=1,3,5,7
/proc/6064/stat : 6064 (lingeling) T 6060 6064 6064 0 -1 4202496 105774 0 0 0 87595 16 0 0 25 0 1 0 538704018 44056576 9958 33554432000 4194304 4352236 140737083256768 18446744073709551615 4328385 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/6064/statm: 10756 9958 129 39 0 9836 0
[pid=6060/tid=6122] ppid=6048 vsize=299440 CPUtime=0 cores=1,3,5,7
/proc/6060/task/6122/stat : 6122 (python) S 6048 6048 5278 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 538797157 306626560 5704 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604456477891392 0 0 -1 7 0 0 0
[pid=6062] ppid=6048 vsize=309696 CPUtime=1.9 cores=1,3,5,7
/proc/6062/stat : 6062 (python) S 6048 6048 5278 0 -1 4202560 993 0 0 0 96 94 0 0 18 0 1 0 538704018 317128704 5678 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 211968249649135880 0 0 17 7 0 0 0
/proc/6062/statm: 77424 5678 371 364 0 13333 0
[pid=6065] ppid=6062 vsize=38176 CPUtime=1148.23 cores=1,3,5,7
/proc/6065/stat : 6065 (lingeling) R 6062 6065 6065 0 -1 4202496 128229 0 0 0 114808 15 0 0 25 0 1 0 538704018 39092224 8746 33554432000 4194304 4352236 140734110210912 18446744073709551615 4329024 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/6065/statm: 9544 8746 129 39 0 8624 0
[pid=6070] ppid=6048 vsize=319952 CPUtime=1.29 cores=1,3,5,7
/proc/6070/stat : 6070 (python) S 6048 6048 5278 0 -1 4202560 1172 0 0 0 65 64 0 0 15 0 2 0 538714027 327630848 5724 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6070/statm: 79988 5724 400 364 0 15894 0
[pid=6072] ppid=6070 vsize=113348 CPUtime=552.82 cores=1,3,5,7
/proc/6072/stat : 6072 (cryptominisat-2) R 6070 6072 6072 0 -1 4202496 108646 0 0 0 55237 45 0 0 25 0 1 0 538714028 116068352 21085 33554432000 4194304 4677096 140735346344000 18446744073709551615 4320039 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/6072/statm: 28337 21085 388 118 0 23296 0
[pid=6070/tid=6114] ppid=6048 vsize=319952 CPUtime=0 cores=1,3,5,7
/proc/6070/task/6114/stat : 6114 (python) S 6048 6048 5278 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 538782701 327630848 5724 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604471125858240 0 0 -1 7 0 0 0
[pid=6115] ppid=6048 vsize=330352 CPUtime=0.28 cores=1,3,5,7
/proc/6115/stat : 6115 (python) S 6048 6048 5278 0 -1 4202560 1157 0 0 0 15 13 0 0 19 0 2 0 538782703 338280448 5756 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6115/statm: 82588 5756 400 364 0 18491 0
[pid=6117] ppid=6115 vsize=9856 CPUtime=97.09 cores=1,3,5,7
/proc/6117/stat : 6117 (SApperloT-base) T 6115 6117 6117 0 -1 4202496 2366 0 0 0 9709 0 0 0 25 0 1 0 538782703 10092544 2099 33554432000 134512640 135674940 4294870208 18446744073709551615 134564854 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/6117/statm: 2464 2099 100 284 0 2178 0
[pid=6115/tid=6127] ppid=6048 vsize=330352 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6127/stat : 6127 (python) S 6048 6048 5278 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538802130 338280448 5756 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604471128545344 0 0 -1 5 0 0 0
[pid=6123] ppid=6048 vsize=340608 CPUtime=0.54 cores=1,3,5,7
/proc/6123/stat : 6123 (python) S 6048 6048 5278 0 -1 4202560 1017 0 0 0 32 22 0 0 18 0 1 0 538797160 348782592 5730 33554432000 4194304 5683644 140737410914880 18446744073709551615 248089718342 0 0 16781312 514 211968249649135877 0 0 17 7 0 0 0
/proc/6123/statm: 85152 5730 371 364 0 21052 0
[pid=6125] ppid=6123 vsize=27844 CPUtime=230.53 cores=1,3,5,7
/proc/6125/stat : 6125 (precosat) R 6123 6125 6125 0 -1 4202496 10458 0 0 0 23048 5 0 0 25 0 1 0 538797160 28512256 6832 33554432000 4194304 4890832 140736966132752 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/6125/statm: 6961 6832 86 171 0 6788 0
[pid=6128] ppid=6048 vsize=350864 CPUtime=0.29 cores=1,3,5,7
/proc/6128/stat : 6128 (python) S 6048 6048 5278 0 -1 4202560 1201 0 0 0 16 13 0 0 19 0 2 0 538802132 359284736 5783 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6128/statm: 87716 5783 406 364 0 23613 0
[pid=6130] ppid=6128 vsize=22780 CPUtime=97.6 cores=1,3,5,7
/proc/6130/stat : 6130 (lingeling) T 6128 6130 6130 0 -1 4202496 20844 0 0 0 9758 2 0 0 25 0 1 0 538802133 23326720 4881 33554432000 4194304 4352236 140736504478960 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/6130/statm: 5695 4881 129 39 0 4775 0
[pid=6128/tid=6137] ppid=6048 vsize=350864 CPUtime=0 cores=1,3,5,7
/proc/6128/task/6137/stat : 6137 (python) S 6048 6048 5278 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538821660 359284736 5783 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 514 18446604471138859136 0 0 -1 7 0 0 0
[pid=6048/tid=6055] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6055/stat : 6055 (python) S 6046 6048 5278 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 9 0 538704011 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 5 0 0 0
[pid=6048/tid=6058] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6058/stat : 6058 (python) S 6046 6048 5278 0 -1 4202560 20 935 0 0 0 0 0 0 25 0 9 0 538704013 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 3 0 0 0
[pid=6048/tid=6061] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6061/stat : 6061 (python) S 6046 6048 5278 0 -1 4202560 39 935 0 0 0 0 0 0 25 0 9 0 538704016 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6063] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6063/stat : 6063 (python) S 6046 6048 5278 0 -1 4202560 18 935 0 0 0 0 0 0 25 0 9 0 538704018 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6071] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6071/stat : 6071 (python) S 6046 6048 5278 0 -1 4202560 30 935 0 0 0 0 0 0 18 0 9 0 538714027 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6116] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6116/stat : 6116 (python) S 6046 6048 5278 0 -1 4202560 29 935 0 0 0 0 0 0 20 0 9 0 538782703 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6124] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6124/stat : 6124 (python) S 6046 6048 5278 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 9 0 538797160 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
[pid=6048/tid=6129] ppid=6046 vsize=361368 CPUtime=0 cores=1,3,5,7
/proc/6048/task/6129/stat : 6129 (python) S 6046 6048 5278 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 9 0 538802133 370040832 7307 33554432000 4194304 5683644 140737410914880 18446744073709551615 248101521841 0 0 16781312 2 18446604466101926656 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4215.21
Current children cumulated vsize (KiB) 3284132

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6048 and gives
#  childrusage.ru_utime.tv_sec=717
#  childrusage.ru_utime.tv_usec=46992
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=912557
# CPU time returned by wait4() is 719.96
# while last known CPU time is 4215.21
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.06
CPU time (s): 4215.21
CPU user time (s): 4210.06
CPU system time (s): 5.15
CPU usage (%): 324.233
Max. virtual memory (cumulated for all children) (KiB): 3305436

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 717.047
system time used= 2.91256
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 109651
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5026
involuntary context switches= 3112

runsolver used 3.3065 second user time and 8.27074 second system time

The end

Launcher Data 

Begin job on node123 at 2011-05-01 19:30:41
IDJOB=3317871
IDBENCH=84808
IDSOLVER=1706
FILE ID=node123/3317871-1304271041
RUNJOBID= node123-1304267283-5297
PBS_JOBID= 13173956
Free space on /tmp= 73416 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT04/industrial/vangelder/cnf-color/myciel6-tr.used-as.sat04-320.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317871-1304271041/watcher-3317871-1304271041 -o /tmp/evaluation-result-3317871-1304271041/solver-3317871-1304271041 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317871-1304271041.cnf -seed 966247080 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5ba57e5cfd40b4a93356dbea5162016d
RANDOM SEED=966247080

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      27648336 kB
Buffers:        355108 kB
Cached:        1714508 kB
SwapCached:        100 kB
Active:        3055888 kB
Inactive:      1878188 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      27648336 kB
SwapTotal:    67111528 kB
SwapFree:     67111428 kB
Dirty:           32480 kB
Writeback:           0 kB
AnonPages:     2864296 kB
Mapped:          26340 kB
Slab:           289856 kB
PageTables:      16364 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  3992552 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73424 MiB
End job on node123 at 2011-05-01 19:52:24