Trace number 3317890

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4145.35 1300.06

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_09_UNKNOWN.cnf
MD5SUM18ad1dee1e9d863458e75a20545ae68a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1430
Number of clauses79453
Sum of the clauses size236162
Maximum clause length10
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22358
Number of clauses of size 377072
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.31/0.45	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.31/0.45	c INFO: solving HOME/instance-3317890-1304268531.cnf
0.31/0.45	c INFO: computing task features
0.60/0.70	c INFO: computed variable-clause graph statistics
0.60/0.71	c INFO: computed clause balance statistics
1.90/2.06	c INFO: computed variable balance statistics
3.10/3.25	c INFO: computed small-clause counts
3.10/3.26	c INFO: computed Horn-clause counts
3.10/3.28	c INFO: computed variable graph statistics
3.10/3.28	c INFO: collected features for HOME/instance-3317890-1304268531.cnf in 2.82 s
3.20/3.30	c INFO: running lingeling-276@0 for 97 with 4797 remaining (b = 0.25)
3.20/3.33	c INFO: running cryptominisat-2.9.0@0 for 485 with 4797 remaining (b = 0.32)
3.20/3.35	c INFO: running lingeling-276@0 for 582 with 4797 remaining (b = 0.36)
3.20/3.38	c INFO: running lingeling-276@0 for 1261 with 4797 remaining (b = 0.43)
352.82/103.45	c INFO: running SApperloT@0 for 97 with 4697 remaining (b = 0.03)
702.82/203.60	c INFO: running precosat-570@0 for 291 with 4596 remaining (b = 0.14)
1653.34/513.99	c INFO: running cryptominisat-2.9.0@0 for 388 with 4286 remaining (b = 0.15)
1872.93/587.11	c INFO: running lingeling-276@0 for 1067 with 4213 remaining (b = 0.29)
2133.62/674.03	c INFO: running precosat-570@295 for 97 with 4126 remaining (b = 0.06)
2550.99/813.22	c INFO: running lingeling-276@0 for 97 with 3987 remaining (b = 0.06)
2924.77/938.22	c INFO: running cryptominisat-2.9.0@583 for 1067 with 3862 remaining (b = 0.34)
3068.28/979.45	c INFO: running precosat-570@390 for 97 with 3821 remaining (b = 0.04)
3406.66/1076.59	c INFO: running lingeling-276@389 for 873 with 3723 remaining (b = 0.22)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317890-1304268531/watcher-3317890-1304268531 -o /tmp/evaluation-result-3317890-1304268531/solver-3317890-1304268531 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317890-1304268531.cnf -seed 1172665892 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.08 6.60 5.27 6/193 22321
/proc/meminfo: memFree=27185196/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=15380 CPUtime=0 cores=0,2,4,6
/proc/22321/stat : 22321 (python) S 22319 22321 21930 0 -1 4202496 819 0 0 0 0 0 0 0 17 0 1 0 617083761 15749120 704 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895488512 0 2147483391 16781312 2 18446744071699215550 0 0 17 4 0 0 0
/proc/22321/statm: 3845 704 334 364 0 332 0

[startup+0.05515 s]
/proc/loadavg: 6.08 6.60 5.27 6/193 22321
/proc/meminfo: memFree=27185196/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=36512 CPUtime=0.04 cores=0,2,4,6
/proc/22321/stat : 22321 (python) R 22319 22321 21930 0 -1 4202496 1590 0 0 0 3 1 0 0 17 0 1 0 617083761 37388288 1426 33554432000 4194304 5683644 140735354209376 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22321/statm: 9128 1427 452 364 0 945 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 36512

[startup+0.101096 s]
/proc/loadavg: 6.08 6.60 5.27 6/193 22321
/proc/meminfo: memFree=27185196/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=104620 CPUtime=0.07 cores=0,2,4,6
/proc/22321/stat : 22321 (python) R 22319 22321 21930 0 -1 4202496 3145 0 0 0 5 2 0 0 17 0 1 0 617083761 107130880 2823 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895490304 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22321/statm: 26155 2823 847 364 0 1903 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104620

[startup+0.301103 s]
/proc/loadavg: 6.08 6.60 5.27 6/193 22321
/proc/meminfo: memFree=27185196/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=198916 CPUtime=0.21 cores=0,2,4,6
/proc/22321/stat : 22321 (python) R 22319 22321 21930 0 -1 4202496 7021 935 1 0 15 6 0 0 17 0 1 0 617083761 203689984 5053 33554432000 4194304 5683644 140735354209376 18446744073709551615 231898899380 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22321/statm: 49729 5053 1466 364 0 3756 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 198916

[startup+0.701047 s]
/proc/loadavg: 6.08 6.60 5.27 6/193 22321
/proc/meminfo: memFree=27185196/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=292448 CPUtime=0.6 cores=0,2,4,6
/proc/22321/stat : 22321 (python) R 22319 22321 21930 0 -1 4202496 14817 935 1 0 50 10 0 0 17 0 1 0 617083761 299466752 10384 33554432000 4194304 5683644 140735354209376 18446744073709551615 47388698371706 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22321/statm: 73112 10386 1812 364 0 9036 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 292448

[startup+1.50089 s]
/proc/loadavg: 6.08 6.60 5.27 7/194 22326
/proc/meminfo: memFree=27138316/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=293068 CPUtime=1.4 cores=0,2,4,6
/proc/22321/stat : 22321 (python) R 22319 22321 21930 0 -1 4202496 15090 935 1 0 130 10 0 0 19 0 1 0 617083761 300101632 10652 33554432000 4194304 5683644 140735354209376 18446744073709551615 4602274 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22321/statm: 73267 10652 1826 364 0 9191 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 293068

[startup+3.10059 s]
/proc/loadavg: 6.08 6.60 5.27 7/194 22326
/proc/meminfo: memFree=27132736/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=293068 CPUtime=3 cores=0,2,4,6
/proc/22321/stat : 22321 (python) R 22319 22321 21930 0 -1 4202496 15091 935 1 0 290 10 0 0 22 0 1 0 617083761 300101632 10653 33554432000 4194304 5683644 140735354209376 18446744073709551615 4539178 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22321/statm: 73267 10653 1827 364 0 9191 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 293068

[startup+6.30092 s]
/proc/loadavg: 6.31 6.64 5.29 10/206 22338
/proc/meminfo: memFree=27062200/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=324432 CPUtime=3.27 cores=0,2,4,6
/proc/22321/stat : 22321 (python) S 22319 22321 21930 0 -1 4202496 17796 935 1 0 316 11 0 0 21 0 5 0 617083761 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22321/statm: 81108 8305 1881 364 0 17017 0
[pid=22327] ppid=22321 vsize=284084 CPUtime=0 cores=0,2,4,6
/proc/22327/stat : 22327 (python) S 22321 22321 21930 0 -1 4202560 809 0 0 0 0 0 0 0 18 0 1 0 617084092 290902016 6693 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510543 0 0 16781312 514 4229719256645730562 0 0 17 4 0 0 0
/proc/22327/statm: 71021 6693 360 364 0 6939 0
[pid=22329] ppid=22327 vsize=13348 CPUtime=2.97 cores=0,2,4,6
/proc/22329/stat : 22329 (lingeling) R 22327 22329 22329 0 -1 4202496 3760 0 0 0 297 0 0 0 25 0 1 0 617084093 13668352 2506 33554432000 4194304 4352236 140733927871600 18446744073709551615 4328390 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/22329/statm: 3337 2506 128 39 0 2417 0
[pid=22330] ppid=22321 vsize=294164 CPUtime=0 cores=0,2,4,6
/proc/22330/stat : 22330 (python) S 22321 22321 21930 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 617084095 301223936 6762 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 9919367299578429700 0 0 17 4 0 0 0
/proc/22330/statm: 73541 6762 349 364 0 9456 0
[pid=22332] ppid=22330 vsize=45000 CPUtime=2.94 cores=0,2,4,6
/proc/22332/stat : 22332 (cryptominisat-2) R 22330 22332 22332 0 -1 4202496 6556 0 0 0 293 1 0 0 25 0 1 0 617084095 46080000 5341 33554432000 4194304 4677096 140736802866160 18446744073709551615 4319802 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22332/statm: 11250 5341 387 118 0 6209 0
[pid=22333] ppid=22321 vsize=304824 CPUtime=0 cores=0,2,4,6
/proc/22333/stat : 22333 (python) S 22321 22321 21930 0 -1 4202560 754 0 0 0 0 0 0 0 18 0 1 0 617084097 312139776 6766 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 4040686819551969540 0 0 17 4 0 0 0
/proc/22333/statm: 76206 6766 349 364 0 12118 0
[pid=22337] ppid=22333 vsize=14116 CPUtime=2.91 cores=0,2,4,6
/proc/22337/stat : 22337 (lingeling) R 22333 22337 22337 0 -1 4202496 3949 0 0 0 291 0 0 0 25 0 1 0 617084100 14454784 2697 33554432000 4194304 4352236 140737253425888 18446744073709551615 4329360 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/22337/statm: 3529 2697 128 39 0 2609 0
[pid=22335] ppid=22321 vsize=315036 CPUtime=0 cores=0,2,4,6
/proc/22335/stat : 22335 (python) S 22321 22321 21930 0 -1 4202560 756 0 0 0 0 0 0 0 18 0 1 0 617084100 322596864 6770 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 4040679122970575106 0 0 17 4 0 0 0
/proc/22335/statm: 78759 6770 349 364 0 14668 0
[pid=22338] ppid=22335 vsize=11296 CPUtime=1.44 cores=0,2,4,6
/proc/22338/stat : 22338 (lingeling) R 22335 22338 22338 0 -1 4202496 3094 0 0 0 143 1 0 0 25 0 1 0 617084100 11567104 1840 33554432000 4194304 4352236 140736323332560 18446744073709551615 4328385 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/22338/statm: 2824 1840 128 39 0 1904 0
[pid=22321/tid=22328] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22328/stat : 22328 (python) S 22319 22321 21930 0 -1 4202560 24 935 0 0 0 0 0 0 25 0 5 0 617084093 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22331] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22331/stat : 22331 (python) S 22319 22321 21930 0 -1 4202560 21 935 0 0 0 0 0 0 25 0 5 0 617084095 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 6 0 0 0
[pid=22321/tid=22334] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22334/stat : 22334 (python) S 22319 22321 21930 0 -1 4202560 39 935 0 0 0 0 0 0 20 0 5 0 617084097 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22336] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22336/stat : 22336 (python) S 22319 22321 21930 0 -1 4202560 23 935 0 0 0 0 0 0 22 0 5 0 617084100 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 13.53
Current children cumulated vsize (KiB) 1606300

[startup+12.7007 s]
/proc/loadavg: 6.53 6.68 5.31 10/206 22338
/proc/meminfo: memFree=26987116/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=324432 CPUtime=3.27 cores=0,2,4,6
/proc/22321/stat : 22321 (python) S 22319 22321 21930 0 -1 4202496 17796 935 1 0 316 11 0 0 21 0 5 0 617083761 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22321/statm: 81108 8305 1881 364 0 17017 0
[pid=22327] ppid=22321 vsize=284084 CPUtime=0 cores=0,2,4,6
/proc/22327/stat : 22327 (python) S 22321 22321 21930 0 -1 4202560 989 0 0 0 0 0 0 0 18 0 1 0 617084092 290902016 6716 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510543 0 0 16781312 514 4229719256645730562 0 0 17 4 0 0 0
/proc/22327/statm: 71021 6716 383 364 0 6939 0
[pid=22329] ppid=22327 vsize=19092 CPUtime=9.33 cores=0,2,4,6
/proc/22329/stat : 22329 (lingeling) R 22327 22329 22329 0 -1 4202496 5196 0 0 0 933 0 0 0 25 0 1 0 617084093 19550208 3942 33554432000 4194304 4352236 140733927871600 18446744073709551615 4328085 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/22329/statm: 4773 3942 128 39 0 3853 0
[pid=22330] ppid=22321 vsize=294164 CPUtime=0 cores=0,2,4,6
/proc/22330/stat : 22330 (python) S 22321 22321 21930 0 -1 4202560 906 0 0 0 0 0 0 0 15 0 1 0 617084095 301223936 6785 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 9919367299578429700 0 0 17 4 0 0 0
/proc/22330/statm: 73541 6785 372 364 0 9456 0
[pid=22332] ppid=22330 vsize=66604 CPUtime=9.29 cores=0,2,4,6
/proc/22332/stat : 22332 (cryptominisat-2) R 22330 22332 22332 0 -1 4202496 14278 0 0 0 927 2 0 0 25 0 1 0 617084095 68202496 9728 33554432000 4194304 4677096 140736802866160 18446744073709551615 4319256 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22332/statm: 16651 9728 391 118 0 11610 0
[pid=22333] ppid=22321 vsize=304824 CPUtime=0 cores=0,2,4,6
/proc/22333/stat : 22333 (python) S 22321 22321 21930 0 -1 4202560 928 0 0 0 0 0 0 0 18 0 1 0 617084097 312139776 6788 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 4040686819551969540 0 0 17 4 0 0 0
/proc/22333/statm: 76206 6788 371 364 0 12118 0
[pid=22337] ppid=22333 vsize=15124 CPUtime=9.31 cores=0,2,4,6
/proc/22337/stat : 22337 (lingeling) R 22333 22337 22337 0 -1 4202496 4201 0 0 0 931 0 0 0 25 0 1 0 617084100 15486976 2949 33554432000 4194304 4352236 140737253425888 18446744073709551615 4328068 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/22337/statm: 3781 2949 128 39 0 2861 0
[pid=22335] ppid=22321 vsize=315036 CPUtime=0 cores=0,2,4,6
/proc/22335/stat : 22335 (python) S 22321 22321 21930 0 -1 4202560 936 0 0 0 0 0 0 0 18 0 1 0 617084100 322596864 6792 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 4040679122970575106 0 0 17 4 0 0 0
/proc/22335/statm: 78759 6792 371 364 0 14668 0
[pid=22338] ppid=22335 vsize=14464 CPUtime=4.64 cores=0,2,4,6
/proc/22338/stat : 22338 (lingeling) R 22335 22338 22338 0 -1 4202496 4036 0 0 0 463 1 0 0 25 0 1 0 617084100 14811136 2782 33554432000 4194304 4352236 140736323332560 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/22338/statm: 3616 2782 128 39 0 2696 0
[pid=22321/tid=22328] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22328/stat : 22328 (python) S 22319 22321 21930 0 -1 4202560 24 935 0 0 0 0 0 0 25 0 5 0 617084093 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22331] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22331/stat : 22331 (python) S 22319 22321 21930 0 -1 4202560 21 935 0 0 0 0 0 0 25 0 5 0 617084095 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 6 0 0 0
[pid=22321/tid=22334] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22334/stat : 22334 (python) S 22319 22321 21930 0 -1 4202560 39 935 0 0 0 0 0 0 20 0 5 0 617084097 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22336] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22336/stat : 22336 (python) S 22319 22321 21930 0 -1 4202560 23 935 0 0 0 0 0 0 22 0 5 0 617084100 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 35.84
Current children cumulated vsize (KiB) 1637824

[startup+25.5013 s]
/proc/loadavg: 7.15 6.81 5.38 10/206 22338
/proc/meminfo: memFree=26907116/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=324432 CPUtime=3.27 cores=0,2,4,6
/proc/22321/stat : 22321 (python) S 22319 22321 21930 0 -1 4202496 17796 935 1 0 316 11 0 0 21 0 5 0 617083761 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22321/statm: 81108 8305 1881 364 0 17017 0
[pid=22327] ppid=22321 vsize=284084 CPUtime=0.02 cores=0,2,4,6
/proc/22327/stat : 22327 (python) S 22321 22321 21930 0 -1 4202560 999 0 0 0 1 1 0 0 18 0 1 0 617084092 290902016 6716 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510543 0 0 16781312 514 9761728114185961730 0 0 17 4 0 0 0
/proc/22327/statm: 71021 6716 383 364 0 6939 0
[pid=22329] ppid=22327 vsize=22412 CPUtime=22.03 cores=0,2,4,6
/proc/22329/stat : 22329 (lingeling) R 22327 22329 22329 0 -1 4202496 6026 0 0 0 2203 0 0 0 25 0 1 0 617084093 22949888 4772 33554432000 4194304 4352236 140733927871600 18446744073709551615 4328114 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/22329/statm: 5603 4772 128 39 0 4683 0
[pid=22330] ppid=22321 vsize=294164 CPUtime=0.03 cores=0,2,4,6
/proc/22330/stat : 22330 (python) S 22321 22321 21930 0 -1 4202560 921 0 0 0 2 1 0 0 15 0 1 0 617084095 301223936 6785 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 9919367299578429700 0 0 17 4 0 0 0
/proc/22330/statm: 73541 6785 372 364 0 9456 0
[pid=22332] ppid=22330 vsize=82640 CPUtime=22.02 cores=0,2,4,6
/proc/22332/stat : 22332 (cryptominisat-2) R 22330 22332 22332 0 -1 4202496 24869 0 0 0 2198 4 0 0 25 0 1 0 617084095 84623360 13270 33554432000 4194304 4677096 140736802866160 18446744073709551615 4320160 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22332/statm: 20660 13270 391 118 0 15619 0
[pid=22333] ppid=22321 vsize=304824 CPUtime=0.02 cores=0,2,4,6
/proc/22333/stat : 22333 (python) S 22321 22321 21930 0 -1 4202560 938 0 0 0 1 1 0 0 18 0 1 0 617084097 312139776 6789 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 9761728114185961732 0 0 17 4 0 0 0
/proc/22333/statm: 76206 6789 372 364 0 12118 0
[pid=22337] ppid=22333 vsize=22292 CPUtime=22.11 cores=0,2,4,6
/proc/22337/stat : 22337 (lingeling) R 22333 22337 22337 0 -1 4202496 5993 0 0 0 2211 0 0 0 25 0 1 0 617084100 22827008 4741 33554432000 4194304 4352236 140737253425888 18446744073709551615 4208047 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/22337/statm: 5573 4741 128 39 0 4653 0
[pid=22335] ppid=22321 vsize=315036 CPUtime=0.02 cores=0,2,4,6
/proc/22335/stat : 22335 (python) S 22321 22321 21930 0 -1 4202560 946 0 0 0 1 1 0 0 18 0 1 0 617084100 322596864 6793 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 9761728114185961730 0 0 17 4 0 0 0
/proc/22335/statm: 78759 6793 372 364 0 14668 0
[pid=22338] ppid=22335 vsize=20096 CPUtime=11.04 cores=0,2,4,6
/proc/22338/stat : 22338 (lingeling) R 22335 22338 22338 0 -1 4202496 5444 0 0 0 1103 1 0 0 25 0 1 0 617084100 20578304 4190 33554432000 4194304 4352236 140736323332560 18446744073709551615 4328100 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/22338/statm: 5024 4190 128 39 0 4104 0
[pid=22321/tid=22328] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22328/stat : 22328 (python) S 22319 22321 21930 0 -1 4202560 24 935 0 0 0 0 0 0 25 0 5 0 617084093 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22331] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22331/stat : 22331 (python) S 22319 22321 21930 0 -1 4202560 21 935 0 0 0 0 0 0 25 0 5 0 617084095 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 6 0 0 0
[pid=22321/tid=22334] ppid=22319 vsize=324432 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22334/stat : 22334 (python) S 22319 22321 21930 0 -1 4202560 39 935 0 0 0 0 0 0 20 0 5 0 617084097 332218368 8305 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0

################
# More data... #
################

/proc/22337/stat : 22337 (lingeling) T 22333 22337 22337 0 -1 4202496 32294 0 0 0 58367 4 0 0 25 0 1 0 617084100 58466304 13442 33554432000 4194304 4352236 140737253425888 18446744073709551615 4328039 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/22337/statm: 14274 13442 128 39 0 13354 0
[pid=22333/tid=22378] ppid=22321 vsize=304824 CPUtime=0 cores=0,2,4,6
/proc/22333/task/22378/stat : 22378 (python) S 22321 22321 21930 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 617142471 312139776 6818 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453853488960 0 0 -1 0 0 0 0
[pid=22335] ppid=22321 vsize=315036 CPUtime=1.66 cores=0,2,4,6
/proc/22335/stat : 22335 (python) S 22321 22321 21930 0 -1 4202560 1011 0 0 0 90 76 0 0 18 0 1 0 617084100 322596864 6793 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 9761728114185961730 0 0 17 0 0 0 0
/proc/22335/statm: 78759 6793 372 364 0 14668 0
[pid=22338] ppid=22335 vsize=64620 CPUtime=931.7 cores=0,2,4,6
/proc/22338/stat : 22338 (lingeling) R 22335 22338 22338 0 -1 4202496 34113 0 0 0 93164 6 0 0 25 0 1 0 617084100 66170880 15323 33554432000 4194304 4352236 140736323332560 18446744073709551615 4328085 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/22338/statm: 16155 15323 128 39 0 15235 0
[pid=22346] ppid=22321 vsize=325028 CPUtime=0.12 cores=0,2,4,6
/proc/22346/stat : 22346 (python) S 22321 22321 21930 0 -1 4202560 1137 0 0 0 7 5 0 0 19 0 2 0 617094107 332828672 6872 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/22346/statm: 81257 6872 400 364 0 17163 0
[pid=22348] ppid=22346 vsize=45376 CPUtime=99.47 cores=0,2,4,6
/proc/22348/stat : 22348 (SApperloT-base) T 22346 22348 22348 0 -1 4202496 10204 0 0 0 9945 2 0 0 25 0 1 0 617094107 46465024 9701 33554432000 134512640 135674940 4290813168 18446744073709551615 134564660 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/22348/statm: 11344 9701 99 284 0 11058 0
[pid=22346/tid=22352] ppid=22321 vsize=325028 CPUtime=0 cores=0,2,4,6
/proc/22346/task/22352/stat : 22352 (python) S 22321 22321 21930 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 617104119 332828672 6872 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453871346688 0 0 -1 6 0 0 0
[pid=22353] ppid=22321 vsize=335404 CPUtime=0.74 cores=0,2,4,6
/proc/22353/stat : 22353 (python) S 22321 22321 21930 0 -1 4202560 1185 0 0 0 38 36 0 0 18 0 2 0 617104122 343453696 6876 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/22353/statm: 83851 6876 400 364 0 19754 0
[pid=22355] ppid=22353 vsize=61160 CPUtime=485.68 cores=0,2,4,6
/proc/22355/stat : 22355 (precosat) T 22353 22355 22355 0 -1 4202496 27020 0 0 0 48562 6 0 0 25 0 1 0 617104122 62627840 15038 33554432000 4194304 4890832 140737370508096 18446744073709551615 4238599 0 0 16781312 17442 18446744071562691360 0 0 17 6 0 0 0
/proc/22355/statm: 15290 15038 86 171 0 15117 0
[pid=22353/tid=22368] ppid=22321 vsize=335404 CPUtime=0 cores=0,2,4,6
/proc/22353/task/22368/stat : 22368 (python) S 22321 22321 21930 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 617135158 343453696 6876 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453906825344 0 0 -1 4 0 0 0
[pid=22369] ppid=22321 vsize=345548 CPUtime=1.08 cores=0,2,4,6
/proc/22369/stat : 22369 (python) S 22321 22321 21930 0 -1 4202560 1219 0 0 0 62 46 0 0 15 0 2 0 617135161 353841152 6881 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/22369/statm: 86387 6881 401 364 0 22287 0
[pid=22371] ppid=22369 vsize=252276 CPUtime=624.2 cores=0,2,4,6
/proc/22371/stat : 22371 (cryptominisat-2) R 22369 22371 22371 0 -1 4202496 263607 0 0 0 62349 71 0 0 25 0 1 0 617135161 258330624 36940 33554432000 4194304 4677096 140733377842064 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/22371/statm: 63069 36940 391 118 0 58028 0
[pid=22369/tid=22438] ppid=22321 vsize=345548 CPUtime=0 cores=0,2,4,6
/proc/22369/task/22438/stat : 22438 (python) S 22321 22321 21930 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 617177581 353841152 6881 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453899489664 0 0 -1 4 0 0 0
[pid=22399] ppid=22321 vsize=356268 CPUtime=0.44 cores=0,2,4,6
/proc/22399/stat : 22399 (python) S 22321 22321 21930 0 -1 4202560 1224 0 0 0 24 20 0 0 18 0 2 0 617165084 364818432 6936 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/22399/statm: 89067 6936 415 364 0 24964 0
[pid=22401] ppid=22399 vsize=30280 CPUtime=184.97 cores=0,2,4,6
/proc/22401/stat : 22401 (lingeling) R 22399 22401 22401 0 -1 4202496 12097 0 0 0 18492 5 0 0 25 0 1 0 617165085 31006720 6739 33554432000 4194304 4352236 140737325343984 18446744073709551615 4328105 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/22401/statm: 7570 6739 128 39 0 6650 0
[pid=22399/tid=22440] ppid=22321 vsize=356268 CPUtime=0 cores=0,2,4,6
/proc/22399/task/22440/stat : 22440 (python) S 22321 22321 21930 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 617181704 364818432 6936 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453914724544 0 0 -1 0 0 0 0
[pid=22321/tid=22328] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22328/stat : 22328 (python) S 22319 22321 21930 0 -1 4202560 29 935 0 0 0 0 0 0 18 0 9 0 617084093 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22331] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22331/stat : 22331 (python) S 22319 22321 21930 0 -1 4202560 21 935 0 0 0 0 0 0 25 0 9 0 617084095 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 6 0 0 0
[pid=22321/tid=22334] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22334/stat : 22334 (python) S 22319 22321 21930 0 -1 4202560 39 935 0 0 0 0 0 0 20 0 9 0 617084097 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22336] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22336/stat : 22336 (python) S 22319 22321 21930 0 -1 4202560 23 935 0 0 0 0 0 0 22 0 9 0 617084100 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22347] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22347/stat : 22347 (python) S 22319 22321 21930 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 9 0 617094107 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22354] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22354/stat : 22354 (python) S 22319 22321 21930 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 9 0 617104122 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22370] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22370/stat : 22370 (python) S 22319 22321 21930 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 9 0 617135161 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22400] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22400/stat : 22400 (python) S 22319 22321 21930 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 9 0 617165085 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3943.83
Current children cumulated vsize (KiB) 3749296



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 8.59 7.99 7.47 10/225 22508
/proc/meminfo: memFree=27238956/32950928 swapFree=67111356/67111528
[pid=22321] ppid=22319 vsize=365788 CPUtime=3.5 cores=0,2,4,6
/proc/22321/stat : 22321 (python) S 22319 22321 21930 0 -1 4202496 21760 935 1 0 338 12 0 0 18 0 9 0 617083761 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22321/statm: 91447 8428 1890 364 0 27344 0
[pid=22327] ppid=22321 vsize=294328 CPUtime=1.08 cores=0,2,4,6
/proc/22327/stat : 22327 (python) S 22321 22321 21930 0 -1 4202560 1217 0 0 0 59 49 0 0 18 0 2 0 617084092 301391872 6754 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/22327/statm: 73582 6754 416 364 0 9500 0
[pid=22329] ppid=22327 vsize=47236 CPUtime=591.35 cores=0,2,4,6
/proc/22329/stat : 22329 (lingeling) R 22327 22329 22329 0 -1 4202496 34056 0 0 0 59128 7 0 0 25 0 1 0 617084093 48369664 10978 33554432000 4194304 4352236 140733927871600 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/22329/statm: 11809 10978 128 39 0 10889 0
[pid=22327/tid=22345] ppid=22321 vsize=294328 CPUtime=0 cores=0,2,4,6
/proc/22327/task/22345/stat : 22345 (python) S 22321 22321 21930 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 617094105 301391872 6754 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453897501504 0 0 -1 4 0 0 0
[pid=22330] ppid=22321 vsize=294164 CPUtime=0.98 cores=0,2,4,6
/proc/22330/stat : 22330 (python) S 22321 22321 21930 0 -1 4202560 1135 0 0 0 57 41 0 0 16 0 2 0 617084095 301223936 6814 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/22330/statm: 73541 6814 400 364 0 9456 0
[pid=22332] ppid=22330 vsize=245904 CPUtime=490 cores=0,2,4,6
/proc/22332/stat : 22332 (cryptominisat-2) T 22330 22332 22332 0 -1 4202496 219058 0 0 0 48945 55 0 0 25 0 1 0 617084095 251805696 36390 33554432000 4194304 4677096 140736802866160 18446744073709551615 4320006 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/22332/statm: 61476 36390 391 118 0 56435 0
[pid=22330/tid=22381] ppid=22321 vsize=294164 CPUtime=0 cores=0,2,4,6
/proc/22330/task/22381/stat : 22381 (python) S 22321 22321 21930 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 617151162 301223936 6814 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453892481088 0 0 -1 2 0 0 0
[pid=22333] ppid=22321 vsize=304824 CPUtime=0.78 cores=0,2,4,6
/proc/22333/stat : 22333 (python) S 22321 22321 21930 0 -1 4202560 1154 0 0 0 44 34 0 0 19 0 2 0 617084097 312139776 6818 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/22333/statm: 76206 6818 400 364 0 12118 0
[pid=22337] ppid=22333 vsize=57096 CPUtime=583.71 cores=0,2,4,6
/proc/22337/stat : 22337 (lingeling) T 22333 22337 22337 0 -1 4202496 32294 0 0 0 58367 4 0 0 25 0 1 0 617084100 58466304 13442 33554432000 4194304 4352236 140737253425888 18446744073709551615 4328039 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/22337/statm: 14274 13442 128 39 0 13354 0
[pid=22333/tid=22378] ppid=22321 vsize=304824 CPUtime=0 cores=0,2,4,6
/proc/22333/task/22378/stat : 22378 (python) S 22321 22321 21930 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 617142471 312139776 6818 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453853488960 0 0 -1 0 0 0 0
[pid=22335] ppid=22321 vsize=315036 CPUtime=1.72 cores=0,2,4,6
/proc/22335/stat : 22335 (python) S 22321 22321 21930 0 -1 4202560 1011 0 0 0 93 79 0 0 18 0 1 0 617084100 322596864 6793 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 9761728114185961730 0 0 17 0 0 0 0
/proc/22335/statm: 78759 6793 372 364 0 14668 0
[pid=22338] ppid=22335 vsize=81004 CPUtime=989.34 cores=0,2,4,6
/proc/22338/stat : 22338 (lingeling) R 22335 22338 22338 0 -1 4202496 38593 0 0 0 98927 7 0 0 25 0 1 0 617084100 82948096 19419 33554432000 4194304 4352236 140736323332560 18446744073709551615 4327859 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/22338/statm: 20251 19419 128 39 0 19331 0
[pid=22346] ppid=22321 vsize=325028 CPUtime=0.12 cores=0,2,4,6
/proc/22346/stat : 22346 (python) S 22321 22321 21930 0 -1 4202560 1137 0 0 0 7 5 0 0 19 0 2 0 617094107 332828672 6872 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/22346/statm: 81257 6872 400 364 0 17163 0
[pid=22348] ppid=22346 vsize=45376 CPUtime=99.47 cores=0,2,4,6
/proc/22348/stat : 22348 (SApperloT-base) T 22346 22348 22348 0 -1 4202496 10204 0 0 0 9945 2 0 0 25 0 1 0 617094107 46465024 9701 33554432000 134512640 135674940 4290813168 18446744073709551615 134564660 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/22348/statm: 11344 9701 99 284 0 11058 0
[pid=22346/tid=22352] ppid=22321 vsize=325028 CPUtime=0 cores=0,2,4,6
/proc/22346/task/22352/stat : 22352 (python) S 22321 22321 21930 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 617104119 332828672 6872 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453871346688 0 0 -1 6 0 0 0
[pid=22353] ppid=22321 vsize=335404 CPUtime=0.74 cores=0,2,4,6
/proc/22353/stat : 22353 (python) S 22321 22321 21930 0 -1 4202560 1185 0 0 0 38 36 0 0 18 0 2 0 617104122 343453696 6876 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/22353/statm: 83851 6876 400 364 0 19754 0
[pid=22355] ppid=22353 vsize=61160 CPUtime=485.68 cores=0,2,4,6
/proc/22355/stat : 22355 (precosat) T 22353 22355 22355 0 -1 4202496 27020 0 0 0 48562 6 0 0 25 0 1 0 617104122 62627840 15038 33554432000 4194304 4890832 140737370508096 18446744073709551615 4238599 0 0 16781312 17442 18446744071562691360 0 0 17 6 0 0 0
/proc/22355/statm: 15290 15038 86 171 0 15117 0
[pid=22353/tid=22368] ppid=22321 vsize=335404 CPUtime=0 cores=0,2,4,6
/proc/22353/task/22368/stat : 22368 (python) S 22321 22321 21930 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 617135158 343453696 6876 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453906825344 0 0 -1 4 0 0 0
[pid=22369] ppid=22321 vsize=345548 CPUtime=1.17 cores=0,2,4,6
/proc/22369/stat : 22369 (python) S 22321 22321 21930 0 -1 4202560 1222 0 0 0 67 50 0 0 15 0 2 0 617135161 353841152 6881 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/22369/statm: 86387 6881 401 364 0 22287 0
[pid=22371] ppid=22369 vsize=210304 CPUtime=681.82 cores=0,2,4,6
/proc/22371/stat : 22371 (cryptominisat-2) R 22369 22371 22371 0 -1 4202496 280786 0 0 0 68106 76 0 0 25 0 1 0 617135161 215351296 45213 33554432000 4194304 4677096 140733377842064 18446744073709551615 4465828 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/22371/statm: 52576 45213 391 118 0 47535 0
[pid=22369/tid=22438] ppid=22321 vsize=345548 CPUtime=0 cores=0,2,4,6
/proc/22369/task/22438/stat : 22438 (python) S 22321 22321 21930 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 617177581 353841152 6881 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453899489664 0 0 -1 4 0 0 0
[pid=22399] ppid=22321 vsize=356268 CPUtime=0.52 cores=0,2,4,6
/proc/22399/stat : 22399 (python) S 22321 22321 21930 0 -1 4202560 1224 0 0 0 28 24 0 0 18 0 2 0 617165084 364818432 6936 33554432000 4194304 5683644 140735354209376 18446744073709551615 231895510598 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/22399/statm: 89067 6936 415 364 0 24964 0
[pid=22401] ppid=22399 vsize=43588 CPUtime=213.37 cores=0,2,4,6
/proc/22401/stat : 22401 (lingeling) R 22399 22401 22401 0 -1 4202496 15424 0 0 0 21332 5 0 0 25 0 1 0 617165085 44634112 10066 33554432000 4194304 4352236 140737325343984 18446744073709551615 4328114 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/22401/statm: 10897 10066 128 39 0 9977 0
[pid=22399/tid=22440] ppid=22321 vsize=356268 CPUtime=0 cores=0,2,4,6
/proc/22399/task/22440/stat : 22440 (python) S 22321 22321 21930 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 617181704 364818432 6936 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 514 18446604453914724544 0 0 -1 0 0 0 0
[pid=22321/tid=22328] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22328/stat : 22328 (python) S 22319 22321 21930 0 -1 4202560 29 935 0 0 0 0 0 0 18 0 9 0 617084093 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22331] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22331/stat : 22331 (python) S 22319 22321 21930 0 -1 4202560 21 935 0 0 0 0 0 0 25 0 9 0 617084095 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 6 0 0 0
[pid=22321/tid=22334] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22334/stat : 22334 (python) S 22319 22321 21930 0 -1 4202560 39 935 0 0 0 0 0 0 20 0 9 0 617084097 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22336] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22336/stat : 22336 (python) S 22319 22321 21930 0 -1 4202560 23 935 0 0 0 0 0 0 22 0 9 0 617084100 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22347] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22347/stat : 22347 (python) S 22319 22321 21930 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 9 0 617094107 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22354] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22354/stat : 22354 (python) S 22319 22321 21930 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 9 0 617104122 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22370] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22370/stat : 22370 (python) S 22319 22321 21930 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 9 0 617135161 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
[pid=22321/tid=22400] ppid=22319 vsize=365788 CPUtime=0 cores=0,2,4,6
/proc/22321/task/22400/stat : 22400 (python) S 22319 22321 21930 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 9 0 617165085 374566912 8428 33554432000 4194304 5683644 140735354209376 18446744073709551615 231907314097 0 0 16781312 2 18446604453885412544 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4145.35
Current children cumulated vsize (KiB) 3728056

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22321 and gives
#  childrusage.ru_utime.tv_sec=3
#  childrusage.ru_utime.tv_usec=392484
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=130980
# CPU time returned by wait4() is 3.52346
# while last known CPU time is 4145.35
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.06
CPU time (s): 4145.35
CPU user time (s): 4140.43
CPU system time (s): 4.92
CPU usage (%): 318.859
Max. virtual memory (cumulated for all children) (KiB): 3812496

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.39248
system time used= 0.13098
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22706
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1042
involuntary context switches= 58

runsolver used 3.89241 second user time and 8.92164 second system time

The end

Launcher Data 

Begin job on node114 at 2011-05-01 18:48:51
IDJOB=3317890
IDBENCH=71098
IDSOLVER=1706
FILE ID=node114/3317890-1304268531
RUNJOBID= node114-1304267292-21949
PBS_JOBID= 13173965
Free space on /tmp= 73412 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_09_UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317890-1304268531/watcher-3317890-1304268531 -o /tmp/evaluation-result-3317890-1304268531/solver-3317890-1304268531 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317890-1304268531.cnf -seed 1172665892 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 18ad1dee1e9d863458e75a20545ae68a
RANDOM SEED=1172665892

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      27185352 kB
Buffers:       1128328 kB
Cached:        2025424 kB
SwapCached:        168 kB
Active:        2423936 kB
Inactive:      2820732 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      27185352 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           39264 kB
Writeback:           0 kB
AnonPages:     2090844 kB
Mapped:          22828 kB
Slab:           447640 kB
PageTables:      14324 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  3837448 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73388 MiB
End job on node114 at 2011-05-01 19:10:33