Trace number 3321723

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrialUNSAT 3528.26 462.441

General information on the benchmark

Nameapplication/manthey/traffic/
traffic_3b_unknown.cnf
MD5SUMb8621ec1841e055a001ab32c33f2b68c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark114.081
Satisfiable
(Un)Satisfiability was proved
Number of variables39151
Number of clauses533919
Sum of the clauses size1968248
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 251568
Number of clauses of size 364292
Number of clauses of size 4418059
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.37/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.37/0.67	c INFO: solving HOME/instance-3321723-1304349266.cnf
0.37/0.67	c INFO: computing task features
2.54/2.83	c INFO: computed variable-clause graph statistics
2.54/2.88	c INFO: computed clause balance statistics
13.24/13.59	c INFO: computed variable balance statistics
20.84/21.19	c INFO: computed small-clause counts
20.94/21.23	c INFO: computed Horn-clause counts
23.04/23.30	c INFO: computed variable graph statistics
23.04/23.30	c INFO: collected features for HOME/instance-3321723-1304349266.cnf in 22.57 s
23.04/23.33	c INFO: running lingeling-276@0 for 97 with 39977 remaining (b = 0.17)
23.04/23.37	c INFO: running cryptominisat-2.9.0@0 for 485 with 39977 remaining (b = 0.17)
23.14/23.40	c INFO: running lingeling-276@0 for 1261 with 39977 remaining (b = 0.34)
23.14/23.43	c INFO: running cryptominisat-2.9.0@0 for 485 with 39977 remaining (b = 0.12)
23.14/23.47	c INFO: running lingeling-276@0 for 1261 with 39977 remaining (b = 0.27)
23.25/23.50	c INFO: running SApperloT@0 for 97 with 39977 remaining (b = 0.02)
23.25/23.54	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39977 remaining (b = 0.37)
23.25/23.57	c INFO: running precosat-570@0 for 291 with 39977 remaining (b = 0.06)
822.75/123.52	c INFO: running lingeling-276@0 for 1164 with 39877 remaining (b = 0.20)
823.53/123.69	c INFO: running lingeling-276@0 for 97 with 39877 remaining (b = 0.06)
1623.56/223.88	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39776 remaining (b = 0.27)
2351.63/315.02	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39685 remaining (b = 0.26)
3527.62/462.38	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321723-1304349266/watcher-3321723-1304349266 -o /tmp/evaluation-result-3321723-1304349266/solver-3321723-1304349266 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321723-1304349266.cnf -seed 1821064645 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.95 5.04 3.28 2/197 31612
/proc/meminfo: memFree=24813152/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=15184 CPUtime=0 cores=0-7
/proc/31612/stat : 31612 (python) S 31610 31612 30702 0 -1 4202496 734 0 0 0 0 0 0 0 20 0 1 0 546527154 15548416 622 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/31612/statm: 3796 622 322 364 0 283 0

[startup+0.100007 s]
/proc/loadavg: 7.95 5.04 3.28 2/197 31612
/proc/meminfo: memFree=24813152/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=87708 CPUtime=0.06 cores=0-7
/proc/31612/stat : 31612 (python) S 31610 31612 30702 0 -1 4202496 2638 0 0 0 4 2 0 0 20 0 1 0 546527154 89812992 2354 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/31612/statm: 21927 2354 717 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87708

[startup+0.200991 s]
/proc/loadavg: 7.95 5.04 3.28 2/197 31612
/proc/meminfo: memFree=24813152/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=124236 CPUtime=0.12 cores=0-7
/proc/31612/stat : 31612 (python) S 31610 31612 30702 0 -1 4202496 4273 0 1 0 8 4 0 0 20 0 1 0 546527154 127217664 3879 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/31612/statm: 31059 3879 996 364 0 2870 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 124236

[startup+0.30103 s]
/proc/loadavg: 7.95 5.04 3.28 2/197 31612
/proc/meminfo: memFree=24813152/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=135752 CPUtime=0.19 cores=0-7
/proc/31612/stat : 31612 (python) S 31610 31612 30702 0 -1 4202496 5965 937 1 0 13 6 0 0 17 0 1 0 546527154 139010048 4150 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809161733 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/31612/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.700929 s]
/proc/loadavg: 7.95 5.04 3.28 2/197 31612
/proc/meminfo: memFree=24813152/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=292780 CPUtime=0.44 cores=0-7
/proc/31612/stat : 31612 (python) R 31610 31612 30702 0 -1 4202496 12832 937 1 0 31 13 0 0 16 0 1 0 546527154 299806720 10510 33554432000 4194304 5683644 140735132767824 18446744073709551615 47118054883825 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/31612/statm: 73195 10510 1761 364 0 9119 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 292780

[startup+1.50079 s]
/proc/loadavg: 7.95 5.04 3.28 2/198 31617
/proc/meminfo: memFree=24751764/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=346324 CPUtime=1.24 cores=0-7
/proc/31612/stat : 31612 (python) R 31610 31612 30702 0 -1 4202496 25697 937 1 0 109 15 0 0 17 0 1 0 546527154 354635776 23375 33554432000 4194304 5683644 140735132767824 18446744073709551615 230808852192 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/31612/statm: 86581 23375 1761 364 0 22505 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 346324

[startup+3.10045 s]
/proc/loadavg: 7.39 4.97 3.27 2/198 31617
/proc/meminfo: memFree=24684400/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=423388 CPUtime=2.84 cores=0-7
/proc/31612/stat : 31612 (python) R 31610 31612 30702 0 -1 4202496 62922 937 1 0 265 19 0 0 19 0 1 0 546527154 433549312 43231 33554432000 4194304 5683644 140735132767824 18446744073709551615 4523408 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/31612/statm: 105847 43231 1826 364 0 41771 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 423388

[startup+6.30087 s]
/proc/loadavg: 7.39 4.97 3.27 2/198 31617
/proc/meminfo: memFree=24646728/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=423388 CPUtime=6.04 cores=0-7
/proc/31612/stat : 31612 (python) R 31610 31612 30702 0 -1 4202496 62922 937 1 0 585 19 0 0 25 0 1 0 546527154 433549312 43231 33554432000 4194304 5683644 140735132767824 18446744073709551615 4324486 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/31612/statm: 105847 43231 1826 364 0 41771 0
Current children cumulated CPU time (s) 6.04
Current children cumulated vsize (KiB) 423388

[startup+12.7007 s]
/proc/loadavg: 6.41 4.84 3.24 2/198 31617
/proc/meminfo: memFree=24648028/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=423388 CPUtime=12.44 cores=0-7
/proc/31612/stat : 31612 (python) R 31610 31612 30702 0 -1 4202496 62922 937 1 0 1225 19 0 0 25 0 1 0 546527154 433549312 43231 33554432000 4194304 5683644 140735132767824 18446744073709551615 4509181 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/31612/statm: 105847 43231 1826 364 0 41771 0
Current children cumulated CPU time (s) 12.44
Current children cumulated vsize (KiB) 423388

[startup+25.5013 s]
/proc/loadavg: 5.58 4.71 3.22 9/222 31641
/proc/meminfo: memFree=23993184/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=559280 CPUtime=23.33 cores=0-7
/proc/31612/stat : 31612 (python) S 31610 31612 30702 0 -1 4202496 68187 937 1 0 2308 25 0 0 21 0 9 0 546527154 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31612/statm: 139820 40576 1889 364 0 75717 0
[pid=31618] ppid=31612 vsize=411708 CPUtime=0 cores=0-7
/proc/31618/stat : 31618 (python) S 31612 31612 30702 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 546529487 421588992 38832 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185807 0 0 16781312 514 17529264021910290689 0 0 17 1 0 0 0
/proc/31618/statm: 102927 38832 353 364 0 38845 0
[pid=31620] ppid=31618 vsize=58620 CPUtime=2.14 cores=0-7
/proc/31620/stat : 31620 (lingeling) R 31618 31620 31620 0 -1 4202496 16150 0 0 0 212 2 0 0 25 0 1 0 546529488 60026880 13696 33554432000 4194304 4352236 140737172327328 18446744073709551615 4207619 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/31620/statm: 14655 13696 127 39 0 13735 0
[pid=31621] ppid=31612 vsize=421964 CPUtime=0 cores=0-7
/proc/31621/stat : 31621 (python) S 31612 31612 30702 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 546529491 432091136 38830 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 4610951548954968324 0 0 17 1 0 0 0
/proc/31621/statm: 105491 38830 347 364 0 41406 0
[pid=31623] ppid=31621 vsize=209656 CPUtime=2.11 cores=0-7
/proc/31623/stat : 31623 (cryptominisat-2) R 31621 31623 31623 0 -1 4202496 38581 0 0 0 205 6 0 0 25 0 1 0 546529491 214687744 37243 33554432000 4194304 4677096 140733449652432 18446744073709551615 4454840 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/31623/statm: 52414 37243 378 118 0 47373 0
[pid=31624] ppid=31612 vsize=497756 CPUtime=0 cores=0-7
/proc/31624/stat : 31624 (python) S 31612 31612 30702 0 -1 4202560 706 0 0 0 0 0 0 0 18 0 1 0 546529494 509702144 38952 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 10388303511266754820 0 0 17 1 0 0 0
/proc/31624/statm: 124439 38952 348 364 0 60351 0
[pid=31626] ppid=31624 vsize=58588 CPUtime=2.07 cores=0-7
/proc/31626/stat : 31626 (lingeling) R 31624 31626 31626 0 -1 4202496 16126 0 0 0 204 3 0 0 25 0 1 0 546529495 59994112 13688 33554432000 4194304 4352236 140734491375440 18446744073709551615 4208528 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/31626/statm: 14647 13688 127 39 0 13727 0
[pid=31627] ppid=31612 vsize=508012 CPUtime=0 cores=0-7
/proc/31627/stat : 31627 (python) S 31612 31612 30702 0 -1 4202560 717 0 0 0 0 0 0 0 15 0 1 0 546529497 520204288 38935 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 5625893140368949508 0 0 17 1 0 0 0
/proc/31627/statm: 127003 38935 348 364 0 62912 0
[pid=31629] ppid=31627 vsize=189796 CPUtime=2.04 cores=0-7
/proc/31629/stat : 31629 (cryptominisat-2) R 31627 31629 31629 0 -1 4202496 35080 0 0 0 198 6 0 0 25 0 1 0 546529498 194351104 33753 33554432000 4194304 4677096 140736978360592 18446744073709551615 4558070 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/31629/statm: 47449 33753 375 118 0 42408 0
[pid=31630] ppid=31612 vsize=518268 CPUtime=0 cores=0-7
/proc/31630/stat : 31630 (python) S 31612 31612 30702 0 -1 4202560 724 0 0 0 0 0 0 0 18 0 1 0 546529501 530706432 39009 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 10388291966394663171 0 0 17 1 0 0 0
/proc/31630/statm: 129567 39009 348 364 0 65473 0
[pid=31632] ppid=31630 vsize=58588 CPUtime=1.99 cores=0-7
/proc/31632/stat : 31632 (lingeling) R 31630 31632 31632 0 -1 4202496 16132 0 0 0 196 3 0 0 25 0 1 0 546529502 59994112 13688 33554432000 4194304 4352236 140737428495584 18446744073709551615 4214833 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/31632/statm: 14647 13688 127 39 0 13727 0
[pid=31633] ppid=31612 vsize=528524 CPUtime=0 cores=0-7
/proc/31633/stat : 31633 (python) S 31612 31612 30702 0 -1 4202560 730 0 0 0 0 0 0 0 18 0 1 0 546529504 541208576 38955 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 4606940255658967039 0 0 17 1 0 0 0
/proc/31633/statm: 132131 38955 348 364 0 68034 0
[pid=31635] ppid=31633 vsize=36092 CPUtime=1.95 cores=0-7
/proc/31635/stat : 31635 (SApperloT-base) R 31633 31635 31635 0 -1 4202496 8942 0 0 0 193 2 0 0 25 0 1 0 546529505 36958208 8681 33554432000 134512640 135674940 4290538496 18446744073709551615 134581549 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31635/statm: 9023 8681 99 284 0 8737 0
[pid=31636] ppid=31612 vsize=538780 CPUtime=0 cores=0-7
/proc/31636/stat : 31636 (python) S 31612 31612 30702 0 -1 4202560 740 0 0 0 0 0 0 0 15 0 1 0 546529508 551710720 38952 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 4605497971281199364 0 0 17 1 0 0 0
/proc/31636/statm: 134695 38952 348 364 0 70595 0
[pid=31638] ppid=31636 vsize=187392 CPUtime=1.93 cores=0-7
/proc/31638/stat : 31638 (cryptominisat-2) R 31636 31638 31638 0 -1 4202496 34489 0 0 0 187 6 0 0 25 0 1 0 546529509 191889408 33158 33554432000 4194304 4677096 140734757835840 18446744073709551615 4462552 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/31638/statm: 46848 33158 372 118 0 41807 0
[pid=31639] ppid=31612 vsize=549036 CPUtime=0 cores=0-7
/proc/31639/stat : 31639 (python) S 31612 31612 30702 0 -1 4202560 775 0 0 0 0 0 0 0 18 0 1 0 546529511 562212864 39037 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 4606944103949664255 0 0 17 4 0 0 0
/proc/31639/statm: 137259 39037 354 364 0 73156 0
[pid=31641] ppid=31639 vsize=111716 CPUtime=1.9 cores=0-7
/proc/31641/stat : 31641 (precosat) R 31639 31641 31641 0 -1 4202496 28187 0 0 0 187 3 0 0 25 0 1 0 546529512 114397184 27310 33554432000 4194304 4890832 140735183641808 18446744073709551615 4238565 0 0 16781312 17442 0 0 0 17 4 0 0 0
/proc/31641/statm: 27929 27310 86 171 0 27756 0
[pid=31612/tid=31619] ppid=31610 vsize=559280 CPUtime=0 cores=0-7
/proc/31612/task/31619/stat : 31619 (python) S 31610 31612 30702 0 -1 4202560 25 937 0 0 0 0 0 0 25 0 9 0 546529488 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 2 0 0 0
[pid=31612/tid=31622] ppid=31610 vsize=559280 CPUtime=0 cores=0-7
/proc/31612/task/31622/stat : 31622 (python) S 31610 31612 30702 0 -1 4202560 26 937 0 0 0 0 0 0 18 0 9 0 546529491 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 3 0 0 0
[pid=31612/tid=31625] ppid=31610 vsize=559280 CPUtime=0 cores=0-7
/proc/31612/task/31625/stat : 31625 (python) S 31610 31612 30702 0 -1 4202560 74 937 0 0 0 0 0 0 25 0 9 0 546529495 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 0 0 0 0
[pid=31612/tid=31628] ppid=31610 vsize=559280 CPUtime=0 cores=0-7
/proc/31612/task/31628/stat : 31628 (python) S 31610 31612 30702 0 -1 4202560 32 937 0 0 0 0 0 0 18 0 9 0 546529498 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 5 0 0 0
[pid=31612/tid=31631] ppid=31610 vsize=559280 CPUtime=0 cores=0-7
/proc/31612/task/31631/stat : 31631 (python) S 31610 31612 30702 0 -1 4202560 32 937 0 0 0 0 0 0 20 0 9 0 546529501 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 0 0 0 0
[pid=31612/tid=31634] ppid=31610 vsize=559280 CPUtime=0 cores=0-7
/proc/31612/task/31634/stat : 31634 (python) S 31610 31612 30702 0 -1 4202560 33 937 0 0 0 0 0 0 21 0 9 0 546529505 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 7 0 0 0
[pid=31612/tid=31637] ppid=31610 vsize=559280 CPUtime=0 cores=0-7
/proc/31612/task/31637/stat : 31637 (python) S 31610 31612 30702 0 -1 4202560 35 937 0 0 0 0 0 0 19 0 9 0 546529508 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 1 0 0 0
[pid=31612/tid=31640] ppid=31610 vsize=559280 CPUtime=0 cores=0-7
/proc/31612/task/31640/stat : 31640 (python) S 31610 31612 30702 0 -1 4202560 36 937 0 0 0 0 0 0 21 0 9 0 546529512 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39.46
Current children cumulated vsize (KiB) 5443776

[startup+51.1016 s]
/proc/loadavg: 6.40 4.97 3.34 9/222 31642
/proc/meminfo: memFree=23716812/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=559280 CPUtime=23.33 cores=0-7
/proc/31612/stat : 31612 (python) S 31610 31612 30702 0 -1 4202496 68187 937 1 0 2308 25 0 0 21 0 9 0 546527154 572702720 40576 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31612/statm: 139820 40576 1889 364 0 75717 0
[pid=31618] ppid=31612 vsize=411708 CPUtime=0.03 cores=0-7
/proc/31618/stat : 31618 (python) S 31612 31612 30702 0 -1 4202560 911 0 0 0 2 1 0 0 18 0 1 0 546529487 421588992 38855 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185807 0 0 16781312 514 8769599190025076993 0 0 17 1 0 0 0
/proc/31618/statm: 102927 38855 376 364 0 38845 0
[pid=31620] ppid=31618 vsize=54984 CPUtime=27.74 cores=0-7
/proc/31620/stat : 31620 (lingeling) R 31618 31620 31620 0 -1 4202496 17556 0 0 0 2771 3 0 0 25 0 1 0 546529488 56303616 12916 33554432000 4194304 4352236 140737172327328 18446744073709551615 4329077 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/31620/statm: 13746 12916 129 39 0 12826 0
[pid=31621] ppid=31612 vsize=421964 CPUtime=0.06 cores=0-7
/proc/31621/stat : 31621 (python) S 31612 31612 30702 0 -1 4202560 949 0 0 0 3 3 0 0 15 0 1 0 546529491 432091136 38853 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 4610951548954968324 0 0 17 1 0 0 0
/proc/31621/statm: 105491 38853 370 364 0 41406 0
[pid=31623] ppid=31621 vsize=271468 CPUtime=27.71 cores=0-7
/proc/31623/stat : 31623 (cryptominisat-2) R 31621 31623 31623 0 -1 4202496 57720 0 0 0 2762 9 0 0 25 0 1 0 546529491 277983232 50580 33554432000 4194304 4677096 140733449652432 18446744073709551615 4337945 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/31623/statm: 67867 50580 390 118 0 62826 0
[pid=31624] ppid=31612 vsize=497756 CPUtime=0.03 cores=0-7
/proc/31624/stat : 31624 (python) S 31612 31612 30702 0 -1 4202560 777 0 0 0 1 2 0 0 18 0 1 0 546529494 509702144 38975 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076996 0 0 17 1 0 0 0
/proc/31624/statm: 124439 38975 371 364 0 60351 0
[pid=31626] ppid=31624 vsize=61116 CPUtime=27.67 cores=0-7
/proc/31626/stat : 31626 (lingeling) R 31624 31626 31626 0 -1 4202496 19082 0 0 0 2764 3 0 0 25 0 1 0 546529495 62582784 14449 33554432000 4194304 4352236 140734491375440 18446744073709551615 4268080 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/31626/statm: 15279 14449 129 39 0 14359 0
[pid=31627] ppid=31612 vsize=508012 CPUtime=0.06 cores=0-7
/proc/31627/stat : 31627 (python) S 31612 31612 30702 0 -1 4202560 816 0 0 0 3 3 0 0 15 0 1 0 546529497 520204288 38958 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 5625893140368949508 0 0 17 5 0 0 0
/proc/31627/statm: 127003 38958 371 364 0 62912 0

################
# More data... #
################

/proc/31630/stat : 31630 (python) S 31612 31612 30702 0 -1 4202560 798 0 0 0 28 28 0 0 18 0 1 0 546529501 530706432 39032 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076995 0 0 17 1 0 0 0
/proc/31630/statm: 129567 39032 371 364 0 65473 0
[pid=31632] ppid=31630 vsize=57220 CPUtime=376.22 cores=0-7
/proc/31632/stat : 31632 (lingeling) R 31630 31632 31632 0 -1 4202496 20066 0 0 0 37619 3 0 0 25 0 1 0 546529502 58593280 13475 33554432000 4194304 4352236 140737428495584 18446744073709551615 4235280 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/31632/statm: 14305 13475 129 39 0 13385 0
[pid=31633] ppid=31612 vsize=528524 CPUtime=0.15 cores=0-7
/proc/31633/stat : 31633 (python) S 31612 31612 30702 0 -1 4202560 988 0 0 0 7 8 0 0 19 0 2 0 546529504 541208576 39007 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/31633/statm: 132131 39007 399 364 0 68034 0
[pid=31635] ppid=31633 vsize=54472 CPUtime=99.42 cores=0-7
/proc/31635/stat : 31635 (SApperloT-base) T 31633 31635 31635 0 -1 4202496 13435 0 0 0 9938 4 0 0 25 0 1 0 546529505 55779328 13076 33554432000 134512640 135674940 4290538496 18446744073709551615 134564660 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/31635/statm: 13618 13076 100 284 0 13332 0
[pid=31633/tid=31646] ppid=31612 vsize=528524 CPUtime=0 cores=0-7
/proc/31633/task/31646/stat : 31646 (python) S 31612 31612 30702 0 -1 4202560 73 0 0 0 0 0 0 0 19 0 2 0 546539520 541208576 39007 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 514 18446604453985330112 0 0 -1 1 0 0 0
[pid=31636] ppid=31612 vsize=538780 CPUtime=0.63 cores=0-7
/proc/31636/stat : 31636 (python) S 31612 31612 30702 0 -1 4202560 838 0 0 0 33 30 0 0 15 0 1 0 546529508 551710720 38975 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 4605497971281199364 0 0 17 1 0 0 0
/proc/31636/statm: 134695 38975 371 364 0 70595 0
[pid=31638] ppid=31636 vsize=271604 CPUtime=378.74 cores=0-7
/proc/31638/stat : 31638 (cryptominisat-2) R 31636 31638 31638 0 -1 4202496 121027 0 0 0 37846 28 0 0 25 0 1 0 546529509 278122496 51546 33554432000 4194304 4677096 140734757835840 18446744073709551615 4320065 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/31638/statm: 67901 51546 390 118 0 62860 0
[pid=31639] ppid=31612 vsize=549036 CPUtime=0.44 cores=0-7
/proc/31639/stat : 31639 (python) S 31612 31612 30702 0 -1 4202560 1047 0 0 0 24 20 0 0 19 0 2 0 546529511 562212864 39089 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31639/statm: 137259 39089 405 364 0 73156 0
[pid=31641] ppid=31639 vsize=115060 CPUtime=291.24 cores=0-7
/proc/31641/stat : 31641 (precosat) T 31639 31641 31641 0 -1 4202496 29024 0 0 0 29120 4 0 0 25 0 1 0 546529512 117821440 28147 33554432000 4194304 4890832 140735183641808 18446744073709551615 4238338 0 0 16781312 17442 18446744071562691360 0 0 17 2 0 0 0
/proc/31641/statm: 28765 28147 86 171 0 28592 0
[pid=31639/tid=31659] ppid=31612 vsize=549036 CPUtime=0 cores=0-7
/proc/31639/task/31659/stat : 31659 (python) S 31612 31612 30702 0 -1 4202560 74 0 0 0 0 0 0 0 19 0 2 0 546558652 562212864 39089 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 514 18446604453985331008 0 0 -1 4 0 0 0
[pid=31647] ppid=31612 vsize=559292 CPUtime=0.15 cores=0-7
/proc/31647/stat : 31647 (python) S 31612 31612 30702 0 -1 4202560 1020 0 0 0 7 8 0 0 19 0 2 0 546539523 572715008 39039 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31647/statm: 139823 39039 399 364 0 75717 0
[pid=31649] ppid=31647 vsize=53684 CPUtime=99.83 cores=0-7
/proc/31649/stat : 31649 (lingeling) T 31647 31649 31649 0 -1 4202496 19141 0 0 0 9979 4 0 0 25 0 1 0 546539524 54972416 12591 33554432000 4194304 4352236 140734168892240 18446744073709551615 4328119 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/31649/statm: 13421 12591 129 39 0 12501 0
[pid=31647/tid=31653] ppid=31612 vsize=559292 CPUtime=0 cores=0-7
/proc/31647/task/31653/stat : 31653 (python) S 31612 31612 30702 0 -1 4202560 78 0 0 0 0 0 0 0 19 0 2 0 546549538 572715008 39039 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 514 18446604453892424128 0 0 -1 1 0 0 0
[pid=31654] ppid=31612 vsize=569548 CPUtime=0.32 cores=0-7
/proc/31654/stat : 31654 (python) S 31612 31612 30702 0 -1 4202560 879 0 0 0 17 15 0 0 15 0 1 0 546549542 583217152 39043 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076999 0 0 17 4 0 0 0
/proc/31654/statm: 142387 39043 372 364 0 78278 0
[pid=31656] ppid=31654 vsize=284664 CPUtime=178.07 cores=0-7
/proc/31656/stat : 31656 (cryptominisat-2) R 31654 31656 31656 0 -1 4202496 70608 0 0 0 17792 15 0 0 25 0 1 0 546549543 291495936 52671 33554432000 4194304 4677096 140736202568544 18446744073709551615 4317711 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31656/statm: 71166 52671 390 118 0 66125 0
[pid=31660] ppid=31612 vsize=579804 CPUtime=0.16 cores=0-7
/proc/31660/stat : 31660 (python) S 31612 31612 30702 0 -1 4202560 875 0 0 0 7 9 0 0 15 0 1 0 546558656 593719296 39030 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076992 0 0 17 1 0 0 0
/proc/31660/statm: 144951 39030 371 364 0 80839 0
[pid=31662] ppid=31660 vsize=284480 CPUtime=86.56 cores=0-7
/proc/31662/stat : 31662 (cryptominisat-2) R 31660 31662 31662 0 -1 4202496 64616 0 0 0 8644 12 0 0 25 0 1 0 546558657 291307520 53391 33554432000 4194304 4677096 140737091091088 18446744073709551615 4319754 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/31662/statm: 71120 53391 390 118 0 66079 0
[pid=31612/tid=31619] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31619/stat : 31619 (python) S 31610 31612 30702 0 -1 4202560 30 937 0 0 0 0 0 0 18 0 12 0 546529488 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 2 0 0 0
[pid=31612/tid=31622] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31622/stat : 31622 (python) S 31610 31612 30702 0 -1 4202560 26 937 0 0 0 0 0 0 18 0 12 0 546529491 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 3 0 0 0
[pid=31612/tid=31625] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31625/stat : 31625 (python) S 31610 31612 30702 0 -1 4202560 74 937 0 0 0 0 0 0 25 0 12 0 546529495 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 0 0 0 0
[pid=31612/tid=31628] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31628/stat : 31628 (python) S 31610 31612 30702 0 -1 4202560 32 937 0 0 0 0 0 0 18 0 12 0 546529498 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 5 0 0 0
[pid=31612/tid=31631] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31631/stat : 31631 (python) S 31610 31612 30702 0 -1 4202560 32 937 0 0 0 0 0 0 20 0 12 0 546529501 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 0 0 0 0
[pid=31612/tid=31634] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31634/stat : 31634 (python) S 31610 31612 30702 0 -1 4202560 33 937 0 0 0 0 0 0 21 0 12 0 546529505 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 7 0 0 0
[pid=31612/tid=31637] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31637/stat : 31637 (python) S 31610 31612 30702 0 -1 4202560 35 937 0 0 0 0 0 0 19 0 12 0 546529508 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 1 0 0 0
[pid=31612/tid=31640] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31640/stat : 31640 (python) S 31610 31612 30702 0 -1 4202560 36 937 0 0 0 0 0 0 21 0 12 0 546529512 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 4 0 0 0
[pid=31612/tid=31648] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31648/stat : 31648 (python) S 31610 31612 30702 0 -1 4202560 43 937 0 0 0 0 0 0 20 0 12 0 546539524 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 3 0 0 0
[pid=31612/tid=31655] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31655/stat : 31655 (python) S 31610 31612 30702 0 -1 4202560 33 937 0 0 0 0 0 0 20 0 12 0 546549543 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 1 0 0 0
[pid=31612/tid=31661] ppid=31610 vsize=590048 CPUtime=0 cores=0-7
/proc/31612/task/31661/stat : 31661 (python) S 31610 31612 30702 0 -1 4202560 34 937 0 0 0 0 0 0 19 0 12 0 546558657 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3048.57
Current children cumulated vsize (KiB) 8068140

[startup+462.301 s]
/proc/loadavg: 8.18 7.33 5.05 10/235 31666
/proc/meminfo: memFree=23411752/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=590048 CPUtime=223.08 cores=0-7
/proc/31612/stat : 31612 (python) S 31610 31612 30702 0 -1 4202496 70504 35575 1 0 2321 27 19933 27 17 0 12 0 546527154 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820995903 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31612/statm: 147512 40550 1896 364 0 83400 0
[pid=31618] ppid=31612 vsize=421952 CPUtime=0.65 cores=0-7
/proc/31618/stat : 31618 (python) S 31612 31612 30702 0 -1 4202560 1132 0 0 0 32 33 0 0 18 0 2 0 546529487 432078848 38894 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/31618/statm: 105488 38894 410 364 0 41406 0
[pid=31620] ppid=31618 vsize=60148 CPUtime=433.43 cores=0-7
/proc/31620/stat : 31620 (lingeling) R 31618 31620 31620 0 -1 4202496 22303 0 0 0 43339 4 0 0 25 0 1 0 546529488 61591552 14207 33554432000 4194304 4352236 140737172327328 18446744073709551615 4328191 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/31620/statm: 15037 14207 129 39 0 14117 0
[pid=31618/tid=31645] ppid=31612 vsize=421952 CPUtime=0 cores=0-7
/proc/31618/task/31645/stat : 31645 (python) S 31612 31612 30702 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 546539503 432078848 38894 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 514 18446604448404108480 0 0 -1 2 0 0 0
[pid=31621] ppid=31612 vsize=0 CPUtime=439.35 cores=0-7
/proc/31621/stat : 31621 (python) Z 31612 31612 30702 0 -1 4202588 1225 112024 0 0 215 77 43613 30 19 0 1 0 546529491 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31621/statm: 0 0 0 0 0 0 0
[pid=31624] ppid=31612 vsize=497756 CPUtime=0.65 cores=0-7
/proc/31624/stat : 31624 (python) S 31612 31612 30702 0 -1 4202560 777 0 0 0 32 33 0 0 18 0 1 0 546529494 509702144 38975 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076996 0 0 17 1 0 0 0
/proc/31624/statm: 124439 38975 371 364 0 60351 0
[pid=31626] ppid=31624 vsize=59364 CPUtime=438.88 cores=0-7
/proc/31626/stat : 31626 (lingeling) R 31624 31626 31626 0 -1 4202496 22505 0 0 0 43884 4 0 0 25 0 1 0 546529495 60788736 14011 33554432000 4194304 4352236 140734491375440 18446744073709551615 4294498 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/31626/statm: 14841 14011 129 39 0 13921 0
[pid=31627] ppid=31612 vsize=508012 CPUtime=0.73 cores=0-7
/proc/31627/stat : 31627 (python) S 31612 31612 30702 0 -1 4202560 829 0 0 0 37 36 0 0 15 0 1 0 546529497 520204288 38960 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076996 0 0 17 5 0 0 0
/proc/31627/statm: 127003 38960 372 364 0 62912 0
[pid=31629] ppid=31627 vsize=272060 CPUtime=438.09 cores=0-7
/proc/31629/stat : 31629 (cryptominisat-2) R 31627 31629 31629 0 -1 4202496 138127 0 0 0 43775 34 0 0 25 0 1 0 546529498 278589440 51404 33554432000 4194304 4677096 140736978360592 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/31629/statm: 68015 51404 390 118 0 62974 0
[pid=31630] ppid=31612 vsize=518268 CPUtime=0.66 cores=0-7
/proc/31630/stat : 31630 (python) S 31612 31612 30702 0 -1 4202560 798 0 0 0 33 33 0 0 18 0 1 0 546529501 530706432 39032 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076995 0 0 17 1 0 0 0
/proc/31630/statm: 129567 39032 371 364 0 65473 0
[pid=31632] ppid=31630 vsize=58976 CPUtime=436.11 cores=0-7
/proc/31632/stat : 31632 (lingeling) R 31630 31632 31632 0 -1 4202496 20513 0 0 0 43608 3 0 0 25 0 1 0 546529502 60391424 13914 33554432000 4194304 4352236 140737428495584 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/31632/statm: 14744 13914 129 39 0 13824 0
[pid=31636] ppid=31612 vsize=538780 CPUtime=0.72 cores=0-7
/proc/31636/stat : 31636 (python) S 31612 31612 30702 0 -1 4202560 838 0 0 0 37 35 0 0 15 0 1 0 546529508 551710720 38975 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076996 0 0 17 1 0 0 0
/proc/31636/statm: 134695 38975 371 364 0 70595 0
[pid=31638] ppid=31636 vsize=273036 CPUtime=438.74 cores=0-7
/proc/31638/stat : 31638 (cryptominisat-2) R 31636 31638 31638 0 -1 4202496 128525 0 0 0 43843 31 0 0 25 0 1 0 546529509 279588864 51797 33554432000 4194304 4677096 140734757835840 18446744073709551615 4226888 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/31638/statm: 68259 51797 390 118 0 63218 0
[pid=31639] ppid=31612 vsize=549036 CPUtime=0.44 cores=0-7
/proc/31639/stat : 31639 (python) S 31612 31612 30702 0 -1 4202560 1050 0 0 0 24 20 0 0 18 0 2 0 546529511 562212864 39089 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820995903 0 0 16781824 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31639/statm: 137259 39089 405 364 0 73156 0
[pid=31641] ppid=31639 vsize=0 CPUtime=291.24 cores=0-7
/proc/31641/stat : 31641 (precosat) R 31639 31641 31641 0 -1 4203524 29024 0 0 0 29120 4 0 0 18 0 1 0 546529512 0 0 33554432000 0 0 0 0 0 0 0 16781312 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31641/statm: 0 0 0 0 0 0 0
[pid=31639/tid=31659] ppid=31612 vsize=549036 CPUtime=0 cores=0-7
/proc/31639/task/31659/stat : 31659 (python) S 31612 31612 30702 0 -1 4202560 74 0 0 0 0 0 0 0 19 0 2 0 546558652 562212864 39089 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781824 2 18446604453985331008 0 0 -1 4 0 0 0
[pid=31654] ppid=31612 vsize=569548 CPUtime=0.41 cores=0-7
/proc/31654/stat : 31654 (python) S 31612 31612 30702 0 -1 4202560 879 0 0 0 22 19 0 0 16 0 1 0 546549542 583217152 39043 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076999 0 0 17 4 0 0 0
/proc/31654/statm: 142387 39043 372 364 0 78278 0
[pid=31656] ppid=31654 vsize=284840 CPUtime=238.07 cores=0-7
/proc/31656/stat : 31656 (cryptominisat-2) R 31654 31656 31656 0 -1 4202496 75059 0 0 0 23791 16 0 0 25 0 1 0 546549543 291676160 53003 33554432000 4194304 4677096 140736202568544 18446744073709551615 4319571 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31656/statm: 71210 53003 390 118 0 66169 0
[pid=31660] ppid=31612 vsize=579804 CPUtime=0.27 cores=0-7
/proc/31660/stat : 31660 (python) S 31612 31612 30702 0 -1 4202560 875 0 0 0 13 14 0 0 16 0 1 0 546558656 593719296 39030 33554432000 4194304 5683644 140735132767824 18446744073709551615 230809185862 0 0 16781312 514 8769599190025076992 0 0 17 1 0 0 0
/proc/31660/statm: 144951 39030 371 364 0 80839 0
[pid=31662] ppid=31660 vsize=269924 CPUtime=146.1 cores=0-7
/proc/31662/stat : 31662 (cryptominisat-2) R 31660 31662 31662 0 -1 4202496 68426 0 0 0 14596 14 0 0 25 0 1 0 546558657 276402176 50409 33554432000 4194304 4677096 140737091091088 18446744073709551615 4320076 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/31662/statm: 67481 50409 390 118 0 62440 0
[pid=31612/tid=31619] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31619/stat : 31619 (python) S 31610 31612 30702 0 -1 4202560 30 35575 0 0 0 0 19933 27 18 0 12 0 546529488 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 2 0 0 0
[pid=31612/tid=31622] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31622/stat : 31622 (python) S 31610 31612 30702 0 -1 4202560 26 35575 0 0 0 0 19933 27 18 0 12 0 546529491 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 3 0 0 0
[pid=31612/tid=31625] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31625/stat : 31625 (python) S 31610 31612 30702 0 -1 4202560 74 35575 0 0 0 0 19933 27 25 0 12 0 546529495 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 0 0 0 0
[pid=31612/tid=31628] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31628/stat : 31628 (python) S 31610 31612 30702 0 -1 4202560 32 35575 0 0 0 0 19933 27 18 0 12 0 546529498 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 5 0 0 0
[pid=31612/tid=31631] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31631/stat : 31631 (python) S 31610 31612 30702 0 -1 4202560 32 35575 0 0 0 0 19933 27 20 0 12 0 546529501 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 0 0 0 0
[pid=31612/tid=31634] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31634/stat : 31634 (python) S 31610 31612 30702 0 -1 4202560 33 35575 0 0 0 0 19933 27 21 0 12 0 546529505 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 7 0 0 0
[pid=31612/tid=31637] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31637/stat : 31637 (python) S 31610 31612 30702 0 -1 4202560 35 35575 0 0 0 0 19933 27 19 0 12 0 546529508 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 1 0 0 0
[pid=31612/tid=31640] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31640/stat : 31640 (python) S 31610 31612 30702 0 -1 4202560 36 35575 0 0 0 0 19933 27 21 0 12 0 546529512 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 4 0 0 0
[pid=31612/tid=31648] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31648/stat : 31648 (python) S 31610 31612 30702 0 -1 4202560 43 35575 0 0 0 0 19933 27 20 0 12 0 546539524 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 3 0 0 0
[pid=31612/tid=31655] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31655/stat : 31655 (python) S 31610 31612 30702 0 -1 4202560 33 35575 0 0 0 0 19933 27 20 0 12 0 546549543 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 1 0 0 0
[pid=31612/tid=31661] ppid=31610 vsize=590048 CPUtime=199.6 cores=0-7
/proc/31612/task/31661/stat : 31661 (python) S 31610 31612 30702 0 -1 4202560 34 35575 0 0 0 0 19933 27 19 0 12 0 546558657 604209152 40550 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 2 18446604449843626944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3527.62
Current children cumulated vsize (KiB) 6051552

Solver just ended. Dumping a history of the last processes samples

[startup+462.401 s]
/proc/loadavg: 8.18 7.33 5.05 10/235 31666
/proc/meminfo: memFree=23411752/32951124 swapFree=59765832/67111528
[pid=31612] ppid=31610 vsize=518200 CPUtime=3528.19 cores=0-7
/proc/31612/stat : 31612 (python) R 31610 31612 30702 0 -1 4202496 75555 660812 1 0 2322 27 349985 485 17 0 2 0 546527154 530636800 40483 33554432000 4194304 5683644 140735132767824 18446744073709551615 230808821175 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/31612/statm: 129550 40483 1874 364 0 65473 0
[pid=31612/tid=31622] ppid=31610 vsize=518200 CPUtime=3504.7 cores=0-7
/proc/31612/task/31622/stat : 31622 (python) S 31610 31612 30702 0 -1 4202560 27 660812 0 0 0 0 349985 485 18 0 2 0 546529491 530636800 40483 33554432000 4194304 5683644 140735132767824 18446744073709551615 230820989361 0 0 16781312 0 18446604449843626944 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3528.19
Current children cumulated vsize (KiB) 518200

Child status: 0
Real time (s): 462.441
CPU time (s): 3528.26
CPU user time (s): 3523.1
CPU system time (s): 5.16221
CPU usage (%): 762.964
Max. virtual memory (cumulated for all children) (KiB): 8083692

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3523.1
system time used= 5.16221
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 750685
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8468
involuntary context switches= 20904

runsolver used 1.62475 second user time and 4.71028 second system time

The end

Launcher Data 

Begin job on node104 at 2011-05-02 17:14:27
IDJOB=3321723
IDBENCH=82502
IDSOLVER=1710
FILE ID=node104/3321723-1304349266
RUNJOBID= node104-1304342614-30716
PBS_JOBID= 13178062
Free space on /tmp= 73420 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/manthey/traffic/traffic_3b_unknown.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321723-1304349266/watcher-3321723-1304349266 -o /tmp/evaluation-result-3321723-1304349266/solver-3321723-1304349266 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321723-1304349266.cnf -seed 1821064645 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b8621ec1841e055a001ab32c33f2b68c
RANDOM SEED=1821064645

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24813308 kB
Buffers:          6636 kB
Cached:         260860 kB
SwapCached:      43460 kB
Active:         327432 kB
Inactive:      7648164 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24813308 kB
SwapTotal:    67111528 kB
SwapFree:     59765832 kB
Dirty:           44800 kB
Writeback:           0 kB
AnonPages:     7675688 kB
Mapped:          12176 kB
Slab:            60952 kB
PageTables:      36816 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 16624128 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73388 MiB
End job on node104 at 2011-05-02 17:22:10