Trace number 3385543

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (exit code) 187.734 47.1916

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v450-c1917-S2065964480-034.SATISFIABLE.cnf
MD5SUM06d324a3bc5f99e4e9d2e5560e56ab8e
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.007998
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses1917
Sum of the clauses size5751
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31917
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.32/0.45	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.45	c INFO: solving HOME/instance-3385543-1305567875.cnf
0.32/0.45	c INFO: computing task features
0.32/0.45	c INFO: computed variable-clause graph statistics
0.32/0.45	c INFO: computed clause balance statistics
0.32/0.49	c INFO: computed variable balance statistics
0.41/0.51	c INFO: computed small-clause counts
0.41/0.51	c INFO: computed Horn-clause counts
0.41/0.52	c INFO: computed variable graph statistics
0.41/0.52	c INFO: collected features for HOME/instance-3385543-1305567875.cnf in 0.07 s
0.41/0.54	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.57)
0.41/0.57	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.37)
0.51/0.61	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.33)
0.51/0.64	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.33)
0.51/0.67	c INFO: running march_hi@0 for 97 with 4999 remaining (b = 0.09)
0.60/0.70	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.08)
0.60/0.74	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.24)
0.60/0.77	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.21)
0.60/0.77	Traceback (most recent call last):
0.60/0.77	  File "HOME/solve", line 33, in <module>
0.60/0.77	    plac.call(main)
0.60/0.77	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
0.60/0.79	    cmd, result = parser_from(obj).consume(arglist)
0.60/0.79	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
0.87/0.89	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
0.87/0.89	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
0.87/0.89	    (_, answer, _) = solver(input_path, budget / cores, cores)
0.87/0.89	  File "HOME/borg/build/lib/borg/bilevel.py", line 226, in __call__
0.87/0.89	    process.die()
0.87/0.89	  File "HOME/borg/build/lib/borg/solvers.py", line 185, in die
0.87/0.89	    os.kill(self._process.pid, signal.SIGUSR1)
0.87/0.89	OSError: [Errno 3] No such process

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385543-1305567875/watcher-3385543-1305567875 -o /tmp/evaluation-result-3385543-1305567875/solver-3385543-1305567875 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385543-1305567875.cnf -seed 936910992 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.82 9.39 8.86 5/501 24502
/proc/meminfo: memFree=24066996/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=16248 CPUtime=0.01 cores=0-7
/proc/24502/stat : 24502 (python) R 24500 24502 23657 0 -1 4202496 1063 0 0 0 1 0 0 0 25 0 1 0 668390176 16637952 935 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634515200 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/24502/statm: 4062 935 381 364 0 549 0

[startup+0.026166 s]
/proc/loadavg: 8.82 9.39 8.86 5/501 24502
/proc/meminfo: memFree=24066996/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=16816 CPUtime=0.01 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 1229 0 0 0 1 0 0 0 25 0 1 0 668390176 17219584 1087 33554432000 4194304 5683644 140736265177504 18446744073709551615 216629591687 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/24502/statm: 4722 1087 418 364 0 691 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16816

[startup+0.10015 s]
/proc/loadavg: 8.82 9.39 8.86 5/501 24502
/proc/meminfo: memFree=24066996/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=104616 CPUtime=0.06 cores=0-7
/proc/24502/stat : 24502 (python) R 24500 24502 23657 0 -1 4202496 3143 0 0 0 5 1 0 0 25 0 1 0 668390176 107126784 2821 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634513408 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/24502/statm: 26154 2821 847 364 0 1902 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104616

[startup+0.300116 s]
/proc/loadavg: 8.82 9.39 8.86 5/501 24502
/proc/meminfo: memFree=24066996/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=198920 CPUtime=0.23 cores=0-7
/proc/24502/stat : 24502 (python) R 24500 24502 23657 0 -1 4202496 7020 934 1 0 18 5 0 0 17 0 1 0 668390176 203694080 5053 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634176017 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/24502/statm: 49730 5053 1466 364 0 3757 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 198920

[startup+0.701013 s]
/proc/loadavg: 8.82 9.39 8.86 5/501 24502
/proc/meminfo: memFree=24066996/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=330484 CPUtime=0.6 cores=0-7
/proc/24502/stat : 24502 (python) R 24500 24502 23657 0 -1 4202496 13605 934 1 0 52 8 0 0 21 0 6 0 668390176 338415616 7258 33554432000 4194304 5683644 140736265177504 18446744073709551615 216637953860 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24502/statm: 82621 7258 1882 364 0 18527 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 330484

[startup+1.50087 s]
/proc/loadavg: 8.82 9.39 8.86 10/514 24533
/proc/meminfo: memFree=24015928/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=310032 CPUtime=0.87 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 15990 3966 1 0 59 9 19 0 24 0 1 0 668390176 317472768 7276 33554432000 4194304 5683644 140736265177504 18446744073709551615 216646345535 0 0 16781312 2 18446744071562232103 0 0 17 6 0 0 2
/proc/24502/statm: 77508 7276 1891 364 0 13405 0
[pid=24511] ppid=24502 vsize=289340 CPUtime=0 cores=0-7
/proc/24511/stat : 24511 (python) S 24502 24502 23657 0 -1 4202560 746 0 0 0 0 0 0 0 15 0 1 0 668390234 296284160 5692 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 11501049960506294531 0 0 17 4 0 0 0
/proc/24511/statm: 72335 5692 348 364 0 8250 0
[pid=24513] ppid=24511 vsize=2132 CPUtime=0.91 cores=0-7
/proc/24513/stat : 24513 (march_hi) R 24511 24513 24513 0 -1 4202496 597 0 0 0 91 0 0 0 23 0 1 0 668390234 2183168 333 33554432000 4194304 4955518 140735260463616 18446744073709551615 4311767 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24513/statm: 533 333 104 186 0 346 0
[pid=24514] ppid=24502 vsize=299124 CPUtime=0 cores=0-7
/proc/24514/stat : 24514 (python) S 24502 24502 23657 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 668390237 306302976 5593 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 1334578421996421377 0 0 17 4 0 0 0
/proc/24514/statm: 74781 5593 348 364 0 10693 0
[pid=24516] ppid=24514 vsize=2132 CPUtime=0.88 cores=0-7
/proc/24516/stat : 24516 (march_hi) R 24514 24516 24516 0 -1 4202496 597 0 0 0 88 0 0 0 23 0 1 0 668390237 2183168 334 33554432000 4194304 4955518 140737022899968 18446744073709551615 4224648 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24516/statm: 533 334 104 186 0 346 0
[pid=24517] ppid=24502 vsize=309984 CPUtime=0 cores=0-7
/proc/24517/stat : 24517 (python) S 24502 24502 23657 0 -1 4202560 768 0 0 0 0 0 0 0 15 0 1 0 668390240 317423616 5716 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 6171747887001600256 0 0 17 5 0 0 0
/proc/24517/statm: 77496 5716 348 364 0 13405 0
[pid=24519] ppid=24517 vsize=2132 CPUtime=0.83 cores=0-7
/proc/24519/stat : 24519 (march_hi) R 24517 24519 24519 0 -1 4202496 598 0 0 0 83 0 0 0 23 0 1 0 668390241 2183168 333 33554432000 4194304 4955518 140736853704640 18446744073709551615 4224532 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/24519/statm: 533 333 104 186 0 346 0
[pid=24520] ppid=24502 vsize=320240 CPUtime=0 cores=0-7
/proc/24520/stat : 24520 (python) S 24502 24502 23657 0 -1 4202560 767 0 0 0 0 0 0 0 15 0 1 0 668390243 327925760 5720 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 9140244564043333891 0 0 17 6 0 0 0
/proc/24520/statm: 80060 5720 348 364 0 15966 0
[pid=24522] ppid=24520 vsize=2132 CPUtime=0.78 cores=0-7
/proc/24522/stat : 24522 (march_hi) R 24520 24522 24522 0 -1 4202496 597 0 0 0 78 0 0 0 25 0 1 0 668390246 2183168 332 33554432000 4194304 4955518 140734901130016 18446744073709551615 4209699 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24522/statm: 533 332 104 186 0 346 0
[pid=24527] ppid=24502 vsize=340752 CPUtime=0 cores=0-7
/proc/24527/stat : 24527 (python) S 24502 24502 23657 0 -1 4202560 777 0 0 0 0 0 0 0 19 0 1 0 668390250 348930048 5745 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 14375124977001136385 0 0 17 1 0 0 0
/proc/24527/statm: 85188 5745 348 364 0 21088 0
[pid=24530] ppid=24527 vsize=2132 CPUtime=0.72 cores=0-7
/proc/24530/stat : 24530 (march_hi) R 24527 24530 24530 0 -1 4202496 598 0 0 0 72 0 0 0 25 0 1 0 668390252 2183168 331 33554432000 4194304 4955518 140734541496960 18446744073709551615 4209701 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/24530/statm: 533 331 104 186 0 346 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 806 0 0 0 0 0 0 0 19 0 1 0 668390253 359432192 5755 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5755 354 364 0 23649 0
[pid=24533] ppid=24531 vsize=2000 CPUtime=0.3 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 594 0 0 0 30 0 0 0 25 0 1 0 668390259 2048000 324 33554432000 4194304 4955518 140735345891536 18446744073709551615 4209643 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 500 324 104 186 0 313 0
Current children cumulated CPU time (s) 5.29
Current children cumulated vsize (KiB) 2233140

[startup+3.10059 s]
/proc/loadavg: 8.82 9.39 8.86 10/514 24533
/proc/meminfo: memFree=24014688/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=310032 CPUtime=0.87 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 15990 3966 1 0 59 9 19 0 24 0 1 0 668390176 317472768 7276 33554432000 4194304 5683644 140736265177504 18446744073709551615 216646345535 0 0 16781312 2 18446744071562232103 0 0 17 6 0 0 2
/proc/24502/statm: 77508 7276 1891 364 0 13405 0
[pid=24511] ppid=24502 vsize=289340 CPUtime=0 cores=0-7
/proc/24511/stat : 24511 (python) S 24502 24502 23657 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 668390234 296284160 5692 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 14924901956487971075 0 0 17 4 0 0 0
/proc/24511/statm: 72335 5692 348 364 0 8250 0
[pid=24513] ppid=24511 vsize=2132 CPUtime=2.51 cores=0-7
/proc/24513/stat : 24513 (march_hi) R 24511 24513 24513 0 -1 4202496 615 0 0 0 251 0 0 0 25 0 1 0 668390234 2183168 351 33554432000 4194304 4955518 140735260463616 18446744073709551615 4295590 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24513/statm: 533 351 104 186 0 346 0
[pid=24514] ppid=24502 vsize=299124 CPUtime=0 cores=0-7
/proc/24514/stat : 24514 (python) S 24502 24502 23657 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 668390237 306302976 5593 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 1334578421996421377 0 0 17 4 0 0 0
/proc/24514/statm: 74781 5593 348 364 0 10693 0
[pid=24516] ppid=24514 vsize=2132 CPUtime=2.48 cores=0-7
/proc/24516/stat : 24516 (march_hi) R 24514 24516 24516 0 -1 4202496 615 0 0 0 248 0 0 0 25 0 1 0 668390237 2183168 352 33554432000 4194304 4955518 140737022899968 18446744073709551615 4209727 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24516/statm: 533 352 104 186 0 346 0
[pid=24517] ppid=24502 vsize=309984 CPUtime=0 cores=0-7
/proc/24517/stat : 24517 (python) S 24502 24502 23657 0 -1 4202560 768 0 0 0 0 0 0 0 15 0 1 0 668390240 317423616 5716 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 6171747887001600256 0 0 17 5 0 0 0
/proc/24517/statm: 77496 5716 348 364 0 13405 0
[pid=24519] ppid=24517 vsize=2132 CPUtime=2.43 cores=0-7
/proc/24519/stat : 24519 (march_hi) R 24517 24519 24519 0 -1 4202496 617 0 0 0 243 0 0 0 25 0 1 0 668390241 2183168 352 33554432000 4194304 4955518 140736853704640 18446744073709551615 4209776 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/24519/statm: 533 352 104 186 0 346 0
[pid=24520] ppid=24502 vsize=320240 CPUtime=0 cores=0-7
/proc/24520/stat : 24520 (python) S 24502 24502 23657 0 -1 4202560 775 0 0 0 0 0 0 0 15 0 1 0 668390243 327925760 5720 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 9140244564043333891 0 0 17 6 0 0 0
/proc/24520/statm: 80060 5720 348 364 0 15966 0
[pid=24522] ppid=24520 vsize=2132 CPUtime=2.36 cores=0-7
/proc/24522/stat : 24522 (march_hi) R 24520 24522 24522 0 -1 4202496 614 0 0 0 236 0 0 0 25 0 1 0 668390246 2183168 349 33554432000 4194304 4955518 140734901130016 18446744073709551615 4261539 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24522/statm: 533 349 104 186 0 346 0
[pid=24527] ppid=24502 vsize=340752 CPUtime=0 cores=0-7
/proc/24527/stat : 24527 (python) S 24502 24502 23657 0 -1 4202560 784 0 0 0 0 0 0 0 15 0 1 0 668390250 348930048 5745 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 14375124977001136385 0 0 17 1 0 0 0
/proc/24527/statm: 85188 5745 348 364 0 21088 0
[pid=24530] ppid=24527 vsize=2132 CPUtime=2.32 cores=0-7
/proc/24530/stat : 24530 (march_hi) R 24527 24530 24530 0 -1 4202496 615 0 0 0 232 0 0 0 25 0 1 0 668390252 2183168 348 33554432000 4194304 4955518 140734541496960 18446744073709551615 4235379 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/24530/statm: 533 348 104 186 0 346 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 807 0 0 0 0 0 0 0 15 0 1 0 668390253 359432192 5755 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5755 354 364 0 23649 0
[pid=24533] ppid=24531 vsize=2132 CPUtime=1.1 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 608 0 0 0 110 0 0 0 25 0 1 0 668390259 2183168 338 33554432000 4194304 4955518 140735345891536 18446744073709551615 4227747 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 533 338 104 186 0 346 0
Current children cumulated CPU time (s) 14.07
Current children cumulated vsize (KiB) 2233272

[startup+6.30102 s]
/proc/loadavg: 8.83 9.38 8.86 10/514 24533
/proc/meminfo: memFree=24013828/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=310032 CPUtime=0.87 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 15990 3966 1 0 59 9 19 0 24 0 1 0 668390176 317472768 7276 33554432000 4194304 5683644 140736265177504 18446744073709551615 216646345535 0 0 16781312 2 18446744071562232103 0 0 17 6 0 0 2
/proc/24502/statm: 77508 7276 1891 364 0 13405 0
[pid=24511] ppid=24502 vsize=289340 CPUtime=0.01 cores=0-7
/proc/24511/stat : 24511 (python) S 24502 24502 23657 0 -1 4202560 911 0 0 0 0 1 0 0 15 0 1 0 668390234 296284160 5715 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 11501049960506294531 0 0 17 2 0 0 0
/proc/24511/statm: 72335 5715 371 364 0 8250 0
[pid=24513] ppid=24511 vsize=2264 CPUtime=5.71 cores=0-7
/proc/24513/stat : 24513 (march_hi) R 24511 24513 24513 0 -1 4202496 629 0 0 0 571 0 0 0 25 0 1 0 668390234 2318336 365 33554432000 4194304 4955518 140735260463616 18446744073709551615 4312226 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24513/statm: 566 365 104 186 0 379 0
[pid=24514] ppid=24502 vsize=299124 CPUtime=0.01 cores=0-7
/proc/24514/stat : 24514 (python) S 24502 24502 23657 0 -1 4202560 916 0 0 0 1 0 0 0 15 0 1 0 668390237 306302976 5616 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 1334578421996421377 0 0 17 4 0 0 0
/proc/24514/statm: 74781 5616 371 364 0 10693 0
[pid=24516] ppid=24514 vsize=2132 CPUtime=4.8 cores=0-7
/proc/24516/stat : 24516 (march_hi) R 24514 24516 24516 0 -1 4202496 626 0 0 0 480 0 0 0 25 0 1 0 668390237 2183168 363 33554432000 4194304 4955518 140737022899968 18446744073709551615 4209635 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24516/statm: 533 363 104 186 0 346 0
[pid=24517] ppid=24502 vsize=309984 CPUtime=0.02 cores=0-7
/proc/24517/stat : 24517 (python) S 24502 24502 23657 0 -1 4202560 940 0 0 0 1 1 0 0 15 0 1 0 668390240 317423616 5739 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 6171747887001600256 0 0 17 5 0 0 0
/proc/24517/statm: 77496 5739 371 364 0 13405 0
[pid=24519] ppid=24517 vsize=2264 CPUtime=5.61 cores=0-7
/proc/24519/stat : 24519 (march_hi) R 24517 24519 24519 0 -1 4202496 631 0 0 0 561 0 0 0 25 0 1 0 668390241 2318336 366 33554432000 4194304 4955518 140736853704640 18446744073709551615 4346998 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/24519/statm: 566 366 104 186 0 379 0
[pid=24520] ppid=24502 vsize=320240 CPUtime=0.01 cores=0-7
/proc/24520/stat : 24520 (python) S 24502 24502 23657 0 -1 4202560 937 0 0 0 0 1 0 0 15 0 1 0 668390243 327925760 5742 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 9140244564043333891 0 0 17 6 0 0 0
/proc/24520/statm: 80060 5742 370 364 0 15966 0
[pid=24522] ppid=24520 vsize=2132 CPUtime=4.71 cores=0-7
/proc/24522/stat : 24522 (march_hi) R 24520 24522 24522 0 -1 4202496 628 0 0 0 471 0 0 0 25 0 1 0 668390246 2183168 363 33554432000 4194304 4955518 140734901130016 18446744073709551615 4224648 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24522/statm: 533 363 104 186 0 346 0
[pid=24527] ppid=24502 vsize=340752 CPUtime=0.01 cores=0-7
/proc/24527/stat : 24527 (python) S 24502 24502 23657 0 -1 4202560 960 0 0 0 0 1 0 0 15 0 1 0 668390250 348930048 5768 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 14375124977001136385 0 0 17 1 0 0 0
/proc/24527/statm: 85188 5768 371 364 0 21088 0
[pid=24530] ppid=24527 vsize=2264 CPUtime=5.49 cores=0-7
/proc/24530/stat : 24530 (march_hi) R 24527 24530 24530 0 -1 4202496 632 0 0 0 549 0 0 0 25 0 1 0 668390252 2318336 365 33554432000 4194304 4955518 140734541496960 18446744073709551615 4229464 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/24530/statm: 566 365 104 186 0 379 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0.01 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 985 0 0 0 1 0 0 0 15 0 1 0 668390253 359432192 5778 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5778 377 364 0 23649 0
[pid=24533] ppid=24531 vsize=2132 CPUtime=3.5 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 627 0 0 0 350 0 0 0 25 0 1 0 668390259 2183168 357 33554432000 4194304 4955518 140735345891536 18446744073709551615 4224697 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 533 357 104 186 0 346 0
Current children cumulated CPU time (s) 30.76
Current children cumulated vsize (KiB) 2233668

[startup+12.7009 s]

################
# More data... #
################

/proc/24517/statm: 77496 5739 371 364 0 13405 0
[pid=24519] ppid=24517 vsize=2448 CPUtime=24.74 cores=0-7
/proc/24519/stat : 24519 (march_hi) R 24517 24519 24519 0 -1 4202496 683 0 0 0 2474 0 0 0 25 0 1 0 668390241 2506752 418 33554432000 4194304 4955518 140736853704640 18446744073709551615 4209776 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/24519/statm: 612 418 104 186 0 425 0
[pid=24520] ppid=24502 vsize=320240 CPUtime=0.08 cores=0-7
/proc/24520/stat : 24520 (python) S 24502 24502 23657 0 -1 4202560 947 0 0 0 3 5 0 0 15 0 1 0 668390243 327925760 5743 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 9140244564043333891 0 0 17 6 0 0 0
/proc/24520/statm: 80060 5743 371 364 0 15966 0
[pid=24522] ppid=24520 vsize=2264 CPUtime=14.3 cores=0-7
/proc/24522/stat : 24522 (march_hi) R 24520 24522 24522 0 -1 4202496 650 0 0 0 1430 0 0 0 25 0 1 0 668390246 2318336 385 33554432000 4194304 4955518 140734901130016 18446744073709551615 4315004 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24522/statm: 566 385 104 186 0 379 0
[pid=24527] ppid=24502 vsize=340752 CPUtime=0.09 cores=0-7
/proc/24527/stat : 24527 (python) S 24502 24502 23657 0 -1 4202560 974 0 0 0 4 5 0 0 15 0 1 0 668390250 348930048 5768 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 14375124977001136385 0 0 17 1 0 0 0
/proc/24527/statm: 85188 5768 371 364 0 21088 0
[pid=24530] ppid=24527 vsize=2448 CPUtime=24.63 cores=0-7
/proc/24530/stat : 24530 (march_hi) R 24527 24530 24530 0 -1 4202496 684 0 0 0 2463 0 0 0 25 0 1 0 668390252 2506752 417 33554432000 4194304 4955518 140734541496960 18446744073709551615 4261387 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/24530/statm: 612 417 104 186 0 425 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0.08 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 995 0 0 0 5 3 0 0 15 0 1 0 668390253 359432192 5778 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5778 377 364 0 23649 0
[pid=24533] ppid=24531 vsize=2264 CPUtime=13.22 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 653 0 0 0 1322 0 0 0 25 0 1 0 668390259 2318336 383 33554432000 4194304 4955518 140735345891536 18446744073709551615 4328148 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 566 383 104 186 0 379 0
Current children cumulated CPU time (s) 126.66
Current children cumulated vsize (KiB) 2234800

Solver just ended. Dumping a history of the last processes samples

[startup+38.3004 s]
/proc/loadavg: 8.63 9.29 8.85 6/510 24538
/proc/meminfo: memFree=24031152/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=310032 CPUtime=0.87 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 15990 3966 1 0 59 9 19 0 15 0 1 0 668390176 317472768 7276 33554432000 4194304 5683644 140736265177504 18446744073709551615 216646345535 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 2
/proc/24502/statm: 77508 7276 1891 364 0 13405 0
[pid=24511] ppid=24502 vsize=0 CPUtime=30.95 cores=0-7
/proc/24511/stat : 24511 (python) Z 24502 24502 23657 0 -1 4202588 1175 689 0 0 19 8 3068 0 17 0 1 0 668390234 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24511/statm: 0 0 0 0 0 0 0
[pid=24514] ppid=24502 vsize=0 CPUtime=30.95 cores=0-7
/proc/24514/stat : 24514 (python) Z 24502 24502 23657 0 -1 4202588 1170 689 0 0 8 6 3081 0 15 0 1 0 668390237 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 4 0 0 0
/proc/24514/statm: 0 0 0 0 0 0 0
[pid=24517] ppid=24502 vsize=0 CPUtime=31.05 cores=0-7
/proc/24517/stat : 24517 (python) Z 24502 24502 23657 0 -1 4202588 1202 691 0 0 8 4 3093 0 17 0 1 0 668390240 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 5 0 0 0
/proc/24517/statm: 0 0 0 0 0 0 0
[pid=24520] ppid=24502 vsize=320240 CPUtime=0.16 cores=0-7
/proc/24520/stat : 24520 (python) S 24502 24502 23657 0 -1 4202560 958 0 0 0 7 9 0 0 15 0 1 0 668390243 327925760 5743 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 9140244564043333891 0 0 17 6 0 0 0
/proc/24520/statm: 80060 5743 371 364 0 15966 0
[pid=24522] ppid=24520 vsize=2448 CPUtime=24.09 cores=0-7
/proc/24522/stat : 24522 (march_hi) R 24520 24522 24522 0 -1 4202496 682 0 0 0 2409 0 0 0 25 0 1 0 668390246 2506752 417 33554432000 4194304 4955518 140734901130016 18446744073709551615 4209672 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24522/statm: 612 417 104 186 0 425 0
[pid=24527] ppid=24502 vsize=0 CPUtime=30.73 cores=0-7
/proc/24527/stat : 24527 (python) Z 24502 24502 23657 0 -1 4202588 1258 692 0 0 5 6 3062 0 15 0 1 0 668390250 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 1 0 0 0
/proc/24527/statm: 0 0 0 0 0 0 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0.15 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 1001 0 0 0 8 7 0 0 15 0 1 0 668390253 359432192 5778 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5778 377 364 0 23649 0
[pid=24533] ppid=24531 vsize=2448 CPUtime=23.01 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 685 0 0 0 2301 0 0 0 25 0 1 0 668390259 2506752 415 33554432000 4194304 4955518 140735345891536 18446744073709551615 4290128 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 612 415 104 186 0 425 0
Current children cumulated CPU time (s) 171.96
Current children cumulated vsize (KiB) 986176

[startup+41.5008 s]
/proc/loadavg: 8.34 9.22 8.83 6/510 24538
/proc/meminfo: memFree=24031284/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=310032 CPUtime=0.87 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 15990 3966 1 0 59 9 19 0 15 0 1 0 668390176 317472768 7276 33554432000 4194304 5683644 140736265177504 18446744073709551615 216646345535 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 2
/proc/24502/statm: 77508 7276 1891 364 0 13405 0
[pid=24511] ppid=24502 vsize=0 CPUtime=30.95 cores=0-7
/proc/24511/stat : 24511 (python) Z 24502 24502 23657 0 -1 4202588 1175 689 0 0 19 8 3068 0 17 0 1 0 668390234 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24511/statm: 0 0 0 0 0 0 0
[pid=24514] ppid=24502 vsize=0 CPUtime=30.95 cores=0-7
/proc/24514/stat : 24514 (python) Z 24502 24502 23657 0 -1 4202588 1170 689 0 0 8 6 3081 0 15 0 1 0 668390237 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 4 0 0 0
/proc/24514/statm: 0 0 0 0 0 0 0
[pid=24517] ppid=24502 vsize=0 CPUtime=31.05 cores=0-7
/proc/24517/stat : 24517 (python) Z 24502 24502 23657 0 -1 4202588 1202 691 0 0 8 4 3093 0 17 0 1 0 668390240 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 5 0 0 0
/proc/24517/statm: 0 0 0 0 0 0 0
[pid=24520] ppid=24502 vsize=320240 CPUtime=0.16 cores=0-7
/proc/24520/stat : 24520 (python) S 24502 24502 23657 0 -1 4202560 958 0 0 0 7 9 0 0 15 0 1 0 668390243 327925760 5743 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 9140244564043333891 0 0 17 6 0 0 0
/proc/24520/statm: 80060 5743 371 364 0 15966 0
[pid=24522] ppid=24520 vsize=2448 CPUtime=27.29 cores=0-7
/proc/24522/stat : 24522 (march_hi) R 24520 24522 24522 0 -1 4202496 686 0 0 0 2729 0 0 0 25 0 1 0 668390246 2506752 421 33554432000 4194304 4955518 140734901130016 18446744073709551615 4290128 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24522/statm: 612 421 104 186 0 425 0
[pid=24527] ppid=24502 vsize=0 CPUtime=30.73 cores=0-7
/proc/24527/stat : 24527 (python) Z 24502 24502 23657 0 -1 4202588 1258 692 0 0 5 6 3062 0 15 0 1 0 668390250 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 1 0 0 0
/proc/24527/statm: 0 0 0 0 0 0 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0.15 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 1001 0 0 0 8 7 0 0 15 0 1 0 668390253 359432192 5778 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5778 377 364 0 23649 0
[pid=24533] ppid=24531 vsize=2448 CPUtime=26.21 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 689 0 0 0 2621 0 0 0 25 0 1 0 668390259 2506752 419 33554432000 4194304 4955518 140735345891536 18446744073709551615 4238696 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 612 419 104 186 0 425 0
Current children cumulated CPU time (s) 178.36
Current children cumulated vsize (KiB) 986176

[startup+44.7013 s]
/proc/loadavg: 8.07 9.15 8.81 6/510 24538
/proc/meminfo: memFree=24031404/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=310032 CPUtime=0.87 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 15990 3966 1 0 59 9 19 0 15 0 1 0 668390176 317472768 7276 33554432000 4194304 5683644 140736265177504 18446744073709551615 216646345535 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 2
/proc/24502/statm: 77508 7276 1891 364 0 13405 0
[pid=24511] ppid=24502 vsize=0 CPUtime=30.95 cores=0-7
/proc/24511/stat : 24511 (python) Z 24502 24502 23657 0 -1 4202588 1175 689 0 0 19 8 3068 0 17 0 1 0 668390234 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24511/statm: 0 0 0 0 0 0 0
[pid=24514] ppid=24502 vsize=0 CPUtime=30.95 cores=0-7
/proc/24514/stat : 24514 (python) Z 24502 24502 23657 0 -1 4202588 1170 689 0 0 8 6 3081 0 15 0 1 0 668390237 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 4 0 0 0
/proc/24514/statm: 0 0 0 0 0 0 0
[pid=24517] ppid=24502 vsize=0 CPUtime=31.05 cores=0-7
/proc/24517/stat : 24517 (python) Z 24502 24502 23657 0 -1 4202588 1202 691 0 0 8 4 3093 0 17 0 1 0 668390240 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 5 0 0 0
/proc/24517/statm: 0 0 0 0 0 0 0
[pid=24520] ppid=24502 vsize=320240 CPUtime=0.18 cores=0-7
/proc/24520/stat : 24520 (python) S 24502 24502 23657 0 -1 4202560 960 0 0 0 8 10 0 0 15 0 1 0 668390243 327925760 5743 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 9140244564043333891 0 0 17 6 0 0 0
/proc/24520/statm: 80060 5743 371 364 0 15966 0
[pid=24522] ppid=24520 vsize=2448 CPUtime=30.49 cores=0-7
/proc/24522/stat : 24522 (march_hi) R 24520 24522 24522 0 -1 4202496 690 0 0 0 3049 0 0 0 25 0 1 0 668390246 2506752 425 33554432000 4194304 4955518 140734901130016 18446744073709551615 4209740 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24522/statm: 612 425 104 186 0 425 0
[pid=24527] ppid=24502 vsize=0 CPUtime=30.73 cores=0-7
/proc/24527/stat : 24527 (python) Z 24502 24502 23657 0 -1 4202588 1258 692 0 0 5 6 3062 0 15 0 1 0 668390250 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 1 0 0 0
/proc/24527/statm: 0 0 0 0 0 0 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0.17 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 1004 0 0 0 10 7 0 0 15 0 1 0 668390253 359432192 5778 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5778 377 364 0 23649 0
[pid=24533] ppid=24531 vsize=2448 CPUtime=29.41 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 692 0 0 0 2941 0 0 0 25 0 1 0 668390259 2506752 422 33554432000 4194304 4955518 140735345891536 18446744073709551615 4209643 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 612 422 104 186 0 425 0
Current children cumulated CPU time (s) 184.8
Current children cumulated vsize (KiB) 986176

[startup+46.301 s]
/proc/loadavg: 8.07 9.15 8.81 5/504 24539
/proc/meminfo: memFree=24035668/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=310032 CPUtime=155.62 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 15991 13432 1 0 59 9 15456 38 15 0 1 0 668390176 317472768 7276 33554432000 4194304 5683644 140736265177504 18446744073709551615 216646345535 0 0 16781312 2 18446744071562232103 0 0 17 6 0 0 2
/proc/24502/statm: 77508 7276 1891 364 0 13405 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0.17 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 1004 0 0 0 10 7 0 0 15 0 1 0 668390253 359432192 5778 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5778 377 364 0 23649 0
[pid=24533] ppid=24531 vsize=2448 CPUtime=31.01 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 695 0 0 0 3101 0 0 0 25 0 1 0 668390259 2506752 425 33554432000 4194304 4955518 140735345891536 18446744073709551615 4314044 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 612 425 104 186 0 425 0
Current children cumulated CPU time (s) 186.8
Current children cumulated vsize (KiB) 663488

[startup+46.7009 s]
/proc/loadavg: 8.07 9.15 8.81 5/504 24539
/proc/meminfo: memFree=24035668/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=310032 CPUtime=155.62 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 15991 13432 1 0 59 9 15456 38 15 0 1 0 668390176 317472768 7276 33554432000 4194304 5683644 140736265177504 18446744073709551615 216646345535 0 0 16781312 2 18446744071562232103 0 0 17 6 0 0 2
/proc/24502/statm: 77508 7276 1891 364 0 13405 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0.17 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 1004 0 0 0 10 7 0 0 15 0 1 0 668390253 359432192 5778 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5778 377 364 0 23649 0
[pid=24533] ppid=24531 vsize=2448 CPUtime=31.41 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 695 0 0 0 3141 0 0 0 25 0 1 0 668390259 2506752 425 33554432000 4194304 4955518 140735345891536 18446744073709551615 4209643 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 612 425 104 186 0 425 0
Current children cumulated CPU time (s) 187.2
Current children cumulated vsize (KiB) 663488

[startup+47.1009 s]
/proc/loadavg: 8.07 9.15 8.81 5/504 24539
/proc/meminfo: memFree=24035668/32951124 swapFree=53501260/67111528
[pid=24502] ppid=24500 vsize=310032 CPUtime=155.62 cores=0-7
/proc/24502/stat : 24502 (python) S 24500 24502 23657 0 -1 4202496 15991 13432 1 0 59 9 15456 38 15 0 1 0 668390176 317472768 7276 33554432000 4194304 5683644 140736265177504 18446744073709551615 216646345535 0 0 16781312 2 18446744071562232103 0 0 17 6 0 0 2
/proc/24502/statm: 77508 7276 1891 364 0 13405 0
[pid=24531] ppid=24502 vsize=351008 CPUtime=0.17 cores=0-7
/proc/24531/stat : 24531 (python) S 24502 24502 23657 0 -1 4202560 1004 0 0 0 10 7 0 0 15 0 1 0 668390253 359432192 5778 33554432000 4194304 5683644 140736265177504 18446744073709551615 216634535494 0 0 16781312 514 8888425614957052164 0 0 17 1 0 0 0
/proc/24531/statm: 87752 5778 377 364 0 23649 0
[pid=24533] ppid=24531 vsize=2448 CPUtime=31.81 cores=0-7
/proc/24533/stat : 24533 (march_hi) R 24531 24533 24533 0 -1 4202496 695 0 0 0 3181 0 0 0 25 0 1 0 668390259 2506752 425 33554432000 4194304 4955518 140735345891536 18446744073709551615 4224551 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24533/statm: 612 425 104 186 0 425 0
Current children cumulated CPU time (s) 187.6
Current children cumulated vsize (KiB) 663488

Child status: 1
Real time (s): 47.1916
CPU time (s): 187.734
CPU user time (s): 187.16
CPU system time (s): 0.574912
CPU usage (%): 397.813
Max. virtual memory (cumulated for all children) (KiB): 2234984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 187.16
system time used= 0.574912
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35585
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2161
involuntary context switches= 1497

runsolver used 0.253961 second user time and 0.538918 second system time

The end

Launcher Data 

Begin job on node103 at 2011-05-16 19:44:35
IDJOB=3385543
IDBENCH=82808
IDSOLVER=1870
FILE ID=node103/3385543-1305567875
RUNJOBID= node103-1305564967-23671
PBS_JOBID= 13350147
Free space on /tmp= 73068 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v450-c1917-S2065964480-034.SATISFIABLE.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385543-1305567875/watcher-3385543-1305567875 -o /tmp/evaluation-result-3385543-1305567875/solver-3385543-1305567875 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385543-1305567875.cnf -seed 936910992 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 06d324a3bc5f99e4e9d2e5560e56ab8e
RANDOM SEED=936910992

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24067152 kB
Buffers:        345352 kB
Cached:        4548460 kB
SwapCached:     340168 kB
Active:        3043384 kB
Inactive:      5525564 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24067152 kB
SwapTotal:    67111528 kB
SwapFree:     53501260 kB
Dirty:           33132 kB
Writeback:           0 kB
AnonPages:     3346628 kB
Mapped:          23852 kB
Slab:           167952 kB
PageTables:      72904 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 162569016 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73036 MiB
End job on node103 at 2011-05-16 19:45:23