runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3218934-1303203369/watcher-3218934-1303203369 -o /tmp/evaluation-result-3218934-1303203369/solver-3218934-1303203369 -C 5000 -W 5000 -M 15500 python portfolio_solver.py -t 5000 -s 1923918667 HOME/instance-3218934-1303203369.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.09 4.79 6.01 3/174 2290
/proc/meminfo: memFree=16670032/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=11800 CPUtime=0 cores=0,2,4,6
/proc/2290/stat : 2290 (runsolver) D 2286 2290 2245 0 -1 4202560 44 0 0 0 0 0 0 0 20 0 1 0 510567789 12083200 54 33554432000 4194304 5434984 140735111743008 18446744073709551615 5055495 0 0 4096 24578 18446744071562234166 0 0 17 0 0 0 0
/proc/2290/statm: 2950 54 34 303 0 2644 0

[startup+0.0333981 s]
/proc/loadavg: 1.09 4.79 6.01 3/174 2290
/proc/meminfo: memFree=16670032/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=1900 CPUtime=0 cores=0,2,4,6
/proc/2290/stat : 2290 (python) D 2286 2290 2245 0 -1 4194304 45 0 0 0 0 0 0 0 20 0 1 0 510567789 1945600 1 33554432000 0 0 140737058170627 18446744073709551615 5055495 0 0 4096 0 18446744071562234166 0 0 17 0 0 0 2
/proc/2290/statm: 475 1 0 0 0 37 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 1900

[startup+0.100392 s]
/proc/loadavg: 1.09 4.79 6.01 3/174 2290
/proc/meminfo: memFree=16670032/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=1900 CPUtime=0 cores=0,2,4,6
/proc/2290/stat : 2290 (python) D 2286 2290 2245 0 -1 4194304 45 0 0 0 0 0 0 0 20 0 1 0 510567789 1945600 1 33554432000 0 0 140737058170627 18446744073709551615 5055495 0 0 4096 0 18446744071562234166 0 0 17 0 0 0 2
/proc/2290/statm: 475 1 0 0 0 37 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 1900

[startup+0.300327 s]
/proc/loadavg: 1.09 4.79 6.01 3/174 2290
/proc/meminfo: memFree=16670032/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=14312 CPUtime=0 cores=0,2,4,6
/proc/2290/stat : 2290 (python) D 2286 2290 2245 0 -1 4194304 193 0 3 0 0 0 0 0 18 0 1 0 510567789 14655488 133 33554432000 4194304 5745468 140737058162720 18446744073709551615 5060320 0 0 4096 0 18446744071562234166 0 0 17 2 0 0 26
/proc/2290/statm: 3578 133 105 379 0 51 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 14312

[startup+0.700291 s]
/proc/loadavg: 1.09 4.79 6.01 3/174 2290
/proc/meminfo: memFree=16670032/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=15144 CPUtime=0 cores=0,2,4,6
/proc/2290/stat : 2290 (python) D 2286 2290 2245 0 -1 4202496 643 0 7 0 0 0 0 0 17 0 1 0 510567789 15507456 548 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562234166 0 0 17 4 0 0 55
/proc/2290/statm: 3786 548 316 379 0 259 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15144

[startup+1.5011 s]
/proc/loadavg: 1.09 4.79 6.01 2/178 2295
/proc/meminfo: memFree=16664820/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=21960 CPUtime=0.04 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 1521 0 8 0 4 0 0 0 17 0 1 0 510567789 22487040 1367 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 126
/proc/2290/statm: 5490 1367 463 379 0 931 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 21960

[startup+3.10079 s]
/proc/loadavg: 1.09 4.79 6.01 4/180 2297
/proc/meminfo: memFree=16643552/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=21960 CPUtime=0.04 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 1521 0 8 0 4 0 0 0 17 0 1 0 510567789 22487040 1367 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 126
/proc/2290/statm: 5490 1367 463 379 0 931 0
[pid=2297] ppid=2290 vsize=8364 CPUtime=1.63 cores=0,2,4,6
/proc/2297/stat : 2297 (features) R 2290 2290 2245 0 -1 4202496 2646 0 0 0 161 2 0 0 22 0 1 0 510567935 8564736 1529 33554432000 134512640 135907751 4292609424 18446744073709551615 135392733 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2297/statm: 2091 1529 111 341 0 1747 0
Current children cumulated CPU time (s) 1.67
Current children cumulated vsize (KiB) 30324
heavy processes:

[startup+6.30119 s]
/proc/loadavg: 1.32 4.77 5.99 2/181 2298
/proc/meminfo: memFree=16652292/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=21960 CPUtime=0.04 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 1521 0 8 0 4 0 0 0 17 0 1 0 510567789 22487040 1367 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 126
/proc/2290/statm: 5490 1367 463 379 0 931 0
[pid=2297] ppid=2290 vsize=4844 CPUtime=4.84 cores=0,2,4,6
/proc/2297/stat : 2297 (features) R 2290 2290 2245 0 -1 4202496 2914 0 0 0 480 4 0 0 25 0 1 0 510567935 4960256 892 33554432000 134512640 135907751 4292609424 18446744073709551615 134518653 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2297/statm: 1211 892 112 341 0 867 0
Current children cumulated CPU time (s) 4.88
Current children cumulated vsize (KiB) 26804
heavy processes:
  %CPU=76 pid=2296 uid=0 cmd=
  %CPU=32 pid=2298 uid=0 cmd=

[startup+12.701 s]
/proc/loadavg: 1.37 4.73 5.97 4/183 2301
/proc/meminfo: memFree=16620448/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=21960 CPUtime=0.04 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 1521 0 8 0 4 0 0 0 17 0 1 0 510567789 22487040 1367 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 126
/proc/2290/statm: 5490 1367 463 379 0 931 0
[pid=2297] ppid=2290 vsize=4844 CPUtime=11.24 cores=0,2,4,6
/proc/2297/stat : 2297 (features) R 2290 2290 2245 0 -1 4202496 2914 0 0 0 1120 4 0 0 25 0 1 0 510567935 4960256 892 33554432000 134512640 135907751 4292609424 18446744073709551615 134518699 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2297/statm: 1211 892 112 341 0 867 0
Current children cumulated CPU time (s) 11.28
Current children cumulated vsize (KiB) 26804

[startup+25.5005 s]
/proc/loadavg: 1.51 4.59 5.91 3/186 2304
/proc/meminfo: memFree=16596580/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=0.05 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 2168 0 8 0 4 1 0 0 18 0 1 0 510567789 35287040 1427 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 126
/proc/2290/statm: 8615 1427 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2303] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2303/stat : 2303 (timerun) S 2290 2290 2245 0 -1 4202496 762 0 0 0 0 0 0 0 17 0 1 0 510569459 8908800 248 33554432000 4194304 4922060 140734342968992 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/2303/statm: 2175 248 208 178 0 68 0
[pid=2304] ppid=2303 vsize=22884 CPUtime=8.79 cores=0,2,4,6
/proc/2304/stat : 2304 (cryptominisat) R 2303 2290 2245 0 -1 4202496 10709 0 0 0 878 1 0 0 25 0 1 0 510569459 23433216 3291 33554432000 134512640 134994940 4289331120 18446744073709551615 134642236 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/2304/statm: 5721 3291 356 118 0 4906 0
Current children cumulated CPU time (s) 24.06
Current children cumulated vsize (KiB) 66044

[startup+51.1007 s]
/proc/loadavg: 1.68 4.38 5.80 3/186 2313
/proc/meminfo: memFree=16628488/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=25.04 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 2479 22908 8 0 4 1 2496 3 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2311] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2311/stat : 2311 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 19 0 1 0 510571960 8908800 248 33554432000 4194304 4922060 140734375351008 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2311/statm: 2175 248 208 178 0 68 0
[pid=2312] ppid=2311 vsize=9816 CPUtime=9.39 cores=0,2,4,6
/proc/2312/stat : 2312 (precosat) R 2311 2290 2245 0 -1 4202496 2394 0 0 0 939 0 0 0 25 0 1 0 510571960 10051584 2349 33554432000 134512640 135142049 4293776304 18446744073709551615 134552554 0 0 16781312 17442 0 0 0 17 0 0 0 0
/proc/2312/statm: 2454 2349 80 154 0 2298 0
Current children cumulated CPU time (s) 49.65
Current children cumulated vsize (KiB) 52976

[startup+102.307 s]
/proc/loadavg: 1.86 4.01 5.60 3/186 2314
/proc/meminfo: memFree=16611028/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=25.04 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 2479 22908 8 0 4 1 2496 3 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2311] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2311/stat : 2311 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 19 0 1 0 510571960 8908800 248 33554432000 4194304 4922060 140734375351008 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2311/statm: 2175 248 208 178 0 68 0
[pid=2312] ppid=2311 vsize=16516 CPUtime=60.59 cores=0,2,4,6
/proc/2312/stat : 2312 (precosat) R 2311 2290 2245 0 -1 4202496 5064 0 0 0 6059 0 0 0 25 0 1 0 510571960 16912384 4000 33554432000 134512640 135142049 4293776304 18446744073709551615 134555764 0 0 16781312 17442 0 0 0 17 0 0 0 0
/proc/2312/statm: 4129 4000 80 154 0 3973 0
Current children cumulated CPU time (s) 100.85
Current children cumulated vsize (KiB) 59676

[startup+162.301 s]
/proc/loadavg: 1.95 3.64 5.37 3/186 2318
/proc/meminfo: memFree=16616708/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=25.04 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 2479 22908 8 0 4 1 2496 3 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2311] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2311/stat : 2311 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 19 0 1 0 510571960 8908800 248 33554432000 4194304 4922060 140734375351008 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2311/statm: 2175 248 208 178 0 68 0
[pid=2312] ppid=2311 vsize=22116 CPUtime=120.58 cores=0,2,4,6
/proc/2312/stat : 2312 (precosat) R 2311 2290 2245 0 -1 4202496 6628 0 0 0 12058 0 0 0 25 0 1 0 510571960 22646784 5386 33554432000 134512640 135142049 4293776304 18446744073709551615 134553712 0 0 16781312 17442 0 0 0 17 0 0 0 0
/proc/2312/statm: 5529 5386 80 154 0 5373 0
Current children cumulated CPU time (s) 160.84
Current children cumulated vsize (KiB) 65276

[startup+222.301 s]
/proc/loadavg: 1.98 3.34 5.16 4/186 2321
/proc/meminfo: memFree=16625620/32950928 swapFree=67111524/67111528

################
# More data... #
################

/proc/2363/stat : 2363 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 20 0 1 0 510611856 8908800 248 33554432000 4194304 4922060 140736896431456 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/2363/statm: 2175 248 208 178 0 68 0
[pid=2364] ppid=2363 vsize=418836 CPUtime=681.63 cores=0,2,4,6
/proc/2364/stat : 2364 (adaptg2wsat2009) R 2363 2290 2245 0 -1 4194304 844 0 0 0 68163 0 0 0 25 0 1 0 510611856 428888064 788 33554432000 134512640 134546244 4291855312 18446744073709551615 134535589 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2364/statm: 104709 788 108 9 0 103373 0
Current children cumulated CPU time (s) 1120.86
Current children cumulated vsize (KiB) 461996

Solver just ended. Dumping a history of the last processes samples

[startup+1126.3 s]
/proc/loadavg: 2.00 2.06 3.17 3/186 2434
/proc/meminfo: memFree=16627724/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=424.01 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 3682 52025 8 0 4 1 42386 10 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2363] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2363/stat : 2363 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 20 0 1 0 510611856 8908800 248 33554432000 4194304 4922060 140736896431456 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/2363/statm: 2175 248 208 178 0 68 0
[pid=2364] ppid=2363 vsize=418836 CPUtime=685.64 cores=0,2,4,6
/proc/2364/stat : 2364 (adaptg2wsat2009) R 2363 2290 2245 0 -1 4194304 844 0 0 0 68564 0 0 0 25 0 1 0 510611856 428888064 788 33554432000 134512640 134546244 4291855312 18446744073709551615 134535667 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2364/statm: 104709 788 108 9 0 103373 0
Current children cumulated CPU time (s) 1124.87
Current children cumulated vsize (KiB) 461996

[startup+1132.7 s]
/proc/loadavg: 2.00 2.05 3.16 3/186 2434
/proc/meminfo: memFree=16627716/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=424.01 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 3682 52025 8 0 4 1 42386 10 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2363] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2363/stat : 2363 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 20 0 1 0 510611856 8908800 248 33554432000 4194304 4922060 140736896431456 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/2363/statm: 2175 248 208 178 0 68 0
[pid=2364] ppid=2363 vsize=418836 CPUtime=692.03 cores=0,2,4,6
/proc/2364/stat : 2364 (adaptg2wsat2009) R 2363 2290 2245 0 -1 4194304 844 0 0 0 69203 0 0 0 25 0 1 0 510611856 428888064 788 33554432000 134512640 134546244 4291855312 18446744073709551615 134535677 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2364/statm: 104709 788 108 9 0 103373 0
Current children cumulated CPU time (s) 1131.26
Current children cumulated vsize (KiB) 461996

[startup+1139.1 s]
/proc/loadavg: 2.00 2.05 3.15 3/186 2435
/proc/meminfo: memFree=16627708/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=424.01 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 3682 52025 8 0 4 1 42386 10 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2363] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2363/stat : 2363 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 20 0 1 0 510611856 8908800 248 33554432000 4194304 4922060 140736896431456 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/2363/statm: 2175 248 208 178 0 68 0
[pid=2364] ppid=2363 vsize=418836 CPUtime=698.43 cores=0,2,4,6
/proc/2364/stat : 2364 (adaptg2wsat2009) R 2363 2290 2245 0 -1 4194304 844 0 0 0 69843 0 0 0 25 0 1 0 510611856 428888064 788 33554432000 134512640 134546244 4291855312 18446744073709551615 134534535 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2364/statm: 104709 788 108 9 0 103373 0
Current children cumulated CPU time (s) 1137.66
Current children cumulated vsize (KiB) 461996

[startup+1140.71 s]
/proc/loadavg: 2.00 2.05 3.15 3/186 2435
/proc/meminfo: memFree=16627708/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=424.01 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 3682 52025 8 0 4 1 42386 10 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2363] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2363/stat : 2363 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 20 0 1 0 510611856 8908800 248 33554432000 4194304 4922060 140736896431456 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/2363/statm: 2175 248 208 178 0 68 0
[pid=2364] ppid=2363 vsize=418836 CPUtime=700.04 cores=0,2,4,6
/proc/2364/stat : 2364 (adaptg2wsat2009) R 2363 2290 2245 0 -1 4194304 844 0 0 0 70004 0 0 0 25 0 1 0 510611856 428888064 788 33554432000 134512640 134546244 4291855312 18446744073709551615 134535168 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2364/statm: 104709 788 108 9 0 103373 0
Current children cumulated CPU time (s) 1139.27
Current children cumulated vsize (KiB) 461996

[startup+1142.3 s]
/proc/loadavg: 2.00 2.05 3.15 3/186 2435
/proc/meminfo: memFree=16627708/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=424.01 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 3682 52025 8 0 4 1 42386 10 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2363] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2363/stat : 2363 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 20 0 1 0 510611856 8908800 248 33554432000 4194304 4922060 140736896431456 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/2363/statm: 2175 248 208 178 0 68 0
[pid=2364] ppid=2363 vsize=418836 CPUtime=701.63 cores=0,2,4,6
/proc/2364/stat : 2364 (adaptg2wsat2009) R 2363 2290 2245 0 -1 4194304 844 0 0 0 70163 0 0 0 25 0 1 0 510611856 428888064 788 33554432000 134512640 134546244 4291855312 18446744073709551615 134534978 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2364/statm: 104709 788 108 9 0 103373 0
Current children cumulated CPU time (s) 1140.86
Current children cumulated vsize (KiB) 461996

[startup+1142.7 s]
/proc/loadavg: 2.00 2.05 3.15 3/186 2435
/proc/meminfo: memFree=16627708/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=424.01 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 3682 52025 8 0 4 1 42386 10 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2363] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2363/stat : 2363 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 20 0 1 0 510611856 8908800 248 33554432000 4194304 4922060 140736896431456 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/2363/statm: 2175 248 208 178 0 68 0
[pid=2364] ppid=2363 vsize=418836 CPUtime=702.03 cores=0,2,4,6
/proc/2364/stat : 2364 (adaptg2wsat2009) R 2363 2290 2245 0 -1 4194304 844 0 0 0 70203 0 0 0 25 0 1 0 510611856 428888064 788 33554432000 134512640 134546244 4291855312 18446744073709551615 134535223 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2364/statm: 104709 788 108 9 0 103373 0
Current children cumulated CPU time (s) 1141.26
Current children cumulated vsize (KiB) 461996

[startup+1142.91 s]
/proc/loadavg: 2.00 2.05 3.15 3/186 2435
/proc/meminfo: memFree=16627708/32950928 swapFree=67111524/67111528
[pid=2290] ppid=2286 vsize=34460 CPUtime=424.01 cores=0,2,4,6
/proc/2290/stat : 2290 (python) S 2286 2290 2245 0 -1 4202496 3682 52025 8 0 4 1 42386 10 18 0 1 0 510567789 35287040 1429 33554432000 4194304 5745468 140737058162720 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 126
/proc/2290/statm: 8615 1429 488 379 0 935 0
[pid=2297] ppid=2290 vsize=0 CPUtime=14.86 cores=0,2,4,6
/proc/2297/stat : 2297 (features) Z 2290 2290 2245 0 -1 4202524 2927 0 0 0 1482 4 0 0 25 0 1 0 510567935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2297/statm: 0 0 0 0 0 0 0
[pid=2302] ppid=2290 vsize=0 CPUtime=0.36 cores=0,2,4,6
/proc/2302/stat : 2302 (coach) Z 2290 2290 2245 0 -1 4202524 3927 0 0 0 36 0 0 0 18 0 1 0 510569421 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/2302/statm: 0 0 0 0 0 0 0
[pid=2363] ppid=2290 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/2363/stat : 2363 (timerun) S 2290 2290 2245 0 -1 4202496 756 0 0 0 0 0 0 0 20 0 1 0 510611856 8908800 248 33554432000 4194304 4922060 140736896431456 18446744073709551615 256415210629 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/2363/statm: 2175 248 208 178 0 68 0
[pid=2364] ppid=2363 vsize=418836 CPUtime=702.24 cores=0,2,4,6
/proc/2364/stat : 2364 (adaptg2wsat2009) R 2363 2290 2245 0 -1 4194304 844 0 0 0 70224 0 0 0 25 0 1 0 510611856 428888064 788 33554432000 134512640 134546244 4291855312 18446744073709551615 134534960 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2364/statm: 104709 788 108 9 0 103373 0
Current children cumulated CPU time (s) 1141.47
Current children cumulated vsize (KiB) 461996

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2290 and gives
#  childrusage.ru_utime.tv_sec=439
#  childrusage.ru_utime.tv_usec=102246
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=162975
# CPU time returned by wait4() is 439.265
# while last known CPU time is 1141.47
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1143
CPU time (s): 1141.47
CPU user time (s): 1141.32
CPU system time (s): 0.15
CPU usage (%): 99.8663
Max. virtual memory (cumulated for all children) (KiB): 1063020

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 439.102
system time used= 0.162975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 63155
page faults= 8
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1493
involuntary context switches= 1267

runsolver used 1.91971 second user time and 3.84741 second system time

The end