Adjust the nonlinear functions not the filters (the weighted sums.)
https://github.com/S6Regen/Fixed-Filter-Bank-Neural-Networks
That seems to work very well within my ability to test with limited hardware.
https://discourse.numenta.org/t/fixed-filter-bank-neural-networks/6392
https://discourse.numenta.org/t/distributed-representations-1984-by-hinton/6378/10
