Are you sure all the brown stuff isn't pleco poop?
Things to try:
Less light
More water changes
More substrate vacuuming
Less food
More plants (anubias, java fern, etc)
Some Amano shrimp
At some point, you will hit the magic combo of the above factors and will be balanced enough to keep brown algae at bay.