There may be other features which that can be quantified and added.
Existing features can be modified or removed entirely to improve the results to ensure that the LR implementation would obtain better and more consistent results.