Observational Constraints for Physical Models of Black Hole Fueling and Feedback