Taft Inauguration

I am trying to find documentation that confirms an oral family story. During the Taft inauguration (March 4, 1909), the Philippine Constabulary Band performed. I was told that Walter Loving, the conductor had not been allowed inside the White House because of his race. Is there any way to confirm this? Are there visitor logs that I could look at? The band played in the inaugural parade and then a reception the day after the inauguration. I believe the reception was held at the White House. Thank you for considering my request.