Attempting To Identify A Black WW2 General

I read a story in a memoir that mentions an unnamed African American general during World War II. I don't imagine there were many of those and this one should have really stood out since he was supposed 6'6" tall. The general in question came to inspect Special Services operations in Lexington, VA in the latter part of the war and stayed with a white officer's family assigned there because of local segregation issues.

Benjamin Oliver Davis Sr. is the obvious candidate, but I can't find anything that would confirm his stateside activity nor his height. All my searching for black generals in WW2 only turns up mentions of him because he was the first black general (in 1940).