Despite a lack of college football experience, Frazier signed with the Houston Oilers of the American Football League (AFL) prior to the 1962 AFL season.[6] With George Blanda and Don Trull at quarterback, Frazier totaled 1,129 receiving yards and 12 touchdown receptions in the 1966 season. His 12 touchdown receptions were the second-most in the AFL that year, trailing only Lance Alworth's 13.[7] Frazier was named to the East's 1966 AFL All-Star team for his accomplishments. In the All-Star game, Frazier scored the game-winning touchdown on a 17-yard pass from Vito Parilli.[8]
In March 1969, the Oilers traded Frazier, Sid Blanks, Ronnie Caveness, and Larry Carwell to the Boston Patriots for Leroy Mitchell.[9] The Patriots placed Frazier on the move list in December 1970, rendering him ineligible to play for the remainder of that season.[10] He retired with 207 receptions, 3,452 receiving yards, and 29 touchdowns.[4]