The company said that two explosions had damaged surrounding property and two other incidents had led to small fires.
Nobody was hurt in any of the events reported so far, according to a spokesman for AT&T.
Canadian company Avestor, which made the lithium-metal-polymer batteries, went bankrupt in October 2006.
AT&T said that it would roll out around 400,000 batteries it currently has in stock from a different manufacturer.
"Normally, we would work with a vendor to diagnose problems and develop solutions, but we cannot do that in this case," an AT&T statement said.
The move is similar to problems that dogged laptop batteries in 2006. Dell recalled 4.1 million Sony-manufactured laptop batteries in August that year after a flaw was found that could make them dangerously overheat.
Apple followed suit later that month with a recall of 1.8 million batteries, while in September 2006 Toshiba recalled Sony batteries because of recharging problems not related to the overheating issues.
This was followed by a similar initiative by Lenovo and IBM, which recalled 526,000 notebook batteries based on the original fire risk.
Sony then announced a global recall of batteries in October, costing the company a quarter of its profits for 2006.