Sir Keir Starmer's government discussed moving out of Downing Street because of concerns about its suitability as a workplace, senior figures from his administration have said.

Ministers and officials from successive governments have privately complained that Number 10's rabbit warren-like layout can lead to a lack of collaboration among those working there.

James Lyons, who served as Sir Keir's director of communications, said over the weekend that "moving out was something that was discussed" during his time in post.

Two other senior figures confirmed that discussions were had about moving staff into an open plan space in another government department.

One source said a space inside the Foreign Office building, a short distance from Downing Street, had been identified.

Both stressed that discussions did not go beyond an early phase and it's not known whether Sir Keir himself was consulted. There's no suggestion that the prime minister would have stopped living in Downing Street if the plan had gone forward.

10 Downing Street is more than 300 years old and is an amalgamation of three houses, which comprises more than 100 rooms.

The building was given to Robert Walpole, widely regarded as the UK's first prime minister, by King George II in 1732.

Lord Walker, the boss of supermarket Iceland and a former adviser to Sir Keir, told the Financial Times on Friday that Number 10 was no longer "fit for purpose".

He said: "I think we should turn it into residences, or a museum. It's a national treasure. It's amazing.

But it's ridiculous. "It's just a Stuart-era building, not fit for purpose. It has tiny, tiny meeting rooms, all on different levels. There are hazards." Lyons, who led Sir Keir's communications operation from October 2024 to September 2025, posted on LinkedIn that "Lord Walker is 100% right".

He added that staff were "deeply envious" of other departments and described Number 10 as a "gloomy, mice-infested, bomb-curtained rabbit warren".

Lyons added: "Moving out was something that was discussed when I was in 10 Downing Street." One source said "there were chats at senior staff level about moving to an open plan office in FCDO" (Foreign, Commonwealth and Development Office).

They said they didn't believe the idea went far, but said "the reason for discussion was serious" and added that the alternative plan was "about staff being open plan and able to collaborate". Sir Keir became increasingly frustrated at Whitehall's ability to deliver change during his time as prime minister.

He was accused of picking a fight with civil servants when he said "too many people in Whitehall are comfortable in the tepid bath of managed decline".

Darren Jones, who served as Sir Keir's chief secretary, told MPs last week that he "tried to abolish the Cabinet Office three times but failed".

He proposed replacing it with a new department that would "abolish those barriers and walls and make them just one integrated team, focusing on the same things and really supporting each other to move it forward".

In his first days after succeeding Sir Keir, Andy Burnham created the Office for the Prime Minister and Cabinet.

The move was seen as an attempt to ensure that things happen when metaphorical levers of power are pulled.

It comprises Number 10, Number 10 North and other key parts of the Cabinet Office and is led by the UK's most senior civil servant, Dame Antonia Romeo.

The government says the new office will "ensure the centre of government is focused on our top strategic priorities".

Those around Burnham say he is yet to form a view about the adequacy of Number 10 as a workplace.

Correction: This story has been amended to make clear King George II offered Number 10 Downing Street to Robert Walpole in 1732, not King George III as an earlier version stated.