In 1896, Sir Frank started constructing his official residence above the Lake Gardens. This was Carcosa, probably a stylization of the Italian cara cosa or "dear place".

In 1904, Sir Frank moved to Carcosa, at the same time finishing a building called "King's House" on an adjacent hillside. King's House, today Seri Negara (which means "beautiful country"), was to house the Governor of the Straits Settlements as well as other illustrious guests of the Malay Federation.

From 1904 until the 1941 Japanese invasion of Malaysia, Carcosa was the official residence of the highest British representative to the Malay States.

Today, Carcosa is one of the leading hotels with its manicured lawns and the lake gardens, a part of Malaysia which seemingly can never change.