The Albany Convict Gaol was built in 1852 which consisted of men's cell blocks and warders' quarters for Imperial convicts shipped to Western Australia as skilled labourers. The Old Gaol was originally established with rehabilitation as a key principle and convicts sentenced to transportation from England between 1850-1868, often served time in the gaol.​

​

The original building served to support the nearby convict hiring deport as a commissariat store and administration office. Following the closure of the hiring deport in 1872, the building was substantially renovated and the store was converted into a home for the Government Residents and Resident Magistrate. The Residency then served as a school hostel, naval depot and training facility. In 1975, the site opened as a museum and part of the WA Museum.

The original H.M Colonial brig Amity was built in Saint John in the Canadian province of New Brunswick, Canada in 1816. The name Amity means ‘Friendship’ and carried the first settlers to Albany arriving in King George’s Sound on the 25th December 1826. The brig anchored near the site where the replica sits today. The brig Amity replica was constructed in 1976 as part of the sesquicentennial, celebrating 150 years, since arriving.

Major Lockyer built the first military garrison around this area in 1827. It included the Commandant's residence, a hospital, cookhouse, morgue, powder magazine, barracks, vegetable garden, kitchen, and quarters for officers, commissariat, blacksmith's shed, boat shed and saw pit. Local Aboriginal people used to congregate here. Major Lockyer raised the flag to proclaim Frederick Town as part of the British Empire on 21 January 1827. The settlement was officially named Albany in 1832.​

Patrick Taylor's Cottage is the oldest surviving dwelling in Western Australia, having been built by the Morley Brothers in 1832 when the town was a military outpost and was originally set on a 240 acre block (97 ha).  The Cottage was purchased by Patrick Taylor in August 1834 and the eleven room - wattle and daub cottage consists of an entry room, boxroom, parlour, nursery, bedroom, dining room, family room, sewing room, kitchen, laundry and side verandah.

Wesley Church was built between 1889-1891 using local granite and elaborate brickwork framing the gothic elements of pointed arched entrances and windows. The Manse was built in 1903 and features elegant ornamentation and turned verandah posts, which was a gift by prominent merchant John Robinson and his wife. In 1977, the Methodist, Presbyterian Church and the Congregational Union of Australia merged to form the Uniting Church.

​

The Anglican Church of St John the Evangelist is the oldest church to be consecrated in Western Australia. The ceremony was conducted by Bishop Short from Adelaide on 25 October 1848. At consecration, the church could accommodate the total population of the town - 170 people. Construction began in 1841 and went through many stages. The Rectory was commenced in 1850. Walls were of 'cob' - a traditional mixture of clay, marl, chalk, gravel and straw - 45cm thick. The brick upper floor was added in 1875. A second rectory was built behind the original in the 1980s.

The Union Bank of Australia Limited building was constructed in 1884 and was designed by architect, George Charles Inskip who also designed the Union bank buildings in Fremantle, Perth, Geraldton and Roebourne. The two street facades are identical with paired arched windows and the entry doors positioned on the corner of York Street and Stirling Terrace. The Union Bank was a great rival of the Bank of Western Australia and the competition between the banks caused an interest rate war in Albany. The Union Bank paid an unheard of £600 for the site.

The Chusan Hotel was the original hotel built on this Stirling Terrace site in 1849 and then later was rebuilt in 1871.  At the turn of the century the London Hotel was built in 1909 for the sum of £7000 by the proprietor Harry Sims, who remained the proprietor until 1918.  The Hotel had a large spacious ground and first floor balcony that commanded views of Princess Royal Harbour and was reminiscent of an English manor. In 1920, the hotel was renovated with elaborate fretwork façade on both the downstairs and upstairs balcony, this was removed in the 1960s. The inscription 'LONDON HOTEL 1909' remains on the building.

The Women's Rest Centre was originally built in 1908 as a shelter for cabmen and their horses. Well-known townsman, Frank Rawlings Dymes and his heiress wife of the prominent Hassell family, Ellen Belinda donated significant funds to construct the rest centre along with the Albany Town Council. In 1909, the Cabmen’s Shelter now known as the Taxi Rank and Women’s Rest Centre was formally donated to the Town of Albany handing over the keys to acting Mayor, William Mawson. In 1926, the shelter was expanded as a women's rest room and in 1976, the building was extended to provide additional facilities. 

Several buildings have been erected on this site including a bakery, tearooms, a wine bottling site, a rural merchant and accommodation. In  1887, a bakery occupied the first structure behind the residence leased from Mrs McKail. The bakehouse was renamed to Ballybane Tearooms and remained until 1961. The site was sold in in 1901 and again in 1903 to Johann Greeves.  C.H. Neumann, a produce merchant, built the double storey building on the centre block in 1903. In 1905 another part of R. Bell and Co was built by Greeves who opened the Ballybane Tearooms on the site of the old tearooms. 

The Albany Courthouse was designed by architect, George Temple Poole and the builder was C. F Layton. The construction commenced in 1896 with the laying of the foundation stone on 29 December 1896. The building was completed on 7 February 1898.  The rare convolute arch doorways are constructed of local granite in the ‘dry stone’ (faced but not fixed in cement) style by local stonemason, William Trott. Also rare is a large external British coat of arms carved in Sydney freestone. The building also housed the Albany Police Station until c.1970.

​