The mill was probably built in the 18th century or in the early 19th century when the surrounding rock was used for the construction and the mill was partially cut into it. Part of the mill rooms were carved into the sandstone rock and the rest of the building was probably built from stone and wood. Millers used water from Vesecký Brook to drive the mill wheel. Water was driven into a pond specially made for this reason above the mill and when the water was released, the mill wheel started to spin. The existence of Skalní mlýn is documented by an imperial imprint of a cadastral map from 1842. The mill ceased to be used in the 19th century and then it started to become dilapidated. It most likely did not survive the early 1950s and the masonry was probably used for some construction in the area.

Not much has been preserved to date. The remains of the mill include only what was cut into the rock – the mill room and the space for the water wheel. These two areas are separated by a rock wall and a staircase.