The castle appears on the 1837 Ordnance Survey six-inch map and was still recorded on the revised 1910 OS 25-inch map, showing a structure measuring approximately 16 metres northwest to southeast and 21 metres northeast to southwest, with a notably straight northeastern wall. According to local information gathered in July 1977, the castle remains were removed more than twenty years prior to that date, leaving behind only the earthwork foundations that can still be spotted on modern aerial photography.

The castle’s history stretches back to at least 1640, when it stood on lands belonging to Rosse Geoghegan, who was described in contemporary records as an ‘Irish Papist’. Interestingly, the structure doesn’t appear on the 1655 Down Survey parish map of Rahugh, possibly indicating it had already fallen into disuse or been deliberately omitted from that particular survey. The Down Survey, commissioned by Oliver Cromwell to map lands confiscated from Catholic landowners, often reflected the turbulent political and religious upheavals of the period.

Today, visitors to the site will find little more than undulating grassy mounds where Kiltober Castle once stood, a subtle reminder of the defensive structures that dotted the Irish countryside for centuries. The earthworks, whilst modest, offer a tangible connection to the Geoghegan family and the broader story of Gaelic and Old English families who built these tower houses and castles throughout the Irish midlands during the medieval and early modern periods.