The Rajbari Palace used to be the residence of Raikats who were the rulers of Baikunthapur estate. It is a beautiful palace with remarkable architecture. The place has two temples, gardens, a palace building, and a portico. The palace garden has a Dighi and beautiful pond. The concrete gateway of the Palace is world-famous for being one of the largest un-reinforced concrete archway in the world.