In the old town center of Brežice, at today's address of Brežice, Kržičnikova 2, a primary school with two classes was built in 1824. The owner and builder of the elementary school was the parish of Saint Lawrence, and at the time of construction, the parish priest was Ignacij Fuks. The school had a ground floor and was made of stone.

In 1881, the ground floor school, which had only two classes, was expanded. The primary school was expanded with burnt bricks on the ground floor for two classrooms and an additional four classrooms were added on the first floor. The elementary school had eight classrooms with the extension, so that in the same year, 1881, an eight-year-old school was introduced. The owner and builder of the building was the Parish of Brežice.

After the Second World War, the primary school building was nationalized in 1949 and remained in state ownership until 2004. The Old Primary School was housed in the building until the school year 1971/1972, when classes ceased due to the construction of a new primary school. Until 1981, classes for children with special needs took place in the building, but after that year the building was empty and by 2004 it was rapidly deteriorating.

In 2004, after denationalization, the building was returned to the ownership of the Brežice Municipality with an exchange contract with the Municipality of Brežice. In 2009, the denationalization process for the return of the functional courtyard to the building owned by the parish was completed.

As early as 2004, protective maintenance work begins, as the building is under the protection of cultural heritage as a cultural monument, to stop the deterioration of the building. In 2010, a construction project was drawn up for the renovation of the building and a building permit was obtained. The renovation of the building under the new name Slomškov dom took place from 2010 to 2016. Thus, the Slomškov dom building also obtained a use permit in 2016.

The renovation of the building took place in stages, so that the interior of the ground floor part of the building and the entire external facade including the roof were renovated. An old bourgeois building in the very center of Brežice has been preserved, and with its beauty and decorations on the facade, it gives this part of the city a touch of the ancient patina of the old city centres.

Under the current name Slomškov dom, the ground floor part of the building houses the Caritas premises, a religious classroom, a hall for lectures and exhibitions, a winter chapel of the Holy Cross, sanitary facilities, and a boiler room. In the renovated premises, Caritas works smoothly, religious classes take place and, in the wintertime, Holy Mass, and the hall for lectures and exhibitions hosts a wide variety of cultural events intended for all citizens.