The law requires textured paint/plasters/finishes only to be removed by a licensed contractor when these coatings contain asbestos. Asbestos was in these finishes until the end of the 1980s. Tackling a job yourself (without getting a test to see whether it contains asbestos - labs in "yellow pages") will leave you risking you/your family's health and also leave residual contamination in your home. Seek advice from you local council. If you have already taken the texture off, a simple test can establish whether it contained asbestos and contaminated your home. Again "yellow pages". Cleaning the mess with a domestic vacuum cleaner would have spread the contamination throughout your home and still be doing it! Get the situation checked - and if it is bad news, you will also want to talk to your doctor. Sorry to be a bringer of bad news.