It looks as though your biggest problem will be because National BMD
Records only go back to 1837. However, it appears that, initially at least, you are trying to find the birth place of Joseph and Mary. Can we have some more clues?
What are the "different places" given?
In which census records have you found Joseph?
What year was their first child born?