Yes, you can do it at the consulate in Edinburgh and it is a pretty straightforward process.
At the end of the process you end up with the certificate for registered birth abroad, their passport and their social security card (these get sent via post, you don't get them on the day).
Brit birth certificate forms will be given to you by the midwives, and Brit passport can be obtained with the Brit birth certificate and a few other things.