1. What type of service and which ISP and what are the connection speeds.
2. Can you confirm that during the night time period when most people sleep that there is nothing switched on and using the connection in the home?
e.g. if this is just an ADSL2+ service then something doing regular uploading may cause the problem and gets much worse during the peak time evening period when you are using the connection yourself.