Are you saying that everyone has left the conference (meaning conference participants = 0), but the conference itself is still active?
Or do you mean you want the conference to end when only a single user remains? If this is the case see this thread for more details on ways to do that.