Yes, once you let the service know that you want a particular device monitored we will notify you when the device drops off the network (i.e., no longer responds to our ARP request).