Without agent server can check server presence on the network using ICMP ping or using SNMP (if available).
If that's sufficient (e.g. you don't need CPU or memory metrics from these servers) — you do not need to install agent.
If that's sufficient (e.g. you don't need CPU or memory metrics from these servers) — you do not need to install agent.