Lanbench ((top)) -

Download LANBench from zachsaw.com and extract it on both machines. The machine receiving the data. Machine B (Client): The machine sending the data. 2. Setting Up the Server Run LANBench.exe on Machine A. Select "Server" mode. Click "Listen" . 3. Running the Client Run LANBench.exe on Machine B. Select "Client" mode. Enter the IP address of Machine A in the "Server IP" field.

is a standalone, lightweight utility designed to benchmark network performance between two computers using the TCP protocol LANBench

You have a 70B parameter model. You can run it quantized to 4-bit (faster, less accurate) or 8-bit (slower, more accurate). Run LANBench with both configurations: Download LANBench from zachsaw