Troubleshooting#

Installation and Verification#

If you encounter issues with installing and configuring prerequisites, follow these steps:

  1. Ensure the NVIDIA Container Toolkit is properly installed and configured.

  2. Verify that your GPU drivers are compatible with the CUDA version.

  3. Check that your user has the necessary permissions to run Docker commands.

  4. Consult the Configuring a NIM section for additional configuration options.

Running NIMs#

If you encounter issues running NIM for Cosmos, follow these steps:

  1. Check that your hardware meets the Prerequisites.

  2. Verify the NIM container is running properly with docker ps.

  3. Ensure your request parameters are within supported ranges.

  4. Check server logs for detailed error messages.

Metrics Collection#

If you encounter issues with metrics collection or visualization, follow these steps:

  1. Ensure the NIM container is running and accessible at the expected address.

  2. Verify that Prometheus can reach the NIM metrics endpoint.

  3. Check Prometheus logs for any scraping errors.

  4. Confirm that the metrics are available by directly accessing the metrics endpoint