Even small GPUs to speed up inference on local encoders would go a long way

I would use this

Having GPU instances would be very helpful to serve NN models and inferences to our customers.

2024, +1 GPU workload support for NLP pipelines on Render.

2024, waiting for this

Agree this is helpful for any LLM apps because otherwise if you want to use prompt compression then you have to pass it outside of render and then back

Would also love GPU instances and avoid having to go to AWS directly, as we host other services on Render.

Would really love this. My specific need is hosting a pre-existing model for inference workload. I know going to AWS directly is always an option but since I'm hosting my other services here, having my GPU service here would be very convenient.

We develop Generative AI applications and it would be very helpful to have GPU instances on Render. We would prefer to stay with Render, but if we can't access the necessary resources we may be forced to find another provider that meets our requirements.

Would significantly simplify our app development