Inferencing From Azure Hosted Models

[tendau]

I am trying to write a sample app to inference magma using the deployed models in Azure Foundry but running into issues. I can only seem to get simple text generation working does the foundry deployed model support image input at all?

[jwyang]

Hi, @tendau , we still encontered some issues with Azure Foundry inference on our side. It should support image as input, but was some issues in HF TGI causing it not work with image inputs. Working on this. Stay tunned!