AI Development FAQ

Q1: How to deploy a large model service?

A: You can use AidGenSE . AidGenSE is a generative AI HTTP service adapted to the OpenAI HTTP protocol, wrapped based on the AidGen SDK. You can call generative AI over HTTP and quickly integrate it into your own applications. Alternatively, you can visit Model Farm and download model files for direct deployment.

Q2: How to verify that QNN is called correctly?

A: Run the download command, for example, to download AidLite-QNN231:

sudo aid-pkg install aidlite-qnn231

Open the folder:

cd /usr/local/share/aidlite/examples/aidlite_qnn231/python

Run the command to see whether it works properly:

python qnn_yolov5_multi.py 3

The output below indicates that QNN is correctly used:

# 4 regions detected
1 [115, 236, 203, 538] 0.84474266 person
2 [212, 244, 282, 514] 0.7853776 person
3 [86, 125, 559, 479] 0.5933 bus
4 [474, 228, 561, 517] 0.5707566 person

Note

If the above issues cannot be resolved, please contact APLUX technical support at noah.yang@aidlux.com