[SkyServe] : API Authentication Options, HTTPS, More Stable Web Server that http serve about skypilot

[concretevitamin]

Thanks for raising this @jithinsarath.

1. SkyServe uses Uvicorn at the moment for the controller / load balancer servers. It has not shown up as bottlenecks as of yet due to the compute-heavy nature of GenAI models. Do you foresee for your use cases this may become a bottleneck?
2. We'd love to get community's help on this! Encrypting the requests/responses will be great to see in SkyServe.
3. Yes, it should be possible. There are two prototypes of this based on Nginx, from @cblmemo:

• #3251 user-side: user simply sets up the auth in YAML; during curl, pass curl --location-trusted .. -H "Authorization: Bearer static_secret_token" ..
• #3250 server-side: changes SkyServe to support nginx auth by default

We'd like to know more about your requirements to figure out the best ways forward :) Happy to follow up here or on Slack.