Comments (3)
I'd like this too. And I'm afraid I will find myself tinkering on this one in the near future. Implementing here would do so much more good for the community and for the projects I'd like to integrate.
The thing is that we would likely need https://github.com/googleapis/nodejs-vertexai.
One issue I can already foresee is that Goggle's Service Account authentication is not supported on Cloudflare Workers (it's where I currently run my very deployment of the gateway and some other software. I tried to get it working but I end up hitting all the corners. Could be a skill issue. However this would work fine if deployed on classic runtime.
We could also use the Rest API using access token but Google's access tokens expire within 60 minutes. So it's unlikely that whose who can generate it will need a gateway (thou not impossible). And those who cannot generate will likely reach a point of frustration.
If anyone who has more experience with Google's SA and edge runtimes could shine, would be great to hear thoughts. I recently discovered that OCR features of Gemini 1.0 Pro Vision are superior to GPT-4V, so let alone what will Gemini 1.5 bring (waiting for access).
from gateway.
Thanks for the note @flexchar !
Gemini has been relatively easy to work with and that is supported within the Gateway. So, if you're looking to use Gemini 1.0 Pro Vision
or even other Gemini models, they work well.
Vertex AI has auth and geo challenges that we're still trying to figure out. Would love if you could take a look or suggest the way forward.
from gateway.
The problem for me, perhaps the most essential point, that I failed to mention, is that the Gemini API (aka, Google AI Studio API) is blocked in EU. So I can only access if I use a VPN to, for example, a city in USA.
Vertex AI, on the other hand, does not impose geo restrictions based on IP address. This is rather mysterious for me as to why...
from gateway.
Related Issues (20)
- 有**的用户吗?我需要请教一些问题。 HOT 2
- [Feat] Anthropic Tool Use
- [Feat] Gemini Function Calling
- [Feature] Google Gemini models function calling - support for "Multi-turn" and support for "Tool choice"
- Fix: map request headers to lower case to avoid key name duplications
- Chore: Add docker organisation secret to docker publish action
- Chore: Remove unused star characters from readme
- [Provider] Kuzco - Free Llama 3 Inference
- Authentication errors should specify if the failure is from portkey's side or the providers
- [Fix] Update node example on readme HOT 1
- Allow stream_options param for openai
- Bug: ZhipuAI authorization header should have Bearer before token
- Pick up usage tokens from anthropic messages stream chunks
- Bug: Use choice index from stream chunk for NovitaAI
- Bug: request config validator fails when only vertex-ai details are sent in a target
- ustomize the code designation
- Locally run
- [Feature] Add support for Pre conditional Request Validation
- Support openai organization and project
- [Provider] Sutra API by Two AI
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gateway.