Coder Social home page Coder Social logo

underneathall / pinferencia Goto Github PK

View Code? Open in Web Editor NEW
558.0 41.0 85.0 9.8 MB

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

Home Page: https://pinferencia.underneathall.app

License: Apache License 2.0

Python 96.55% Shell 3.30% Dockerfile 0.15%
ai inference-server predict inference deep-learning modelserver machine-learning python serving model-deployment

pinferencia's People

Contributors

havef avatar oufl avatar wjiuhe avatar yanfeng-li avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

pinferencia's Issues

Video Template

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Pull Request Template

Is your feature request related to a problem? Please describe.
Pull Request Template

Describe the solution you'd like
Provide Pull Request Templates

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

[Docs] Document content disappears

请描述下这个bug

  • 我已经在 issue 里搜索过,没有找到相关 bug

讲一下这个bug的人生吧

环境

  • OS:
  • Python 版本:
  • Pinferencia 版本:
  • 如果你用容器的话,请提供一下镜像(非必填):

复现这个bug

告诉我怎么抓到这个 bug 吧:
1.
2.
3.

你期待中应该是怎样的

描绘下入锅没有这个 bug,世界是怎样的

日志

日志很重要,告诉我这个 bug 让 Pinferencia 爆了那些粗口。

# 日志写在这里吧

还没说完

还有想说的?来吧。

Add backend api tests

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Add Streamlit into pyproject.toml

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Currently it took forever for the poetry to resolve streamlit as a dependency with python version 3.6 and above.

However, we can first add it to the pyproject.toml to facilitate the installation. Like:

pip install pinferencia[streamlit]

to install pinferencia with streamlit.

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Provide Sklearn(Joblib), Pytorch and Tensorflow Handlers

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Provide Sklearn(Joblib), Pytorch and Tensorflow Handlers

Describe the solution you'd like
A clear and concise description of what you want to happen.

Add new handlers

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Shorten Decorator Registration Function Name

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Support JSON Web Token Verification

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Support verification with JSON Web Token.

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Packing

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Pack user's model and codes.

Automatically generate requirements.txt

Automatically generate Dockerfile.

Automatically unpack, install requirements and serve.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

中文readme

哪部分文档你觉得不得劲?

送你一枝花,聊聊你的看法

Improve e2e tests

Describe the bug

  • I have search current issues and no related issues are found.

Should use a new folder to start and test

should use subprocess to start the server

A clear and concise description of what the bug is.

Environment

  • OS:
  • Python Version:
  • Pinferencia Version:
  • If you use it in a container, the Docker Image(Optional):

To Reproduce

Steps to reproduce the behavior:
1.
2.
3.

Expected behavior

A clear and concise description of what you expected to happen.

Logs

If applicable, add logs to help explain your problem.

# logs here

Additional context

Add any other context about the problem here.

Documentation of REST API

Which part of the documentation you'd like to improve

REST API Documentation

Your proposal

Introduce how to use the default api set and kserve api set

In frontend mode, APP should not be a compulsory argument of pinfer

Describe the bug

  • I have search current issues and no related issues are found.

A clear and concise description of what the bug is.

Environment

  • OS:
  • Python Version:
  • Pinferencia Version:
  • If you use it in a container, the Docker Image(Optional):

To Reproduce

Steps to reproduce the behavior:
1.
2.
3.

Expected behavior

A clear and concise description of what you expected to happen.

Logs

If applicable, add logs to help explain your problem.

# logs here

Additional context

Add any other context about the problem here.

Basic API Implementation

Is your feature request related to a problem? Please describe.
Basic API Implementation

Describe the solution you'd like
Support Default v1 and Kserve v2 API

Describe alternatives you've considered
None

Additional context
Add any other context or screenshots about the feature request here.

Github Repo Shows as a CSS Projct

Describe the bug

  • I have search current issues and no related issues are found.

Github Repo Shows as a CSS Projct

A clear and concise description of what the bug is.

Environment

  • OS:
  • Python Version:
  • Pinferencia Version:
  • If you use it in a container, the Docker Image(Optional):

To Reproduce

Steps to reproduce the behavior:
1.
2.
3.

Expected behavior

A clear and concise description of what you expected to happen.

Logs

If applicable, add logs to help explain your problem.

# logs here

Additional context

Add any other context about the problem here.

Static Folder not Found Bug

Describe the bug

  • I have search current issues and no related issues are found.
    image

A clear and concise description of what the bug is.

The static folder is not packed in the wheel.

Environment

  • OS:
  • Python Version:
  • Pinferencia Version:
  • If you use it in a container, the Docker Image(Optional):

To Reproduce

Steps to reproduce the behavior:
1.
2.
3.

Expected behavior

A clear and concise description of what you expected to happen.

Logs

If applicable, add logs to help explain your problem.

# logs here

Additional context

Add any other context about the problem here.

[Design] How Should Metrics Be Exported

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

How to export meaningful metrics when deployed:

[ ] locally
[ ] in the cloud with single instance
[ ] distributed in the cloud with multiple instances

and export:

[ ] what metrics

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Support Model Function Registration With Decorator

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Like flask, use decorator to register a function

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Support Kserve v1 API

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Support Kserve V1 API
Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.