Skip to content

Issues: InftyAI/llmaz

Milestone v0.2.0
#259 opened Jan 27, 2025 by kerthcet
Open 3
Milestone v0.3.0
#433 opened Jun 2, 2025 by kerthcet
Open
Benchmark toolkit support
#66 opened Aug 6, 2024 by kerthcet
Open 5
Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

38 Open 107 Closed
38 Open 107 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add fields ownedBy and createdAt for OpenModel feature Categorizes issue or PR as related to a new feature. good first issue Good for newcomers needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#435 opened Jun 2, 2025 by kerthcet
1 of 3 tasks
1
@googs1025
5
Milestone v0.3.0 feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#433 opened Jun 2, 2025 by kerthcet
9 tasks
Enable envoy token rate limiting by configuration feature Categorizes issue or PR as related to a new feature. help wanted Extra attention is needed needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#412 opened May 14, 2025 by kerthcet
1 of 3 tasks
@googs1025
6
Add T/$ as indicator to measure the cost efficiency feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#401 opened May 6, 2025 by kerthcet
3 tasks
Manage the ai gateway resources automatically feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#387 opened Apr 30, 2025 by kerthcet
3 tasks done
1
open-webui support namespaces feature Categorizes issue or PR as related to a new feature. help wanted Extra attention is needed needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#386 opened Apr 29, 2025 by kerthcet
3 tasks
1
[Umbrella] advanced traffic load balancing algorithms feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#376 opened Apr 24, 2025 by kerthcet
2 of 7 tasks
[Umbrella] inference engine metrics installation feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#375 opened Apr 24, 2025 by kerthcet
1 of 7 tasks
v0.2.0
@kerthcet
2
Envoy gateway plugin support with random selection feature Categorizes issue or PR as related to a new feature. needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#371 opened Apr 23, 2025 by kerthcet
3 tasks done
@googs1025
11
[OSPP] KEDA-based Serverless Elastic Scaling for llmaz feature Categorizes issue or PR as related to a new feature. needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#362 opened Apr 22, 2025 by pacoxu
3 tasks
3
[OSPP]Enabling Efficient Model and Container Image Distribution in LLMaz with Dragonfly feature Categorizes issue or PR as related to a new feature. needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#361 opened Apr 22, 2025 by pacoxu
3 tasks
Support runai model streamer for fast model loading feature Categorizes issue or PR as related to a new feature. needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#352 opened Apr 18, 2025 by kerthcet
1 of 3 tasks
v0.2.0
1
@cr7258
5
feature: Integrate upstream crd verification feature Categorizes issue or PR as related to a new feature. important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. needs-kind Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#351 opened Apr 18, 2025 by googs1025
3 tasks
@googs1025
3
Can this initcontainer image be configurable? needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#350 opened Apr 17, 2025 by pacoxu
7
after backend runtime update, should we re-create the playground pod? bug Categorizes issue or PR as related to a bug. needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#332 opened Mar 26, 2025 by pacoxu
3
Lora Autoscaler feature Categorizes issue or PR as related to a new feature. needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#287 opened Feb 28, 2025 by kerthcet
3 tasks done
v0.3.0
@kerthcet
3
Add popular open source models as in-tree support cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#268 opened Feb 14, 2025 by kerthcet
3 tasks
v0.3.0
9
Introduce inference reserve config for standby instance important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. needs-kind Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#265 opened Feb 8, 2025 by kerthcet
3 tasks done
v0.3.0
11
Milestone v0.2.0 needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#259 opened Jan 27, 2025 by kerthcet
2 tasks
3
vllm only has /health endpoint needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#241 opened Jan 17, 2025 by kerthcet
3 tasks
2
Able to set the toRender parameters dynamically needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#239 opened Jan 16, 2025 by kerthcet
1 of 3 tasks
2
Unify the chat api for all inference servers feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#218 opened Dec 10, 2024 by kerthcet
3 tasks
2
Serverless support needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#192 opened Oct 29, 2024 by kerthcet
3 tasks done
v0.3.0
3
Support to serving Stable Diffusion models needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#189 opened Oct 23, 2024 by kerthcet
1 of 3 tasks
[Umbrella] Improve test coverages cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. good first issue Good for newcomers needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#156 opened Sep 12, 2024 by kerthcet
@X1aoZEOuO
6
ProTip! Mix and match filters to narrow down what you’re looking for.