fix(llm): enable tasks concurrency configs in Gradio (#188)

fix #176 

Blocking and Queuing Behavior: Gradio, by default, has a concurrency
limit of 1. This causes blocking when multiple users or windows are
accessing the application simultaneously.

No Asynchronous Execution: The current implementation does not specify
concurrency_limit, leading to sequential execution.

Queue Configuration: If queue() is not configured properly, tasks are
processed one at a time.

---------

Co-authored-by: imbajin <jin@apache.org>
4 files changed
tree: 4d49acb0aefb94de94e9ee1e023d3c515067539c
  1. .github/
  2. docker/
  3. hugegraph-llm/
  4. hugegraph-ml/
  5. hugegraph-python-client/
  6. scripts/
  7. style/
  8. .asf.yaml
  9. .gitattributes
  10. .gitignore
  11. .licenserc.yaml
  12. DISCLAIMER
  13. LICENSE
  14. NOTICE
  15. README.md
README.md

hugegraph-ai

License

hugegraph-ai aims to explore the integration of HugeGraph with artificial intelligence (AI) and provide comprehensive support for developers to leverage HugeGraph's AI capabilities in their projects.

Modules

  • hugegraph-llm: The hugegraph-llm will house the implementation and research related to large language models. It will include runnable demos and can also be used as a third-party library, reducing the cost of using graph systems and the complexity of building knowledge graphs. Graph systems can help large models address challenges like timeliness and hallucination, while large models can help graph systems with cost-related issues. Therefore, this module will explore more applications and integration solutions for graph systems and large language models. (GraphRAG/Agent)
  • hugegraph-ml: The hugegraph-ml will focus on integrating HugeGraph with graph machine learning, graph neural networks, and graph embeddings libraries. It will build an efficient and versatile intermediate layer to seamlessly connect with third-party graph-related ML frameworks.
  • hugegraph-python-client: The hugegraph-python-client is a Python client for HugeGraph. It is used to define graph structures and perform CRUD operations on graph data. Both the hugegraph-llm and hugegraph-ml modules will depend on this foundational library.

Learn More

The project homepage contains more information about hugegraph-ai.

And here are links of other repositories:

  1. hugegraph (graph's core component - Graph server + PD + Store)
  2. hugegraph-toolchain (graph tools loader/dashboard/tool/client)
  3. hugegraph-computer (integrated graph computing system)
  4. hugegraph-website (doc & website code)

Contributing

  • Welcome to contribute to HugeGraph, please see Guidelines for more information.
  • Note: It's recommended to use GitHub Desktop to greatly simplify the PR and commit process.
  • Code format: Please run ./style/code_format_and_analysis.sh to format your code before submitting a PR. (Use pylint to check code style)
  • Thank you to all the people who already contributed to HugeGraph!

contributors graph

License

hugegraph-ai is licensed under Apache 2.0 License.

Contact Us