Intro
What is Rill Flow?
Rill Flow is a high-performance and scalable distribution process programming service that was initially designed to address the complexity of the processes under the microblog video business scenario and the performance problems associated with the implementation of large traffic tasks, so that ease of usage, high and low latency is a core feature of Rill Flow.
At present, Rill Flow has been widely used in Weibo, with a daily processing volume of tens of millions, supporting the core processes of Weibo's multiple businesses such as business orchestration, media processing, and AIGC.
Why Rill Flow?
Rill Flow is designed to solve the orchestration of complex business processes and the execution performance of large-traffic tasks. It is also optimized and adapted for cloud-native architecture and large-scale language model (LLM) applications. It is a solution for complex processes in cloud-native distributed scenarios. An excellent solution for orchestration, large-traffic task execution performance, and rapid integration of AIGC applications.
Organize asynchronous tasks
For some asynchronous processes that take a long time to execute, such as OA approval workflow, graphical arrangement and execution can effectively improve development efficiency and reduce subsequent maintenance costs.Rill Flow supports asynchronization and visualization of asynchronous processes, which can be effectively interfaced.
Parallel processing
When running heavy-duty tasks such as media processing, you may need to shard the task and use multiple servers to work together to reduce task processing latency.Rill Flow provides good support for parallel distribution and can quickly implement task segmentation, parallel processing and merging processes.
LLMs
The development of LLM technology has brought about the rapid development of models. Large models that handle different tasks may contain different runtime dependencies or resource requirements, and different languages and technology stacks may need to be used in the entire process link.Use Rill Flow to better organize and coordinate different large models and related tasks, distribute different tasks to different proprietary models, decouple models and couples, and promote model localization.
Serve with Serverless
Serveress technology can effectively reduce transaction costs and can be deployed on demand by encapsulating logic to an independent `function'.At the same time, due to the atomicity of Serverless, when the business process needs to connect different Serverless, some 'glue code' is needed. Rill Flow can well connect with Serverless functions and realize business requirements quickly and at low cost.
Major Advantage of Rill Flow
- High performance: Supports the execution of tens of millions of tasks per day, with execution latency less than 100ms
- Distributed: Supports orchestration and scheduling of heterogeneous distributed systems
- Ease of use: supports visual process orchestration and plugins
- Cloud Native: Supports cloud native container deployment and cloud native function orchestration
- AIGC: Supports rapid integration of LLMs
Why not Rill Flow?
Orchestrate single-machine low-latency synchronization tasks
Rill Flow is designed as a distributed orchestration framework, which will introduce additional performance losses in a single-machine scenario.If the execution time of a complete process is less than 1 second, the overall benefit of introducing Rill Flow may be reduced.