Architecture
*thinking 🤔 * we will have a projectors that will store things initially in Redis and we will put a limitation on the size of Redis to X, and once it reaches close to this we will spill these cached projections to a mongoldb or postgres cache which is indexed on the key, and the stay alive of these projections is 4 hour we will have a cron job running every four hour to delete (prune) these old projections
The initial idea right now is process manager will be written using MediatR+Domain events. Each state will only be able to move to the next step. We will implement using retry logic using polly.net.
Beyond this process manager will be easily able to scale up without having too much load up time.