313 sats \ 3 replies \ @nullcount 29 Sep 2023 \ parent \ on: Mutiny Blog Our Data Driven Approach to Fixing Payment Reliability bitcoin
We're interested in combining probing data with gossip data to create a reinforcement learning
My hunch is RL on a dynamic graph won't perform well. Have you defined a problem statement for training the agent?
write
preview
312 sats \ 1 reply \ @anon 30 Sep 2023
A dynamic graph is precisely why you would use a learning agent
reply
0 sats \ 0 replies \ @nullcount 30 Sep 2023
The dynamic graph of LN probes and gossip data has many temporal dependencies. I.e. past actions affect the topology of the graph. It is challenging to account for these temporal patterns in the problem statement of the RL agent.
reply
203 sats \ 0 replies \ @TonyGiorgio 29 Sep 2023
We haven't done any work on it yet. If it were strictly based on probing data, I don't think it would work because the graph is dynamic. But there might be something in there by feeding in the dynamic parts via the historical gossip we are saving, combined with the probing data. Even the gossip alone might help identify trends and changes in liquidity / fees across the network.
reply