I always avoided Operation-based synchronization because 1 wrong step could have totally unpredictable consequences for data or systems that might only become visible when it was way too late to do something about it.
Got to that conclusion very early on in my career seeing how people memorized procedures and then occasionally started executing them blindly in the wrong menu or on the wrong system.
The checking systems required to make sure everything was duly processed were often more complex ( or downright too complex ) than setting a basic state-based synchronization which of course could not capture how things had changed or why. Hence lots of time spent puzzling with outdated log-files and unexplainable state-changes but given the possibilities we managed.
Looking around now I often wind up wondering how to use stuff in ways it might not have been originally built tor but could have added value.
With the concept of a block-chain type mechanism in the middle between synchronizing systems as a recorder with programmable abilities one could not only guarantee delivery but even have a rewind and repeat function too, Or build sequencing and control of execution plus correctness into the block-chain contracts ( The contracts could be dynamically created like generating sql )
I’d love to get that into simulation scenarios. Like having a chain of events ( not limited to sql statements but any type action ) being locally recorded and stored - and here is the twist - why not try to add their ‘undo’ counterparts - so any simulation or test system can scroll backward and forward to replay from any desired point of the status and take another route from there. That in it’s turn would be recorded …
No doubt it already exists for specific systems but in my environment definitely not as a generalized concept, In this environment ( classic DB&SQL etc… in industrial settings ) something like that would have been very valuable to prevent mistakes and errors to be made over and over again.
Most of the managers I came across in my career don’t even have a full grasp on what a simulation is let alone what it can do so … I’ll need to play around with this in my own time.
Question: What do you think is a good tool/language to work with big multidimensional arrays of mainly numeric and ascii based data really fast ( for simulations ) ? I Came across Rasdaman but that is mainly for image processing as far as I can see.