Storage Exception due to power failure

[JustinVoitel]

Environment Details

• EclipseStore Version: 2.1.3
• JDK version: 17
• OS: Linux SUSE
• Used frameworks: Spring, Vaadin

Describe the Issue

Due to a large Power Failure in our city one of our Java application (docker tomcat container) which uses eclipse store did not shutdown properly...

Now after booting up we get the following error on startup:

org.eclipse.store.storage.exceptions.StorageException: Non-deleted non-empty data file not found: channel 0, file 91283
        at org.eclipse.store.storage.types.StorageFileManager$Default.validateStorageDataFilesLength(StorageFileManager.java:841) ~[storage-2.1.3.jar:?]
        at org.eclipse.store.storage.types.StorageFileManager$Default.initializeStorage(StorageFileManager.java:884) ~[storage-2.1.3.jar:?]
        at org.eclipse.store.storage.types.StorageChannel$Default.initializeStorage(StorageChannel.java:782) ~[storage-2.1.3.jar:?]
        at org.eclipse.store.storage.types.StorageChannelTaskInitialize$Default.succeed(StorageChannelTaskInitialize.java:200) ~[storage-2.1.3.jar:?]
        at org.eclipse.store.storage.types.StorageChannelTaskInitialize$Default.succeed(StorageChannelTaskInitialize.java:34) ~[storage-2.1.3.jar:?]
        at org.eclipse.store.storage.types.StorageChannelSynchronizingTask$AbstractCompletingTask.synchronizedComplete(StorageChannelSynchronizingTask.java:78) [storage-2.1.3.jar:?]
        at org.eclipse.store.storage.types.StorageChannelSynchronizingTask$AbstractCompletingTask.complete(StorageChannelSynchronizingTask.java:126) [storage-2.1.3.jar:?]
        at org.eclipse.store.storage.types.StorageChannelTask$Abstract.processBy(StorageChannelTask.java:260) [storage-2.1.3.jar:?]
        at org.eclipse.store.storage.types.StorageChannel$Default.work(StorageChannel.java:453) [storage-2.1.3.jar:?]
        at org.eclipse.store.storage.types.StorageChannel$Default.run(StorageChannel.java:536) [storage-2.1.3.jar:?]
        at java.base/java.lang.Thread.run(Thread.java:840) [?:?]

Is there a way to fix the Database or is it forever lost ? Are there practices to prevent such errors for the future ?

[hg-ms]

The exception gets thrown because there is an entry in the transaction log of channel 0 for a file with number 91283 that is not empty and has no related deletion entry in the transaction log but is not found among the channel files. This is most likely caused by an incomplete I/O operation due to the power failure.
As the storage never overwrites data in the files there is a chance to rescue the storage even if there is no backup.
As files usually don’t vanish I’d assume that the storage deleted the missing file during housekeeping, but the file deletion log entry was not written to the log file.
In that case you just may try to delete all transaction log files of all channels and try to start the storage. Please don’t try this without having a Backup of the whole Storage!

Alternatively, you can analyze the transaction log in detail. To do so you can convert it to human readable text using the Transaction log converter. With maven use the profile Ptransaction-file-converter to build it:

 mvn -Ptransaction-file-converter clean package

[fschoning]

Isn't it a bit worrying that this can happen at all? Especially as there is no auto recover! This means that when a server crashes or reboots after a power failure the app may not be able to start and it may require days of analysis to get the server back up again! This can kill a business. Kind regards, Franz Schöning

…

On Fri, Sep 12, 2025 at 10:15 AM hg-ms ***@***.***> wrote: *hg-ms* left a comment (eclipse-store/store#459) <#459 (comment)> The exception gets thrown because there is an entry in the transaction log of channel 0 for a file with number 91283 that is not empty and has no related deletion entry in the transaction log but is not found among the channel files. This is most likely caused by an incomplete I/O operation due to the power failure. As the storage never overwrites data in the files there is a chance to rescue the storage even if there is no backup. As files usually don’t vanish I’d assume that the storage deleted the missing file during housekeeping, but the file deletion log entry was not written to the log file. In that case you just may try to delete all transaction log files of all channels and try to start the storage. Please don’t try this without having a Backup of the whole Storage! Alternatively, you can analyze the transaction log in detail. To do so you can convert it to human readable text using the Transaction log converter <https://github.com/eclipse-store/store/blob/bed43de0fbd631506f1b853d016ac74e2ce2459b/storage/storage/src/main/java/org/eclipse/store/storage/util/MainUtilTransactionFileConverter.java>. With maven use the profile Ptransaction-file-converter to build it: mvn -Ptransaction-file-converter clean package — Reply to this email directly, view it on GitHub <#459 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AVCVNIBX2G4NPS6TLKJQ3CD3SJ6L5AVCNFSM6AAAAACGGVQU3SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTEOBUGI2DENZXGY> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>