Troubleshooting OpenEBS - Jiva

Jiva target pod may not be syncing data across all replicas when replica pod logs contains below kind of messages:

Troubleshooting:

Perform following steps to restore the missing metadata file of internal snapshots.

  • Consider the replica that have above kind of error messages in its logs as faulty.

  • Log in to the nodes of healthy and faulty replica and list all the snapshots under /var/openebs/<PV-name>.

    Example snippet of Healthy replica:

    From above snippet of faulty replica, metadata for the snapshot is not present.

  • If only one meta file is missing, then copy meta file name and content from one of the healthy replica to the faulty replica.

    For above case, copy from healthy replica to faulty replica and restart the faulty replica. You can verify the logs of the replica pod to ensure that there are no error messages as mentioned above.

  • If multiple meta files are missing, then delete all files from replica pods and then restart the faulty replica pod to rebuild from healthy replica.