Is it possible to import books using CSV or XML files?

Plugin does not have a built-in import functionality. This is because there are plenty of plugins with this ability. WooCommerce Bookstore is fully compatible with WP All Import plugin and you can setup a job to import Books in WooCommerce either using CSV or XML files.