Creating unlogged (PostgreSQL) tables in Rails
Create unlogged tables to improve performance especially in test environments in Rails and PostgreSQL
One of the most important aspects of a relational database is durability. The database has to make certain guarantees which add overhead to the database system. But what if you want to give up on the durability aspect and increase the speed instead?
This can be especially be done in test environment where one may not care about the durability aspect and want to run tests faster. PostgreSQL supports multiple settings for non durability which forgo data integrity and can increase the performance. One such thing is unlogged tables.
Data written to unlogged tables is not written to the write-ahead log which makes them considerably faster than ordinary tables. But it comes with a rider. These tables are not crash proof. Whenever there is a crash or unintended shutdown, such tables are truncated.
But they can be used in test environment where we don't really care about the durability aspect. They can also be used for temporary tables which are recreated even if they are wiped out. We can create unlogged tables as follows.
prathamesh@/tmp:prathamesh> create unlogged table users (name varchar, email varchar);
CREATE TABLE
Time: 0.031s
Unlogged tables and Rails
Rails allows creating unlogged tables with PostgreSQL adapter from Rails 6 onwards. We can either create unlogged tables in a migration or we can set a global setting that all tables are created as unlogged.
Creating unlogged table in a migration
Rails provides create_unlogged_table
similar to create_table
which creates an unlogged table.
class CreateUsers < ActiveRecord::Migration[6.0]
def change
create_unlogged_table :users, id: :uuid do |t|
t.text :name
t.text :email
t.timestamps
end
end
end
Creating all tables as unlogged tables
We can set ActiveRecord::ConnectionAdapters::PostgreSQLAdapter.create_unlogged_tables
to true
to create all tables as unlogged. This can be set for test environment as follows.
# config/environments/test.rb
config.to_prepare do
ActiveSupport.on_load(:active_record) do
ActiveRecord::ConnectionAdapters::PostgreSQLAdapter.create_unlogged_tables = true
end
end
That's it. All tables created in test environment are by default unlogged.
This setting is set to false by default in all environments.
Does this actually show any improvements?
Our test suite in a Rails API app has seen improvement in execution time after this change. The database setup step was earlier taking 15 seconds, now it takes 7 seconds. Total tests execution used to take 45 seconds, now it takes 41 seconds.
Caution!
Unlogged tables are not crash proof and should not be used in production environment unless durability is not a concern. Don't use them blindly.
Interested in knowing more about Rails and PostgreSQL, subscribe to my newsletter.