Documentation

Define custom partitions

Use the Admin UI, the influxctl CLI, or the Management HTTP API to define custom partition strategies when creating a database or table. By default, InfluxDB Clustered partitions data by day.

The partitioning strategy of a database or table is determined by a partition template which defines the naming pattern for partition keys. Partition keys uniquely identify each partition. When a partition template is applied to a database, it becomes the default template for all tables in that database, but can be overridden when creating a table.

Create a database with a custom partition template

The following examples show how to create a new example-db database and apply a partition template that partitions by distinct values of two tags (room and sensor-type), bucketed values of the customerID tag, and by day using the time format %Y-%m-%d:

influxctl database create \
  --template-tag room \
  --template-tag sensor-type \
  --template-tag-bucket customerID,500 \
  --template-timeformat '%Y-%m-%d' \
  example-db

The following command flags identify partition template parts:

  • --template-timeformat: A Rust strftime date and time string that specifies the time part in the partition template and determines the time interval to partition by. Use one of the following:

    • %Y-%m-%d (daily)
    • %Y-%m (monthly)
    • %Y (annually)
  • --template-tag: An InfluxDB tag to use in the partition template.

  • --template-tag-bucket: An InfluxDB tag and number of “buckets” to group tag values into. Provide the tag key and the number of buckets to bucket tag values into separated by a comma: tagKey,N.

curl \
  --location "https://console.influxdata.com/api/v0/accounts/
ACCOUNT_ID
/clusters/
CLUSTER_ID
/databases"
\
--header "Authorization: Bearer
MANAGEMENT_TOKEN
"
\
--json '{ "name": "example-db", "maxTables": 500, "maxColumnsPerTable": 250, "retentionPeriod": 2592000000000, "partitionTemplate": [ { "type": "tag", "value": "room" }, { "type": "tag", "value": "sensor-type" }, { "type": "bucket", "value": { "tagName": "customerID", "numberOfBuckets": 500 } }, { "type": "time", "value": "%Y-%m-%d" } ] }'

Replace the following in your request:

The partitionTemplate property in the request body is an array of JSON objects that identify the partition template parts.

Create a table with a custom partition template

The following example creates a new example-table table in the example-db database and applies a partition template that partitions by distinct values of two tags (room and sensor-type), bucketed values of the customerID tag, and by month using the time format %Y-%m:

The InfluxDB Clustered Admin UI lets you apply a custom partition template when creating a table.

  1. To access the InfluxDB Clustered Admin UI, visit the following URL in your browser:

    https://console.influxdata.com
    
  2. In the cluster list, click the cluster you want to manage.

  3. Create the example-db database or click the row of an existing database.

  4. Click the New Table button above the table list.

In the Create Table dialog:

  1. Set Table name to example-table.
  2. If the Use default partitioning toggle is on, turn it off to enable custom partitioning.
  3. Under Custom partition template time format, set the time format to %Y-%m.
  4. Under Custom partition template parts:
  5. In the Partition template part type dropdown, click Tag, set Tag name to room.
  6. Click Add Tag.
  7. In the Partition template part type dropdown, click Tag, set Tag name to sensor-type.
  8. Click Add Tag.
  9. In the Partition template part type dropdown, click Bucket, set Tag name to customerID and Buckets to 500.
  10. Click Create Table to apply the template.
Create table dialog with custom partitioning example values
influxctl table create \
  --template-tag room \
  --template-tag sensor-type \
  --template-tag-bucket customerID,500 \
  --template-timeformat '%Y-%m' \
  example-db \
  example-table
curl \
  --location "https://console.influxdata.com/api/v0/accounts/
ACCOUNT_ID
/clusters/
CLUSTER_ID
/databases/example-db/tables"
\
--request POST \ --header "Authorization: Bearer
MANAGEMENT_TOKEN
"
\
--json '{ "name": "example-table", "partitionTemplate": [ { "type": "tag", "value": "room" }, { "type": "tag", "value": "sensor-type" }, { "type": "bucket", "value": { "tagName": "customerID", "numberOfBuckets": 500 } }, { "type": "time", "value": "%Y-%m" } ] }'

Replace the following in your request:

Partition template requirements and guidelines

Always specify 1 time part in your template. A template has a maximum of 8 parts: 1 time part and up to 7 total tag and tag bucket parts.

For more information about partition template requirements and restrictions, see Partition templates.

Partition templates can only be applied on create

You can only apply a partition template when creating a database. You can’t update a partition template on an existing database.

Example partition templates

Given the following line protocol with a 2024-01-01T00:00:00Z timestamp:

prod,line=A,station=weld1 temp=81.9,qty=36i 1704067200000000000

The following tables show how the partition key is generated based on the partition template parts you provide.

Partitioning by distinct tag values
DescriptionTag partsTime partResulting partition key
By day (default)%Y-%m-%d2024-01-01
By month%Y-%m2024-01
By year%Y2024
Single tag, by dayline%Y-%m-%dA | 2024-01-01
Single tag, by monthline%Y-%mA | 2024-01
Single tag, by yearline%YA | 2024
Multiple tags, by dayline, station%Y-%m-%dA | weld1 | 2024-01-01
Multiple tags, by monthline, station%Y-%mA | weld1 | 2024-01
Multiple tags, by yearline, station%YA | weld1 | 2024
Partition by tag buckets
DescriptionTag partTag bucket partTime partResulting partition key
Distinct tag, tag buckets, by daylinestation,100%Y-%m-%dA | 3 | 2024-01-01
Distinct tag, tag buckets, by monthlinestation,500%Y-%mA | 303 | 2024-01

Was this page helpful?

Thank you for your feedback!


The future of Flux

Flux is going into maintenance mode. You can continue using it as you currently are without any changes to your code.

Read more

Now Generally Available

InfluxDB 3 Core and Enterprise

Start fast. Scale faster.

Get the Updates

InfluxDB 3 Core is an open source, high-speed, recent-data engine that collects and processes data in real-time and persists it to local disk or object storage. InfluxDB 3 Enterprise builds on Core’s foundation, adding high availability, read replicas, enhanced security, and data compaction for faster queries and optimized storage. A free tier of InfluxDB 3 Enterprise is available for non-commercial at-home or hobbyist use.

For more information, check out: