Verifying GROUP_CONCAT limit without using variables

I have a case where I must know if group_concat_max_len is at its default value (1024), which means there are some operation I cannot work out. I’ve ranted on this here.

Normally, I would simply:

SELECT @@group_concat_max_len

However, I am using views, where session variables are not allowed. Using a stored function can do the trick, but I wanted to avoid stored routines. So here’s a very simple test case: is the current group_concat_max_len long enough or not? I’ll present the long version and the short version.

The long version

SELECT
  CHAR_LENGTH(
    GROUP_CONCAT(
      COLLATION_NAME SEPARATOR ''
    )
  )
FROM
  INFORMATION_SCHEMA.COLLATIONS;

If the result is 1024, we are in a bad shape. I happen to know that the total length of collation names is above 1800, and so it is trimmed down. Another variance of the above query would be:

SELECT
  CHAR_LENGTH(
    GROUP_CONCAT(
      COLLATION_NAME SEPARATOR ''
    )
  ) = SUM(CHAR_LENGTH(COLLATION_NAME))
    AS group_concat_max_len_is_long_enough
FROM
  INFORMATION_SCHEMA.COLLATIONS;

+-------------------------------------+
| group_concat_max_len_is_long_enough |
+-------------------------------------+
|                                   0 |
+-------------------------------------+

The COLLATIONS, CHARACTER_SETS or COLLATION_CHARACTER_SET_APPLICABILITY tables provide with known to exist variables (assuming you did not compile MySQL with particular charsets). It’s possible to CONCAT, UNION or JOIN columns and tables to detect longer than 1800 characters in group_concat_max_len. I admit this is becoming ugly, so let’s move on.

The short version

Don’t want to rely on existing tables? Not sure what values to expect? Look at this:

SELECT CHAR_LENGTH(GROUP_CONCAT(REPEAT('0', 1025))) FROM DUAL

GROUP_CONCAT doesn’t really care about the number of rows. In the above example, I’m using a single row (retrieved from the DUAL virtual table), making sure it is long enough. Type in any number in place of 1025, and you have a metric for your group_concat_max_len.

SELECT
  CHAR_LENGTH(GROUP_CONCAT(REPEAT('0', 32768))) >= 32768 As group_concat_max_len_is_long_enough
FROM
  DUAL;
+-------------------------------------+
| group_concat_max_len_is_long_enough |
+-------------------------------------+
|                                   0 |
+-------------------------------------+

The above makes a computation with REPEAT. One can replace this with a big constant.

11 thoughts on “Verifying GROUP_CONCAT limit without using variables

  1. @Sheeri,
    I figured you might have figured it ;), but there’s more to it.
    The mycheckpoint monitoring tool works in a special way. The whole point of the tool is to create a sophisticated (if I may say so) views hierarchy; such that for getting monitored data (reports, charts, full blown HTML pages) — you don’t actually use the tool; you just query for the data, e.g.
    SELECT html FROM sv_report_html_brief;
    or
    SELECT report FROM sv_report_human_sample;

    So – no tool here. Nowhere to set the session variable. I hastily dropped in the openark-kit. You are correct: I do not have this issue there.

  2. It is kind of (well especially, perhaps) evil, but you could create a stored function that sets the session variables. Then instruct users to select from a view that invokes that SP before they select from any other views.

    DELIMITER ;;
    DROP FUNCTION IF EXISTS test.set_gc_len;;

    CREATE FUNCTION test.set_gc_len (
    )
    RETURNS TINYTEXT
    NO SQL
    BEGIN
    SET SESSION group_concat_max_len=65535;
    RETURN ”;
    END
    ;;

    DELIMITER ;

    CREATE VIEW `test`.`z1` AS select group_concat(`test`.`set_gc_len`() separator ‘,’) AS `group_concat(test.set_gc_len())`,(char_length(group_concat(repeat(‘0’,32768) separator ‘,’)) >= 32768) AS `group_concat_max_len_is_long_enough`;

    — this first call to the view increases the max GC len
    mysql> select * from test.z1\G
    *************************** 1. row ***************************
    group_concat(test.set_gc_len()):
    group_concat_max_len_is_long_enough: 0
    1 row in set, 1 warning (0.00 sec)

    mysql> select * from test.z1\G
    *************************** 1. row ***************************
    group_concat(test.set_gc_len()):
    group_concat_max_len_is_long_enough: 1
    1 row in set (0.01 sec)

  3. Oh, and you don’t have to call it in group_concat, it can just be a select from dual.. I was just trying to trick MySQL into somehow evaluating the session var change in the same SQL statement, but that doesn’t work.

  4. @Justin,

    Yes, I was referring to this type of solution on “…Using a stored function can do the trick…”.

    It *is* somewhat evil 🙂

Leave a Reply

Your email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.