Comments on: Converting an OLAP database to TokuDB, part 3: operational stuff https://shlomi-noach.github.io/blog/mysql/converting-an-olap-database-to-tokudb-part-3-operational-stuff Blog by Shlomi Noach Mon, 28 Jul 2014 19:57:36 +0000 hourly 1 https://wordpress.org/?v=5.3.3 By: shlomi https://shlomi-noach.github.io/blog/mysql/converting-an-olap-database-to-tokudb-part-3-operational-stuff/comment-page-1#comment-256081 Mon, 28 Jul 2014 19:57:36 +0000 https://shlomi-noach.github.io/blog/?p=6603#comment-256081 Hi Matt,

As you say, it’s in production; we’re running a mixed topology of TokuDB and InnoDB. We keep those InnoDB servers to be on the safe side.
We have two standing bugs, both relate to locking. In one bug we get frequent “lock wait timeout” upon concurrent writes to same table (even though for different areas). On another bug we get mysterious slowness on LOAD DATA INFILE, inconsistent — just caught one today, and it relates to locks as well.

I should mention we’re still doing YEARly partitioning even though we would really like to do DAYly or MONTHly — due to open files issue mentioned in previous part.

Other than the above we’re good. I haven’t tested OLTP load, just OLAP (low write concurrency, infrequent big reads)

]]> By: Matt Lord https://shlomi-noach.github.io/blog/mysql/converting-an-olap-database-to-tokudb-part-3-operational-stuff/comment-page-1#comment-256072 Mon, 28 Jul 2014 16:54:59 +0000 https://shlomi-noach.github.io/blog/?p=6603#comment-256072 Hi Shlomi!

I’m wondering how things are going, now that it’s been in production for 6 months or so?

Best Regards

]]> By: shlomi https://shlomi-noach.github.io/blog/mysql/converting-an-olap-database-to-tokudb-part-3-operational-stuff/comment-page-1#comment-223592 Tue, 19 Nov 2013 10:38:14 +0000 https://shlomi-noach.github.io/blog/?p=6603#comment-223592 @Eyal,
File system is not the only issue here. The cleanup of the buffer pool is another major factor. When you DROP a table, the buffer pool locks down until all relevant pages are flushed out. Also see Lazy Drop Table feature in Percona Server.

]]> By: Eyal Hashai https://shlomi-noach.github.io/blog/mysql/converting-an-olap-database-to-tokudb-part-3-operational-stuff/comment-page-1#comment-223520 Mon, 18 Nov 2013 22:16:09 +0000 https://shlomi-noach.github.io/blog/?p=6603#comment-223520 InnoDB DROPs are not an issue with a good filesystem.

Thanks for sharing Shlmoni, I got here after I’ve went through the same process 🙂

]]> By: shlomi https://shlomi-noach.github.io/blog/mysql/converting-an-olap-database-to-tokudb-part-3-operational-stuff/comment-page-1#comment-221974 Sun, 27 Oct 2013 10:29:59 +0000 https://shlomi-noach.github.io/blog/?p=6603#comment-221974 The “your” thin is an English phrasing. Since neither of us are native English speakers, let’s skip it.

]]> By: shlomi https://shlomi-noach.github.io/blog/mysql/converting-an-olap-database-to-tokudb-part-3-operational-stuff/comment-page-1#comment-221961 Sun, 27 Oct 2013 04:11:31 +0000 https://shlomi-noach.github.io/blog/?p=6603#comment-221961 @Shantanu,
Which is the precise reason for these blog posts: sharing my experience so as to promote knowledge. And it is the reason why our experiment is now three months into the works, with probably one more month till we go into production.

]]> By: Shantanu Oak https://shlomi-noach.github.io/blog/mysql/converting-an-olap-database-to-tokudb-part-3-operational-stuff/comment-page-1#comment-221959 Sun, 27 Oct 2013 03:45:24 +0000 https://shlomi-noach.github.io/blog/?p=6603#comment-221959 >> Nothing like “your” InnoDB.
“our” innodb? I can see your are impressed by TokuDB and so do I.
But TokuDB is still new to me (or “us”) and has to prove itself to be used in production.

]]>