Comments on: Tool of the day: q https://shlomi-noach.github.io/blog/mysql/tool-of-the-day-q Blog by Shlomi Noach Mon, 13 Jan 2014 17:29:33 +0000 hourly 1 https://wordpress.org/?v=5.3.3 By: Valerie Parham-Thompson https://shlomi-noach.github.io/blog/mysql/tool-of-the-day-q/comment-page-1#comment-228737 Mon, 13 Jan 2014 17:29:33 +0000 https://shlomi-noach.github.io/blog/?p=6417#comment-228737 Oh, happy day. A dream come true. Thanks for sharing!

]]> By: Rabin https://shlomi-noach.github.io/blog/mysql/tool-of-the-day-q/comment-page-1#comment-216765 Sat, 10 Aug 2013 17:59:57 +0000 https://shlomi-noach.github.io/blog/?p=6417#comment-216765 It can be a nice addition to my script/tool collection,
for most part of my needs i use bash scripting.

And if the data is messy, i use OpenRefine( http://openrefine.org/) formally know as GoogleRefine.

]]> By: shlomi https://shlomi-noach.github.io/blog/mysql/tool-of-the-day-q/comment-page-1#comment-216651 Thu, 08 Aug 2013 19:16:20 +0000 https://shlomi-noach.github.io/blog/?p=6417#comment-216651 @Tomer,

I’ll pass along 🙂
While I don’t speak for Harel, my personal opinion is that for importing XML and JSON you really need an altogether different tool, based on XPath or similar expression language; not SQL.

SQL over unstructured data would be limited, to say the least.

Moreover, I don’t see that SQL, having the diversities it offers, can ever be a stream editor. a GROUP BY over random data is example enough to present the need of “get all the data upfront”.

For the really large data, well, that’s what RDBMS is for. I agree q should be used with the smaller datasets.

Again, all the above my own personal understanding.

Cheers

]]> By: Tomer Cohen https://shlomi-noach.github.io/blog/mysql/tool-of-the-day-q/comment-page-1#comment-216630 Thu, 08 Aug 2013 12:25:09 +0000 https://shlomi-noach.github.io/blog/?p=6417#comment-216630 This is indeed a nice idea, but I’d appreciate if it will have some additional file formats, such as CSV, XML and JSON ready for importing and exporting directly from the tool. Also, since it does create temporary sqlite table, I afraid it’d be inefficient for processing large files as well as repeated tasks.

]]>