Comments on: Integrating MySQL and Hadoop – or – A different approach on using CSV files in MySQL http://aprilmayjune.org/2010/09/05/integrating-mysql-and-hadoop-or-a-different-approach-on-using-csv-files-in-mysql/ Mon, 13 Sep 2010 17:20:49 +0000 hourly 1 http://wordpress.org/?v=3.3 By: Robert http://aprilmayjune.org/2010/09/05/integrating-mysql-and-hadoop-or-a-different-approach-on-using-csv-files-in-mysql/#comment-13116 Robert Tue, 07 Sep 2010 15:05:30 +0000 http://pero.blogs.aprilmayjune.org/2010/09/05/integrating-mysql-and-hadoop-or-a-different-approach-on-using-csv-files-in-mysql/#comment-13116 Hi, I had a similar idea, when I worked on the optimization attempt, I published here: http://www.xarg.org/2010/09/resolve-many-to-many-relations-a-bit-different-with-mysql/ The only problem I see with your UDF is, that the solution isn't universally valid, which means you expect an ordered CSV file. On the other side, this brings the speed by using a binary search. I think a good improvement would also be to interpolate the binary search by storing the state of the previous match in the structure. Robert Hi,

I had a similar idea, when I worked on the optimization attempt, I published here: http://www.xarg.org/2010/09/resolve-many-to-many-relations-a-bit-different-with-mysql/

The only problem I see with your UDF is, that the solution isn’t universally valid, which means you expect an ordered CSV file. On the other side, this brings the speed by using a binary search. I think a good improvement would also be to interpolate the binary search by storing the state of the previous match in the structure.

Robert

]]> By: Twitter Trackbacks for pero on anything » Blog Archive » Integrating MySQL and Hadoop - or - A different approach on using CSV files in MySQL [aprilmayjune.org] on Topsy.com http://aprilmayjune.org/2010/09/05/integrating-mysql-and-hadoop-or-a-different-approach-on-using-csv-files-in-mysql/#comment-13099 Twitter Trackbacks for pero on anything » Blog Archive » Integrating MySQL and Hadoop - or - A different approach on using CSV files in MySQL [aprilmayjune.org] on Topsy.com Sun, 05 Sep 2010 22:24:42 +0000 http://pero.blogs.aprilmayjune.org/2010/09/05/integrating-mysql-and-hadoop-or-a-different-approach-on-using-csv-files-in-mysql/#comment-13099 [...] pero on anything » Blog Archive » Integrating MySQL and Hadoop - or - A different approach on usin... pero.blogs.aprilmayjune.org/2010/09/05/integratin...-different-approach-on-using-csv-files-in-mysql/ – view page – cached Integrating MySQL and Hadoop - or - A different approach on using CSV files in Tweets about this link [...] [...] pero on anything » Blog Archive » Integrating MySQL and Hadoop – or – A different approach on usin… pero.blogs.aprilmayjune.org/2010/09/05/integratin…-different-approach-on-using-csv-files-in-mysql/ – view page – cached Integrating MySQL and Hadoop – or – A different approach on using CSV files in Tweets about this link [...]

]]>