| *** Gerhard has joined #ingres | 02:48 | |
| *** dyki has joined #ingres | 03:12 | |
| Deyan | Gerhard: is there any way to make faster insertion? | 04:30 |
|---|---|---|
| Deyan | inserting 1M rows into a table works at least 10x faster on MySQL 5 | 04:31 |
| pboro | you could try disabling logging | 04:31 |
| Deyan | ok, thanks | 04:32 |
| pboro | and using a heap table would also give more speed... and removing all indices... etc. :) | 04:32 |
| *** rossand has joined #ingres | 05:09 | |
| *** ChanServ sets mode: +o rossand | 05:09 | |
| atrofast | pboro: Heap tables are not necessarily faster if you're using multiple connections/sessions in concurrency | 05:15 |
| atrofast | Since a heap only has one insertion point (end at the table) in concurrency there will be a lot of wait | 05:15 |
| pboro | atrofast, is there a better option in heavily concurrent case? | 05:16 |
| atrofast | hash and btree with page or row level locking, althouigh there will be quite a bit of locking overhead with row level locking | 05:16 |
| atrofast | But then you also got make sure you pre-allocate a good amount of pages so that they don't have to be created during insert, that will also speed it up | 05:17 |
| pboro | ok | 05:18 |
| Deyan | it is little bit faster, not nowhere near MySQL | 05:27 |
| Deyan | i switched to read_commited isolation level just to check if it will work faster | 05:27 |
| Deyan | no change | 05:28 |
| Deyan | so now i am back to serialized | 05:28 |
| pboro | btw serialized is not a good option if you need concurrency | 05:28 |
| Deyan | i know that | 05:28 |
| Deyan | we need integrity | 05:29 |
| Deyan | concurrency is not a big issue here | 05:29 |
| atrofast | I'm sorry to say Deyan that on a row by row insert, it is going to be kinda slow | 05:29 |
| Deyan | atrofast: yep | 05:29 |
| atrofast | If the data is in a copy acceptable format, that would be faster | 05:30 |
| Deyan | i am waiting for Grant | 05:30 |
| Deyan | because apparently php extension cannot in fact be used to do a bulk insert | 05:30 |
| Deyan | because ingres_query() will commit | 05:30 |
| Deyan | even though i am not using autocommit | 05:30 |
| Deyan | there is a bug there, i am 100% sure | 05:31 |
| atrofast | Which version are you using? | 05:31 |
| Deyan | latest | 05:31 |
| Deyan | svn | 05:31 |
| atrofast | Okay, I thought that bug was fixed | 05:31 |
| Deyan | because it fixes a bug i have discovered 2 weeks ago | 05:31 |
| *** Gerhard has quit IRC | 06:05 | |
| *** DarylM has joined #ingres | 06:38 | |
| *** Deyan has quit IRC | 06:52 | |
| *** dyki has quit IRC | 06:54 | |
| *** mull has joined #ingres | 07:05 | |
| *** toumi01 has quit IRC | 08:16 | |
| *** toumi01 has joined #ingres | 08:16 | |
| *** toumi01 has left #ingres | 08:17 | |
| *** toumi01 has joined #ingres | 08:17 | |
| *** rossand has quit IRC | 08:48 | |
| *** Alex| has joined #ingres | 10:18 | |
| *** Nornagest has joined #ingres | 10:19 | |
| *** Alex| is now known as Alex|off | 10:20 | |
| *** Alex|off is now known as Alex| | 10:20 | |
| *** ChanServ sets mode: +o Alex| | 10:20 | |
| *** rossand has joined #ingres | 10:40 | |
| *** ChanServ sets mode: +o rossand | 10:40 | |
| *** zxiiro_ has joined #ingres | 11:57 | |
| *** zxiiro has quit IRC | 11:57 | |
| *** zxiiro_ is now known as zxiiro | 11:57 | |
| *** ChanServ sets mode: +v zxiiro | 11:57 | |
| *** mull has quit IRC | 12:32 | |
| *** Alex| is now known as Alex|off | 13:25 | |
| *** mull has joined #ingres | 14:12 | |
| *** zxiiro has quit IRC | 14:14 | |
| *** zxiiro has joined #ingres | 14:17 | |
| *** ChanServ sets mode: +v zxiiro | 14:17 | |
| *** DarylM has quit IRC | 15:29 | |
| *** omega187 has joined #ingres | 16:48 | |
| *** omega187 has joined #ingres | 16:49 | |
| *** omega187 has quit IRC | 16:52 | |
| *** omega187 has joined #ingres | 17:07 | |
| *** omega187 has quit IRC | 17:08 | |
| *** rossand has quit IRC | 17:10 | |
| *** zxiiro has quit IRC | 18:53 | |
| *** zxiiro has joined #ingres | 18:54 | |
| *** ChanServ sets mode: +v zxiiro | 18:54 | |
| *** zxiiro has quit IRC | 19:14 | |
| *** zxiiro has joined #ingres | 19:17 | |
| *** ChanServ sets mode: +v zxiiro | 19:17 | |
| *** rossand has joined #ingres | 19:35 | |
| *** ChanServ sets mode: +o rossand | 19:35 | |
| *** zxiiro has quit IRC | 19:54 | |
| *** zxiiro has joined #ingres | 19:55 | |
| *** ChanServ sets mode: +v zxiiro | 19:55 | |
| *** zxiiro has quit IRC | 20:34 | |
| *** zxiiro has joined #ingres | 20:35 | |
| *** ChanServ sets mode: +v zxiiro | 20:35 | |
| *** mull has quit IRC | 20:58 | |
| *** _Nornagest has joined #ingres | 21:05 | |
| *** Nornagest has quit IRC | 21:05 | |
| *** _Nornagest is now known as Nornagest | 21:06 | |
| *** rossand has quit IRC | 21:10 | |
| *** Alex|off is now known as Alex| | 22:36 | |
| *** Alex| is now known as Alex|off | 23:07 | |
| *** Alex|off is now known as Alex| | 23:24 | |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!