How to read data from database with high speed
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hello Community,
I am trying to load the data from oracle into designer using the ODBC driver but it is too slow. I have millions of data. Is there any alternative to ODBC driver ?
- Labels:
- Database Connection
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
This is usually a tricky conversation 😉 but WHY are you pulling data into Designer, or rather why are you NOT using in-DB tools instead ?
The WHY answer is usually because you're moving the data somewhere else, because if the input and output are the same Oracle instance then don't use the normal tools.
The why NOT use in-DB is (sometimes) the key to speeding up workflows. You don't mention how many records, but do you need ALL the records, ALL the fields, or a subset that you can summarise (in-DB) before bringing into the normal tools ?
There could be a lot more reasons that I'm missing here, but "keep the data in the database" as much as possible, and only pull out what you need when you need it at the level that you need it (ie not a million records when you only need a monthly summary).
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Or the short answer to your question .... I usually use the OCI driver for Oracle, I haven't done any tests but I think it's faster than OBDC and JDBC would be slower still.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
I have used In-DB tools with OCI driver for reading from Oracle database. But it is slower that the traditional way.
