FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

User avatar
nageswaragunupudi
Posts: 8017
Joined: Sun Nov 19, 2006 5:22 am
Location: India
Contact:

FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by nageswaragunupudi »

New RecSet class is under development for loading and browsing very large tables. For testing and development, we are using a free cloud server which is obviously slower than local servers or business class servers. In version 17.03 this class is available for use with a limited functionality and will be fully functional in 17.04.

In this post we present a preview of the new class. We have a table `custbig` on the cloud server with one million records. This table is created by inserting "customer.dbf" 2000 times.

This is sample program. ( fwh\samples\maria10.prg )

Code: Select all

#include "fivewin.ch"

function Main()

   local oCn, oRs, nRecs

   oCn   := FW_DemoDB()
   ? nRecs := oCn:QueryResult( "SELECT COUNT(*) FROM custbig" ), "Record in table `custbig`"
   oRs   := oCn:RecSet( "custbig", 1000 )
   oRs:nLastRec   := nRecs
   XBROWSER oRs TITLE "`Custbig` table with million records. Ready to browse in " + ;
      Transform( oRs:nReadSecs, "999.9999" ) + " Seconds"  SHOW RECID FASTEDIT
   oCn:Close()

return nil
 
Image

After you download FWH17.03 you can build and test this program by executing
build? maria10
You do not need to have access to any mysql/mariadb server to run this program. This program will connect to the cloud server and display the table.

Even if you do not have FWH17.03 or even if you do not have FWH at all, still you can test this program by downloading zip file from the link below.

http://anserkk.com/gnraomysql/view.php?id=1

Download the zip file, unzip the contents into any blank folder, switch to that folder and run maria10.exe from that folder.

Depending on your own internet speeds, normally you should see the browse of million records within about one second and will be able to gobottom, gotop or use vertical scrollbar for moving to anywhere in the table very fast. You can also modify the data by inline edit or edit dialog and check the performance. We disabled appends in this test program.

Please note that we are getting from a free cloud based server and performance in real life on business -servers / inhouse-servers should be far better.

Whether you are interested or not in FWMARIADB and whatever version of FWH you are using, we encourage you download the EXE and run it and experience it.

We welcome your feedback as well as criticism.
Regards

G. N. Rao.
Hyderabad, India
kok joek hoa
Posts: 117
Joined: Tue Jan 03, 2006 6:18 pm

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by kok joek hoa »

Dear G. N. Rao.,

just 1.89 second for get all data

Regards,

Kok
dpesic
Posts: 11
Joined: Thu Jan 21, 2016 8:26 pm

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by dpesic »

Thats realy amazing ! :)

Is there any chance for 'FWPOSTGRESDB' ? :)
User avatar
nageswaragunupudi
Posts: 8017
Joined: Sun Nov 19, 2006 5:22 am
Location: India
Contact:

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by nageswaragunupudi »

Is there any chance for 'FWPOSTGRESDB' ? :)
As of now, we do not have any plans.
We would consider if we see many users interested in it.
Regards

G. N. Rao.
Hyderabad, India
User avatar
miragerr
Posts: 140
Joined: Tue Oct 11, 2005 2:36 am
Location: Brasil

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by miragerr »

Hello, friends

I'm very interested in PostGreSql, including can collaborate in the development.

I'm standing by.
Jackson Douglas C. Brito
Boa Vista - RR - Brasil
FWH 12.09 Last Build
xHarbour Free
UESTUDIO
SQLRDD
dpesic
Posts: 11
Joined: Thu Jan 21, 2016 8:26 pm

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by dpesic »

nageswaragunupudi wrote:
Is there any chance for 'FWPOSTGRESDB' ? :)
As of now, we do not have any plans.
We would consider if we see many users interested in it.
How many is minimum :) ? or ... maybe minimum budget for this ?
User avatar
nageswaragunupudi
Posts: 8017
Joined: Sun Nov 19, 2006 5:22 am
Location: India
Contact:

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by nageswaragunupudi »

I see that (x)Harbour contributions already have postgre library. I have never used though.

May we know what more our members are expecting?
Regards

G. N. Rao.
Hyderabad, India
MGA
Posts: 1219
Joined: Mon Feb 25, 2008 2:54 pm
Location: Brasil/PR/Maringá
Contact:

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by MGA »

Parabéns pelo excelente trabalho.

Sr. Nages, todas estas funcionalidades estão disponíveis tanto para MYSQL como para MARIADB?
ubiratanmga@gmail.com

FWH17.04
FWPPC
Harbour/xHarbour
xMate
Pelles´C
TDolphin
User avatar
nageswaragunupudi
Posts: 8017
Joined: Sun Nov 19, 2006 5:22 am
Location: India
Contact:

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by nageswaragunupudi »

MYSQL como para MARIADB?
Yes.
Both MariaDB server and MySql server behave the same way.
FWH application whether linked with libmariadb.lib or libmysql.lib and run with libmariadb.dll or libmysql.dll work the same way both on mariadb server and mysql server.
Regards

G. N. Rao.
Hyderabad, India
User avatar
James Bott
Posts: 4654
Joined: Fri Nov 18, 2005 4:52 pm
Location: San Diego, California, USA
Contact:

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by James Bott »

Wow!

Color me impressed.

James
FWH 18.05/xHarbour 1.2.3/BCC7/Windows 10
hua
Posts: 861
Joined: Fri Oct 28, 2005 2:27 am

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by hua »

nageswaragunupudi wrote:I see that (x)Harbour contributions already have postgre library. I have never used though.

May we know what more our members are expecting?
I am interested in Firebird.
FWH 11.08/FWH 19.03
xHarbour 1.2.1 (Rev 6406) + BCC
Harbour 3.1 (Rev 17062) + BCC
Harbour 3.2.0dev (r1904111533) + BCC
User avatar
Maurizio
Posts: 705
Joined: Mon Oct 10, 2005 1:29 pm
Contact:

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by Maurizio »

Hello Rao.,

just 0.89 for the first block

Regards,

Maurizio
User avatar
dutch
Posts: 1395
Joined: Fri Oct 07, 2005 5:56 pm
Location: Thailand

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by dutch »

here is 1.023 seconds, great job.
Regards,
Dutch

FWH 19.01 / xHarbour Simplex 1.2.3 / BCC73 / Pelles C / UEStudio
FWPPC 10.02 / Harbour for PPC (FTDN)
ADS V.9 / MySql / MariaDB
R&R 12 Infinity / Crystal Report XI R2
(Thailand)
Marcelo Via Giglio
Posts: 1033
Joined: Fri Oct 07, 2005 3:33 pm
Location: Cochabamba - Bolivia

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Post by Marcelo Via Giglio »

PostgreSQL +1
Post Reply