FiveTech Support Forums

FiveWin / Harbour / xBase community
Board index FiveWin for Harbour/xHarbour FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posts: 10733
Joined: Sun Nov 19, 2006 05:22 AM
FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sat Mar 25, 2017 09:20 AM
New RecSet class is under development for loading and browsing very large tables. For testing and development, we are using a free cloud server which is obviously slower than local servers or business class servers. In version 17.03 this class is available for use with a limited functionality and will be fully functional in 17.04.

In this post we present a preview of the new class. We have a table `custbig` on the cloud server with one million records. This table is created by inserting "customer.dbf" 2000 times.

This is sample program. ( fwh\samples\maria10.prg )
Code (fw): Select all Collapse
#include "fivewin.ch"

function Main()

   local oCn, oRs, nRecs

   oCn   := FW_DemoDB()
   ? nRecs := oCn:QueryResult( "SELECT COUNT(*) FROM custbig" ), "Record in table `custbig`"
   oRs   := oCn:RecSet( "custbig", 1000 )
   oRs:nLastRec   := nRecs
   XBROWSER oRs TITLE "`Custbig` table with million records. Ready to browse in " + ;
      Transform( oRs:nReadSecs, "999.9999" ) + " Seconds"  SHOW RECID FASTEDIT
   oCn:Close()

return nil




After you download FWH17.03 you can build and test this program by executing
build? maria10
You do not need to have access to any mysql/mariadb server to run this program. This program will connect to the cloud server and display the table.

Even if you do not have FWH17.03 or even if you do not have FWH at all, still you can test this program by downloading zip file from the link below.

http://anserkk.com/gnraomysql/view.php?id=1

Download the zip file, unzip the contents into any blank folder, switch to that folder and run maria10.exe from that folder.

Depending on your own internet speeds, normally you should see the browse of million records within about one second and will be able to gobottom, gotop or use vertical scrollbar for moving to anywhere in the table very fast. You can also modify the data by inline edit or edit dialog and check the performance. We disabled appends in this test program.

Please note that we are getting from a free cloud based server and performance in real life on business -servers / inhouse-servers should be far better.

Whether you are interested or not in FWMARIADB and whatever version of FWH you are using, we encourage you download the EXE and run it and experience it.

We welcome your feedback as well as criticism.
Regards



G. N. Rao.

Hyderabad, India
Posts: 117
Joined: Tue Jan 03, 2006 06:18 PM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sat Mar 25, 2017 09:45 AM

Dear G. N. Rao.,

just 1.89 second for get all data

Regards,

Kok

Posts: 11
Joined: Thu Jan 21, 2016 08:26 PM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sat Mar 25, 2017 11:01 AM

Thats realy amazing ! :)

Is there any chance for 'FWPOSTGRESDB' ? :)

Posts: 10733
Joined: Sun Nov 19, 2006 05:22 AM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sat Mar 25, 2017 11:26 AM
Is there any chance for 'FWPOSTGRESDB' ? :-)

As of now, we do not have any plans.
We would consider if we see many users interested in it.
Regards



G. N. Rao.

Hyderabad, India
Posts: 140
Joined: Tue Oct 11, 2005 02:36 AM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sat Mar 25, 2017 12:37 PM

Hello, friends

I'm very interested in PostGreSql, including can collaborate in the development.

I'm standing by.

Jackson Douglas C. Brito

Boa Vista - RR - Brasil

FWH 12.09 Last Build

xHarbour Free

UESTUDIO

SQLRDD
Posts: 11
Joined: Thu Jan 21, 2016 08:26 PM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sat Mar 25, 2017 12:55 PM
nageswaragunupudi wrote:
Is there any chance for 'FWPOSTGRESDB' ? :-)

As of now, we do not have any plans.
We would consider if we see many users interested in it.


How many is minimum :-) ? or ... maybe minimum budget for this ?
Posts: 10733
Joined: Sun Nov 19, 2006 05:22 AM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sat Mar 25, 2017 02:36 PM

I see that (x)Harbour contributions already have postgre library. I have never used though.

May we know what more our members are expecting?

Regards



G. N. Rao.

Hyderabad, India
Posts: 1286
Joined: Mon Feb 25, 2008 02:54 PM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sun Mar 26, 2017 03:47 PM

Parabéns pelo excelente trabalho.

Sr. Nages, todas estas funcionalidades estão disponíveis tanto para MYSQL como para MARIADB?

ubiratanmga@gmail.com

FWH24.04
BCC7.3
HARBOUR3.2
xMate
Pelles´C
TDolphin
Posts: 10733
Joined: Sun Nov 19, 2006 05:22 AM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sun Mar 26, 2017 03:55 PM
MYSQL como para MARIADB?

Yes.
Both MariaDB server and MySql server behave the same way.
FWH application whether linked with libmariadb.lib or libmysql.lib and run with libmariadb.dll or libmysql.dll work the same way both on mariadb server and mysql server.
Regards



G. N. Rao.

Hyderabad, India
Posts: 4840
Joined: Fri Nov 18, 2005 04:52 PM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Sun Mar 26, 2017 09:42 PM

Wow!

Color me impressed.

James

FWH 18.05/xHarbour 1.2.3/BCC7/Windows 10
Posts: 1096
Joined: Fri Oct 28, 2005 02:27 AM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Mon Mar 27, 2017 05:37 AM
nageswaragunupudi wrote:I see that (x)Harbour contributions already have postgre library. I have never used though.

May we know what more our members are expecting?


I am interested in Firebird.
FWH 11.08/FWH 19.12

BCC5.82/BCC7.3

xHarbour/Harbour
Posts: 842
Joined: Mon Oct 10, 2005 01:29 PM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Mon Mar 27, 2017 07:32 AM

Hello Rao.,

just 0.89 for the first block

Regards,

Maurizio

Posts: 9020
Joined: Thu Oct 06, 2005 08:17 PM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Mon Mar 27, 2017 08:25 AM

Wow, 0.28 seconds here! :-)

Great work, Rao!

EMG

Posts: 1598
Joined: Fri Oct 07, 2005 05:56 PM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Mon Mar 27, 2017 11:11 AM

here is 1.023 seconds, great job.

Regards,

Dutch



FWH 2304 / xHarbour Simplex 1.2.3 / BCC73 / Pelles C / UEStudio

FWPPC 10.02 / Harbour for PPC (FTDN)

ADS V.9 / MySql / MariaDB

R&R 12 Infinity / Crystal Report XI R2

(Thailand)
Posts: 1088
Joined: Fri Oct 07, 2005 03:33 PM
Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables
Posted: Mon Mar 27, 2017 12:22 PM

PostgreSQL +1