Export all rows as CSV

fmvalsera

Hi REI3 team,

I have a relation with more than 10000 rows and I want to export all to a CSV file. When I launch the exportation I set the param "Row count" to 0 in order to fetch everything but I get a file with no more than 10000. Only if I set it to a number bigger or equals to the total number of rows I get the right file.

I would like to ask if this is the expected behavior, that is, with a implicit limit of 10000 rows when the "Row count" is set to 0.

Thanks in advance!

gabriel

fmvalsera I had a look and we currently have a fixed 10.000 record limit in place. I do not remember why and I cannot find a reference to a reason in our docs. I will have a look at whether we can remove this limit.

fmvalsera

Related to the CSV exportation I will add that negative numbers with negative exponents (i.e. -0.03) are not being converted properly to string in the CSV file.

Checking the code I found that the function PgxNumericToString at tools/pgx.go is not dealing with the sign in these cases:

https://github.com/r3-team/r3/blob/a72c874bd930fbd858dfb16fff529d879584852d/tools/pgx.go#L19

Playing with the code to verify this behavior I have written a possible patch for this function that can be found at:

https://goplay.tools/snippet/v-S223HDxBX

I hope this helps.
Best regards!

gabriel

fmvalsera
Thank you for the report & suggested fix. I will try to replicate the issue and see that it will be fixed.

gabriel

Update: I removed to arbitrary 10.000 export limit and found a fix for the numerics export issue.

The changes will be part of the next patch release. Thank you very much for raising the issues.

fmvalsera

gabriel thank you for your fast resolution 😃 !