Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DataTracker throws PSQLException at CopyManager.copyIn if sourcename contains non-ASCII character #2355

Open
sammyjava opened this issue May 3, 2021 · 0 comments

Comments

@sammyjava
Copy link
Member

sammyjava commented May 3, 2021

So this is an i8n bug. I have a source named "vigun.iSelect-consensus-2016.gen.Muñoz-Amatriaín_Mirebrahim_2017". The data tables load fine, but the integration fails, throwing the following exception:

Caused by: org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0xf1 0x6f 0x7a 0x2d
  Where: COPY tracker, line 1, column sourcename
        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2433)
        at org.postgresql.core.v3.QueryExecutorImpl.processCopyResults(QueryExecutorImpl.java:1114)
        at org.postgresql.core.v3.QueryExecutorImpl.writeToCopy(QueryExecutorImpl.java:996)
        at org.postgresql.core.v3.CopyInImpl.writeToCopy(CopyInImpl.java:35)
        at org.postgresql.copy.CopyManager.copyIn(CopyManager.java:224)
        at org.postgresql.copy.CopyManager.copyIn(CopyManager.java:203)
        at org.intermine.dataloader.DataTracker.writeMap(DataTracker.java:551)
        at org.intermine.dataloader.DataTracker.flush(DataTracker.java:404)
        ... 139 more

This isn't an InterMine bug per se, but it means that if we use org.postgresql.copy.CopyManager.copyIn(String, InputString) to populate the tracker table, we're not supporting international source names. (That's arguably a bug in copyIn, since 0xf1=ñ is most definitely a UTF-8 character, and that's under the JDBC package.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant