Thread: about psql copy ,we would like to seek help,Thanks.

about psql copy ,we would like to seek help,Thanks.

From
高升
Date:

PSQL engineers, hello:

We encountered a problem during the process of importing data from a text file to the PG database using psql's COPY command, and we would like to seek help. The issue is that if there are any exceptional records in the file, the program exits, but we want to skip those erroneous records and continue with the rest of the import.

We have looked at some tutorials, and it seems that we can use the "CONTINUE" option. By using the CONTINUE option, the COPY command should ignore error rows and continue with the copying operation until all rows are copied. The relevant error information for the error rows will be recorded.

COPY table_name FROM '/path/to/data/file.csv' (FORMAT csv, DELIMITER ',', NULL '', CONTINUE);

However, when we actually tried this, an error occurred, and it seems that the parameter is not recognized.

ERROR: option "continue" not recognized

 

My psql version : psql (PostgreSQL) 12.7

 

 

 

Could this be due to the version? Are there any other ways to handle this? Thank you for your support.

 

Best Regards.

Gaosheng

2023-12-14 from China

Re: about psql copy ,we would like to seek help,Thanks.

From
"David G. Johnston"
Date:
On Wed, Dec 13, 2023 at 6:22 PM 高升 <13325718563@189.cn> wrote:

PSQL engineers, hello:


The project is PostgreSQL, psql is a command line program included within the distribution.

We encountered a problem during the process of importing data from a text file to the PG database using psql's COPY command, and we would like to seek help. The issue is that if there are any exceptional records in the file, the program exits, but we want to skip those erroneous records and continue with the rest of the import.

We have looked at some tutorials,


Then those tutorials are buggy, not PostgreSQL.  Nowhere does our documentation say that this keyword is valid or that this capability is present.  There are third-party tools out there that do this kind of thing.  You will need to use one of them.

David J.

Re: about psql copy ,we would like to seek help,Thanks.

From
hubert depesz lubaczewski
Date:
On Thu, Dec 14, 2023 at 09:04:55AM +0800, 高升 wrote:
> We have looked at some tutorials, and it seems that we can use the
> "CONTINUE" option. By using the CONTINUE option, the COPY command should
> ignore error rows and continue with the copying operation until all rows are
> copied. The relevant error information for the error rows will be recorded. 

I searched the web using google and duckduckgo, and the phrase "By using
the CONTINUE option, the COPY command should" doesn't exist anywhere.

Which suggests that it wasn't "some tutorial" but rather hallucination
by chatgpt or some other "ai" that provides untruths.

In future, I would suggest to verify the things that these things spew,
as even 5 second glance at copy documentation
https://www.postgresql.org/docs/current/sql-copy.html shows that there
is no such option.

depesz



Re: about psql copy ,we would like to seek help,Thanks.

From
Christophe Pettus
Date:

> On Dec 14, 2023, at 00:08, hubert depesz lubaczewski <depesz@depesz.com> wrote:
> Which suggests that it wasn't "some tutorial" but rather hallucination
> by chatgpt or some other "ai" that provides untruths.

Snowflake (for example) has a CONTINUE option on COPY, so it's possible either the OP pulled up a tutorial for a
differentdatabase system, or the "author" of the tutorial smashed multiple different systems together. 


答复: about psql copy ,we would like to seek help,Thanks.

From
高升
Date:
Dear engineers,

   Thank you for your valuable input and suggestions. We appreciate your
assistance and guidance in this matter. We are grateful for your support
,Thanks very much .

Best regards,
Gaosheng
2023-12-15

-----邮件原件-----
发件人: xof@thebuild.com [mailto:xof@thebuild.com]
发送时间: 2023年12月14日 16:15
收件人: depesz@depesz.com
抄送: 高升; pgsql-bugs@lists.postgresql.org
主题: Re: about psql copy ,we would like to seek help,Thanks.



> On Dec 14, 2023, at 00:08, hubert depesz lubaczewski <depesz@depesz.com>
wrote:
> Which suggests that it wasn't "some tutorial" but rather hallucination
> by chatgpt or some other "ai" that provides untruths.

Snowflake (for example) has a CONTINUE option on COPY, so it's possible
either the OP pulled up a tutorial for a different database system, or the
"author" of the tutorial smashed multiple different systems together.