Bulk copy out huge table on sybase adaptive server

sybasesybase-ase

anyone has a good approach or even strategy to bulk copy out single table with 500+ millions rows. the table encountered unitialized logical page, and we are looking to atleast salvage good records.

we are running sybase adaptive server version 12.5 on linux platform.

TIA

Best Answer

We have done very large table migrations successfully with Sqoop. Yes, there will be a bunch of setup that is needed but it is tuneable to run in multiple threads for faster performance.

From Comments:

Over the years, I have used many methods to extract data from sybase tables. BCP, IBM Optim (very proprietary), Apache MetaModel and Apache Sqoop. Using Sqoop I found is the most effective for very large tables. The setup for Sqoop would need some basic Hadoop libraries to run. Then you would install the sqoop server and the client software. All of this is not very difficult to do. Sqoop does not offically support Sybase but it does work really well. Here is a good starting point for installing Sqoop on a single node.

Related Question