ETL
Writing to PostgreSQL database format without using PostgreSQL
I am collecting lots of data from lots of machines. These machine开发者_Go百科s cannot run PostgreSQL and the cannot connect to a PostgreSQL database. At the moment I save the data from these machines[详细]
2023-03-11 21:43 分类:问答Database ETL Design Question
A dataset I receive for routine refresh purposes contains a date field that\'s actually VARCHAR. As this will be an indexed/searched field, I\'m left with...[详细]
2023-03-11 06:34 分类:问答talend take out zeros before the comma
I have a file with two columns the first one with a name and the second one with a number. The size of the number column is 20 chars, the numbers use to be less than 2 chars size the rest of the char[详细]
2023-03-09 07:47 分类:问答Retrieving newly added database records
Let\'s assume we have the following generic scenario: An RDBMS as a data source, which is a live database (fills up with data all the time).[详细]
2023-03-08 15:07 分类:问答Slow progress when adding sequential identity column
We have 8 million row table and we need to add a sequential id column to it. It is used for data warehousing.[详细]
2023-03-05 18:29 分类:问答Use embeded firebird database with SSIS for ETL process
I don\'t have too many experience with SSIS, and I would like some suggestions / advices. I need to implement a SSIS package for ETL, for migrationg firebird database to Sql Server.[详细]
2023-03-05 11:57 分类:问答Use WCF service as source / destination for SSIS
I need to create a SSIS package and I would li开发者_开发知识库ke to know if I can use a WCF service as data source for it.[详细]
2023-03-05 11:52 分类:问答Any tools made for comparing data in dump files?
This question is slightly similar to this one, but more specific. I would like to test an ETL process by getting a visualization of the differences in two dump files. The dump files contain the entire[详细]
2023-03-05 09:09 分类:问答CloverETL Transaction Blocks for Temporary Tables
I am attempting to build an ETL script in the CloverETL Designer that, as part of its processing, builds a temporary table that it then uses it in a join.For reasons specific to the system a temp tabl[详细]
2023-03-04 03:01 分类:问答Strategy to avoid OutOfMemoryException during ETL in .NET
I have wrote a ETL process that perform ETL process. The ETL process needs to process more than 100+ million or rows overall for 2 years worth of records.To avoid out of memory issue, we chunk the dat[详细]
2023-03-01 03:43 分类:问答