It's possible to import data from an oracle database directly into Xcalar tables without overloading the source database?

[flinox]

Hi,

It's possible to import data from an oracle database directly into Xcalar tables without overloading the source database ?

I read another topic on the forum who tells to use ODBC, but is this the only way ? I'm not consider import csv files.

I would like to use something more performatic to get only the records changes, like a CDC solution.

Is there any way to do that with xcalar ? something like read data from archive logs, redo logs, to get only the updates and without overloading the source ?

I was reading the documentation and videos on youtube and I saw a very strong focus on CSV files as a source.

Sorry the english lol !
Tks.

[oagha]

Hi Fernando,

Thank you for posting your question to the discourse page for Xcalar! We can use CDC records to retrieve record changes in a database. Can you please provide more information about your use case? We can also schedule time to speak on this subject in more detail.

-Omar Agha

[flinox]

Tks Oagha.

I have an oracle database and I want to replicate all record changes as soon as they occur in some tables to a cloud database on AWS / Google / Azure or even to produce that changes to a kafka topic.

Can I use XCalar to do something like a CDC ( oracle goldengate ) does? to read files of transaction logs of an oracle database.

look, I can't query directly the tables to don't overloading the source system, and even if i could i don't have a timestamp to filter differences between reads.

I don't want to build a trigger to load another table with changes that occurs.

So, because of that I need to know if XCalar can read files of transaction logs...

I hope you understand me...

Regards.