Has anyone implemented Reverse ETL between cloud and On-prem?
We have both layers active - Cloud and On-prem- that run different applications. We have need for moving data from On-prem (Oracle/MySQL) to Snowflake and Snowflake to On-prem database as well. The reverse is more to do with loading Sf processed data.
Although Data size varies quite a bit.. it usually is around a couple of million rows that end up being few GB.
While we can find many solutions for the On-prem Oracle->snowflake, we can't find any tools/implementations for the other way around. We currently do the below as a temporary/quick solution.
Snowflake --> Unload data to S3 --> Move Files to Oracle server using a python script --> Load to Oracle using external tables.
Is there a better solution or a proper tool out there that does this?
(Heard Airbyte cloud and some suggestions around AWS DataSync/Storage gateway etc.. Appreciate any input here. )