Azure SQL Database Tables not refreshing/updating in Fabric Lakehouse
I am working with the lakehouse in fabric for the first time, and am having issues refreshing/updating the tables I brought in.
I created a pipeline using the "Copy Data Assistant" option/template. This worked well, but seems very inflexible and a one off solution, but it effectively created my tables, so success!
I later noticed that the tables in the lakehouse would not refresh, so I created a dataflow to hopefully resolve this issue. The tables are unaltered from the source, and I set the destination to the tables created in the lakehouse via the pipeline from earlier.
The tables do not refresh via this method, is there anything I am missing? The new data is present in the dataflow preview, but it does not update the lakehouse. I am unsure if this is user error, or a glitch in the system that requires a workaround. Any guidance would be greatly appreciated!