VirtualTableInput¶
VirtualTableInput is a TableElement and an Input.
VirtualTableInput is a "virtual" counterpart of a table node in a DataflowGraph used for analysis when only the schema matters (and the "parent" table could not be available in a catalog).
Creating Instance¶
VirtualTableInput takes the following to be created:
-
TableIdentifier - Optional User-Specified Schema
- Incoming Flow
TableIdentifiers -
sessionCaseSensitiveflag - Available ResolvedFlows (default: empty)
It's assumed that the destinationIdentifier of all the availableFlows is exactly this identifier.
VirtualTableInput is created when:
CoreDataflowNodeProcessoris requested to process a table node
Load Data¶
load infers the schema from the incoming flows unless this specifiedSchema is defined.
In the end, load creates an empty batch or streaming DataFrame (based on asStreaming flag).