Plugins
Plugins reside in their own folders and can consist of several jars. The names of the plugin foldersare arbitrary.
Each plugin is loaded through its own classloader and completely isolated from any other plugin.Hence, the and flink-azure-fs-hadoop
can depend on different conflictinglibrary versions. There is no need to relocate any class during the creation of fat jars (shading).
NoteCurrently, more Flink core classes are stillaccessible from plugins as we flesh out the SPI system.
Furthermore, the most common logger frameworks are whitelisted, such that logging is uniformlypossible across Flink core, plugins, and user code.
File Systems
WarningThe s3 file systems (flink-s3-fs-presto
andflink-s3-fs-hadoop
) can only be used as plugins as we already removed the relocations. Placingthem in libs/ will result in system failures.
AttentionBecause of the strict , file systems do not have access to credential providers in lib/anymore. Please add any needed providers to the respective plugin folder.