overview

features

Inlong-sort is an multi-tenancy system, which means you can extract data from different sources(these sources must be of the same source type) and load data into different sinks(these sinks must be of the same storage type). e.g. you can extract data form different topics of inlong-tubemq and the load them to different hive clusters.

supported sources

• inlong-tubemq
• pulsar

supported storages

• clickhouse
• hive (Currently we just support parquet file format)

limitations

Currently, we just support extracting specified fields in the stage of Transform.

future plans

Hbase, Elastic Search, and etc