13.204. Release 0.69
The following config properties must be removed from the file on both the coordinator and workers:
presto-metastore.db.type
presto-metastore.db.filename
Additionally, the datasources
property is now deprecated and should also be removed (see Datasource Configuration).
We have a new config property, node-scheduler.include-coordinator
, that allows or disallows scheduling work on the coordinator. Previously, tasks like final aggregations could be scheduled on the coordinator. For larger clusters, processing work on the coordinator can impact query performance because the machine’s resources are not available for the critical task of scheduling, managing and monitoring query execution.
Datasource Configuration
The datasources
config property has been deprecated. Please remove it from your etc/config.properties
file. The datasources configuration is now automatically generated based on the node-scheduler.include-coordinator
property (see Prevent Scheduling Work on Coordinator).
Presto has an extremely experimental connector that was previously called the native
connector and was intertwined with the main Presto code (it was written before Presto had connectors). This connector is now named and lives in a separate plugin.
As part of this refactoring, the presto-metastore.db.type
and presto-metastore.db.filename
config properties no longer exist and must be removed from etc/config.properties
.
If you would like to experiment with the connector, create a catalog properties file such as etc/catalog/raptor.properties
on both the coordinator and workers that contains the following:
Machine Learning Functions
Presto now has functions to train and use machine learning models (classifiers and regressors). This is currently only a proof of concept and is not ready for use in production. Example usage is as follows:
SELECT evaluate_classifier_predictions(label, classify(features, model))
FROM (
SELECT learn_classifier(label, features) AS model
)
In the above example, the column label
is a bigint
and the column features
is a map of feature identifiers to feature values. The feature identifiers must be integers (encoded as strings because JSON only supports strings for map keys) and the feature values are numbers (floating point).
General Changes
- Add missing operator:
timestamp with time zone
-interval year to month
- Support explaining sampled queries
- Add JMX stats for abandoned and canceled queries
- Improve error categorization in event logging