OpenSearch v2.11 Documentation
首页 白天 夜间 下载 阅读记录
  • 书签 我的书签
  • 添加书签 添加书签 移除书签 移除书签
编辑文档

Ingest Pipelines

来源 1 浏览 133 扫码 打印 2024-01-08 13:44:08
上一篇:
下一篇:
  • 书签
  • 添加书签 移除书签
  • Creating and tuning your cluster
    • Cluster manager task throttling
    • Tuning for indexing speed
    • Cross-cluster replication
      • API
      • Replication security
      • Getting started
      • Auto-follow
      • Replication settings
    • Availability and recovery
      • Search backpressure
      • Remote-backed storage
        • Shallow snapshots
        • Remote segment backpressure
        • Remote cluster state
        • Remote Store Stats API
      • Snapshots
        • Take and restore snapshots
        • Snapshot management
        • Searchable snapshots
        • Snapshot management API
      • Segment replication
        • Segment replication backpressure
      • Shard indexing backpressure
        • Stats API
        • Settings
  • Migrate to OpenSearch
    • Migrating from Elasticsearch OSS to OpenSearch
    • Using snapshots to migrate data
    • Migrating Docker clusters to OpenSearch
    • Migrating from Kibana OSS to OpenSearch Dashboards
  • Security analytics
    • OpenSearch Security for Security Analytics
    • API tools
      • Detector APIs
      • Alerts and findings APIs
      • Mappings APIs
      • Rule APIs
      • Log type APIs
      • Correlation engine APIs
    • Security Analytics settings
    • Setting up Security Analytics
      • Creating correlation rules
      • Creating custom log types
      • Creating detectors
      • Supported log types
    • Using Security Analytics
      • Working with alerts
      • Working with detectors
      • Working with findings
      • Working with the correlation graph
      • The Overview page
      • Working with detection rules
  • Security in OpenSearch
    • Audit logs
      • Audit log storage types
      • Audit log field reference
    • OpenSearch Dashboards multi-tenancy
      • Multi-tenancy aggregate view for saved objects
      • Multi-tenancy configuration
      • Dynamic configuration in OpenSearch Dashboards
    • Configuration
      • Generating self-signed certificates
      • Configuring sign-in options
      • Disabling security
      • Configuring TLS certificates
      • Applying changes to configuration files
      • Modifying the YAML files
      • System indexes
      • API rate limiting
      • Configuring the Security backend
    • Authentication backends
      • Proxy-based authentication
      • HTTP basic authentication
      • OpenID Connect
      • SAML
      • JSON Web Token
      • Client certificate authentication
      • Active Directory and LDAP
    • Access control
      • Users and roles
      • API
      • Default action groups
      • Cross-cluster search
      • REST layer authorization
      • Field masking
      • Field-level security
      • User impersonation
      • Permissions
      • Document-level security
  • OpenSearch Integrations
  • Text analysis
    • Language analyzers
    • Token filters
      • Delimited term frequency
    • Search analyzers
    • Index analyzers
  • Aggregations
    • Bucket aggregations
      • Range
      • Filters
      • Missing
      • Geohex grid
      • Histogram
      • Global
      • Significant text
      • Sampler
      • Terms
      • Multi-terms
      • Filter
      • Adjacency matrix
      • Date histogram
      • Diversified sampler
      • Significant terms
      • Geohash grid
      • Date range
      • Geotile grid
      • Geodistance
      • Nested
      • Reverse nested
      • IP range
    • Metric aggregations
      • Scripted metric
      • Stats
      • Average
      • Geobounds
      • Maximum
      • Percentile ranks
      • Percentile
      • Extended stats
      • Sum
      • Cardinality
      • Minimum
      • Value count
      • Top hits
      • Matrix stats
    • Pipeline aggregations
  • Install and upgrade
    • Managing OpenSearch Dashboards plugins
    • Installing plugins
    • Installing OpenSearch
      • Debian
      • Docker
      • RPM
      • Tarball
      • Windows
      • Helm
      • Ansible playbook
    • Installing OpenSearch Dashboards
      • Docker
      • Windows
      • Helm
      • Configure TLS
      • Tarball
      • RPM
      • Debian
    • Configuring OpenSearch Dashboards
    • Configuring OpenSearch
      • Index settings
      • Configuration and system settings
      • Plugin settings
      • Logs
      • Cluster settings
      • Circuit breaker settings
      • Network settings
      • Availability and recovery settings
      • Search settings
      • Discovery and gateway settings
      • Experimental feature flags
      • Security settings
    • Upgrading OpenSearch
      • Upgrades appendix
        • Rolling upgrade lab
      • Rolling Upgrade
  • Developer documentation
    • Extensions
  • About OpenSearch
    • Intro to OpenSearch
    • Version history
    • Quickstart
    • Breaking changes
  • Search
    • Improving search performance
      • Asynchronous search
        • Settings
        • Asynchronous search security
      • Concurrent segment search
    • Searching data
      • Highlight query matches
      • Sort results
      • Paginate results
      • Autocomplete
      • Did-you-mean
      • Point in Time
        • Point in Time API
    • Neural search tutorial
    • Search relevance
      • Querqy
      • Compare Search Results
        • Search Relevance Stats API
    • Neural search
    • Keyword search
    • Conversational search
    • Multimodal search
    • SQL and PPL
      • Data Types
      • Limitations
      • SQL and PPL CLI
      • Monitoring
      • Full-Text Search
      • Troubleshooting
      • SQL
        • ODBC Driver
        • Basic Queries
        • Functions
        • Delete
        • Aggregate Functions
        • Complex Queries
        • JDBC Driver
        • JSON Support
        • Metadata Queries
      • Settings
      • SQL and PPL API
      • Response formats
      • PPL
        • Commands
        • Syntax
      • Identifiers
      • Functions
    • Semantic search
    • Hybrid search
    • k-NN search
      • JNI libraries
      • k-NN index
      • API
      • Settings
      • Performance tuning
      • Approximate k-NN search
      • Exact k-NN with scoring script
      • k-NN Painless extensions
      • k-NN search with filters
    • Search pipelines
      • Using a search pipeline
      • Retrieving search pipelines
      • Search processors
        • Rename field
        • Filter query
        • Script
        • Personalize search ranking
        • Normalization
        • Neural query enricher
      • Creating a search pipeline
      • Search pipeline metrics
    • Neural sparse search
  • Troubleshooting
    • Troubleshoot OpenID Connect
    • Troubleshoot securityadmin.sh
    • Troubleshoot SAML
    • Troubleshoot TLS
  • Observability
    • Event analytics
    • Trace Analytics
      • Distrbuted tracing
      • Getting Started
      • OpenSearch Dashboards plugin
      • Analyzing Jaeger trace data
    • Anomaly detection
      • Anomaly result mapping
      • Anomaly detection API
      • Anomaly detection security
      • Settings
      • Anomaly detection visualizations and dashboards
    • Log ingestion
    • Notifications
      • API
    • Metrics analytics
    • Notebooks
    • Observability security
    • Alerting
      • Monitors
        • Composite monitors
        • Per cluster metrics monitors
        • Actions
        • Per document monitors
        • Triggers
        • Per query and per bucket monitors
      • Alerting dashboards and visualizations
      • Alerting security
      • Cron
      • Management
      • API
    • Operational panels
    • Application analytics
    • Cross-cluster search
    • Simple Schema for Observability
  • Ingest Pipelines
    • Simulate pipeline
    • Delete pipeline
    • Handling pipeline failures
    • Ingest processors
      • Text/image embedding
      • Remove
      • Lowercase
      • Uppercase
      • Text embedding
      • Convert
      • KV
      • Date
      • Date index name
      • Append
      • IP2Geo
      • Sparse encoding
      • Grok
      • CSV
      • Bytes
    • Get pipeline
    • Create pipeline
  • OpenSearch Dashboards
    • Snapshot Management
    • Dev Tools
      • Running queries in the Dev Tools console
    • Custom branding
    • Creating dashboards
    • Quickstart guide
    • Dashboards Query Language (DQL)
    • Discover
      • Time filter
    • Search telemetry
    • Index Management
      • Data streams
      • Notification settings
      • Component templates
      • Force merge
      • Rollover
      • Indexes
    • Building data visualizations
      • Using Gantt charts
      • Using area charts
      • Using coordinate and region maps
        • Using maps
        • Maps Stats API
        • Configuring a Web Map Service (WMS)
        • Using the self-host maps server
      • Using VisBuilder
    • Data sources
      • Configuring and using multiple data sources
      • Connecting Amazon S3 to OpenSearch
        • Optimize query performance using OpenSearch indexing
        • Query and visualize Amazon S3 data
    • Query Workbench
    • Dashboards Management
      • Advanced settings
      • Index patterns
  • API reference
    • Search templates
    • Scroll
    • Snapshot APIs
      • Delete Snapshot Repository
      • Register Snapshot Repository
      • Create Snapshot
      • Get Snapshot
      • Restore Snapshot
      • Delete Snapshot
      • Verify Snaphot Repository
      • Get Snapshot Status
      • Get Snapshot Repository
    • Ranking evaluation
    • Nodes APIs
      • Nodes info
      • Nodes reload secure settings
      • Nodes usage
      • Nodes hot threads
      • Nodes stats
    • Remote cluster information
    • Index APIs
      • Create or update mappings
      • Clear cache
      • Alias
      • Get settings
      • Dangling indexes
      • Index exists
      • Shrink index
      • Stats
      • Create index
      • Delete index
      • Split index
      • Update settings
      • Close index
      • Open index
      • Clone index
      • Get index
      • Force merge
    • CAT API
      • CAT snapshots
      • CAT tasks
      • CAT templates
      • CAT aliases
      • CAT recovery
      • CAT cluster manager
      • CAT shards
      • CAT nodeattrs
      • CAT pending tasks
      • CAT indices operation
      • CAT thread pool
      • CAT segment replication
      • CAT health
      • CAT segments
      • CAT allocation
      • CAT nodes operation
      • CAT count
      • CAT plugins
      • CAT field data
      • CAT repositories
    • Ingest APIs
    • Profile
    • Tasks
    • Count
    • Script APIs
      • Execute Painless stored script
      • Delete Script
      • Get Stored Script
      • Execute Painless script
      • Get Stored Script Contexts
      • Create or Update Stored Script
      • Get Script Language
    • Search
    • Cluster APIs
      • Cluster routing and awareness
      • Cluster settings
      • Cluster stats
      • Cluster allocation explain
      • Cluster decommission
      • Cluster health
    • Popular APIs
    • Supported units
    • Multi-search
    • Document APIs
      • Delete document
      • Multi-get document
      • Delete by query
      • Index document
      • Update document
      • Bulk
      • Get document
      • Reindex document
      • Update by query
    • Common REST Parameters
    • Analyze API
      • Analysis API Terminology
    • Explain
  • Mappings and field types
    • Supported field types
      • String field types
        • Keyword
        • Token count
        • Text
      • Alias
      • Range field types
      • Autocomplete field types
        • Search as you type
        • Completion
      • Object field types
        • Flat object
        • Join
        • Nested
        • Object
      • Date field types
        • Date nanoseconds
        • Date
      • IP address
      • Boolean
      • Percolator
      • Geographic field types
        • Geoshape
        • Geopoint
      • Binary
      • Rank field types
      • Numeric field types
        • Unsigned long
      • Cartesian field types
        • xy point
        • xy shape
      • k-NN vector
  • Reporting
    • Reporting using the CLI
      • Create and request visualization reports
      • Schedule reports with AWS Lambda
      • Download and install the Reporting CLI tool
      • Reporting CLI options
      • Use environment variables with the Reporting CLI
      • Schedule reports with the cron utility
    • Reporting using OpenSearch Dashboards
  • Monitoring your cluster
    • Performance Analyzer
      • Root Cause Analysis
        • API
        • Hot shard identification
        • RCA Reference
      • API
      • Metrics Reference
      • Create PerfTop Dashboards
    • Job Scheduler
  • Machine learning
    • Supported algorithms
    • Managing ML models in OpenSearch Dashboards
    • ML Commons API
      • Tasks APIs
        • Delete task
        • Get task
      • Model group APIs
        • Search for a model group
        • Update model group
        • Register model group
        • Delete model group
      • Stats
      • Execute algorithm
      • Model APIs
        • Get model
        • Undeploy model
        • Deploy model
        • Delete model
        • Register model
      • Connector APIs
        • Get connector
        • Create connector
        • Delete connector
      • Train and Predict APIs
        • Train and predict
        • Train
        • Predict
      • Profile
    • ML Commons cluster settings
    • Integrating ML models
      • Model access control
      • Using ML models within OpenSearch
        • GPU acceleration
        • Pretrained models
        • Custom models
      • Connecting to externally hosted models
        • Connector blueprints
        • Connectors
  • Query DSL
    • Full-text queries
      • Match phrase prefix
      • Match
      • Match Boolean prefix
      • Multi-match
      • Intervals
      • Simple query string
      • Match phrase
      • Query string
    • Geographic and xy queries
      • xy
      • Geo-bounding box
    • Minimum should match
    • Match all queries
    • Term-level queries
      • Terms
      • Regexp
      • Range
      • Fuzzy
      • Term
      • Wildcard
      • Exists
      • IDs
      • Prefix
      • Terms set
    • Compound queries
      • Function score
      • Constant score
      • Disjunction max
      • Boosting
      • Hybrid
      • Boolean
    • Query and filter context
    • Term-level and full-text queries compared
    • Span queries
    • Specialized queries
      • Script score
      • Neural sparse
      • Neural
  • Tools
    • OpenSearch Kubernetes Operator
    • Logstash
      • Advanced configurations
      • Ship events to OpenSearch
      • Read from OpenSearch
      • Logstash execution model
      • Common filter plugins
    • Grafana
    • OpenSearch CLI
    • Terraform
  • Managing Indexes
    • Index templates
    • Refresh search analyzer
    • Index aliases
    • ISM Error Prevention
      • ISM Error Prevention API
      • ISM Error Prevention resolutions
    • Index rollups
      • Index rollups API
      • Settings
    • Index management security
    • Index transforms
      • Transforms APIs
    • Index State Management
      • Settings
      • Policies
      • Managed indexes
      • ISM API
    • Data streams
    • Reindex data
    • Notification settings
暂无相关搜索结果！

    本文档使用 全库网 构建

    展开/收起文章目录

    思维导图备注

    文章二维码

    手机扫一扫，轻松掌上读

    文档下载

    请下载您需要的格式的文档，随时随地，享受汲取知识的乐趣！
    PDF文档 EPUB文档 MOBI文档

    书签列表

      阅读记录

      阅读进度: 0.00% ( 0/0 ) 重置阅读进度