Add a data stream

edit

A data stream is a logical sub-division of an integration package, dealing with a specific observable aspect of the service or product being observed. For example, the Apache integration has three data streams, each represented by a separate folder of assets in the data_stream directory:

apache
└───data_stream
│   └───access
│   └───error
│   └───status

Bootstrap a new data stream using the TUI wizard. In the directory of your package, run:

elastic-package create data-stream

Follow the prompts to name, title, and select your data stream type. Then, run this command each time you add a new data stream to your integration.

Next, manually adjust the data stream:

  • define required variables
  • define used fields
  • define ingest pipeline definitions (if necessary)
  • update the Elastic Agent’s stream configuration