Event Stream Processing

Read and write events, such as Kafka^® events

When you install the Streaming Data Framework for MATLAB^® Production Server™, you can:

Read and write event streams from an event streaming platform, such as Kafka.
Simulate the production environment for testing your streaming analytic algorithms. (Requires MATLAB Compiler SDK™)
Scale your streaming analytic algorithms by deploying them. (Requires MATLAB Production Server)

Install the Streaming Data Framework for MATLAB Production Server support package from the MATLAB Add-On Explorer. For information about installing add-ons, see 애드온을 받고 관리하기 (MATLAB).

함수

모두 확장

Connect to Event Streams

`kafkaStream`	Create connection to event stream in Kafka topic (R2022b 이후)
`inMemoryStream`	Create connection to event stream hosted by MATLAB without schema processing applied (R2022b 이후)
`testStream`	Create connection to event stream hosted by MATLAB with schema processing applied (R2022b 이후)

Read and Write Events

Basic Import and Export

`readtimetable`	Read timetable from event stream (R2022b 이후)
`writetimetable`	Write timetable to event stream (R2022b 이후)
`seek`	Set read position in event stream (R2022b 이후)
`preview`	Preview subset of events from event stream (R2022b 이후)
`identifyingName`	Event stream name (R2022b 이후)

Import and Export Options

`detectImportOptions`	Create import options based on event stream content (R2022b 이후)
`eventStreamImportOptions`	Create options for importing events from stream into MATLAB (R2022b 이후)
`ImportOptions`	Import options for event stream (R2022b 이후)
`getvartype`	Data types used to export variables to stream (R2022b 이후)
`setvartype`	Set data types used to import and export variables to stream (R2022b 이후)
`detectExportOptions`	Create export options based on event stream content (R2022b 이후)
`ExportOptions`	Export options for event stream (R2022b 이후)

Kafka Stream Operations

`readevents`	Read raw events from Kafka stream without schema processing applied (R2022b 이후)
`flush`	Reset read window boundaries (R2022b 이후)
`stop`	Stop processing event streams from Kafka topic (R2022b 이후)
`createTopic`	Create topic in Kafka cluster (R2022b 이후)
`deleteTopic`	Remove topic from Kafka cluster (R2022b 이후)
`loggederror`	Error information for Kafka stream operation (R2022b 이후)

Kafka Provider Properties

`categoryList`	Kafka stream provider property list (R2022b 이후)
`getProviderProperties`	Kafka stream configuration property data (R2022b 이후)
`setProviderProperties`	Set properties specific to Kafka configuration (R2022b 이후)
`isProperty`	Determine if Kafka stream provider property is set (R2022b 이후)

Simulate Production Environment

`eventStreamProcessor`	Apply stream analytic function to event stream (R2022b 이후)
`execute`	Execute event stream processing function on specific number of event windows (R2022b 이후)
`package`	Package stream processing function into deployable archive configured by `EventStreamProcessor` (R2022b 이후)
`seek`	Set position in event stream to begin processing events (R2022b 이후)
`start`	Start processing event streams using local test server (R2022b 이후)
`startServer`	Start local test server (R2022b 이후)
`stop`	Stop processing event streams using local test server (R2022b 이후)
`stopServer`	Shut down local test server (R2022b 이후)

Deploy Streaming Analytic

streamingDataCompiler Package stream processing function into deployable archive (R2022b 이후)

도움말 항목

Process Event Streams

Streaming Data Framework for MATLAB Production Server Basics
Use Streaming Data Framework for MATLAB Production Server to read from and write to event streaming platforms, such as Kafka.
Process Kafka Events Using MATLAB
Process events from a Kafka stream using a streaming analytic function.
Connect to Secure Kafka Cluster
Set Kafka provider properties during stream object creation.

Test and Deploy Streaming Analytic Function

Test Streaming Analytic Function Using Local Test Server
Use the development version of MATLAB Production Server to test a streaming analytic function before deployment to MATLAB Production Server.
Deploy Streaming Analytic Function to MATLAB Production Server
Package a streaming analytic function and deploy to server.

문제 해결

Obtain Kafka Event Stream Log Files

Locate event stream log files to help with debugging issues.