ibmstreams / vscode-ide

IBM Streams extension for Visual Studio Code

IBM Streams extension for Visual Studio Code

Build solutions that drive real-time business decisions by combining streaming and stored data with analytics with IBM Streams.

This extension provides support for IBM Streams within the Visual Studio Code editor and works with the following Streams versions.

• IBM Cloud Pak for Data deployment: Delivers a platform for combining streaming and stored data with AI to build solutions that impact business decisions in real time.
• IBM Streams standalone deployment (on-premises): Delivers a programming language and IDE for applications, a runtime system and analytic toolkits to speed development.
• IBM Streaming Analytics on IBM Cloud: Offers most of the features of IBM Streams on an agile, cloud-based platform.

Visual Studio Code 1.41.0 or later is required.

More information and documentation can be found here.

Getting started

Follow the Quick start guide to get up and running with this extension.

Features

Streams Explorer

Easily manage your Streams instances and toolkits, and access helpful resources. Learn more here.

Develop applications

Create Streams applications with SPL language support included. Typical code editing features are supported, including content assist, code folding, etc. Learn more here.

Build applications and submit jobs

Build your Streams applications and submit them directly to a Streams instance of your choice. If you already have Streams application bundles, you can submit those as well! Learn more here.

Job graph

Visualize and monitor your Streams jobs. You can monitor metrics and flow rates, view flowing data, and much more! Learn more here.

vscode-ide's Issues

Support multiple toolkit root directories for builds

To specify multiple directories for the ibm-streams.toolkitsPath setting, a user can use , or ; as delimiters. For instance,

/home/user/toolkits1,/home/user/toolkits2 or /home/user/toolkits1;/home/user/toolkits2

The build will pick up all valid toolkit subdirectories therein.

Show markers in the gutter when errors are reported

Currently, red squiggly lines are added in the editor, but they may not be visible if lines are long.

Cancel job and collect logs improvement

When I cancel a job there should be a possibility to cancel and download the job logs in one step. This should be implemented like the streamtool command canceljob with option --collectlogs. Because this is the only way to get the logs when the job is shutdown.

submit via console link disappears

When user selects submit via console, the information pop-up disappears without dismissal and no way to get it back. Should be visible until user clicks or closes.

Update 'IBM Cloud Private for Data' references

IBM Cloud Private for Data was renamed to IBM Cloud Pak for Data, so all references need to be updated.

cant build spl file with no namespace

build fails when no namespace

Support of Cloud Pak for Data 2.5

Current version does not work with Cloud Pak for Data 2.5

Current value:  https://syss161.pok.stglabs.ibm.com:31350/
[2019-12-19T17:19:26+01:00][ERROR]    Invalid URI "/streams-build/instances/sample-streams/nbg//toolkits"
[2019-12-19T17:19:26+01:00][ERROR]    Error occurred during REFRESH_TOOLKITS
[2019-12-19T17:19:26+01:00][ERROR]  
Error: Invalid URI "/streams-build/instances/sample-streams/nbg//toolkits"
	at Request.init (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:273:31)
	at new Request (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:127:8)
	at request (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/index.js:53:10)
	at /Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/index.js:100:12
	at Observable._subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/out/src/build/v5/util/streams-rest-v5.js:330:9)
	at Observable._trySubscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:44:25)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:30:22)
	at DoOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/tap.js:32:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at MapOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/map.js:32:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at MapOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/map.js:32:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at MergeMapOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:39:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at DoOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/tap.js:32:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at MapOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/map.js:32:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at DoOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/tap.js:32:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at CatchOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/catchError.js:32:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at /Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeTo.js:22:31
	at Object.subscribeToResult (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToResult.js:10:45)
	at MergeMapSubscriber._innerSub (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:82:29)
	at MergeMapSubscriber._tryNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:76:14)
	at MergeMapSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:59:18)
	at MergeMapSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at WithLatestFromSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/withLatestFrom.js:80:34)
	at WithLatestFromSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at FilterSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/filter.js:52:30)
	at FilterSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at Notification.observe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Notification.js:22:50)
	at QueueAction.ObserveOnSubscriber.dispatch (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/observeOn.js:48:22)
	at QueueAction.AsyncAction._execute (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/AsyncAction.js:71:18)
	at QueueAction.execute (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/QueueAction.js:38:18)
	at QueueScheduler.AsyncScheduler.flush (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/AsyncScheduler.js:52:32)
	at QueueAction.schedule (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/QueueAction.js:32:24)
	at QueueScheduler.Scheduler.schedule (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Scheduler.js:11:53)
	at QueueScheduler.AsyncScheduler.schedule (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/AsyncScheduler.js:40:46)
	at ObserveOnSubscriber.scheduleMessage (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/observeOn.js:53:40)
	at ObserveOnSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/observeOn.js:56:14)
	at ObserveOnSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at MergeMapSubscriber.notifyNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:92:26)
	at InnerSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/InnerSubscriber.js:28:21)
	at InnerSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at MergeMapSubscriber.notifyNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:92:26)
	at InnerSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/InnerSubscriber.js:28:21)
	at InnerSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at CatchSubscriber.Subscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:89:26)
	at CatchSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at MergeMapSubscriber.notifyNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:92:26)
	at InnerSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/InnerSubscriber.js:28:21)
	at InnerSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at MergeMapSubscriber.notifyNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:92:26)
	at InnerSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/InnerSubscriber.js:28:21)
	at InnerSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at /Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeTo.js:17:28
	at Object.subscribeToResult (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToResult.js:10:45)
	at MergeMapSubscriber._innerSub (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:82:29)
	at MergeMapSubscriber._tryNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:76:14)
	at MergeMapSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:59:18)
	at MergeMapSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at Observable._subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToArray.js:5:20)
	at Observable._trySubscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:44:25)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:30:22)
	at MergeMapOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:39:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at /Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeTo.js:22:31
	at Object.subscribeToResult (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToResult.js:10:45)
	at MergeMapSubscriber._innerSub (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:82:29)
	at MergeMapSubscriber._tryNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:76:14)
	at MergeMapSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:59:18)
	at MergeMapSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at Request._callback (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/out/src/build/v5/util/streams-rest-v5.js:341:21)
	at Request.self.callback (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:185:22)
	at Request.emit (events.js:200:13)
	at Request.EventEmitter.emit (domain.js:471:20)
	at Request.<anonymous> (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:1161:10)
	at Request.emit (events.js:200:13)
	at Request.EventEmitter.emit (domain.js:471:20)
	at IncomingMessage.<anonymous> (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:1083:12)
	at Object.onceWrapper (events.js:288:20)
	at IncomingMessage.emit (events.js:205:15)
	at IncomingMessage.EventEmitter.emit (domain.js:471:20)
	at endReadableNT (_stream_readable.js:1154:12)
	at processTicksAndRejections (internal/process/task_queues.js:84:9)
[2019-12-19T17:19:26+01:00][ERROR]    Invalid URI "/streams-build/instances/sample-streams/nbg//builds"
[2019-12-19T17:19:26+01:00][ERROR]    Error occurred during NEW_BUILD
[2019-12-19T17:19:26+01:00][ERROR]  
Error: Invalid URI "/streams-build/instances/sample-streams/nbg//builds"
	at Request.init (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:273:31)
	at new Request (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:127:8)
	at request (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/index.js:53:10)
	at /Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/index.js:100:12
	at Observable._subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/out/src/build/v5/util/streams-rest-v5.js:330:9)
	at Observable._trySubscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:44:25)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:30:22)
	at MapOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/map.js:32:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at CatchOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/catchError.js:32:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at /Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeTo.js:22:31
	at Object.subscribeToResult (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToResult.js:10:45)
	at MergeMapSubscriber._innerSub (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:82:29)
	at MergeMapSubscriber._tryNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:76:14)
	at MergeMapSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:59:18)
	at MergeMapSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at WithLatestFromSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/withLatestFrom.js:80:34)
	at WithLatestFromSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at FilterSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/filter.js:52:30)
	at FilterSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at Notification.observe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Notification.js:22:50)
	at QueueAction.ObserveOnSubscriber.dispatch (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/observeOn.js:48:22)
	at QueueAction.AsyncAction._execute (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/AsyncAction.js:71:18)
	at QueueAction.execute (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/QueueAction.js:38:18)
	at QueueScheduler.AsyncScheduler.flush (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/AsyncScheduler.js:52:32)
	at QueueAction.schedule (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/QueueAction.js:32:24)
	at QueueScheduler.Scheduler.schedule (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Scheduler.js:11:53)
	at QueueScheduler.AsyncScheduler.schedule (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/scheduler/AsyncScheduler.js:40:46)
	at ObserveOnSubscriber.scheduleMessage (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/observeOn.js:53:40)
	at ObserveOnSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/observeOn.js:56:14)
	at ObserveOnSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at MergeMapSubscriber.notifyNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:92:26)
	at InnerSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/InnerSubscriber.js:28:21)
	at InnerSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at MergeMapSubscriber.notifyNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:92:26)
	at InnerSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/InnerSubscriber.js:28:21)
	at InnerSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at CatchSubscriber.Subscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:89:26)
	at CatchSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at MergeMapSubscriber.notifyNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:92:26)
	at InnerSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/InnerSubscriber.js:28:21)
	at InnerSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at MergeMapSubscriber.notifyNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:92:26)
	at InnerSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/InnerSubscriber.js:28:21)
	at InnerSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at MergeMapSubscriber.notifyNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:92:26)
	at InnerSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/InnerSubscriber.js:28:21)
	at InnerSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at /Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeTo.js:17:28
	at Object.subscribeToResult (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToResult.js:10:45)
	at MergeMapSubscriber._innerSub (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:82:29)
	at MergeMapSubscriber._tryNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:76:14)
	at MergeMapSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:59:18)
	at MergeMapSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at Observable._subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToArray.js:5:20)
	at Observable._trySubscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:44:25)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:30:22)
	at MergeMapOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:39:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at /Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeTo.js:22:31
	at Object.subscribeToResult (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToResult.js:10:45)
	at MergeMapSubscriber._innerSub (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:82:29)
	at MergeMapSubscriber._tryNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:76:14)
	at MergeMapSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:59:18)
	at MergeMapSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at Observable._subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToArray.js:5:20)
	at Observable._trySubscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:44:25)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:30:22)
	at MergeMapOperator.call (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:39:23)
	at Observable.subscribe (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Observable.js:25:31)
	at /Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeTo.js:22:31
	at Object.subscribeToResult (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/util/subscribeToResult.js:10:45)
	at MergeMapSubscriber._innerSub (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:82:29)
	at MergeMapSubscriber._tryNext (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:76:14)
	at MergeMapSubscriber._next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/operators/mergeMap.js:59:18)
	at MergeMapSubscriber.Subscriber.next (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/rxjs/internal/Subscriber.js:66:18)
	at Request._callback (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/out/src/build/v5/util/streams-rest-v5.js:341:21)
	at Request.self.callback (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:185:22)
	at Request.emit (events.js:200:13)
	at Request.EventEmitter.emit (domain.js:471:20)
	at Request.<anonymous> (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:1161:10)
	at Request.emit (events.js:200:13)
	at Request.EventEmitter.emit (domain.js:471:20)
	at IncomingMessage.<anonymous> (/Users/hegermar/.vscode/extensions/ibm.ibm-streams-0.5.0/node_modules/request/request.js:1083:12)
	at Object.onceWrapper (events.js:288:20)
	at IncomingMessage.emit (events.js:205:15)
	at IncomingMessage.EventEmitter.emit (domain.js:471:20)
	at endReadableNT (_stream_readable.js:1154:12)
	at processTicksAndRejections (internal/process/task_queues.js:84:9)

js-yaml vulnerability found in package-lock.json

Details

WS-2019-0063
high severity
Vulnerable versions: < 3.13.1
Patched version: 3.13.1

Js-yaml prior to 3.13.1 are vulnerable to Code Injection. The load() function may execute arbitrary code injected through a malicious YAML file.

Remediation

Upgrade js-yaml to version 3.13.1 or later. For example:

"dependencies": {
  "js-yaml": ">=3.13.1"
}

or…

"devDependencies": {
  "js-yaml": ">=3.13.1"
}

Always verify the validity and compatibility of suggestions with your codebase.

Bundle output path has Linux-style path separators on Windows

Instead of a backslash \, the output path contains a forward slash/. Need to use OS-specific path separators.

Vulnerability found in diff in package-lock.json

Details

WS-2018-0590
high severity
Vulnerable versions: < 3.5.0
Patched version: 3.5.0

A vulnerability was found in diff before v3.5.0, the affected versions of this package are vulnerable to Regular Expression Denial of Service (ReDoS) attacks.

Remediation

Upgrade diff to version 3.5.0 or later. For example:

"dependencies": {
  "diff": ">=3.5.0"
}

or…

"devDependencies": {
  "diff": ">=3.5.0"
}

Always verify the validity and compatibility of suggestions with your codebase.

Add new Streaming Analytics commands

• Open IBM Streaming Analytics Console: ibm-streams.openStreamingAnalyticsConsole
• Open IBM Cloud Dashboard: ibm-streams.openCloudDashboard

Accessible from the Command Palette (⇧⌘P).

Bundle extension using webpack and compile with Babel

Initial .vsix file size (generated using vsce package): 11517 files, 35.98MB

Initial startup performance with all other extensions disabled (Developer: Startup Performance and Developer: Show Running Extensions commands in VS Code): 413ms

Extension	Eager	Load Code	Call Activate	Finish Activate	Event
vscode.debug-auto-launch	true	1	0	19	*
vscode.emmet	true	3	1	18	*
vscode.git	true	18	2	75	*
vscode.merge-conflict	true	1	2	18	*
IBM.ibm-streams	true	399	14	5	*
vscode.configuration-editing	false	3	1	7	onLanguage:jsonc
vscode.extension-editing	false	7	1	21	onLanguage:markdown
vscode.json-language-features	false	11	4	3	onLanguage:jsonc
vscode.markdown-language-features	false	19	2	19	onLanguage:markdown
vscode.typescript-language-features	false	11	3	0	onLanguage:jsonc

Resources:

• webpack
• Babel
• https://code.visualstudio.com/api/working-with-extensions/bundling-extension
• https://code.visualstudio.com/api/working-with-extensions/publishing-extension#.vscodeignore
• https://devblogs.microsoft.com/typescript/typescript-and-babel-7

Hovers hard to read with dark theme

Hovers hard to read with dark theme due to background color washing into the editor area.

Toolkits aren't being detected correctly when the toolkitPaths setting contains spaces

These values work fine:

• /path/to/toolkits/directory1;/path/to/toolkits/directory2
• /path/to/toolkits/directory1,/path/to/toolkits/directory2

These values do not:

• /path/to/toolkits/directory1; /path/to/toolkits/directory2
• /path/to/toolkits/directory1 ; /path/to/toolkits/directory2
• /path/to/toolkits/directory1, /path/to/toolkits/directory2
• /path/to/toolkits/directory1 , /path/to/toolkits/directory2

Expired JWT Token

Not sure if I had VSCode open for too long, but I got this error when trying to submit:
CDISB5033E The authentication credentials could not be validated. Error is: 'jwt expired at 2019-08-16T02:39:14+0000, current time is 2019-08-16T04:41:12+0000 with leeway of 0 ms'.
Had to quit and restart.

Regex for linting build messages breaks when building an application that's not in a namespace

Example

HelloWorld.spl:9:33: CDISP0053E ERROR: An unknown identifier was referenced in the SPL program: Becon.

vs.

Sample/vwap.spl:110:18: CDISP0053E ERROR: An unknown identifier was referenced in the SPL program: csv.

Vulnerability in "https-proxy-agent" found in package-lock.json

Details

WS-2019-0310

moderate severity
Vulnerable versions: < 2.2.3
Patched version: 2.2.3

There is a Machine-In-The-Middle vulnerability found in https-proxy-agent before 2.2.3. There is a failure of TLS enforcement on the socket. Attacker may intercept unencrypted communications.

Remediation

Upgrade https-proxy-agent to version 2.2.3 or later. For example:

"dependencies": {
  "https-proxy-agent": ">=2.2.3"
}

or…

"devDependencies": {
  "https-proxy-agent": ">=2.2.3"
}

Always verify the validity and compatibility of suggestions with your codebase.

submit dialog has wrong image

The submit selection message has default vscode image, should be IBM Streaming Analytics image

Allow users to re-enter ICP4D credentials

Provide a command so that a user can log in with different credentials. Also, we might want to add a link to re-enter on the error notification message if we cannot validate credentials.

Vulnerability in "acorn" found in package-lock.json

Details

GHSA-6chw-6frg-f759

moderate severity
Vulnerable versions: >= 6.0.0, < 6.4.1
Patched version: 6.4.1

Affected versions of acorn are vulnerable to Regular Expression Denial of Service.
A regex in the form of /[x-\ud800]/u causes the parser to enter an infinite loop.
The string is not valid UTF16 which usually results in it being sanitized before reaching the parser.
If an application processes untrusted input and passes it directly to acorn,
attackers may leverage the vulnerability leading to Denial of Service.

Remediation

Upgrade acorn to version 6.4.1 or later. For example:

"dependencies": {
  "acorn": ">=6.4.1"
}

or…

"devDependencies": {
  "acorn": ">=6.4.1"
}

Always verify the validity and compatibility of suggestions with your codebase.

Nested composite definitions are not recognized

e.g.:

composite MyComposite1(output Out) { ... }
composite MyComposite2(input In; output Out) { ... }

Improve submit job workflow

Current behavior

Automatically open the Streaming Analytics Console and copy the output directory path to the user's clipboard

Proposed behavior

• After a build finishes, display a dialog with two submission options:
  1. Submit: submit with the default configuration
  2. Submit via Console: use the Streaming Analytics Console to customize the submission-time configuration
     • Display a notification with two buttons: Copy output path and Open Streaming Analytics Console
• Support ability to submit an application from the context of a .sab file (new command)

Support building and submitting to an IBM Cloud Private for Data Streams add-on

Prompt user to enter service credentials if none are found

This would set the ibm-streams.streamingAnalyticsCredentials configuration setting.

If SA service is not started, give user the option to start it and retry build/submit

code completions -- turn off fuzzy matching

Code completions show "Fuzzy" matching. For example, File shows anything with file in it, should just show things that actually start with file

Allow users to trigger a build from a Makefile

Instead of forcing users to trigger a build from the context of a specific .spl file, allow users to trigger a build from a Makefile.

Job-Log download improvement

When I download the job-logs a file save dialogue opens. This dialogue opens always with the root-directory as location. It would be nice if this dialogue opens with the last selected download-location or with the home-directory or downloads-directory.

Rename of streams variable not functioning correctly

When renaming a $xyz variable, the rename appears to go through. On closer inspection, the initial "$" disappears. Also, it might be the case that the instances of the variables might not be changed (this needs to be verified).

Note that the "dialog" for rename shows the text of the variable but not the $, whether or not it was selected before the rename. Renaming of the text part only does not retain the "$". Renaming and also providing the "$" does apparently retain the "$" (not sure about the instances).

Expected behavior alternatives:

1. do not show the "$" but use it behind the scenes in the rename
2. show the rename and allow the user provide the entire variable new name

For the latter, it is possible (likely?) to accidentally rename without the "$", since the rename dialog default is to have the entire name selected. Question is, would the user notice that they omitted the "$" when overtyping the whole variable name?

Unhelpful error when the user's Streaming Analytics service is not started

The error message is: Cannot read property 'length' of undefined. Need to handle build error messages more gracefully.

Make it clearer what URL should be used for the ICP4D URL setting

Setting name: ibm-streams.icp4d.url

The user should enter the URL that's used to access the ICP4D UI. For example, if their UI homepage is https://9.114.60.128:31844/zen/#/homepage, then the user should enter https://9.114.60.128:31844 as the setting value.

There is confusion as to which URL to enter... e.g., externalBuildEndpoint, externalConsoleEndpoint, externalRestEndpoint, etc.

Regex for detecting composite names breaks in certain scenarios

Base scenario: Use HelloWorld.spl as a starting point. Then, duplicate the HelloWorld composite and give it a unique name (e.g. HelloWorld2). The application looks like this:

composite HelloWorld {
	...
} // End of HelloWorld composite.

composite HelloWorld2 {
	...
} // End of HelloWorld2 composite.

• If you comment out the HelloWorld2 composite with // and then try to build, the available composite options are HelloWorld and .. The . comes from the // End of HelloWorld composite. comment.

composite HelloWorld {
	...
} // End of HelloWorld composite.

// composite HelloWorld2 {
// 	...
// } // End of HelloWorld2 composite.

• If you comment out the HelloWorld2 composite with /* ... */ and then try to build, the available composite options are HelloWorld and HelloWorld2.

composite HelloWorld {
	...
} // End of HelloWorld composite.

/* composite HelloWorld2 {
 	...
} // End of HelloWorld2 composite. */

---

For both scenarios, I would expect that there is only one composite available to build (HelloWorld), and thus the composite selector should not show up.

Add unit tests

Tests will be written using Mocha, Chai, and Sinon.JS.

• activation
• build
  • build source archive
  • v5
    • actions
    • epics
    • reducers
    • util
      • source-archive-utils
      • streams-toolkits-utils
      • streams-utils
• commands
• utils
  • configuration
  • keychain
  • logger

Running tests

You can run tests using the command line or in VS Code:

• command line: npm run test (note that there must not be any VS Code instances open)
• VS Code:
  • click on Debug icon in left side bar
  • select Launch Extension Tests from the dropdown at the top
  • click on the green play button to run the tests

Resources

• https://code.visualstudio.com/api/working-with-extensions/testing-extension
• https://github.com/microsoft/vscode-extension-samples/tree/master/helloworld-test-sample

Warning for unsaved changes

When I build a spl and there are unsaved changes in the editor window, the tool should emit a warning about the unsaved changes.

Bad completions -- annotations

@parallel ( then ask for completions and you get key which is not allowed and makes no sense.

No support for info.xml toolkit dependency version ranges

We should be able to read intervals for the toolkit dependencies from the info.xml file (e.g.,: [2.0.0,3.0.0)).

See IBMStreams/build-ibmstreams@7911053.

code completions in odd order

The completion list is left at the bottom which is not expected, should be at the top

Add commands to set streamingAnalyticsCredentials and toolkitsPath configuration settings

Would be easier for users. Show an input box where users could paste the values rather than having to navigate to the settings.

Possible command names:
Set IBM Streaming Analytics Service Credentials
Set IBM Streams Toolkits Path

Support job submission with a job configuration overlay JSON file

Reference: https://www.ibm.com/support/knowledgecenter/en/SSCRJU_4.3.0/com.ibm.streams.admin.doc/doc/job_configuration_overlays.html

Improve behavior when executing 'Open IBM Streaming Analytics Console' command

If user executes Open IBM Streaming Analytics Console command and credentials aren't set,

Current behavior: Nothing happens and there is no warning or info message.
Proposed behavior: Show a warning notification with message IBM Streaming Analytics service credentials are not set and a button to Set credentials. After user enters credentials, re-execute command.

Annotations not coloring correctly

Annotations should be in keyword color.

Improve linting support

TSLint is being deprecated. We should use ESLint with TypeScript support.

• https://eslint.org/blog/2019/01/future-typescript-eslint
• https://github.com/typescript-eslint/typescript-eslint

Add package version number to build service request for improved debugging

Snippets for annotations

Current annotation completions are not that useful. You get the annotation name but then have to go thru the process of adding the ( and then getting each key. Better if you could simply drop the annotation template in with all the keys there and tab through them.

should not prompt for missing toolkit path all the time

Submitted a build and got an unexpected prompt for toolkit path which I did not need.

Build commands shown in Output view

Build commands are shown in the context menu of the Output view. Running the command does nothing, however.

Vulnerability in "minimist" found in package-lock.json

Details

CVE-2020-7598

high severity
Vulnerable versions: < 0.2.1
Patched version: 0.2.1

minimist before 1.2.2 could be tricked into adding or modifying properties of Object.prototype using a "constructor" or "proto" payload.

Remediation

Upgrade minimist to version 0.2.1 or later. For example:

"dependencies": {
  "minimist": ">=0.2.1"
}

or…

"devDependencies": {
  "minimist": ">=0.2.1"
}

Always verify the validity and compatibility of suggestions with your codebase.

Allow user to start a Streaming Analytics service if stopped

If a user is adding or authenticating to a service is enabled and the state is stopped, we should show a button that when clicked, will start the service and then retry the addition/authentication.

Improve logging behavior for setting changes

• Better formatting
• Detect changes to spl.trace.server

Grammar should not include $ characters in variable names (unless it's a composite parameter)

Example:

stream <rstring message> $xyz = Beacon() {

$xyz is invalid and will generate the following error upon build:

HelloWorld.spl:9:1: CDISP0412E ERROR: Only the composite formal identifiers must lead with a dollar sign symbol ($). The $xyz identifier is not a valid identifier.