Dear Community User! We have started the migration process.
This community is now in READ ONLY mode.
Read more: Important information on the platform change.

cancel
Showing results for 
Search instead for 
Did you mean: 
SOLVED

AI assisted coding in NodeRed via Chat

AI assisted coding in NodeRed via Chat

CodeShepherd
Community Moderator
Community Moderator

Is it possible to use a LLM chat bot in NodeRED?

1 REPLY 1

schwaenen
Member

Hi community,

as part of a mere extra curricular activity, I implemented an assistant for coding in NodeRed via a chatbot dashboard.

The main features of this flow are to:

  • Provide a chatbot-like dashboard directly in NodeRed with some nice UX features
  • Enable piping the output of any NodeRed flow‘s node of interest directly to the LLM prompt (no copy&paste), for example for debugging or analysis
  • Utilize open source LLMs ( Large Language Models (LLMs) @ Bosch) from the API marketplace provided by Bosch Corporate Research (free of charge)
  • Allow switching between different LLMs (depending on availability), even in running conversation, without loosing the context 
  • Offer a customizable system prompt

Please find more information along with some use cases/screencasts in the ppt attached. The source code as .json file can directly be imported in NodeRed and is attached as well in the .zip file.

Since it uses the cURL command for the API, I would expect a straightforward implementation of OpenAIs models, but this is not done. I was hoping for an API to AskBosch, but could not convince Bosch BD that this is not just another chatbot.

Looking forward to your feedback,

Markus

 

Icon--AD-black-48x48Icon--address-consumer-data-black-48x48Icon--appointment-black-48x48Icon--back-left-black-48x48Icon--calendar-black-48x48Icon--center-alignedIcon--Checkbox-checkIcon--clock-black-48x48Icon--close-black-48x48Icon--compare-black-48x48Icon--confirmation-black-48x48Icon--dealer-details-black-48x48Icon--delete-black-48x48Icon--delivery-black-48x48Icon--down-black-48x48Icon--download-black-48x48Ic-OverlayAlertIcon--externallink-black-48x48Icon-Filledforward-right_adjustedIcon--grid-view-black-48x48IC_gd_Check-Circle170821_Icons_Community170823_Bosch_Icons170823_Bosch_Icons170821_Icons_CommunityIC-logout170821_Icons_Community170825_Bosch_Icons170821_Icons_CommunityIC-shopping-cart2170821_Icons_CommunityIC-upIC_UserIcon--imageIcon--info-i-black-48x48Icon--left-alignedIcon--Less-minimize-black-48x48Icon-FilledIcon--List-Check-grennIcon--List-Check-blackIcon--List-Cross-blackIcon--list-view-mobile-black-48x48Icon--list-view-black-48x48Icon--More-Maximize-black-48x48Icon--my-product-black-48x48Icon--newsletter-black-48x48Icon--payment-black-48x48Icon--print-black-48x48Icon--promotion-black-48x48Icon--registration-black-48x48Icon--Reset-black-48x48Icon--right-alignedshare-circle1Icon--share-black-48x48Icon--shopping-bag-black-48x48Icon-shopping-cartIcon--start-play-black-48x48Icon--store-locator-black-48x48Ic-OverlayAlertIcon--summary-black-48x48tumblrIcon-FilledvineIc-OverlayAlertwhishlist