v0.14.0

BlockSuite v0.14.0 is now released with 348 PRs landed and 5 new contributors.
It's currently used in Affine 0.14. This release includes a lot of new features, improvements, and bug fixes.
And it's a version centered around the AI features.

AI Features

Important

The AI features are only available in the Affine AI due to the dependency on the backend service.

We have added a lot of AI features in this release to support the Affine AI project.
Thanks to our team members and contributors (@Flrande, @pengx17, @fundon, @donteatfriedrice, @zzj3720, @doouding, @regischen) for their hard work on this release.

• AI Action Infra: The AI features are supported by a new AI action infrastructure.
• Ask AI Format Bar: The format bar now has a new button to ask AI for help.
• AI Chat Panel: A new AI panel is added to the right sidebar. It can generate text, images, and slides.
• Edgeless AI: The edgeless elements and blocks now can be interacted with AI actions.

Contribution Details

• chore(presets): sync ai create message interface parameters @fundon (#6741)
• feat: format bar ask ai @donteatfriedrice (#6578)
• feat: add slash menu ai button @donteatfriedrice (#6605)
• feat: copilot client @regischen (#6626)
• feat: add basic ai example with backend integration @Flrande (#6661)
• feat: add iframe message template on ai chat panel @fundon (#6701)
• feat: chat panel @regischen (#6645)
• feat: add text action renderer @regischen (#6740)
• feat: add actions renderer @regischen (#6756)
• feat: add slide action @regischen (#6759)
• feat: add discard modal for ai panel @donteatfriedrice (#6765)
• feat: support copy ai answer and fix ui issues @donteatfriedrice (#6774)
• feat: add chat pause @regischen (#6836)
• feat: support clicking to send content to AI @donteatfriedrice (#6846)
• feat: support display answer and error at the same time @donteatfriedrice (#6856)
• feat: add image renderer and fix bug @regischen (#6863)
• feat: pressing escape to stop ai generating @donteatfriedrice (#6917)
• feat(blocks): instantiating Copilot in RootService @zzj3720 (#6528)
• feat(blocks): copilot add EditorHost parameter @zzj3720 (#6529)
• feat(blocks): support real abort for copilot @zzj3720 (#6530)
• feat(blocks): add ai action panel @Flrande (#6567)
• feat(blocks): add action config for ai answer ui component @Flrande (#6580)
• feat(blocks): support custom placeholder for paragraph @Flrande (#6787)
• feat(blocks): add esc tip when iframe is fullscreen @fundon (#6968)
• feat(edgeless): copilot selection widget @doouding (#6497)
• feat(edgeless): add mindmap support @doouding (#6508)

Infra Improvements

• Rewrite the view store to support the new block collection and selector. (#6521, #6672, #6534, #6737, #6780)
  In previous versions, the view store is responsible for managing the views of the blocks.
  It was designed to control different views of the same block, such as the editor view and the preview view.
  However, we found that it's a anti-pattern to render different views of the same block in the same block tree.
  Which makes it hard to track the view by the block model.
  In this release, we introduce the block collection and selector to make it easier to render different views of the same block.

• Introduced the draft model for the transformer. (#6630)
  The draft model is a new model that can be used to transform the block model to a new model.
  It's useful when you want to transform the block model to a new model without changing the original block model.

• Bson for clipboard. (#6526, #6562)
  We use bson for the clipboard mime to optimize the clipboard data serialization and deserialization.

• Add spec builder. (#6976)
  The spec builder is a new tool to manage the block specs.

• Switch to es2022 targets. (#6527)
  We have switched to the es2022 targets to support the latest JavaScript features.

• refactor(store): support streaming editor.doc from empty state @doodlewind (#6522)

• refactor(examples): sync collection lifecycle with provider @doodlewind (#6683)

Embed Doc Polishing

In this release, we have polished the embed doc feature to make it more user-friendly.

• Move embed reload button. (#6502)
• Polish the styles. (#6523, #6536)
• Make embed card toolbar a widget. (#6635)
• Fix the issue that creating linked doc from block selection will loss data. (#6510)
• Fix the issue that users can't jump into doc inside embed synced doc. (#6531)

Database Enhancements

In this release, the Database has seen a series of enhancements aimed at increasing the fluidity of the editing experience, with improvements to keyboard shortcuts and cursor behavior:

1. Supports using the Tab key to move the cursor to the next field (#6565)
2. Supports selecting additional rows using arrow keys (#6941)
3. Clicking on “New Record” now focuses on the title cell of the new row (#6561)
4. Supports filling a column with the same content via drag-and-drop (#6895)

Additionally, enhancements to the title column now allow it to link to another page (#6572).
When you drag Kanban cards to the edge, the Kanban will now automatically scroll (#6614).
The Database will display as many views as possible instead of just three (#6642), and the same goes for filters (#6739).

There are also some experimental features that can be enabled through feature flags:

1. Table now includes a statistics feature (#6560)
2. The Database now supports using Todo blocks from all pages as a data source (#6785)

Documentation Improvements

We've added some new examples thanks to @doodlewind, @L-Sun.

• Add vanilla-indexeddb example. (#6525)
• Add react-indexeddb example. (#6689)
• Add react-websocket example. (#6624)

Community Features

• Lasso Tool: A new lasso tool is added to the edgeless whiteboard thanks to @golok727 (#6602, #6716, #6874)
• Pie Menu: A new pie menu is added to the edgeless whiteboard thanks to @golok727 (#6493, #6571, #6632, #6553)

Detailed Bug Fixes and Improvements

• chore: remove unused code @c0sc0s (#6807)
• docs: commanddata -> commandcontext @golok727 (#6938)
• feat: remove card view box shadow when doc mode @donteatfriedrice (#6532)
• feat: create zod union @F4lkr4m (#6855)
• feat: create zod union @F4lkr4m (#6855)
• feat(edgeless): shift key to constrain to axis @golok727 (#6543)
• feat(edgeless): shift + arrow keys to move elements with 10px inc @golok727 (#6544)
• feat(edgeless): connector keep only one shortcut key L @fundon (#6573)
• feat(edgeless): paste SVG in text/plain mime @golok727 (#6540)
• feat(edgeless): shift + s to toggle between shapes @golok727 (#6634)
• feat(edgeless): note block supports auto complete panel @fundon (#6591)
• feat(edgeless): font family panel refactoring @RubaXa (#6692)
• feat(edgeless): remove the kerning information stored in a font @RubaXa (#6978)
• feat(page): html adapter YouTube import @fourdim (#6705)
• fix: publish script @doodlewind (#6524)
• fix: deletion behavior in DocsPanel component @congzhou09 (#6511)
• fix: clean up documentation content @fourdim (#6558)
• fix: arrow up and down works incorrectly @Saul-Mirone (#6593)
• fix: placeholder visibility and cursor style in readonly mode @L-Sun (#6686)
• fix: frame selection conflicts with note selection @Saul-Mirone (#6802)
• fix: bash escape by ` in PR title linting @lawvs (#6839)
• fix: memory leak @doouding (#6977)
• fix: should not inherit last text element hasMaxWidth prop @donteatfriedrice (#6990)
• fix(blocks): pdf preview @zkwolf (#6659)
• fix: catch error in ydoc transaction and doc getter @Saul-Mirone (#6989)
• fix(blocks): ignore formart-bar-widget&block-selection tags when exporting png/pdf @Tzyito (#6711)
• fix(blocks): the IME sometimes break because of placeholder @Flrande (#6734)
• fix(blocks): do not log error when parse url hostname @Flrande (#6779)
• fix(blocks): page movement due to scrolling into view @fundon (#6776)
• fix(blocks): update list number prefix when updating a block @lawvs (#6790)
• fix(blocks): switch the file-type to @sgtpooki/file-type @lawvs (#6803)
• fix(blocks): should not delete children when transform block type @Flrande (#6840)
• fix(blocks): edge case for toggle link @Flrande (#6841)
• fix(blocks): should not go proxy when it is an onsite image @fundon (#6859)
• fix(blocks): github icon dark mode @donteatfriedrice (#6864)
• fix(blocks): optimize height and position of panels @fundon (#6866)
• fix(blocks): linked doc horizontal card quote block @donteatfriedrice (#6865)
• fix(blocks): video attachments can not be embed @donteatfriedrice (#6869)
• fix(blocks): try fix surface ref note portal stuck @EYHN (#6867)
• fix(blocks): linked doc style without note block or image block @donteatfriedrice (#6876)
• fix(blocks): should reset scroll top while retrying @fundon (#6882)
• fix(blocks): github block title text color @donteatfriedrice (#6887)
• fix(blocks): line break in reference node @Flrande (#6894)
• fix(blocks): do not display name in remote cursor when no user info @Flrande (#6898)
• fix(blocks): missing elements when frames are selected @fundon (#6915)
• fix(blocks): allow users to enter prompt words when content is missing @fundon (#6930)
• fix(blocks): last pos should be updated in not wheeling @fundon (#6939)
• fix(blocks): zoom bar toggle button should be displayed when the width of viewport is equal to 1200 @fundon (#6954)
• fix(blocks): reference node not update as expected @Flrande (#6958)
• fix(blocks): use passive listeners to improve wheel event @fundon (#6960)
• fix(blocks): support config the vertical scroll container of rich-text @Flrande (#6965)
• fix(blocks): block portal should be display: block in firefox @fundon (#6909)
• fix(database): slow first rendering of the Database Block @zzj3720 (#6563)
• fix(database): group as Database cannot keep inbound link @zzj3720 (#6564)
• fix(database): incorrect insertion and focus position @zzj3720 (#6569)
• fix(database): select all text in the rich-text cell by press Ctrl+A or Cmd+A @zzj3720 (#6570)
• fix(database): delete the corresponding cell data while removing row data @zzj3720 (#6589)
• fix(database): cannot move Kanban card when text-field was selected last @zzj3720 (#6590)
• fix(database): incorrect position of detail panel @zzj3720 (#6588)
• fix(database): cannot open detail panel @zzj3720 (#6596)
• fix(database): the first render should not have an empty YText @zzj3720 (#6617)
• fix(database): soft enter removes next character @golok727 (#6691)
• fix(database): can't scroll in database side details @golok727 (#6851)
• fix(database): can't undo in number cell @golok727 (#6912)
• fix(database): rich-text cell level copy and paste @zzj3720 (#6918)
• fix(database): cant move to next kanban card if next group is empty @golok727 (#6910)
• fix(database): drag to fill value conflict @golok727 (#6920)
• fix(database): edge-cases for drag to fill @golok727 (#6942)
• fix(edgeless): horizontal pan with mouse under the windows system @doouding (#6507)
• fix(edgeless): should not be dragged in editing @regischen (#6519)
• fix(edgeless): copyAsPng on shape with rotation has cutoff edges @golok727 (#6537)
• fix(edgeless): connector missing c and x shortcuts @fundon (#6547)
• fix(edgeless): copyAsPng failed to copy on image blocks @golok727 (#6538)
• fix(edgeless): auto complete panel position @fundon (#6579)
• fix(edgeless): connector default color @fundon (#6574)
• fix(edgeless): auto complete panel position when zooming in and out @fundon (#6595)
• fix(edgeless): connector indicator style @fundon (#6576)
• fix(edgeless): code not updated #6622 @golok727 (#6633)
• fix(edgeless): empty element like group or brush should have correct deserializedXYWH @doouding (#6644)
• fix(edgeless): click on the whiteboard throw error when the format-bar is active @Flrande (#6662)
• fix(edgeless): stash/pop of surface element @doouding (#6648)
• fix(edgeless): viewport should not scroll when scrolling in format-bar @golok727 (#6649)
• fix(edgeless): selection when all elements are connectors @fundon (#6652)
• fix(edgeless): remove redundant variables @fundon (#6673)
• fix(edgeless): use relative points @fundon (#6681)
• fix(edgeless): update path in local connector @fundon (#6684)
• fix(edgeless): connector modes display order issue @fundon (#6688)
• fix(edgeless): should not switch shapes in editing @fundon (#6690)
• fix(edgeless): exclude canvas editor when sync range and selection @Flrande (#6685)
• fix(edgeless): element-handle should consider rotation @golok727 (#6717)
• fix(edgeless): curve path bounding box @fundon (#6694)
• fix(edgeless): refine mindmap @doouding (#6736)
• fix(edgeless): selection issue with copilot tool @fundon (#6791)
• fix(edgeless): edgeless issues @doouding (#6781)
• fix(edgeless): paste as note block if all other cases fails @golok727 (#6827)
• fix(edgeless): optimize ai panel user experience @fundon (#6810)
• fix(edgeless): mindmap refine @doouding (#6824)
• fix(edgeless): add a paragraph block when clicking on empty space on the note block @golok727 (#6870)
• fix(edgeless): surface-ref rendering @doouding (#6890)
• fix(edgeless): hide the template in expand/regenerate mind map @doouding (#6888)
• fix(edgeless): refine mindmap @doouding (#6879)
• fix(edgeless): edgeless-index-label has empty reference @doouding (#6893)
• fix(edgeless): prevent mindmap node from adding to other group @doouding (#6899)
• fix(edgeless): support for moving elements by scroll wheel @fundon (#6789)
• fix(edgeless): caret does not display when text is empty @doouding (#6953)
• fix(edgeless): shape text cannot be edited @doouding (#6957)
• fix(edgeless): ai panel text layout @doouding (#6964)
• fix(edgeless): improve element toolbar bottom position @L-Sun (#6969)
• fix(edgeless): focus on mindmap after generate @doouding (#6972)
• fix(edgeless): incorrect cursor style of selected rect @L-Sun (#6983)
• fix(edgeless): text element issue @donteatfriedrice (#6991)
• fix(edgeless): imporve ai pannel position in edgeless @L-Sun (#6993)
• fix(examples): angular compat and list reactivity @doodlewind (#6516)
• fix(inline): select line when triple click @Flrande (#6698)
• fix(inline): delete backward not works in the start of line in firefox @Flrande (#6758)
• fix(page): non-spread markdown list export @fourdim (#6556)
• fix(page): should not remove empty line when canceling insertion @lawvs (#6584)
• fix(page): treat data url as fetchable @fourdim (#6600)
• fix(page): add missing assets back @fourdim (#6641)
• fix(page): the imported markdown file name is displayed by default @Tzyito (#6702)
• fix(page): process mime types in adapters @fourdim (#6732)
• fix(page): support notion plain table import @fourdim (#6743)
• fix(page): import markdown file title @zkwolf (#6778)
• fix(page): add caption when exporting @fourdim (#6845)
• fix(page): hide placeholder when printing @fourdim (#6925)
• fix(playground): fallback to broadcast channel when failed to connect websocket @Flrande (#6618)
• fix(playground): playground debug menu icon in dev mode @doouding (#6742)
• fix(playground): generate random doc id for the starter entry @doouding (#6955)
• fix(presets): fragment import suffix @doodlewind (#6517)
• fix(presets): ask ai in slash menu @pengx17 (#6687)
• fix(presets): should send markdown to remote api @pengx17 (#6699)
• fix(presets): ai message should be encoded @pengx17 (#6707)
• fix(presets): expose global namespace BlockSuitePresets @pengx17 (#6715)
• fix(presets): ai panel response style @donteatfriedrice (#6718)
• fix(presets): fix code error action @pengx17 (#6722)
• fix(presets): support code block in ai text renderer @donteatfriedrice (#6723)
• fix(presets): should stop propagation pointerdown events @fundon (#6725)
• fix(presets): continue in chat action @pengx17 (#6726)
• fix(presets): ai response insert and replace @donteatfriedrice (#6744)
• fix(presets): should extract image when content does not exist @fundon (#6760)
• fix(presets): requestContinueInChat issue @pengx17 (#6768)
• fix(presets): text stream error handling @pengx17 (#6795)
• fix(presets): incorrect error message handling @pengx17 (#6798)
• fix(presets): filter out image blocks @donteatfriedrice (#6815)
• fix(presets): stable get photo url @pengx17 (#6814)
• fix(presets): auto scroll answer text to bottom when generating @donteatfriedrice (#6817)
• fix(presets): insert and replace @regischen (#6819)
• fix(presets): should not show discard modal when showing error panel @pengx17 (#6820)
• fix(presets): add edgeless ai panel entry @donteatfriedrice (#6821)
• fix(presets): should not update ai panel when generation is aborted @fundon (#6822)
• fix(presets): should preprocess html @fundon (#6823)
• fix(presets): add login error handle in chat @regischen (#6828)
• fix(presets): should not send attachments when multiple blocks selected @pengx17 (#6831)
• fix(presets): edgeless ai panel response actions @donteatfriedrice (#6835)
• fix(presets): fix send attachments logic @donteatfriedrice (#6838)
• fix(presets): filter out non text content in text preview @donteatfriedrice (#6843)
• fix(presets): update error message @pengx17 (#6837)
• fix(presets): optimize ai images @fundon (#6847)
• fix(presets): review action list items @pengx17 (#6848)
• fix(presets): review action list @pengx17 (#6873)
• fix(presets): ai text preview without widgets @donteatfriedrice (#6878)
• fix(presets): ai action panel icons @donteatfriedrice (#6880)
• fix(presets): add canvas export options for generating image @fundon (#6881)
• fix(presets): move find actions to the last of generate group @donteatfriedrice (#6886)
• fix(presets): bring explain this code action back @donteatfriedrice (#6889)
• fix(presets): create popper only if more button exists @fundon (#6891)
• fix(presets): ai star icon size @fundon (#6904)
• fix(presets): ai panel bottom padding @pengx17 (#6902)
• fix(presets): mindmap expand @pengx17 (#6921)
• fix(presets): explain image action missing picture @fundon (#6919)
• fix(presets): optimize make it real action @fundon (#6906)
• fix(presets): add new note in right position and change icon @regischen (#6923)
• fix(presets): add user change logic for chat panel @pengx17 (#6932)
• fix(presets): update ai action icons @donteatfriedrice (#6933)
• fix(presets): ai text renderer default style @donteatfriedrice (#6931)
• fix(presets): update slides template @regischen (#6935)
• fix(presets): trim content directly within function @fundon (#6940)
• fix(presets): fix insert below in chat @regischen (#6952)
• fix(presets): chat ui issue @regischen (#6959)
• fix(presets): insert slide bug @regischen (#6961)
• fix(presets): optimize insertion position, left alignment @fundon (#6951)
• fix(presets): refine ai tracking properties @pengx17 (#6966)
• fix(presets): update error message @pengx17 (#6967)
• fix(presets): limit ai text rendering @donteatfriedrice (#6971)
• fix(presets): text renderer scroll behavior @donteatfriedrice (#6973)
• fix(presets): chat input support image paste @regischen (#6979)
• fix(presets): add make it real to doc note @pengx17 (#6980)
• fix(presets): add unauthorized event to ai provider @pengx17 (#6987)
• fix(presets): improve make it real action @fundon (#6988)
• fix(std): outline in editor host @golok727 (#6905)
• fix(store): fix export snapshot error @EYHN (#6877)
• refactor: optimizing element check @fundon (#6653)
• refactor(database): remove duplicate event listener @golok727 (#6913)
• refactor(edgeless): remove redundant code @regischen (#6518)
• refactor(edgeless): remove duplicate return @shvixxl (#6945)
• refactor(store): support more node props in base adapter @fourdim (#6926)
• revert: build: manual split chunks #6654 @fourdim (#6657)
• feat(edgeless): edgeless copilot panel @doouding (#6620)
• feat(edgeless): mindmap gen @doouding (#6675)
• feat(edgeless): edgeless copilot actions @doouding (#6714)
• feat(edgeless): edgeless copilot toolbar entry @doouding (#6763)
• feat(edgeless): expand mindmap action @doouding (#6852)
• feat(playground): add chat panel to playground @pengx17 (#6735)
• feat(presets): new chat panel fragment @regischen (#6514)
• feat(presets): ai actions in format bar @pengx17 (#6679)
• feat(presets): support render ai answer text as rich text @donteatfriedrice (#6682)
• feat(presets): copilot uses documentation as background knowledge @zzj3720 (#6719)
• feat(presets): ai create message @fundon (#6724)
• feat(presets): support image to text @pengx17 (#6727)
• feat(presets): add more doc mode actions @pengx17 (#6733)
• feat(presets): ai images @fundon (#6728)
• feat(presets): ai create an image @fundon (#6746)
• feat(presets): error handling @pengx17 (#6775)
• feat(presets): add UnauthorizedError handling @pengx17 (#6809)
• feat(presets): add chat copy and more button @regischen (#6825)
• feat(presets): add generating placeholder for some ai actions @donteatfriedrice (#6842)
• feat(presets): create an image from user input @fundon (#6849)
• feat(presets): add actions slots @pengx17 (#6860)
• feat(presets): add seed to image generation @fundon (#6900)
• feat(presets): add edgeless actions to doc mode @pengx17 (#6903)
• feat(presets): add beta flags for some actions @pengx17 (#6929)
• feat(presets): add more tracked actions to ai @pengx17 (#6948)
• fix: move slash menu ai entry to presets @donteatfriedrice (#6677)
• fix: should not trigger ai panel when composing @Flrande (#6721)
• fix: use createTextRenderer @regischen (#6738)
• fix: check isComposing @regischen (#6753)
• fix: filter wrong histories data @regischen (#6761)
• fix: get doc scope actions @regischen (#6762)
• fix: edgeless copilot discard modal @donteatfriedrice (#6769)
• fix: hide ai panel when open chat sidebar @donteatfriedrice (#6801)
• fix: filter wrong data @regischen (#6797)
• fix: add chat item order @regischen (#6804)
• fix: flip ai sub menu @donteatfriedrice (#6808)
• fix: blob should has correct mime type @doouding (#6812)
• fix: ai panel answer ui style @donteatfriedrice (#6813)
• fix: add image renderer @regischen (#6811)
• fix: chat panel error not showing @pengx17 (#6826)
• fix: chat bug @regischen (#6834)
• fix: optimize discard cases @donteatfriedrice (#6850)
• fix: copilot selection rect should be considered zoom @fundon (#6854)
• fix: image insertion position @fundon (#6853)
• fix: optimize image size @fundon (#6868)
• fix: ai panel input keyboard behavior @donteatfriedrice (#6884)
• fix: change icon @regischen (#6885)
• fix: focusout event should focus at host when click empty space in edgeless @doouding (#6896)
• fix: error handle and code style @regischen (#6897)
• fix: update ai panel config when handle action @donteatfriedrice (#6927)
• fix: ai error and change tone typo @donteatfriedrice (#6928)
• fix: wait new host to insert markdown @regischen (#6956)
• fix(blocks): ai panel position @fundon (#6747)
• fix(blocks): copilot panel position @fundon (#6750)
• fix(blocks): copilot panel needs to fill the width of the host @fundon (#6757)
• fix(blocks): should not show copilot panel when no element is selected @fundon (#6771)
• fix(blocks): element toolbar should not be displayed when in copilot tool @fundon (#6792)
• fix(blocks): optimize copilot tool user experience @fundon (#6794)
• refactor: make ai panel support config toggle way @Flrande (#6615)
• refactor: move ai spec to preset package @Flrande (#6668)
• refactor: extract common insert and replace logic @regischen (#6786)
• refactor(blocks): copilot entity naming @doodlewind (#6548)
• refactor(blocks): add fullscreen wrapper to iframe @fundon (#6970)
• refactor(database): make the extensibility of the database block more apparent @zzj3720 (#6730)
• refactor(presets): aiconfig provider @pengx17 (#6703)
• refactor(presets): remove copilot client from presets @pengx17 (#6748)
• refactor(presets): iframe and image templates @fundon (#6772)
• refactor(presets): add photo engine to AIProvider @pengx17 (#6764)
• refactor(presets): upload image using blob @fundon (#6872)