Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rustdoc: Format constant values as rich-text and visibility-awarely #99688

Conversation

fmease
Copy link
Member

@fmease fmease commented Jul 24, 2022

In rustdoc, we now attempt to display arbitrary constant values (e.g. structs, arrays). However, we do so intelligently by not showing private or #[doc(hidden)] fields and by creating hyperlinks to the definitions of structs, enums, enum variants, and struct & variant fields. Further, we won't show overly long arrays and (byte) string literals. Instead, we will display a placeholder.
As an aside, a constant value is an evaluated constant expression.

Fixes #98929.
Fixes #99630.

I expect that the UI changes will need some tweaking over time. Consider them an MVP.

The basic framework of the formatter is borrowed from the pretty-printers pretty_print_const{,value} in rustc_middle.
For now, we only pretty-print rustc_middle::ty::Consts and MIR ConstValues. Valtrees are just displayed as _ as I don't
think they surface in rustdoc at the moment since anonymous constants / constant arguments are not evaluated at the time of this writing (see #82852) and just stored as hir::Exprs.

@rustbot label T-rustdoc A-rustdoc-ui

CC @jsha
r? @GuillaumeGomez


You can browse the generated docs of src/test/rustdoc/const-value.rs here (points of major interest: Struct and Protocol).

@rustbot rustbot added the T-rustdoc Relevant to the rustdoc team, which will review and decide on the PR/issue. label Jul 24, 2022
@rustbot
Copy link
Collaborator

rustbot commented Jul 24, 2022

Error: Only Rust team members can ping teams.

Please file an issue on GitHub at triagebot if there's a problem with this bot, or reach out on #t-infra on Zulip.

@rust-highfive rust-highfive added the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. label Jul 24, 2022
@rustbot rustbot added the A-rustdoc-ui Area: rustdoc UI (generated HTML) label Jul 24, 2022
@fmease fmease changed the title rustdoc: format constant values as rich-text and visibility-aware rustdoc: format constant values as rich-text and visibility-awarely Jul 24, 2022
@rustbot
Copy link
Collaborator

rustbot commented Jul 24, 2022

Error: Parsing ping command in comment failed: ...'nst-eval~~' | error: expected end of command at >| ' (lacking '...

Please file an issue on GitHub at triagebot if there's a problem with this bot, or reach out on #t-infra on Zulip.

@jyn514
Copy link
Member

jyn514 commented Jul 24, 2022

cc @rust-lang/wg-const-eval

@RalfJung
Copy link
Member

RalfJung commented Jul 24, 2022

I pretty much copied & pasted pre-existing pretty-printing code and adapted it to the needs of rustdoc:

Is this necessary? The current const pretty-printing is not the result of a lot of careful design, it's just "good enough" for now. It is barely ever seen by users, so there is little pressure to improve it. Given that the rustdoc one will probably be polished, and is seen much more, I think it'd be great if the code could be shared, so that consts as printed in MIR can be (almost) as nice as what rustdoc does.

@fmease
Copy link
Member Author

fmease commented Jul 25, 2022

Thanks for giving some context. I get where you are coming from and I understand your concern about a potential lack of code sharing / potential code duplication.

I think, however, that rustdoc's version of the pretty-printer is going to heavily diverge from the original one both over the course of this PR and over the general lifetime of rustdoc. Already, there are some parts that drastically differ.

In the beginning, I did indeed copy & paste the printing logic but it was a mere starting point – and the only one I'd argue.
Now, my version does not concern itself in the slightest with faithfully rendering all different sorts of inference variables and placeholders, nor pointers and addresses. It simply outputs _ instead. That'd be pretty useless as a debug format.

I really hope that some of my advancements will flow back into the original pretty-printer. Although most of the polishing you speak of will be very specific to rustdoc. Right now it consists of hiding private and hidden fields, hyperlink anchors and ellipses for long arrays and strings. I am not sure whether they fit your use case but I'd be happy to be corrected :)

@GuillaumeGomez
Copy link
Member

Overall it's really great! I didn't review too much into the details since we need to have everyone on board with this change but I'm really hopeful about this.

cc @rust-lang/rustdoc

@RalfJung
Copy link
Member

@fmease that does sound reasonable; I wanted to make sure you thought about this. :) Would be good to ensure the PR description reflects the final reaosning when the PR lands (as that will be embedded in the git history, too). I'm not familiar enough with the code to really make any concrete suggestions here. Let's see if @oli-obk has any ideas.

src/librustdoc/html/render/constant.rs Outdated Show resolved Hide resolved
src/librustdoc/html/render/constant.rs Outdated Show resolved Hide resolved
@fmease fmease force-pushed the rustdoc-fmt-const-vals-as-rich-text-vis-aware branch 2 times, most recently from e094a0a to 097a3ff Compare July 26, 2022 17:07
@rust-log-analyzer

This comment has been minimized.

@fmease fmease force-pushed the rustdoc-fmt-const-vals-as-rich-text-vis-aware branch 2 times, most recently from ee5d85f to 33570cf Compare July 27, 2022 20:07
@fmease fmease changed the title rustdoc: format constant values as rich-text and visibility-awarely Rustdoc: Format constant values as rich-text and visibility-awarely Jul 27, 2022
@fmease fmease marked this pull request as ready for review July 27, 2022 20:08
@rustbot
Copy link
Collaborator

rustbot commented Jul 27, 2022

Some changes occurred in src/librustdoc/clean/types.rs

cc @camelid

Some changes occurred in HTML/CSS/JS.

cc @GuillaumeGomez, @Folyd, @jsha

rustdoc-json-types is a public (although nightly-only) API. If possible, consider changing src/librustdoc/json/conversions.rs; otherwise, make sure you bump the FORMAT_VERSION constant.

cc @CraftSpider, @aDotInTheVoid

@fmease fmease force-pushed the rustdoc-fmt-const-vals-as-rich-text-vis-aware branch from 33570cf to 2385e24 Compare July 27, 2022 20:11
@rustbot rustbot added T-bootstrap Relevant to the bootstrap subteam: Rust's build system (x.py and src/bootstrap) T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue. labels Jul 27, 2022
@fmease fmease force-pushed the rustdoc-fmt-const-vals-as-rich-text-vis-aware branch 2 times, most recently from d8a007a to 5266047 Compare July 27, 2022 20:24
@rustbot rustbot removed the T-bootstrap Relevant to the bootstrap subteam: Rust's build system (x.py and src/bootstrap) label Jul 27, 2022
@bors
Copy link
Contributor

bors commented Aug 2, 2022

☔ The latest upstream changes (presumably #100063) made this pull request unmergeable. Please resolve the merge conflicts.

@GuillaumeGomez
Copy link
Member

I think the current version is a great improvement. I expect some UI fixes to follow but we can see that later.

@RalfJung @oli-obk: Is it ok for you to approve this PR?

@bors
Copy link
Contributor

bors commented Aug 9, 2022

☔ The latest upstream changes (presumably #100318) made this pull request unmergeable. Please resolve the merge conflicts.

@fmease fmease force-pushed the rustdoc-fmt-const-vals-as-rich-text-vis-aware branch from 637e156 to c5a4d38 Compare August 9, 2022 18:27
@bors
Copy link
Contributor

bors commented Aug 10, 2022

☔ The latest upstream changes (presumably #100346) made this pull request unmergeable. Please resolve the merge conflicts.

@fmease fmease force-pushed the rustdoc-fmt-const-vals-as-rich-text-vis-aware branch from c5a4d38 to 6ef267a Compare August 10, 2022 11:28
@RalfJung
Copy link
Member

This is not changing the const-eval interpreter or its const representation in any way, and presumably uses the existing APIs in much the same way as the existing pretty-printer, so I don't think there is much I can contribute here in terms of reviewing -- unless you have questions about specific const-eval / interpreter APIs.

So, I leave the decision here up to the primary maintainers of the rustdoc crate.

@lcnr and @oli-obk know better than me what is planned for const representation and valtrees, which affect this much more than my own work on the interpreter internals.

@GuillaumeGomez
Copy link
Member

Let's wait to see if one of the two has something to add then. :)

@lcnr
Copy link
Contributor

lcnr commented Aug 13, 2022

my current goal would result in constants in patterns always being fully opaque using PartialEq and for us to not support partial valtrees. Not sure if that's possible, haven't had a lot of time for this recently.

This means that to print associated constants, you will have to continue using the ctfe representation as they might not be representable using valtrees. Constants in the type system, i.e. array lengths or arguments for const parameters, will all be representable using valtrees but the compiler has to be able to convert them back to the ctfe representation anyways as they might be used as values by const eval.

I think printing mir constants for rustdoc isn't great, but it seems unavoidable if you want to print associated consts. Also using that routine for type system consts is better than having two routines, one for valtrees and one for associated consts.

The approach therefore feels appropriate to me as long as the rustdoc team has to capacity to maintain this printing routine.

@GuillaumeGomez
Copy link
Member

Ok, thanks for approving it. This is now something we need to discuss with @fmease and the other rustdoc team members then.

@bors
Copy link
Contributor

bors commented Aug 14, 2022

☔ The latest upstream changes (presumably #100511) made this pull request unmergeable. Please resolve the merge conflicts.

@fmease fmease force-pushed the rustdoc-fmt-const-vals-as-rich-text-vis-aware branch from 6ef267a to 85c0d9e Compare August 14, 2022 13:55
@bors
Copy link
Contributor

bors commented Aug 15, 2022

☔ The latest upstream changes (presumably #100595) made this pull request unmergeable. Please resolve the merge conflicts.

@GuillaumeGomez
Copy link
Member

So we already have two approvals from here. The discussion on zulip seems stalled so do you think it's okay to merge this as a first step @rust-lang/rustdoc ?

@fmease
Copy link
Member Author

fmease commented Nov 3, 2022

This PR is currently blocked by an RFC I am in the process of writing as per Zulip discussion.

@rustbot blocked

@rustbot rustbot added S-blocked Status: Marked as blocked ❌ on something else such as an RFC or other implementation work. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Nov 3, 2022
@fmease
Copy link
Member Author

fmease commented Aug 26, 2023

I don't think it makes sense to keep this PR open, it's too bit-rotten. Further, this feature won't land as is anyway but hopefully as part of a more general and flexible mechanism dubbed #[doc(const_display)]. See Zulip topic.

@fmease fmease closed this Aug 26, 2023
@fmease fmease deleted the rustdoc-fmt-const-vals-as-rich-text-vis-aware branch August 26, 2023 22:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-rustdoc-json Area: Rustdoc JSON backend A-rustdoc-ui Area: rustdoc UI (generated HTML) S-blocked Status: Marked as blocked ❌ on something else such as an RFC or other implementation work. T-rustdoc Relevant to the rustdoc team, which will review and decide on the PR/issue.
Projects
None yet