ruby-core@ruby-lang.org archive (unofficial mirror)
 help / color / mirror / Atom feed
From: "tenderlovemaking (Aaron Patterson) via ruby-core" <ruby-core@ml.ruby-lang.org>
To: ruby-core@ml.ruby-lang.org
Cc: "tenderlovemaking (Aaron Patterson)" <noreply@ruby-lang.org>
Subject: [ruby-core:120550] [Ruby master Feature#21005] Update the source location method to include line start/stop and column start/stop details
Date: Wed, 08 Jan 2025 04:55:36 +0000 (UTC)	[thread overview]
Message-ID: <redmine.journal-111357.20250108045535.40939@ruby-lang.org> (raw)
In-Reply-To: <redmine.issue-21005.20250105210016.40939@ruby-lang.org>

Issue #21005 has been updated by tenderlovemaking (Aaron Patterson).


mame (Yusuke Endoh) wrote in #note-12:
> tenderlovemaking (Aaron Patterson) wrote in #note-11:
> > I think we should add a reader method on RubyVM::InstructionSequence to get the node id.
> 
> I don't think it is good for a user to handle `node_id` explicitly.
> Rather, I think Prism should provide a simple method to directly retrieve a node subtree of a Method/Proc object given, like `RubyVM::AST.of`.

I agree. The problem is that `RubyVM::AST` is built in to Ruby, so it has access to `rb_iseq_t` members.  Prism cannot access fields on `rb_iseq_t`.

My idea is to apply a patch like this to iseq.c: https://github.com/tenderlove/ruby/commit/9a54230012d8837a981e0ddec88384ab6ef4db89

Then add code to Prism like this:

```ruby
require "prism"

# Put the following code in Prism
module Prism
  def self.ast_for iseq
    ast = Prism.parse(File.read(iseq.absolute_path))
    node_id = iseq.node_id
    ast.value.breadth_first_search { |node| node.node_id == node_id }
  end
end

# User code is below
f = proc { <<END }
  heredoc
END

iseq = RubyVM::InstructionSequence.of(f)
tree = Prism.ast_for(iseq)
p tree
```

I implemented the Prism method as a monkey patch just as demonstration. But the idea is the same as `RubyVM::AbstractSyntaxTree.of`, where `Prism.ast_for` takes an iseq object and returns the AST for that iseq.

----------------------------------------
Feature #21005: Update the source location method to include line start/stop and column start/stop details
https://bugs.ruby-lang.org/issues/21005#change-111357

* Author: bkuhlmann (Brooke Kuhlmann)
* Status: Open
----------------------------------------
## Why

👋 Hello. After discussing with Kevin Newton and Benoit Daloze in [Feature 20999](https://bugs.ruby-lang.org/issues/20999), I'd like to propose adding line start/stop and column start/stop information to the `#source_location` method for the following objects:

- [Binding](https://docs.ruby-lang.org/en/master/Binding.html)
- [Proc](https://docs.ruby-lang.org/en/master/Proc.html)
- [Method](https://docs.ruby-lang.org/en/master/Method.html)
- [UnboundMethod](https://docs.ruby-lang.org/en/master/UnboundMethod.html)

At the moment, when using `#source_location`, you only get the following information:

``` ruby
def demo = "A demonstration."

# From disk.
method(:demo).source_location  # ["/Users/bkuhlmann/Engineering/Misc/demo", 15]

# From memory.
method(:demo).source_location  # ["(irb)", 3]
```

Notice, when asking for the source location, we only get the path/location as the first element and the line number as the second element but I'd like to obtain a much richer set of data which includes line start/stop and column start/stop so I can avoid leaning on the `RubyVM` for this information. Example:

``` ruby
def demo = "A demonstration."

# From disk.
instructions = RubyVM::InstructionSequence.of method(:demo)
puts [instructions.absolute_path, *instructions.to_a.dig(4, :code_location)]

[
  "/Users/bkuhlmann/Engineering/Misc/demo",  # Source path.
  15,                                        # Line start.
  0,                                         # Column start.
  15,                                        # Line stop.
  29                                         # Column stop.
]

# From memory.
instructions = RubyVM::InstructionSequence.of method(:demo)
puts instructions.script_lines

[
  "def demo = \"A demonstration.\"\n",
  ""
]
```

By having access to the path (or lack thereof in case of IRB), line start/stop, and column start/stop, this means we could avoid using the RubyVM to obtain raw source code for any of these objects. This would not only enhance debugging situations but also improve Domain Specific Languages that wish to leverage this information for introducing new features and/or new debugging capabilities to the language.

## How

Building upon the examples provided above, I'd like to see `Binding`, `Proc`, `Method`, and `UnboundMethod` respond to `#source_location` as follows:

``` ruby
[
  "/Users/bkuhlmann/Engineering/Misc/demo",  # Source path.
  15,                                        # Line start.
  15,                                        # Line stop.
  0,                                         # Column start.
  29                                         # Column stop.
]
```

Notice, for data grouping purposes, I changed the array structure to always start with the path as the first element, followed by line information, and ending with column information. Alternatively, it could might be nice to improve upon the above by answering a hash each time, instead, for a more self-describing data structure. Example:

``` ruby
{
  path: "/Users/bkuhlmann/Engineering/Misc/demo",
  line_start: 15,
  line_stop: 15,
  column_start: 0,
  column_stop: 29
}
```

For in-memory, situations like IRB, it would be nice to answer the equivalent of `RubyVM::InstructionSequence#script_lines` which would always be an `Array` with no line or column information since only the source code is necessary. Example:

``` ruby
[
  "def demo = \"A demonstration.\"\n",
  ""
]
```

From a pattern matching perspective, this could provide the best of both worlds especially if information is answered as either a `Hash` or and `Array`. Example:

``` 
def demo = "A demonstration."

case method(:demo).source_location
  in Hash then puts "Source information obtained from disk."
  in Array then puts "Source obtained from memory."
  else fail TypeError, "Unrecognized source location type."
end
```

This above is only a simple example but there's a lot we could do with this information if the above pattern match was enhanced to deal with the extraction and formatting of the actual source code!

## Notes

This feature request is related to the following discussions in case more context is of help:

- [Feature 6012](https://bugs.ruby-lang.org/issues/6012)
- [Feature 20999](https://bugs.ruby-lang.org/issues/20999)




-- 
https://bugs.ruby-lang.org/
 ______________________________________________
 ruby-core mailing list -- ruby-core@ml.ruby-lang.org
 To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
 ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/

  parent reply	other threads:[~2025-01-08  4:56 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-01-05 21:00 [ruby-core:120488] " bkuhlmann (Brooke Kuhlmann) via ruby-core
2025-01-06 14:39 ` [ruby-core:120504] " Eregon (Benoit Daloze) via ruby-core
2025-01-06 20:20 ` [ruby-core:120508] " bkuhlmann (Brooke Kuhlmann) via ruby-core
2025-01-07  8:51 ` [ruby-core:120517] " mame (Yusuke Endoh) via ruby-core
2025-01-07 11:12 ` [ruby-core:120521] " byroot (Jean Boussier) via ruby-core
2025-01-07 15:23 ` [ruby-core:120526] " bkuhlmann (Brooke Kuhlmann) via ruby-core
2025-01-07 20:04 ` [ruby-core:120534] " byroot (Jean Boussier) via ruby-core
2025-01-07 20:28 ` [ruby-core:120536] " Earlopain (Earlopain _) via ruby-core
2025-01-08  0:40 ` [ruby-core:120540] " tenderlovemaking (Aaron Patterson) via ruby-core
2025-01-08  0:49 ` [ruby-core:120541] " tenderlovemaking (Aaron Patterson) via ruby-core
2025-01-08  1:24 ` [ruby-core:120542] " mame (Yusuke Endoh) via ruby-core
2025-01-08  4:55 ` tenderlovemaking (Aaron Patterson) via ruby-core [this message]
2025-01-08 10:24 ` [ruby-core:120555] " Eregon (Benoit Daloze) via ruby-core
2025-01-08 14:15 ` [ruby-core:120557] " Dan0042 (Daniel DeLorme) via ruby-core
2025-01-08 17:22 ` [ruby-core:120559] " tenderlovemaking (Aaron Patterson) via ruby-core
2025-01-09 14:36 ` [ruby-core:120578] " Eregon (Benoit Daloze) via ruby-core

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=redmine.journal-111357.20250108045535.40939@ruby-lang.org \
    --to=ruby-core@ml.ruby-lang.org \
    --cc=noreply@ruby-lang.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).