* [ruby-core:118132] [Ruby master Bug#20517] `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string.
@ 2024-06-01 3:37 tompng (tomoya ishida) via ruby-core
2024-06-01 10:40 ` [ruby-core:118134] " nobu (Nobuyoshi Nakada) via ruby-core
` (2 more replies)
0 siblings, 3 replies; 4+ messages in thread
From: tompng (tomoya ishida) via ruby-core @ 2024-06-01 3:37 UTC (permalink / raw)
To: ruby-core; +Cc: tompng (tomoya ishida)
Issue #20517 has been reported by tompng (tomoya ishida).
----------------------------------------
Bug #20517: `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string.
https://bugs.ruby-lang.org/issues/20517
* Author: tompng (tomoya ishida)
* Status: Open
* ruby -v: ruby 3.4.0dev (2024-04-11T08:57:52Z master e7f8db9079) [x86_64-linux]
* Backport: 3.1: UNKNOWN, 3.2: UNKNOWN, 3.3: UNKNOWN
----------------------------------------
~~~ruby
Ripper.tokenize '"\\M-あ"'
=> ["\"", "\\M-\xE3", "\x81", "\x82", "\""]
~~~
I expect all tokens to be valid_encoding if the source string is valid_encoding.
Similar to https://bugs.ruby-lang.org/issues/20030
--
https://bugs.ruby-lang.org/
______________________________________________
ruby-core mailing list -- ruby-core@ml.ruby-lang.org
To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
ruby-core info -- https://ml.ruby-lang.org/mailman3/postorius/lists/ruby-core.ml.ruby-lang.org/
^ permalink raw reply [flat|nested] 4+ messages in thread
* [ruby-core:118134] [Ruby master Bug#20517] `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string.
2024-06-01 3:37 [ruby-core:118132] [Ruby master Bug#20517] `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string tompng (tomoya ishida) via ruby-core
@ 2024-06-01 10:40 ` nobu (Nobuyoshi Nakada) via ruby-core
2024-06-04 21:58 ` [ruby-core:118178] " k0kubun (Takashi Kokubun) via ruby-core
2024-07-15 13:02 ` [ruby-core:118607] " nagachika (Tomoyuki Chikanaga) via ruby-core
2 siblings, 0 replies; 4+ messages in thread
From: nobu (Nobuyoshi Nakada) via ruby-core @ 2024-06-01 10:40 UTC (permalink / raw)
To: ruby-core; +Cc: nobu (Nobuyoshi Nakada)
Issue #20517 has been updated by nobu (Nobuyoshi Nakada).
https://github.com/ruby/ruby/pull/10893
----------------------------------------
Bug #20517: `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string.
https://bugs.ruby-lang.org/issues/20517#change-108573
* Author: tompng (tomoya ishida)
* Status: Open
* ruby -v: ruby 3.4.0dev (2024-04-11T08:57:52Z master e7f8db9079) [x86_64-linux]
* Backport: 3.1: REQUIRED, 3.2: REQUIRED, 3.3: REQUIRED
----------------------------------------
~~~ruby
Ripper.tokenize '"\\M-あ"'
=> ["\"", "\\M-\xE3", "\x81", "\x82", "\""]
~~~
I expect all tokens to be valid_encoding if the source string is valid_encoding.
Similar to https://bugs.ruby-lang.org/issues/20030
--
https://bugs.ruby-lang.org/
______________________________________________
ruby-core mailing list -- ruby-core@ml.ruby-lang.org
To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
ruby-core info -- https://ml.ruby-lang.org/mailman3/postorius/lists/ruby-core.ml.ruby-lang.org/
^ permalink raw reply [flat|nested] 4+ messages in thread
* [ruby-core:118178] [Ruby master Bug#20517] `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string.
2024-06-01 3:37 [ruby-core:118132] [Ruby master Bug#20517] `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string tompng (tomoya ishida) via ruby-core
2024-06-01 10:40 ` [ruby-core:118134] " nobu (Nobuyoshi Nakada) via ruby-core
@ 2024-06-04 21:58 ` k0kubun (Takashi Kokubun) via ruby-core
2024-07-15 13:02 ` [ruby-core:118607] " nagachika (Tomoyuki Chikanaga) via ruby-core
2 siblings, 0 replies; 4+ messages in thread
From: k0kubun (Takashi Kokubun) via ruby-core @ 2024-06-04 21:58 UTC (permalink / raw)
To: ruby-core; +Cc: k0kubun (Takashi Kokubun)
Issue #20517 has been updated by k0kubun (Takashi Kokubun).
Backport changed from 3.1: REQUIRED, 3.2: REQUIRED, 3.3: REQUIRED to 3.1: REQUIRED, 3.2: REQUIRED, 3.3: DONE
ruby_3_3 commit:05553cf22d43dd78b8f30cc4591230b5c000c538.
----------------------------------------
Bug #20517: `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string.
https://bugs.ruby-lang.org/issues/20517#change-108622
* Author: tompng (tomoya ishida)
* Status: Closed
* ruby -v: ruby 3.4.0dev (2024-04-11T08:57:52Z master e7f8db9079) [x86_64-linux]
* Backport: 3.1: REQUIRED, 3.2: REQUIRED, 3.3: DONE
----------------------------------------
~~~ruby
Ripper.tokenize '"\\M-あ"'
=> ["\"", "\\M-\xE3", "\x81", "\x82", "\""]
~~~
I expect all tokens to be valid_encoding if the source string is valid_encoding.
Similar to https://bugs.ruby-lang.org/issues/20030
--
https://bugs.ruby-lang.org/
______________________________________________
ruby-core mailing list -- ruby-core@ml.ruby-lang.org
To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
ruby-core info -- https://ml.ruby-lang.org/mailman3/postorius/lists/ruby-core.ml.ruby-lang.org/
^ permalink raw reply [flat|nested] 4+ messages in thread
* [ruby-core:118607] [Ruby master Bug#20517] `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string.
2024-06-01 3:37 [ruby-core:118132] [Ruby master Bug#20517] `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string tompng (tomoya ishida) via ruby-core
2024-06-01 10:40 ` [ruby-core:118134] " nobu (Nobuyoshi Nakada) via ruby-core
2024-06-04 21:58 ` [ruby-core:118178] " k0kubun (Takashi Kokubun) via ruby-core
@ 2024-07-15 13:02 ` nagachika (Tomoyuki Chikanaga) via ruby-core
2 siblings, 0 replies; 4+ messages in thread
From: nagachika (Tomoyuki Chikanaga) via ruby-core @ 2024-07-15 13:02 UTC (permalink / raw)
To: ruby-core; +Cc: nagachika (Tomoyuki Chikanaga)
Issue #20517 has been updated by nagachika (Tomoyuki Chikanaga).
Backport changed from 3.1: REQUIRED, 3.2: REQUIRED, 3.3: DONE to 3.1: REQUIRED, 3.2: DONE, 3.3: DONE
ruby_3_2 commit:96a82418b2efe98a92f239a9a1cbf30dd396d335 merged revision(s) commit:05553cf22d43dd78b8f30cc4591230b5c000c538.
----------------------------------------
Bug #20517: `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string.
https://bugs.ruby-lang.org/issues/20517#change-109137
* Author: tompng (tomoya ishida)
* Status: Closed
* ruby -v: ruby 3.4.0dev (2024-04-11T08:57:52Z master e7f8db9079) [x86_64-linux]
* Backport: 3.1: REQUIRED, 3.2: DONE, 3.3: DONE
----------------------------------------
~~~ruby
Ripper.tokenize '"\\M-あ"'
=> ["\"", "\\M-\xE3", "\x81", "\x82", "\""]
~~~
I expect all tokens to be valid_encoding if the source string is valid_encoding.
Similar to https://bugs.ruby-lang.org/issues/20030
--
https://bugs.ruby-lang.org/
______________________________________________
ruby-core mailing list -- ruby-core@ml.ruby-lang.org
To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2024-07-15 13:04 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2024-06-01 3:37 [ruby-core:118132] [Ruby master Bug#20517] `Ripper.tokenize('"\\M-あ"')` separates encoding valid string to encoding invalid string tompng (tomoya ishida) via ruby-core
2024-06-01 10:40 ` [ruby-core:118134] " nobu (Nobuyoshi Nakada) via ruby-core
2024-06-04 21:58 ` [ruby-core:118178] " k0kubun (Takashi Kokubun) via ruby-core
2024-07-15 13:02 ` [ruby-core:118607] " nagachika (Tomoyuki Chikanaga) via ruby-core
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).