You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
SubStrings and InternedStrings solve roughly the same problem.
29
29
But with different techniques and trade-offs.
30
-
If you are using StringInterning you probably don't want a substring anywhere.
30
+
If you are using InternedStrings you probably don't want a substring anywhere.
31
31
Since you might mistakenly end-up holding on to a really big string.
32
32
The very problem this is designed to avoid.
33
33
@@ -150,7 +150,7 @@ Which requires writing more manual memory management (at least reference countin
150
150
than I want to do.
151
151
But like even 16 bit pointers (65,536) are probably just enough for most NLP tasks.
152
152
153
-
One thing to do is to use (on-top of StringInterning.jl), [MLLabelUtils.jl](https://github.com/JuliaML/MLLabelUtils.jl) and encode your strings as Ints.
153
+
One thing to do is to use (on-top of InternedStrings.jl), [MLLabelUtils.jl](https://github.com/JuliaML/MLLabelUtils.jl) and encode your strings as Ints.
0 commit comments