as if I don't have enough software bugs, I have actual bugs

Streamed

All things story merging! The limitations of the db model (bug factory), some UI hassles (metadata, knowing which comment is where), unclear practices. So I started reviewing all the merges to build up understanding while working towards better documentation and UI.

Here’s the TSV of all merged stories from the end of the stream.

scratch


all things story merging
  motivations:
    bug factory https://github.com/lobsters/lobsters/issues/1298
    lacking features https://github.com/lobsters/lobsters/issues/519
    unclear ui in stories; which comment replies to what
    not well-explained rules of which is merged into which
    "but my exposure" https://lobste.rs/active
    encourage post links in comments
  draft: https://lobste.rs/s/skds9f/reduce_merge_story_window#c_hm96y1
  original announcement: https://lobste.rs/s/cqq0kg/story_merging
  categorize and review


saccades https://en.wikipedia.org/wiki/Saccade
  unless tracking a moving object, people's eyes snap between things
  people are functionally blind for the couple dozen ms this takes!
  example

                             ^ always face straight
                             |
    you, top-down:    |______O______|




useful examples of merged stories:
  https://lobste.rs/s/imgdoi/keygen_is_now_fair_source
  https://lobste.rs/s/ltwlfp/compromising_openwrt_supply_chain_via
  https://lobste.rs/s/zknzmj/microsoft_acquire_github_for_7_5_billion


# notes about story merging

draft from old comment:

    It keeps discussion together. When other sites split discussion across multiple links it feels like 90% of each discussion reiterates the same points and maybe 10% is generating interesting new ideas. When Lobsters merges a story we don’t waste commenters’ time on reiteration so a much higher percent of the discussion is really high-quality, novel material.
    It keeps the front page uncluttered; I’d rather see 25 different stories on the homepage.
    It reduces the value of writing and submitting hot takes for content marketers. This summer feels like we’ve seen a steady increase in topical-but-promotional stories on Lobsters.*
    It’s useful for hiding. If you’re really not interested in a thread, you click ‘hide’ and it’s gone. Maybe you’ll see it again in a week, but probably not.

deciding which will be the primary story:

  prefer primary sources
    merge in third-party writeups (like news) and responses
    merge in responses
    merge in updates
    except in the case of legal proceedings - ideally we get a lawyer writing for nonlawyers
  prefer technical writups to general news sites
  merge into the earliest submitted

practices in merging:

  one week timeline (pin in this)
    merge candidates submitted within a week of original get merged,
    after a week, the first next story is the target for future merges
    a balance happening here between keeping discussions together and exposure
    hassle: site traffic is strongly cyclical, so like Thu -> Mon is a bigger gap than Mon -> Fri
    option: maybe story merging 'week window' should be a calendar week?
      it's easier to explain, more likely to be seen, builds on natural rhythm

reasons for merging stories:
  duplicate links
  responding to a story
  combine series/update posts
  don't use stories as a super-reply/super-response/super-comment, link in a comments

tied together:
  clarity in which story a comment replying to
  super-replies
  highlighting best links in a story
  -> what if a comment could be promoted to a story by commenter, mod, readers
  -> clean up the metadata on links at the top of the page, first item's meta apepars below merged stories
  -> in comments, repeated each story's title as a section header for "its" comments
  -> rather than organize top-level comments by score, they'd be in their story sections
  -> possibility of continuing to vote on individual stories tio sort comments


title:
  as if I don't have enough software bugs, I have actual bugs

post-stream:
    

Transcripts are autogenerated. Warning: the system currently mistranscribes basically every username and technical term.

Recording



02:46jangomandalorian Hey @pushcx , long time no see
Pardon? Starting a minute late. Oh, that was me. Almost spilling my nice big glass of water across my entire desk. Wouldn’t that have been a great distracting way to start stream when I’m already running late. Oh, boy, frici Oh no, starting stream with a keyboard bath is never a good idea HahaSweat
give me one second. It’s only a splash. But if I get it off of shit, here we go. All right. Hello. Hello? Yeah, it was very, I don’t know if that came through on the mic, but you might have heard the whole, like pint glass of water wobbling on the surface of the wooden desk. I, was moving something out of the way and caught it and it, it thought about tipping over and just barely didn’t, it probably would have gone straight into the keyboard too. Oh, boy. Luckily, you know, even that wouldn’t be the end of the world because there are several spare keyboards around. I got into, mechanical keyboards. Gosh, I don’t know, seven years ago. So I’ve soldered a few. I’m not sure there’s one within arm’s reach that uses Cordy though. Yeah, it’s been a couple of years but I was using the Norman layout and it’s lovely. But I never did get the, it, the speed back. So let’s not allow that guess I missed closing something there. I don’t know if the, five seconds of rock came through there. All that aside. Nice to see you for C Django Mandalorian and then for everybody else. This is the lobster’s office hours stream where twice a week I take any kind of questions that folks have about the site, the community, the code base. And when folks don’t have stuff, I work on the site usually that’s code. But my plan for the day absent questions is more writing, which is why this stream started 20 minutes late. There was the big meta topic last week around the brave browser. I just left a comment that is about that and I’m just not a particularly fast writer, especially when I’m trying to be clear about contentious stuff. So I was working on that comment and then working and working and working and I realized it was just gonna be better to pause the stream than wait another couple of hours cause it’s already been a couple of days of reflecting on it. So that’s about that.

05:50How are folks doing? I see a lot of familiar names in the the user list. Thanks for coming back. Although I understand it’s rude in twitch to call individuals out. So I won’t, my, my general plan was to talk about story merging, which has come up on the stream a couple of times. I guess that’s part of why it’s in my head is maybe three streams ago. We talked a little about the U I of story merging, which is this item here. frici Now you got me curious, time to find out what the large stream blocker comment was 👀
But I’ve got a couple of couple of reasons I think it’s worth spending some more time on story merging.

06:37 Yeah, we can just here. I can find the link real fast. It’s whatever my last comment was, which the Threads page should have. Some were down here, pushcx https://lobste.rs/s/iopw1d/what
many big threats. It’s this one I’m talking about. So let me grab this link. Oh, yeah. What is this? Like 600 words?

07:13Yeah, I learned in college writing papers that I could write a good paper at a rate. Almost exactly one page per hour. So if I had a five page paper to write, I could just block off five hours and I would write it and it was always, always that amount of time and I would get really good grades on papers. that was pretty consistent but then just I am such a slow writer when I’m going for quality. obviously silly comments. I can bang out pretty fast. But having worked with jmiven hello!
professional journalists, I mean, I was a professional journalist at the Washington Post but like I did, I built sites that went along with news stories rather than directly writing articles myself. And, yeah, I guess the other thing I did that was journalism was, I built the, the Tech Crunch job board and did some other stuff in the early days of Tech Crunch. I had a contract with the New York Times that didn’t work out anyways. I gotta get in gear. I’m, I’m distracting. but I was always impressed by the, espartapalma Hi Hello, folks
bsandro VoHiYo
the pros journalists will call them who could just bang out stories so fast because I would look at the stuff they would write and I’d be like, oh, that would take me two hours to write and they’d write it in literally 15 minutes. Professional writers. Pretty cool. Ah, hey Jay Ivan, that’s part Biss Sandra. Welcome back, folks. Nice to see so many familiar faces. I didn’t actually expect that for lobsters hours that there would be, you know, a nice little core group that returns, but that’s been super pleasant actually. So absent meta stuff. The other meta stuff is story merging. I had talked a little, oh, because it’s such a usual stream fixture. I should maybe mention there’s been no movement on any whole request since the last stream. So I’m just not even gonna go there. The pushcx https://github.com/lobsters/lob
this bug that we talked about on stream a little while ago and I’ll throw the link and chat

09:46was kind of funny because let’s, let’s actually have that open on a tab for an example of story emerging because not that guy. Which one was it? Yes. Not this thread. Didn’t I put it in my notes. Yes.

10:22pushcx https://lobste.rs/s/skds9f/redu
So this comment is where I did a big write up of story merging a while ago. And let’s get rid of that highlighting for contrast, the, the funny bit that popped out at me was saying, oh, if the saving feature doesn’t work properly on merge stories, that’s a bug and please file it. And if saving is broken prob hiding probably is as well. So I wrote that September of 2019 and then August. So almost exactly five years later, we had this bug reported that. Oh yeah, if you hide a story, it doesn’t actually hide all the comments on the story. So the the gist of the way story merging works is it’s kind of a bug factory. So here’s a really small example of merging stories where there was an official blog post and then also someone submitted. I think Keygen created this fair source thing. These were the two things. So they announced that they were becoming fair source and then they created this fair source group. So since they were the same topic from the same company, I merged the two stories together. And so you can kind of see an example of, well, there’s two headlines and then this text is a little funny and then if we dig down somewhere in the ah yeah. So like here’s some comments from the merged Story, they get this icon on the front and they have the title of the story on the right. And if you’re just skimming along it, especially for the top level comments. So like this one, a consistent thing that comes up is basically people miss this U I, they don’t notice this title. And so actually this is a great example because this person says, 02 years, so they are responding to something that is in the article. But if you’re just browsing this story, it’s not super clear which of the two links they’re responding to people just they missed this part of it. And this U I is not super useful inside of a story because so we reuse this template for comments and every place that we print comments, we use this template. So this links to the story, but on a merged story, this just kind of like links to the page and it tells you it’s merged, but it’s not clear. Oh If you want to understand why this person is saying two years, you have to click the second link, not the first.

13:34jmiven just as a note before I forget: if I'm not mistaken, yawaramin is waiting for a comment in PR #1383 :)
So the way merging is implemented a note before you forget. Oh, they’re waiting for a coming to the pull request. That’s that’s worth interrupting for cause otherwise, I was just gonna go into story emerging for pretty much the whole time. So,

14:00all right. So there was this, I reviewed it. Oh That’s great.

…28How, how long was that sitting? That I missed it? Two weeks? Oh man, I must have clicked in and accidentally cleared that little blue line that notes that it’s new and then I just never looked back.

…48It’s indenting a good idea. Honestly, people miss the indented message for editing titles. Let’s find that code to refer to it. We use that before. Aren’t that? So that’s over in location. Js has the what is it called? Delimiter? No separator. Yeah, here we go. The check story title has a really simple bit of code that just says if you see one of these punctuations, the dash, the colon and then like the N dash, the M dash A pipe A dot A different dot or the word by. We’re probably seeing a title where someone that was automatically fetched from the page and it’s something like cool things in Python pipe blog by Alice Smith. And we don’t include the blog by Alice Smith on the end of titles. It’s just a style issue. And so there’s this really simple title reminder that says, hey, look, if we have one of those, just that is the best time to tell people this, which is what is that over in the story form. Yeah, it says please remove extraneous com components from titles such as the name of the site blog section and author. This is pretty much lifted from the story guidelines, but those appear below the story and they don’t show up all of the time. Usually the the guidelines are collapsed. So it’s deliberately echoing that text.

17:46How does that answer? See Yah Warman is kind of implicitly asking what the message should be here. So speaking of slow writing.

18:09Yeah. So the thing that I wanna see out of this message is that it is clear to the submitter that we just replaced the thing they pasted because so their example here even is kind of similar like it’s a short Euro, but it’s very often the the last part of the URL that has changed. So here it’s just a trailing slash, but sometimes it’s a dot html or a dot PHP or a something else way out at the end of the URL. And when I say way out at the end, I mean, some URL s are so long, it’s off to the side in the box and when people are tabbing along in this form, the next field title is right below. And as soon as they out focus this title typically within, I mean, it it depends on how fast the we can round trip to the target server, but typically in like 50 or 100 milliseconds, we prefill the title. So people’s eyes tend to like just snap down to that next line of the form. And so they’re going to be looking away specifically from the URL and when the human eye moves from one place to another, unless it’s tracking a moving object, it moves in what’s called A CCA. That’s actually pretty cool topic if you don’t know it.

19:56pushcx https://en.wikipedia.org/wiki/S
So the eye basically snaps around. Yeah. So it’s saying what I was saying of if it’s following something that’s moving smoothly, the eyes move smoothly, but otherwise the eyes do a quick simultaneous movement of both eyes. So when people are looking from the URL, they just pasted and then they snap down to the movement. I’m not gonna read the whole Wikipedia page to you. But the useful thing to know there is people are functionally blind when they are Cicada bsandro is it when brain puts a picture into your memory and you think you saw it?
and you can see this yourself. So is there a way of I’m never gonna have a diagram. Let’s make a terrible diagram. This is one of those, this is a little bit like that. What was it called? the card test that I did. That’s an example on screen a month or two ago of, can you recognize which of these cards to flip over in a logic test? B Sandro? I think you’re thinking of like Pariah Dola or bsandro nono
which is when people see faces in things or then there’s another one, I’m not remembering less tracking.

21:59bsandro when you move your eyes quickly to the object
bsandro your eyes can't see anything on the move but your brain can't interrupt the "video stream"
I’m not sure I understand what you’re asking well enough to say if it’s the same thing because, you know, I read about this stuff because I think it’s neat. I’m not any kind of expert on the brain or the visual thing. So as an example let’s see. Let’s make some art, ask you art about it.

22:28All right. So bsandro so once you focus on the image it puts the same image into your memory, and it is uninterrupted - feels like
yeah. OK. So this is a ask your art version, your eyes can’t see anything on the move but your brain can’t interrupt the video stream. You focus on the

…48that could totally be how it works. But I don’t know. My understanding has been that bsandro that's why if you look at the analog clock second hand it often feels that it stays there longer than a second
when you are Cicada, you generally can’t see things and your brain is just used to it and covers the gap like you don’t notice that you have a blind spot in the middle of your vision. Oh Yeah, that one about the, when you first look at a clock, it feels long. Yeah, I know that one. But

23:25bsandro yeah it is a terrible brain hack :D
so here’s ask the art, this is you top down. So assuming you are not where somewhere someone is gonna give you weird looks if you put your arms out to the left and right. So that’s actually here we go.

…55Let’s get a the pipe and a carrot. So I want you to always face straight ahead. Your chin should be pointed directly ahead, say towards your monitor. And then if you lift up your left and right arms and you hold them out and keeping your chin pointed perfectly straightforward, move your eyes all the way to the left and put your left hand with one finger up. You can choose your finger, put your hand with one finger up. So you just see it with your eyes. All the way to the left and then put your right hand, keeping your chin forward, do the same thing. So if you look all the way to your right, you can just see one finger up on your right hand without moving your head, look at your right finger and then snap your eyes to your left finger. It is the longest possible CCA you can do all the way from left to right and it is long enough and slow enough that you may see sort of a bit of blackness in the middle and it’s not really blackness because your inner eye is not a movie camera, but you may realize that in the middle when you’re doing this exceptionally long CCA, there’s kind of a feeling of blankness, you just don’t see what’s in front of you, which is what you would naively expect if your eyes were tracking from left to right. And so if something changes in front of you in that, I don’t know what that’s gonna take. I think the longest CCAS are around 100 milliseconds. So 1/10 of a second, if something changes right in front of you, you’re not gonna see it. And there is a smaller version of this bringing it back to the form where something appears down here and your vision snaps from the URL down. And if the URL changes at the same time, you literally cannot see the change. So that’s why I’m especially careful around forms that change things for people because naively, it feels like they’re looking straight at it. But if they are in the process of moving to the next field or there is an animation happening somewhere else that their attention snaps to, they are blind to the change. So that is the very long way of saying I would like this message to be clear about what happened. And so let’s say

27:00I would like to say canonical, but it’s jargon that people won’t know.

…14So I’m trying to start with the noun of the thing you are caring about and we’re just thinking about.

…58Is there a good?

28:04See, I’m just hoping MDN has a page for it.

…13Is there a ah it’s kind of a shame this talks about search engines. That’s a little distracting and is not why we use it. We use it because we use it for a similar reason, which is there are often many URL S and we want to avoid getting duplicate URL s submitted.

…39That is probably enough. All right,

…51let’s see if that’s reasonable

…59to will be given by the server. I’d like the message to start with the URL as the subject because it’s what the user was just thinking about. Explain an active voice that it was changed when I say active voice. the URL above. No, but then the server is the subject. The URL is the object. Yeah. So I’m not even being grammatical.

29:59Yeah. And I do try pretty hard to write messages in active voice. But in this case, I think it’s clearest for the user if they see the object that they were just paying attention to anyways. Thank you, Jay Mi I I appreciate you bringing up the pr that was hanging around. I didn’t realize it was waiting for attention.

30:35So coming back to story merging, but with the reminder that if you have stuff you would like to talk about on stream, you can just bring up questions most anytime I will either stick them in the dock and come back to them in a few minutes or just jump into them.

…57So we’re talking about how story emerging there is this feature that’s been hanging out where users can submit, suggested title changes, which is very often removing things like the name of the blog or the author of the blog because people don’t always catch that in line help or tag editing where they’re like. Yeah, you know, this is about a programming language and you just tagged programming generally rather than Python or what’s the other one that’s real common? Yeah, I’m not sure there is one that’s quite as ubiquitous as folks leaving and stuff that we take out of titles

31:52so users can do that, but they cannot suggest story merges. And that one is also it’s been there was a discussion on the site. I don’t think this one, the other merging story guy that I clicked by and I closed it. But there’s like in a narrow technical sense, allowing users to set the merged story ID column is the exact same functionality as allowing them to suggest title. And it’s just as easy to reverse. But then like the resulting UU I of merged stories is a little bit clunky and it’s not clear to submitters what that means. We’ll talk about that in a minute. And so I’ve been reluctant to pick this up even though it’s been an obvious feature for 6.5 years. And I noted down here today when I was reviewing before the show that we talked about the story controller yas application to lean more into rails by splitting up the story controllers actions like allowing users to suggest or allowing mods to edit into their own controllers. And it would also benefit from the reactor refactor in 1298 which is already open. It’s the bug from the bug factory where a feature does not interact well with story emerging because story merging is implemented as each story has a column in the database called Merged story ID. And so the story table and Rails is very table oriented. It makes the story table kind of equivocate between whether a story is a single link or a single text. And then the alternate thing it could be is a merged story, which might mean the group of all stories that were submitted to make this one entry, which is kind of how the URL thinks of it or the target for all of those merged story ID columns, which is again an individual link, but that one that becomes kind of special and I call it the Bug factory because as I put it on the post leading up to the stream, if anybody follows me on blue sky or Mastodon story is a God object and then everything that interacts with it has to have the complexity of checking the merged story ID column in both directions. Both is this story merged into others and are other stories merged into this? And then it’s not clear. So the way the hidden stories table works is it is a very small join table from user ID. In this case, Gustav who is here sometimes I think to story ID and so in the extra step of looking up comments, it doesn’t respect the story merging and it, yeah, it really should.

35:53So maybe last stream or the one before where to go.

36:07I’d have to look back at the scratches. We talked about some options for how to factor this and how I was kind of blocked on what to call the two entities resulting. And after sleeping on it for a few days, I really come along to doing the opposite of what I wrote in this issue and having a headline which is the item that can appear on the front page. that, that seems nice. And then a story is the individual link or text and or text if we want to be pedantic and then features like hidden stories becomes hidden headlines and they are forced to say, oh yeah, someone has hidden this headline. So we are merging, you know, all stories listed on it and the common case is going to be that there is exactly one. But every time there’s a merge, we’re gonna merge the others or include the others. I hope that’s clear how we factoring this would, would solve the bug factory because then every story, regardless of whether or not it’s merged has the same database structure and it’s not strictly needed for fixing some of the UIs stuff, but it always seems nicer to fix database issues before U I issues.

37:57So we’ve talked about the bug factor, we’ve talked about features, we don’t really have the other feature we don’t have that people kind of want is down here for. But my exposure, so especially when people are self promoting or trying to rebut something that they are really disagree with. They get pretty unhappy about seeing their link submitted even when they are very explicitly submitting it to respond to an existing story. And we merged to keep our discussions together to avoid having to rehash things. But people feel like they are missing out on exposure and this is kind of an uncharitable way of putting it. But my exposure, I don’t have a better way to put it because people don’t usually explicitly say that they feel entitled to one of the 25 slots on the home page, but that’s what they want. And it’s not obvious because the story disappears from slash newest when it’s merged into something else. And that’s one of the ways that people read the site. But those discussions do show up on slash active. So if any story in emerged story and I don’t, are there any on the page here, Firefox, is that why is there a, this is one of those stories that sounds like it’s gonna be about using software instead of actually making software, which is not a super strict distinction on the site for topicality. But I think about it a little bit,

40:02Firefox is also a developer tool. So yeah. Oh, here we go. Here’s a merged story. So it’s not obvious from this list, but this one has had another link merged into it and it’s ordering on slash active is the latest comment in any of its merged stories. So the exposure is there and this is why I put slash active like literally next to the logo. The top thing in the upper left, this was only about pushcx https://lobste.rs/s/ltwlfp/comp
2.5 years ago and so on a regular basis, long time users still notice slash active for the first time. Yeah, I’ll throw this one in as long as I’m sharing an example, Mert’s story and then in the where are we in the notes here? I will throw in that we have a couple of examples

41:11and no discussion of merged stories would be complete. Speaking of examples without the most merged story in Lobster’s history. Does anybody know what it is offhand? This has come up on the site? I know it’s come up in the chat room maybe two or three times over the years.

…37The story and Lobster’s history that includes the most links merged into it bsandro hehe
is Microsoft acquires github. I think that’s the title that ended up getting used.

42:04Yeah, here we go, Microsoft to acquire github for 7.5 billion. frici holy…
So this one has pushcx https://lobste.rs/s/zknzmj/micr
123456789, 1011, 1213 linked into it. Yep, that is the most and I included because I think it’s always useful to have these kind of outliers to understand. Well, what’s the most extreme version of this? bsandro hah even ddevault is there
And I think it is to the site’s benefit that all of these got merged together. Oh, there’s actually like 1/14 link that the original submitter put into the story text. Yeah. So one of the places that merge stories are especially useful is hot take responses. Like a bunch of these are like this one. Floss rambling on Microsoft buy github has sold us out like these are people who have moralizing quick responses rather than very deep. What does this mean kind of reflection? Because if we went and looked at these dates, so 649 15 and then the first one that kind of sounds like response is 64, 1255. So like in 3.5 hours, did this user think extremely deeply on it and come up with not user author, think deeply on it and come up with something not, not really you frici I remember avoiding those stories cause I figured they would be rambling and fighting more than things I could learn or reasonably discuss about
you’re not gonna come up with something deep in three hours, but a lot of this stuff just kinda poured in in the first couple of hours.

44:00frici but i never looked if or how they got merged LUL
This one is also a pretty good example because some of these I didn’t see instantly for the merging. Yeah. And so they had pretty good threads on them. Oh It’s funny, I I just randomly scrolled in here and landed on people talking about story merging. And so then it became some amount of confusing rehashes. People are like, wait, which story are you responding to? Cause again, people just don’t see the part on the right.

…48Yeah. One of the benefits of merged stories is and this one Microsoft to acquire github that is straight up business news, right? Everybody knows it. And I would remove, I have removed many acquisition stories. I left this one up because just get how this ubiquitous we obviously need to talk about it by the fact that it was submitted 14 different links. I think it was worth bending the rules on topicality. A little there. And Fritchie, what you’re saying really gets to one of the benefits of story emerging is if you don’t want to get into it, you can ignore that story. You can click hide on that story. Well, not that it works perfectly, but it mostly works and you can move on with your life. A lot of the times there’s lots of stuff where you’re like, you know what I’m not required to have an opinion on this. How’s that that Seneca quote? Go

46:07oh yeah, there it is. Oh, not Seneca Aurelius, I guess I got close enough. We have the power to hold no opinion about a thing and to not let it upset our state of mind for things have no natural power to shape our judgment. So meditations is a series of notes that Aurelius wrote to himself. So you can read this as someone saying like, dude, you don’t have to carry about every bit of news that passes by. You don’t have to have a hot take. You know, that would be the modern translation. You can just let events go by. And if you don’t have an opinion on this kind of thing, you can click hide on the story and move on as opposed to if we didn’t have story merging, it would have been basically the whole front page for two or three days. call it half of the home page. But story emerging, one of the things it does just by existing is it is it encourages people to post in comments. Oh, there’s a topic. Yeah, put that in the notes.

47:22So I just shoved that in the scratch scratch file, but it encourages people to leave comments with links instead of starting more stories. So I’m not gonna go through this one. But if we didn’t have story merging, and this was the first time we’ve had story merging, we probably would have seen at least five or 10 more links as people were responding to stuff and then linking in comments instead of submitting top level stories. As I recall the next two or three days, the hacker news home page was just all Microsoft buying github and I think our programming was similar. pushcx https://lobste.rs/s/skds9f/redu
So that’s one of the benefits of story merging. Speaking of the benefits of story emerging.

48:20So five years ago, this person said they quoted the about page and said a lot of what we’ve talked about where there are downsides to story merging, where it feels like they vanish from the home page. Oftentimes in the middle of active discussion, this might even be where I picked up the word active because at the time of this post, we did not have active up in the top level merging, disrupts the comment threading where it’s really unclear by the U I and then this one relevant and interesting news effectively get hidden from a large part of the readership that is kind of the first post. Again, I think maybe the difference is, or first point again, I think maybe the difference is no, I don’t know another way to put that besides it’s about exposure.

49:27I guess the and their example here is breaking news that had developments and breaking news is especially prone to having pretty rough discussions as people both rehash what came before the the news and then react to the title. And when we have stories where people react to the title, which mostly is paywalls, but then also happens a lot with news, we have more likely incendiary discussions and don’t really get anywhere interesting, which is why paywall stuff gets removed.

50:22Yeah, save stories is the bug.

…29So I left a there was a, a solid discussion about this one arh68 so may I ask: how many merges have there been, like total ?
and I improved the description of merging on the about page based on it, but in the years since cause it has been five years. I’ve come to think that arh68 is it like 1/week or smth
how many mergers have there been like total? Let’s check. Oh A Rhi was wondering if I’d see you. We had a weird event maybe two days ago. Yeah, it must have been Sunday cause I was Yeah, well, Sunday, someone submitted a story about Mozilla rebranding and they had a user name similar to yours. And oddly enough, they submitted a story and then like an hour later came back and deleted their account and it was a, it was all done by the time I saw it, but they had just gotten a couple of anodyne comments about branding and then arh68 huh kinda weird. not me tho
I was really puzzled by it. I was hoping it wasn’t you, but they did have a user name similar.

51:48arh68 1 username's enough for me
OK. Well, glad you’re still with us.

52:03So when you say how many mergers have there been?

…12I wanna make sure I’m making this join in the right direction. Where’s that other example? That one was also too. So, so a Rh for your query, would you count this as one or would you count this as 13? arh68 oh like 13
Well, I mean, just the one target rather than the 12 that were merged in? arh68 the # of merge icons basically
OK, 13. So do you wanna include arh68 1 + is fine<br>the top level one or just the ones that emerged? Number of merge icons? Sure.

53:06What is it? Banana and come here? Oh, red line.

…19not deleted that, I guess it is deleted and it just didn’t wanna autocomplete for me. That’s or not is known.

…42OK. So we’ve had 754 in the life of the sight

…57and then just for a ballpark, this is just top level, there’s 100 and 6000, 237 or maybe a better overall denominator would be 100 yeah, rounded to 100 and 7000. So that’s what,

54:36arh68 1% kinda higher than i'd thought
yeah, 0.7% I mean, it’s almost your user name, right? 0.69 instead of 68.

…57And we get roughly lately,

55:07it feels like we get about 20 or so 20 to 30 links a day. I would have to check. And so that’s a, a story gets merged every couple of days, you know, call it two times a week. I can query out the exact numbers, but that’s just kind of my ballpark.

…45arh68 how is un-merging .. possible ? like is that a mess
So emerging is

…52it is and isn’t a mess. arh68 do votes get moved from mergee to .. &c
It isn’t a mess in the sense of on any given story, you could update that merged story ID column right out to another. You could just update that to know and those comments, like you see this very first top comment, it has the story ID for the Bloomberg one which was reporting. And so if on this Bloomberg story, I clicked on merge this comment tree would move over, but at the same time, and I’m not logged in. So you don’t see the comment box. But if I were logged in and I was mostly wanting to respond to the Bloomberg story or one of the comments and I left a new top level comment, it would always go to this with this story ID rather than say Bloomberg or as somebody else pointed out, Drew de Vault’s response. And so in that sense, it would kind of be a mess. There is no site feature for arh68 how did the story only get 26 upvotes lol
moving threads from one story to another and I could do it in the database. But it would, boy, that would be just dangerous because there’s no, no guardrails if I go to the database and then I have to manually write moderation messages. arh68 i'm losin frames 1 sec
So that 26 up votes is bsandro yeah me too :C
so let’s see. Yeah, it got 31. So it’s air, it’s net 26. So it got 31 up votes and then four flags. But you’re losing one frame one second. I am not getting any kind of error out of arh68 F ?
my streaming setup. BS thinks it hasn’t dropped any frames and the stream health graph is still green.

58:32No. Now the stream, now that I reload the dashboard Twitch says the stream is unstable. Thanks. Twitch.

…49pushcx Twitch says 'unstable', let's give it a sec to clear up…
OK. Are you right? I shouldn’t put this in chat. I should just put it on the screen. Right.

59:18The only

…26a rich, what are you asking about? F pushcx arh68: What are you asking about F?
I don’t know if I’m audible.

…47arh68 F means stream died
arh68 i'm just askin if it died for y'all too
Oh F in the chat f to pay respects. All right. Just took me a second to get there.

…57gtfrvz https://en.wikipedia.org/wiki/P
Yeah, it’s just gone to hell for no discernible reason. It didn’t even rain today. Ah, hey, again, GTFRVZ. Yeah, that’s, that’s the meme. I didn’t how funny to see a, a meme page on Wikipedia instead of on know your meme.

01:00:37Yeah. The situation is really frustrating and I don’t know if it is on Twitch’s end or my end. Probably mine. Right. But s doesn’t show any issue.

01:01:00Hm.

…10Are the Am I audible cleanly or am I? Is my voice also dropping out? Is it just that the video is behind? Because if it’s just that the video is behind, arh68 i think i can hear ya. could you pull up a clock like time dot gov
I can be a little slower jumping around between things and we can keep rolling. But if I’m not audible, I should just stop whether that’s a pause or a give up for the day. Ok. Pull up the clock. Yeah.

…44So let’s bring that in. Mhm.

01:02:03dr3ig it seems to be fine now;it was pretty much unlistenable for a minute
arh68 all good here SeemsGood
chamlis_ after a refresh I think you're good for me
bsandro voice is ok
Seems to be fine now. Ok, good. Yeah, the so Twitch has a little stream health graph that is not always responsive after refresh. You think you’re good. Ok, so please refresh if things are awful and let’s keep rolling. Shameless. Nice to see you again.

…31jmiven only 30s late here and voice is ok
Alrighty, only 30 seconds late and the voice is ok, chamlis_ hi! doing some admin so not paying 100% attention
30 seconds is a lot more delay. Usually the delay tends to be in the 5 to 8 2nd range. I did notice that folks are responding a little slower in the chat. But yeah, so anyways having broken out of that, I will do a, you know, a station bumper that this is the lobster’s office hours. And if you want to talk about the site of the community, frici its 2.30s for me but it can get far more delayed if your side is playing up and we lose frames.
you can pop up anytime with questions and we will talk about it. We are working on otherwise a project to help the site understand itself better, which is to say to talk about what story emerging is to how it works, how it’s implemented, how it can be buggy. Hm. F for, are you saying 2.5 minutes or are you saying like 2.3 seconds? jmiven I think 30s is usual for me and my european DSL link
frici 2.3 seconds lol
Cause 2.5 minutes is a hell of a lot. Nobody’s ever said that much delay before.

01:03:53Hm. 2.3 seconds. Ok. Just, you know, the number was either big enough that it was surprising or small enough that it was surprising.

01:04:10So, in this meta thread I had just kind of drifted into, hey, here’s the virtues of story merging and this was longer than the value of

…32longer than the, the text I added to the about page which we should click over and look at that.

…51So I believe, oh man, so the last couple of streams I have talked about writing stuff and then run to get blame and then no, I didn’t write it or at most I tweaked it a little. So I’m gonna avoid putting my foot in my mouth again about the history of this bullet point.

01:05:16I just actually when I just roll right into it, I wanna say we had like this short sentence and I wrote the later stuff. Oh And I linked a couple of example stories like I’m pretty sure this was me. Yeah. Well, there’s the large example that must have been me because it came well, after J CS left or not left, step down. So

…52I’m basically saying, where is this link to? So this links to J CS S original description of story merging. And I would like to replace this link with a full page description. So it would live at something like lobsters slash story merging or lobsters about slash merging rather than there’s a little blurb here that links off to this kind of out of date thing I say kind of cause like the core of this is the same but this also points to some of the issues or it doesn’t cover some of the issues is maybe a better way to say it. So,

01:07:17so given that nobody has piped up with more site questions. What I was basically gonna do is take this figure out where to stick a page and look at categorizing the existing story merges which I did years ago for ah so many tabs. I can’t keep track of where stuff was, which I did roughly for this where I made a tab separated value of all the merge stories. So we could see the scope of the topic and I kind of skimmed it. This is certainly still true. I really appreciate efforts to try and build a shared foundation for discussion. Remind of that slash about note that I run queries. This is the same kind of impulse that led me this year to start doing these office hours because a big chunk of what I feel is my responsibility as a moderator is to help the site understand itself and sometimes that means you have to run queries against the production database to understand that story merging happens 0.7% of stories. And if we look at the moderation messages for all of the merges, we can get themes of. So the other thing I wanted to include in a document is the practices around story merging. So I believe with that giant github thread that the Bloomberg story was released first, they they beat the press releases into publishing by a couple of hours, maybe less. But we merged into Microsoft’s announcement because it’s kind of the official primary source. And so most of the time we prefer to link to the primary source if it’s going to make enough sense to have context and honestly, the only place I should stop should stop rambling and start making notes, right? So, all right. So the topics here, let’s, there we go. So here’s kind of those

01:09:56topics emerging.

01:10:05It’s a pain in the week timeline. Practices prefer primary source, but for technical write ups to what’s the term here? So if we have, if we have two stories submitted about the same time that are on the same topic, and one of them is like the cnn.com version and one of them is Bob’s deeply technical blog. I would prefer to make Bob’s deeply technical Ball blog the primary write up because the CNN one is gonna spend a lot of time it’s not gonna go into his depth and it’s gonna spend a lot of its time on other stuff rather than the real valuable part for us. So, I guess just two general news sites I try and discourage general news, but that’s neither here nor there. The other thing I was gonna say is for primary sources and this comes up very rarely, maybe every two years in the, except in the case of legal proceedings. And this one has not been a universal practice but stuff that’s come up in the last year or two has driven home the value of it because

01:11:47legal documents have a heck of a lot of jargon and they have a heck of a lot of assumptions and a naive nonla reading of them kind of rounds to worthless. And I say that as someone who has worked closely with lawyers on different products and on contracts for my consulting, I learned many times that my non lawyerly understandings of documents were often just hilariously wrong because I was missing stuff, missing assumptions that they teach in the second year of law school or missing that something was a particular jargon. And so I would interpret a term like reasonable person to just be like, yeah, ok, I know what it means to be reasonable. It’s somebody who’s not flying off the handle. No, actually, that’s a term that’s a legal standard with like 19 big pieces of case law and is a major open doctrine in us legal proceedings. So one example of that, yeah, I don’t think we need to dive into examples and I really don’t wanna like if you’ll pardon the pun litigate those examples.

01:13:20And so for legal matters, we tend to have really pretty good discussions actually when we have a lawyer writing for non lawyers. And that’s happened with, I think the Dino suing Oracle over the Javascript trademark. That’s just happened in the last week or two. And then the other one is there’s somebody who writes about software licensing and I’m blanking on his name. Is there a blue in his name?

01:14:04jmiven kemitchell
jmiven ?
Bye, Ke Mitchell. Yes. J Ivan. That is exactly who I’m thinking of. And is that a, I wanna say he might even be a user on the site? Yes.

…30What’s his site name? Rating dot Ken mitchell.com? Not Ken Ke, I swear there is someone that had the word blue in the title of their name of their

…51Yeah, Blue Oak. That’s what I’m thinking of.

01:15:02That’s a lot of

…12jmiven yeah they are involved in the blue oak thing
this might be just going back to Ke Mitchell again. So this one, there’s a, oh, yep, here he is. Here’s Ke Mitchell again. That’s exactly why I was coming back to it. So, yeah, sorry. This one is writing dot Ke michell.com. So if we swap that out to say pushcx https://lobste.rs/domains/writi
these have been pretty consistently some of the best writing on software licensing that has appeared on the site and software licensing is pretty hot topic. Like, as you can see, by 80 47 37 32 you know, when our median number of comments on stories is like six or seven, we tend to have fairly large discussions and even though these are licensing, they don’t tend to turn into flame wars. I’m not gonna say they haven’t, I’m not gonna say they haven’t gotten contentious because people have a lot of strong feelings about licensing and I don’t wanna dismiss those. But, hm Kyle Mitchell, there is part of what informs this opinion of mine that when we get a lawyer who is explicitly writing for non lawyers, we have our best chances of having a really fruitful discussion. And that is always my north star for the site is, are we having healthy discussions where people are sharing interesting things and forming opinions and feel safe asking questions and building on one another’s knowledge and connecting with people who have shared interests. When we do that, it is the best of an online forum. It is why running Lobsters is so satisfying for me. I love being able to, I don’t know, be the the party host who helps those discussions happen. So that’s why I say the primary source except for law because as a bunch of, you know, programming teaches you to be nitpicky and teaches you to rely on the written word and you kind of we drive into the ditch and I, I say this knowing I, I drove into the ditch many times trying to discuss legal stuff when I just don’t have the training and experience to be able to talk about it with the confidence that is very tempting just from a career spent in programming because they’re, ah, they’re so similar. It’s, you know, it’s writing, made real writing that changes the world. Ah, that’s the whole thing I do as a programmer. Right. So then this other kind of guideline of preferring technical write ups to general news sites, that one’s pretty obvious.

01:18:44jmiven if people haven't seen this article, it's a must-read: https://writing.kemitchell.com/
The mit license line by line. Which one is this?

…57Oh, yeah, this is a great post.

01:19:08I have been occasionally tempted to actually go to law school for dealing with software licensing and other IP issues. Not quite so much. I’ve actually done it, but if there were a remote law school, especially one that allowed me to move at my own pace, I probably would go do that. I’ve looked a couple of times and they all are very oriented around the idea that it is a three year program. There are really only a few law schools that are not full time in person or like night school in person. And that’s really hard to fit into being well into another career and not actually wanting to change careers, just wanting to have a deep understanding of the topic. And the other option would be to find the curricula for a law school and hire some tutors and just do the studying and not the structure. But I don’t know. So where was, let’s grab this link to because this is useful.

01:20:35What is happening here? Clipboard hassles.

…52So let’s go look at these merged stories, right?

01:21:03So we’ll grab that and then we will say what I really would like is, yeah, I better do it at the console interactively and then I’ll dump it to a TSV to look at like the other time that we reviewed all the moderation decisions. All right. So we want to starting from stories. Let’s select the short ID, the title from stories where merged stories ID is not known.

…48I’m gonna say limit 10 just to make it reasonable. Wanted to get wrong here. OK. Open the wrong console. Let’s try that again.

01:22:11It’s merge Story Singular. So here are offhand. These are probably the 1st 10 and

…31

…40OK, so there’s the merges and that’s gonna also include Unm Meges, right?

01:23:01That’s I didn’t mean that.

…09Oh I see. We wanted to say there was a, now the action column is just the whole thing. I keep expecting there to be a verb column on the moderation, but we we don’t actually have that. All right. So we want the ones whose action starts with merged into and that mer has been consistent. We’ve never changed that description.

…47So let’s join against.

…57It’s not story ID, it’s stories dot ID and I’m just building up a table of all the examples where merge story is not me and action is like merged into.

01:24:22I actually wanna see that. It’s the reason I won. There we go. First couple not too informative. All right.

…48Say order by stories ID. Desk limit 10 just to look at the most recent 10. Yeah, this is stuff I’ve written as reasons.

01:25:22All right. So let’s take off the limit

…33and then just to count and I’m not allowed to sub query like that. I just wanted to grab the number of lines real fast. That’s fine. So this is my query and I already can tell I’m gonna have red line hassles in two seconds, but that’s ok.

01:26:01Good. And we’ll dump that into slash T MP slash merges dot TSV. Let’s look at that. All right. Looks good.

…31Almost want to sound.

…43So duplicate links. You know, we’ve already seen it just scroll by a bunch in the last 10. That’s most of them.

…55I know that’s a reason. So if I said

01:27:05712. Ok. Huh. That’s actually a pretty big drop from the 777. It shouldn’t be possible for a story to get merged without a moderation. So there shouldn’t be a left out or joint kind of thing, should it? It’s easy enough to check.

…34And I’m into fighting red line, which I really don’t enjoy doing.

…52Yeah. That’s ridiculous. But it worked.

…59That’s still only 712. Hm. It’s like a 10% difference between 7, 12 and 777. Do you think that’s worth investigating?

01:28:28arh68 deleted ?
gtfrvz VoteYea
Yeah. Deleted. I didn’t in neither query did I, well, maybe it is deleted. Do you know stories? Just don’t arh68 idk seems like the number would go up HahaThink
if a story is merged it’s almost never deleted.

…59Come here.

01:29:13Yeah. There have only been seven of those. So this isn’t deletion.

…27dr3ig does "action like 'merge into'" filter down?
So this gets us 745 does action like merged into filter down? Yes. Yeah. You know, I was doing the the left outer join. So if I said Count Star, this should be the number we already saw. Yes. And then if I get rid of the merged into, oh, I think I know what this might be. Now we get 779. OK. So it’s Sam for a while for the longest time story emerging was sort of a special operation and the controller for stories was written so that if the moderator merged a story, the other edits on the form were ignored and this was the source of many hassles. So if I said select re from Moderations where action like merged into and action not like merged into. And so the net effect of this is the action will contain the phrase merged into, but it might not be the first thing because the action is generated from all of the edits that the moderator makes And so if the moderator edits a title and merges, it might say that they updated the title comma merged into blah. So let’s say limit 10. Yeah, so here’s, oh no, that’s the I wanted the action field, but you can see actually me doing it of remove story text or story text is not for summarizing or. So this is me changing the title or changing the story text as well. Yeah. So these are changed description from and then where is it out at the end? Yeah, two, no description changed markdown description because it’s so redundant and then comma merged into art. So it’s just the potential for it to be. So if we said count Star and get rid of the limit, it’s only 34 out of the, what was that? About 60. So there’s half of our story

01:32:52Castro Moderations.

01:33:09So if we change this to say action like merge into the start or action like percent comma merged into percent that gets us up to 744

…40I see even there, there’s like a half by one cause it was 7-Eleven plus 34 and we ended up with 744 like I’m not gonna track down the last 7% but I feel like we’re or the last 1% but I feel like 5% is maybe worth it.

01:34:03Let’s take a look at these.

…14The only way I can think of to diagnose this is to do just a big giant joint of find me everything in the first query. That’s not in the second one.

…35stories where merge merge story ID is not, no, not, no. And sport ID is not in select short id dot dot dot And then thanks red line. All right. So here’s a handful. I’m going to grab this short ID and open it off screen so I can just do it as a logged in moderator because maybe there’s something weird here. So yeah, this one was indeed merged and it was just a some kind of alternate link or somebody wrote it up.

01:35:44So how is there? Let’s,

01:36:20so there is a moderation

…31and it’s a dupe like I noticed this, this title here matches this. So did we just get this one, URL submitted multiple times? Cause that actually does happen fairly often with merged stories where either the, the dupe detector doesn’t fire because there’s some slight difference that it didn’t normalize away or something else happened. And so then there’s duplicate for dinner. The action here is that I deleted the story.

01:37:25This must be the

…33this must be that hassle with if you change the merge ID stuff doesn’t change. There was another one where if I click delete on a story, it wouldn’t just set deleted. A it would throw away the other edits in the tab. So that might be these other what? 30?

01:38:03It’s weird that there’s a moderation for un deleting this story, but not for deleting this story.

…38Ok. So it was only submitted once

…45if I would by idea.

…58Yeah, there’s an un delete, but nothing else. Now, how is that possible? It’s possible the original submitter removed it. Right. Yes, actually, and this story was posted seven years ago. I am sure not gonna remember that. Let’s look at a newer one.

01:39:42So we’ve got HTSSPG.

…57So this is a story about ah some kind. Yeah, I think, and if I said,

01:40:16let’s find all the Moderations related to it,

…27that’s

…35so this was a year ago. This is weird. It shouldn’t be possible for this story to have the merge story ID set without there being, without there being a moderation to match. You know, I look at it. I’ve got it come here. There’s something else that pops out. I’m gonna bring it up here. So this story, nothing too exciting. You know, something about compression and text classification. Something that catches my eye is that Hunter merged this or Hunter submitted the second link and Hunter is a site moderator and the story form is weird about moderators.

01:41:38So let’s grab these submitter names.

…46Stories cause if these are all moderators that would explain it the story form. Yeah, it’s all, it’s all callbacks, it’s active record callbacks and I’ve hated this bug and it bit me even two weeks ago. Join users on stories dot user ID equals users dot id. Let’s get rid of this desk or limit 10 because we’ve only got 30.

01:42:27Ok. So all, but three of these are site moderators. So what’s happened here is I hate this bug. I don’t think it’s even in the issue tracker, although I know which bug it goes on. So, where am I here? We’ve talked about how the story’s controller is overloaded and does a lot of stuff. Well, there is one edit form if and when you host to it, you get the form and then when you submit the form, it calls the update method. When you call the update method, it checks if you’re allowed to edit it, which is to say, are you the person who submitted it and it’s only a few hours old or are you a moderator? And then it sets this virtual attribute story editor. And the thing that’s missing here is boy, where does the moderation get created? Well, it’s not in the controller mo story instead before save the log moderation hook calls. And the moderation hook says if this is a new record, well, if this is a brand new record, we don’t have to log in moderation because it hasn’t been persisted. And if you are not editing from suggestions or you are the submitter, oh, you are editing your own story. And so the concept of is a moderator editing, this is implicit in the false path through this giant bullion. And so what the short version is when a moderator edits their own story, it doesn’t create entries in the mod log. And so the other unmarked stories there r the ones where a moderator submitted a story and realized it was a should be merged into a story that was already submitted and did so themselves. Oh So that’s the bug factory. But this one, this one has the the different fix. The different fix for this one is splitting up the story controller functionality because the story controllers form handles both users editing their own stories and moderators who have different permissions and different things they’re allowed to do and different timing and then the moderation logging happens after in a callback. So let’s just note that

01:46:15moderator edits plural. It’s harder for me to type because they can’t just curl up in my lap.

01:47:22All right. So with that bug run down, I think we’re good to go ahead with the TSV.

…39We wanna say, oh, red lying. Why are you doing this to me? We wanna say like this

…58to catch the ones where it’s not the first thing and then I need to write parenthesis, some unknown number of characters.

01:48:21Oh Looks like I got it in the right place, right? All I did was hit right there. I was like spelled this out. So it was like 61411, you know. OK. And then how many lines are in this still only 712 that should have gone up to like 740 oh, because I missed the closing percent.

01:49:05Now we got 745 and the reason it’s 745 instead of 744 is it has a header line. So there’s that off by one error and then the rest of these are gonna be moderators doing things. So I feel pretty good that we’ve got something accurate

…35you want? Let’s grab that

…43and I’m gonna fire up Libre office. So we’re about to switch from dark mode to light mode.

01:50:00I’m gonna open this off stream because I’m gonna have to like browse files and stuff. So that’s code lobsters merges dot TSV. Good. So here’s the dialogue. So we have the short ID, the title and the merging response. So this all looks pretty reasonable and hit, ok, and bring this back on stream. All right. So arh68 ahhh GUI PopGhost
this clearly there was some long ass reason on something. I’m gonna shrink that down so we can fit on screen. If folks want to tell me how the font size is. gy, yeah, I know I could probably use what’s the name arh68 font is a lil small but it's fine
like visit data or data set. But as neat as I think those things are, I don’t actually have them installed and know how to use them. Font is a little small, but it’s fine. I’ll, I’ll nudge up a little bit and we’ll just kind of chop more off of this and this. Correct. So here there’s a quick way to say I don’t want the text to overhang. I don’t want to rap.

01:51:47Just I see that there’s like this one is overhanging into here and I want to hide that because I know it’s when I skim it’s gonna be hard to see.

01:52:03What’s the view.

…14There’s something. All right. Well,

…24form out these cells dr3ig It's weird that moderation is created as a callback in the story model. Intuitively it should depend on who performs the editing action, and so occur in the controller.
and I say, yeah, not that one. It’s a rap. It’s weird. The moderation is create as back in the storm. Yeah. Drag it is. it is just one of those slightly hairy places where arh68 uh maybe fill R10C4 with content ? or wrap with fixed 1.0L height
it is some of the first functionality written in the code base by someone who wasn’t very familiar with rails and it wasn’t as clear as,

01:53:07yeah, that’s fine. We got a couple extra lines, but

…18all right. So

…24now what I would love is if it was possible to do a multi cursor thing and select every line that included like merging response

…44as far as I know, I can’t actually do that. And I try and be really consistent in these messages. I wasn’t super consistent at first but then arh68 mmmm ya Excel kinda wins there. i stil like libreoffice
sort of built out a set of standard messages and I have Firefox set to remember the form, input on the story form. So those are pretty repetitive, which I think helps. So if I said merging write out,

01:54:25yeah, honestly, I could do this and be easier couldn’t I for some of these? All right. Hold on. Oh, don’t open a new one. Let’s just add a tab. arh68 M-x butterfly SeriousSloth
And so for everything that says

…51so what’s a, what are useful categories? MX Butterfly? Yeah, I don’t know that one. Not an emacs guy never have been. So there are 99 of those.

01:55:24Yeah. Don’t need two there.

…35And if there are 99 it’s just easier to do it by hand than write the macro and also give me a chance to kind of skim some of these others.

01:56:04Ok. So the other one is very clearly merging reply because I’ve done that a bunch.

…25It hopes if I spell things right though, where spots only five of those anybody else. So this idea of dupes, how many of these, we have 62 dupes? All right. And I’m gonna do another search in a second for the word duplicate because there surely will be some

01:57:09and just hitting these, these most popular ones real fast in vim, it’s easier than churning through them in the Libre office because we have, you know, 740 some rather than, like the last time I categorized stuff where it was 100 or something and we didn’t actually need to use all of them. Oh, no, it’s saying more than 99. 0, no. So I actually maybe should have. What line are we on? 621? All right, we’ll get in the home stretch, but there may be responses that I missed. All right. So where was that last search? So, if I went down and searched up, yeah, here’s a couple.

01:58:22Come on. You just rapping on me. Thank you.

01:59:12Go ahead. Cat. Make yourself at home. Knock my stuff down.

…32How are there so many? Oh, I’m only at line 400. That’s how, so lots of responses.

02:00:04Oh, there we go. There’s my limit. So the other one I know I’ve used a few times, especially if I’m grumpy and I’m expecting that I’m gonna be cleaning up after nonsense. Is I have sometimes said merging Hot take and I am gonna go ahead and categorize them as responses because they are. I was just grumpy about them and feeling a little spicy myself. The, hot takes rarely add much two stories. This is a sort of a personal opinion more than a, professional opinion. Oh, that’s interesting. This one is both a dupe and a roundup. I am just, it’s a hot take and a dupe and around all. I’m just gonna leave that one as dupe. Yeah. Oh, this one, this one is me correcting an error,

02:01:24which is going to be a response to this one. Let’s check. One of these is just gonna be a moderator error.

…42I’m pulling up that ID. Yeah. So this is a, this story being angry at Chromium. So this one, wait, no more Google that one. Is a response. Tom is a ***.

02:02:23All right. So, somewhere there is a, and I, it’s not so many that I want to break them out into

…44their own section. So

…51let’s find the rest.

…58738. Ok.

02:03:08So another thing that’s pretty common here is if something is a write up, so we got 30 of those and sometimes I call that an alternate link, I guess. So that’s, those are especially common on security stories like this open W RT. So the write up is some sort of technical news site wrote about it. But we also had submitted the original link of the security researcher, an alternate la alternate. Well, actually, yeah, there is a distinction. So a write up is third party and an alternate link is first party. And the thing that pops out at me is Tickle TK nine. I don’t even have to pull up this story. I remember someone submitted like the the github releases page and then also their blog post where it was like the blog post and the download page, something like that. So that’s when I use the phrase alternate link. And I guess if we’re being fair to the criticism that story merging is confusing, I should split out those primaries versus third party. So what do we want to call those? The write up would be, it’s not a third party response. We’ll just call it right up, right.

02:05:12dr3ig I think you've put 'response' or 'dupe' on newlines a few times (or it may be just wrapping)
I think you’ve put response or dupes on new lines a few times or maybe wrapping, it’s mostly wrapping. But those will stand out pretty clear once I pull it back into Libre office. So I’m not too worried about it.

…33There’s also the possibility of accidentally put two categories on something because I’ve moved real fast on some of these text edits. And again, that’s gonna stand out in Libre Office. So I’m not too concerned about it.

…53So for alternate links, I’m just gonna say alternate and we’re gonna remember that that means it’s from the same source and I’m gonna pull all of these unique reasons into the scratch file or into the the draught to explain.

02:06:30It looks like a reply. Just one of those. All right. So I think that might be enough. Oh Yeah, into primary. How many mobile links do we have? None? So this one’s just a dupe link. I remember this one where the site has a like m.whatever.com or you know, question mobile equals one. And then it just provides a different view. Then some of these are, these are gonna be responses or write ups.

02:07:27This one is an alternate link emerging, right? This one is an alternative. I remember that

…44tagged S

…57oh Yeah, there was a lot going on in that one. I’m gonna call that one. A response

02:08:13takes our responses about this one. Yeah. Merging plagiarism into primary source. I remember that one. There was I wanna say it was even submitted before the primary source, which was kind of gross but somebody just copied a post. I think I might have ended up banning the plagiarism site for this one. I don’t recall instantly, but they just knocked off the blog post. But we had already had some comments on by the time it got. So what am I gonna call that? Don’t wanna just say plagiarism make it its own category. It’s real rare. It’s like a maybe once a year thing.

02:09:11Hm

…18I’m gonna classify it as a write up cause there’s so few. I don’t know that it’s worth breaking out and I’m not gonna be so I’m, I’m not trying to be ontological complete here. The goal is what’s useful for writing this document for users and I don’t think it needs to call out. Hey, don’t submit plagiarism. This one’s a write up

…52that was already done. Done. Done.

02:10:07Come down. Du du du du,

…16that’s a write up and I was grumpy about if I called it content marketing. Oh Free node, man. You know exactly which week that was what like three years and change ago. There’s another one that had a bunch of merges was frici Oh what a time…
when free note was taken over.

…49Yeah. Come here.

…59frici i missed the /s there
That’s a response. That’s also a response because those are a couple of hot takes and then these are write ups

02:11:18Merging into the same story as one I should do right. Run through here in a minute. Oh, yeah. This one X NSA Hecker drops New Zero Days Doom for Zoom. Not only was it a dupe, it was a, like a general news site and we had already had the primary source submitted that’s real common for security news because somebody sees something interesting and security is just sort of always a little emotionally salient. Like, it kind of grabs you. I found a bunch of the times where I’m like, wow, like, not only is it already posted, it’s not actually a ton of interesting stuff. Like the only interesting thing might be who is the victim rather than how

02:12:21write ups dope

…32handled response response.

…40I’ve wrapped around. Ok. So this into s story. These are like half responses and half write ups, jmiven there's also some "Same story"
more, more complicated. They also can be. There’s also some same story. Ah, yeah. Good Eye. I see it up here at the top, a different kind of CT log. So some of these, there are a couple of things so they are third party write ups. This post mortem one. I think I would call it an alternate because it was from the same source and then some of these are responses. So we’re gonna have to look at those individually.

02:13:53arh68 could you explain the "This one is a little backwards …" action
Yeah, I think all of those I’ll have to look at individually.

02:14:01Let’s make all those links. Could you explain that this one is a little backwards?

…14Oh, so Nintendo is suing the creator of switch emulator y you. This is a little backwards but to keep together links on the same story in one week emerging, the third party right up into the more recent and decisive primary source. So this is I bet there was a time gap between the first one which was a third party write up and then the first party source. So usually that’s not in the notes, That’s a good one. So, so this one is 34 at 2 p.m. and this one is 228 so six days earlier and that’s why I kind of called it out as a little backwards cause arh68 ah I see. thx
merge into the earliest submitted rather than the latest submitted. But here it was intention or with this idea of preferred primary sources. So maybe we’re seeing some kind of priority order. So good eye. Yeah, actually on these like technical write ups, I think. Yeah. So really what’s going on here is like there’s this practice and then just the question of deciding which will be the primary story. And this is kind of the decision tree of first, is it the primary source? Second, is it the earlier one? And this one, this honestly is a little fuzzy and we could go through them. But I think,

02:16:17you know, if it’s an hour or two, especially if there’s just one or two comments, I’ll go ahead and merge an earlier news story into the technical right up. But if it’s days, well, no, actually, I think that’s, I think that’s pretty consistent as kind of the tiebreaker. So the earliest submitted. All right. Right. So great questionnaire Rich. Thank you.

02:17:30This is sort of an ultimate take on this and then merge in responses, merge in updates. Like I haven’t categorized many as updates, but that’s part of what these same story ones are.

…55All right. So, oh, this one, I remember this one. It was a oh I don’t know if it was first or third party, so I have to pull it up later. All right. So another thing that pops out at me. Oh, wait. Did I finish the primary sources? No, because here’s what I missed. Maybe I just missed it.

02:18:33I think that was a write up. Let me double check that one

…43and I’m fighting the cursor. Come here,

…54just grabbed the tab at the end of it. Oh, yeah. This one is third party. Yeah, I like that guy’s blog though. So that one was a write out

02:19:19and then this, I sure don’t remember. Looks like I just missed one or two in the middle because all the rest of these are done. Strip to the bottom. Look back. Oh, it looks like we’ve got some of these safe stories. Same stories.

…49Yeah. Looks like there’s plenty actually. All right. So I lost my place investigating that one. We’ll just start from here.

02:20:28Can I search for, hang on primary source and then

…40any character that’s not a tab.

…51So say no tab star to the end. There we go. That cuts out all the ones that have already been looked at. So this was right up. That one. I don’t know. This one is an alternate.

02:21:21What’s this? This one was a write up. This one was a response. Only 14 of these left and then we can get back to Libre office and sear your retinas.

…50This one’s all right up.

…57This ones are right up. This one’s I guess I’d call it an alternate. So it was the same story. So same story also just means an independent thing. So like in this one, there was an exploit called Checkmate where at the same day there was the original announcement and then there was another interview with the author and I wonder, I think I could just call that an alternate cause it’s an interview with the primary source. Yeah, I think that’s fair.

02:22:43This one’s a, this one’s a response.

…58This one was this a fish because it’s an alternator or a write up. I don’t recall looking at it off stream. Oh Man. Many duplicates. So this one was titled Getting Started. So it was from medium. So it’s just some quick follow of here’s how you do the thing. I’m gonna call that a response. This one is the alternate. So like a H I called it out here of merged mailing list archive and a story from primary source posted later. So this was, we had somebody’s mailing list post and then probably a few hours or a few days later, someone submitted the actual announcement.

02:24:05This one was a write up.

…14arh68 ah like they leaked it lol
This was a write up, less that they leaked it and more that’s just where somebody happened to hear of it. So, on the mailing list, you know, if someone was subscribed to the mailing list and they saw the announcement, they might immediately submit that where we probably would do better with a like actual product announcement, product, not necessarily a product but a version announcement, blog post because, you know, sometimes the mailing list post is just a change log or is otherwise written more for internal consumption and then like a blog post is better to start a discussion from. I don’t remember what that one is. We’ll have to look at it. This one’s a write up.

02:25:15That was all right. No, this was a response.

…24This one was a ready go. That’s a write up and that’s all the way around. OK. So anything. Oh, press release. So those are gonna be alternates. Only seven, not too bad.

02:26:00And then anybody else popping out.

…18arh68 you got some same story left
This one’s a right up and it’s about lobsters jmiven official announcement?
every once in a while. So like part of being a moderator is being the no fun police. But I figure like once a year this kind of like

…41it’s the lobster emoji, which is not super topical, especially because it was just, some guy fighting over being the gold sponsor, Lobsters, our site was the silver sponsor for that emoji. in any case. Oh, I see. Je, and you’re suggesting that that’s a pattern we’re sipping through. Come here. Let’s do that. jmiven yes, sorry
I’m gonna reuse that.

02:27:21Ok. Looks like we got eight of those. No, it’s enough for me to go on. So, so these are gonna be write ups because otherwise I would not have referred to those as the announcement. All right. So there’s those,

…48that one’s right up. Hey, look, here’s the the day of the Microsoft acquisition and you can just kind of see a bunch of them. All right.

02:28:09There is a bunch down here where J CS did not write reasons for his merges. Oh, and he liked calling them dub instead of dupe. All right.

…31OK. I think that’s probably enough to get back into Libre office, which is there a reload? Cancel all changes? All right. So I’m gonna have to shrink this back over. Can I just format all of these as links right now? Oh, are you format anchor? No data? Yeah, I guess I’ll just copy and paste instead of click on them. They’d head over to my personal browser anyway. So I was gonna have to. OK. So could shrink that in. And this column is category

02:29:35And if we take all this and can I just make a, yeah, here we go. So, here if we sort ascending, here’s everybody that’s marked. So that was roughly half of them categorized. That’s not bad for the amount of time it took.

02:30:17Oh, mosquito. Excuse me. The noise compressor should have kept that from being too bad. But, oh yeah, there’s a place where I slipped on to two lines. This one was a duke and then I have to delete the rows.

…40This one also

…47probably just get these pretty easy by using the control down. jmiven 369 also
Yep.

02:31:05369 also. Did I get it in the time? Oh, yep, you got it. I did not get it. Oh, not in sir. Rose. Delete. I can see this one. I wonder if these came in before I I shift the lead to I control the lead. I could use a shortcut for deleting the row

…46but there isn’t one. So I will just have to use the mouse back in the eighties. Oh, man, I thought I would only goof these on two or three. This is like a bunch.

02:32:13Here’s the four sp

…22response. Guess I was moving pretty fast on those responses.

…36All right. That’s all of them. This one is a dupe. This one is a write up. This is an alternative. This is a write up

…57more definitive length. This is probably a write up as are these do remerge. Yeah. The the U I on merging is not quite as helpful as you might want. And so it is, you basically as a moderator just have to open the tabs and copy out of the URL and paste the story ID as opposed to the form, having any kind of feature in there to help. Huh? Old news. And I think that’s the, the one that’s down a little ways. So I’m curious if that’s a merged that happened way more than a week later. So the first one was 2, 16, second one was 224. So only six days. All right. The way it said that I thought it was gonna be a link down to one of these down here. But I guess get host by name and get adder info or not. It got some blanks.

02:34:14frici I'm surprised how all this time libreoffice calc doesn't have a delete row shortcut…
These are write ups.

…25That’s stupid. It’s all right up. That’s right up actually. No, that’s a response.

…56All right.

02:35:05frici you can do it with "Ctrl -" but you still need to confirm what deletion you want. which doesn't necessarily need the mouse but its also more hindering but helpful
Oh, these are write ups. Very topical advent of code. Oops, what did I just do come here? You can do it with control minus, but you still need to confirm. Let’s see what that looks like. Oh, yeah. Then I would still need to. So the the pop up appears off stream because new windows on my desktop automatically appear off of the area of the desktop for streaming just to minimize how much I’m flashing stuff up.

…52These are write ups.

02:36:10frici yeahas you saw it still needs you to ckick the radio for "delete entire row(s)"
frici yeah as*
Mhm Yeah. Yeah. So the radio appeared off stream and I didn’t just drag it in.

…22Oh, here we go. So I was looking for one of these. Please don’t submit stories as a super reply to other stories. Just link them in a comment. So let me pull this one up because it’s not gonna be too spicy I don’t think which is convenient cause it, you know, pushcx https://lobste.rs/s/jlrwng
so someone submitted this article that was, yeah, let’s just throw the link in the chat if you’re curious increase test fidelity by avoiding mocks. And then how, how much later couple hours 31, 2051 32. OK. So five hours later, six hours what a sad about six hours later a thing that people sometimes do infrequently, but it happens is they see an article and either they disagree with it or they feel like it is a narrow window on a topic. And in response they say, you know what I saw an excellent post about this, I will submit the excellent post and in this case, the excellent post was from 20 years ago. Yeah. Can remember when this came out? Oh, it’s gone. I guess I’m dating myself there and very often I don’t know if it’s the case here, but often the person who is submitting a story. Yeah, so you can see it doesn’t have the merged I URL here. So non crab, there’s actually a really, really lucky example because it’s very clear from the fact that non crab left a comment on the target story that they are replying to the story. And they said this paper makes this point. jmiven ah yes it's the Freman-Pryce-Mackinnon paper
So

02:39:06jmiven Freeman
I read them not as rebutting something they disagree with as expanding on something that they feel was limited. Yeah, mock world is not object is such a, a classic story. I actually, I now would say, yeah, we’re getting distracted into what it’s actually about but yes, good paper. So not to put, I am speaking more for the general case than the specific. Although it’s kind of clear what happened here is someone felt that the rebuttal or the alternate explanation on the same topic was so much better that they wanted to have a thread that was just about their link. And it’s sort of a way to use a story as a super comment. And I think I’ve called it a super reply or a super comment. And this is not a great term because it’s clear to me what I mean, but it is not automatically clear to people who see it in the mod log because people ask about it in the chat room or I get a puzzle DM about it of why did you merge my story? And it’s because we are trying to keep the discussion together. And if we split the discussion up into multiple posts, we end up rehashing a lot of the same stuff. And in this case, like these replies to the paper would not be visible on the paper story if it were an independent link. So this is strongly one of the values, one of the most significant values for story merging and maybe also one of the more contentious because when people do this, they are often, you know, I don’t wanna cast aspersions because this is such a a case by case basis. And I can’t always tell what somebody’s goal is. But it’s often that they feel that the alternate link that they are submitting is so much superior that it should have its own discussion. That’s just about it. And sometimes definitely not this case because this one’s not even an argument. Sometimes that is with hot takes especially it’s like, well, I want a story thread that’s just about how everyone agrees with me and we’re gonna have a whole threaded discussion that’s gonna start from my favorite blog posts. Hot take on these events. And then I will get what I want, which is a thread full of people agreeing with me, less than a thread full of people discussing the topic.

02:42:24So this is one of those practices that needs to get explained. Don’t use stories as a super reply link in comments and I don’t know how to say it better than to call it a super reply or a super comment.

…51But I hope the the general outline of the practice is pretty clear there. So let’s say half. And I said super oh this guy doesn’t library office isn’t gonna give me a quick version of let me save the TSV. And then come on, let’s go.

02:43:21So there’s one for supercomputer. So there’s the items. So super response looks like we got four of those and super comment one of those. So it’s not a thing I say very often. It’s I might also have said super reply, mightn’t I Yeah. So one of those two super reply, super comment. Oh super response. All right. So we got a three variance. So this one is

02:44:16let’s put it in the scratch which I guess this all should just be in the scratch because we’re getting towards time

…35and if I write slow, it’s definitely not getting written today.

…46Great super reply. Super comment.

…57So it’s not just that I only do this on average one time a year cause if there’s like seven of these, that’s one time a year.

02:45:11Yeah, it’s not super clear to people.

…22And I think actually if I search for comment, I might have found alternate ways to say it. Yeah, please don’t submit stories to be a super response. Super comment arh68 "ratio"ing that's the phrase i was trying to think of
unrelated. No, I’m searching for come here

…48ratio. Oh yeah, yeah, that’s arh68 when you post reply B to get more votes than A ya
the Twitter or blue sky version of it. Yes. Yeah. Oh I did find an alternate way to say it. I knew there was something. Please don’t use stories to reply to stories, just post a comment. Yeah. And that’s why I was trying to be careful about the, the casting Aspersions part was, it’s sometimes it’s just, I’m really excited arh68 ya I think a lot of time they think it's more polite to move the disagreers Over There
and I have a great link on this topic and then sometimes it’s, I want a thread where everyone agrees with me and I wanna kind of show you up and I arh68 so Story A ppl can chat amongst themselves w/o like dual brigading
move the disagrees over there. Yeah, it could be. That is certainly a more charitable explanation. I, I like that. I would hope it is more often that on the other hand, our community is small enough, it can’t really brigade itself in the way that arh68 but it seems the Lobsters "politeness" is to keep it 1 party instead of parties of 1
that could be an issue on Reddit or could be on hacker news cause they are enormously larger than us. And when I say Reddit, I’m really referring to like a specific programming subreddit. Yeah, that’s also part of why so on that topic of disagrees. That’s also part of why I characterized lobsters in that meta comment maybe a year and a half ago as it’s like a big backyard barbecue. I think lobsters is at its best when it’s a bunch of people who are sharing discussion around a topic rather than people who are trying to win a fight about a topic. There’s very rarely a lot of progress in the public understanding of a topic that comes out of fights. It, it and I’m speaking here just of stuff on our site. It’s when people are having really hard disagreements. Even if they don’t get into flame wars, arh68 experts are still unclear as to what, exactly, SKUB is HahaHide
they don’t tend to be able to, when you focus on winning, you almost can’t learn. I think that’s just, yeah, s oh, there’s a good reference. You should please drop a link for that one because some of these are, are kind of deep cut memes and I guess it’s becoming clear on these streams that I’m extremely online that I’m getting most of these memes log for J was not the one that got a lot of merges I think. arh68 https://pbfcomics.com/comics/sk
And I wanna say there was like three weeks of stories about it where there were three threads. Yeah, it was PB F comics. That’s right.

02:49:15So the two guys people,

…28yeah, it’s just human nature that if things are different people kind of wanna find which one is better

…42and obviously the one that I like more is better, right?

02:50:03This once in A I turn it,

…24this one’s right out. Stalin’s got cancer. I don’t think I knew that. I mean, this is me merging it but didn’t register.

…45All right.

…54So I’m gonna save this and since I just labeled a few more things, let’s resort it. Oh Look at that type Bos

02:51:15386 out of 745. So that’s pretty close to half. Yeah.

…30Is there a way to get, I guess I could just say come here. So if I filter this to how many of them are alternates

…49and then like, I’m just trying to get some rough ideas of statistics. So, so far that’s 28. And then if I replace with Dupes, oh, yeah. Looks like there was one where I had two things. So Dupes, there are 64

02:52:27let’s say, let’s say responses. So responses is 100 and 98. If there’s 200 out of 350 that’s the bulk of it. And then write ups are the other 100. OK. So responses are most popular and then write ups and then dupes and then alternates. I kind of wanted to eyeball that because I’m wondering, are those numbers gonna change much if I actually go through the other half of this list

02:53:28looks like there’s one more category of updates. So like these, this one like these two are, but this one is as well where someone submitted a whole bunch of like a, a series of blog posts. Yeah, I search for series.

02:54:02Yeah.

…08Oh Yeah. Or here is another one that just happened to show up of merging update into earlier submission. So sometimes that’s someone breaks up a blog post into multiple posts, you know, f series Gear Selector. Part one, the idea and then part two, the breakthrough. But they only come like two days apart. The other one is someone submits part one, they get a bunch of responses whether on our side or somewhere else. And then they write a part two like a day later.

…54That’s a write up

02:55:04any more serious nights. I got the ones,

…31jmiven "this week" seems also common
I guess that’s a reason

…38because this one is so we’re coming up on the end here of Lobster’s office hours because I only wanna run for about three weeks. And I realize if I start writing this up, I’m not gonna get anywhere meaningful on stream. So I’m gonna punt that part to the next stream. But the two things I thought were worth writing a little more about and saying a little more about have come up. The two things are

02:56:16a couple of things are tied together,

…24clarity in which story comment is replying to

…34super replies and then kind of the inverse of super replies is highlighting best links in a story. And so what that becomes is what if a comment could be promoted to a story? So we have a story submitted like I’m reading off of the spreadsheet. Let’s just use that that testing title. So actually, this is, this really is a great example. The the one about increased test fidelity by avoiding mocks and then non crab submitted a comment that was largely saying, hey, this paper was great. Let’s talk about that too. This week also seems common. Yeah, that’s me. That’s the other thing that I there is to talk about. I’ll come back to that in just a sec. So

02:57:51if non crab or users could have said you know, this comment include a link to something that we haven’t seen before. You know, that’s not, not, haven’t seen before. Actually, never mind that part. If it includes a link, what if there was a way for the author, comment, author or for readers to say, I think this should be promoted to a story. And part of the reason I think that is, this display is real confusing and it only gets more confusing when there’s a whole bunch of stories merged in and I guess I closed the ones, but when there’s like four or five, it’s especially strange that the links for this one are after all the others, right? So if we go to, you know, the most extreme example, this top link is Microsoft’s press release and then this is the metadata for that one and the metadata for these others is just kind of in line which is weird. And then stories from the merged links have this tag that people miss. And so I guess what I’m saying is bye, commenter reader, Mad or readers. And then also rather than so hang on, I’ll say two things clean up the metadata on links at the top of the page. Confusing display first items. Meta appears last low merged stories, right? But then also in comments, what if we repeated each stories title and thread title as a section header for it’s comments. And I say it’s in quotes because the value of story emerging is that we keep the discussion together if we have a section header. And so we said, rather than organizing all of the comments by score. So yeah, rather than organize top level comments by score, they’d be in there story sections and possibility of continuing to vote on individual stories

03:01:16to sort comments. So this would be a pretty big change to the way merged stories get displayed, but it would make it clear that they’re responding to different aspects to different stories under that headline. If we went with headline as the top level title, it kind of rolls in a whole bunch of things and it makes the line between stories and comments a little permeable

03:02:10a while ago. So I’ve been thinking about this for Oh man a while. Right. So that’s the draft and then this is also there. So if I go to Tig app models link, I thought about this for a while. But I created this link model in July. Oh, it’s been kicking around in my head for at least a year. And the idea of the link model is it reads story texts and it reads comment bodies and it finds all internal and external links. And the idea for internal links, it figures out the the foreign key relationship. There’s a fucking mosquito. I don’t know if I got it. Excuse me, as if I don’t have enough software bugs, I have actual bugs. So there it is

03:03:42this link model, I want to use it to interlink, comment to interlink stories and comments a bit so that you might even see metadata on a comment. So if what are we up to Carol? If Carol leaves a comment in February about mock and then in July, Dave writes a comment and happens to link to Carol’s. It would be nice if looking at Carol’s comment showed you that there was a later response in another story from Dave or not necessarily a response, a reference. And so that would be nice for internal links. And I’m slowly working towards that functionality. But the other part of it is it pulls out external links as well. So if a comment links off to actually let’s just go right back to our working example. This comment has an associated link record in the database, we don’t do anything with it yet, but it’s there that links to this and I think there’s a, there might be, since this story was submitted, I might have tweaked the story submission form to look for those and say, hey, actually, yeah, I did, I did, didn’t I, where is it? Yeah, so when checking to see if someone is submitting a duplicate URL, I checked to see if they’re, they are linking to something that was recently in the comments and you what war per and then they get this message that says, hey, this comment just time ago in words, which might be 10 minutes or two days. Also linked to this story, please grow the existing discussion rather than splitting up the discussion. Adding a comment will bump it to the top of the active stories because I wanted people to see you’re going to get the exposure you want. If you re respond, if you reply to the link that has already been submitted, instead of trying to use a story as a super reply. And this one has been a minute, right? So to blame analog app views stories form errors. So this one has been there two months and so let’s jump over to live. It’s a good time to check in to see if there have been fewer merges in the last two months because of it.

03:07:16I need a kill.

…28The numbers might be low enough that there’s nothing clear here, but we’ll see.

…52So over the weeks of the year. Here’s how many we have? 124, 14 and then what it was eight weeks ago. 12345678. I don’t see a strong pattern popping out at me. The numbers on either side of the date look pretty samey.

03:08:23arh68 more missing rows near the endd, but ya
Yeah, the numbers are small enough. It’s not worth trying to, work towards any kind of epistemic rigor, but it’s the kind of small nudge change that I hope has an effect like that.

…44All right. arh68 seems like it nips that in the bud
So Jay Mivan, you said over here in the scratch seems like it nips that in the bud it does. Oh Were there missing rows at the end? Wait a minute.

03:09:13Oh, you’re right. I missed it. There’s no 44. Well, maybe it did work then 49 there’s only one like some of this is gonna be really influenced by if something spicy happened. But you’re right. These are contiguous and there is a gap here. So we had a zero

…45oh and 48 is missing. OK. That’s, that’s enough that I’m gonna tip it over to say, yeah, it did improve the situation. I am doing fewer merges since adding that, you know, I’m not gonna try and pretend that there’s enough data here to have any kind of rigor on it. But as you know, like a stick your finger in the wind kind of thing. Yeah, it helped a little. That’s great. Thank you for catching that. A Rh So Jay Mivan, you pointed out that this week also seems common. It shows up a bunch in descriptions because I’m trying to explain what the behavior is merged into other intro from this week, merging this week’s rust async stories, this week’s terraform story. So some of what’s happening is I am trying to explain people to people what the merging rules are. And when I say this week, at least people can figure out, oh, I should expect that stories will get merged in the span of a week. And when I reiterate what that rule is, those individuals who submitted the merge story are a little less likely to do it again, not 100% likely, but fairly less. And then also people can see it in the mod log and go oh It’s a this week kind of thing. Some of these are

03:11:45a big news story happens that carries on for weeks and the because I merged stories that are submitted within a week of the original. Well, eight days later, it’s time for a new thread. And so that’s why you see the this week’s story a bunch

03:12:10and I wrote Pin in this.

…20What do we call them here? Like merged candidates submitted are within a week of original get merged after a week. Why am I doing the arrow thing here after a week? The first next story is the target for future merges. This is mostly good. So like there is a limit to how often we’re gonna merge stories and we don’t wanna merge forever. And there’s kind of a kind of a balance. Yeah. Well, not kind of, there is a balance happening here between keeping discussions together and exposure a hassle though is

03:13:35site traffic is strongly cyclical. We’ve seen it in a few quarries on the stream here where Monday is the busiest and then Tuesday is almost as busy. You know, Wednesday falls off. Thursday falls off Friday, falls off and then Saturday, Sunday are what 20% of Monday. So, you know, it’s like a gentle slope and then clunk down to Saturday, Sunday and jump back up for Monday. This is, this is every site, by the way, almost everybody looks like this unless you know, you have a Taco Tuesday restaurant, everybody looks like this. So when a real interesting story is submitted on a Thursday, it gets about a day and a half of strong discussion and then a little over the weekend and then Monday, Monday is a new week with a lot more traffic than Thursday had. And so the Monday submitter may not even be aware of the Thursday story because it’s certainly fallen off the home page by then. It may even have fallen off s slash active by then because the week is so weekend is so quiet

03:15:17Thursday.

…33So this is also a little hard for mods to keep track of. So story merging only happens in 1% of the time, maybe less now that I put in that link model. But I have a mental list of stories I’ve seen in the last week and especially when it’s something like Thursday to next Wednesday, people seem especially surprised by the merge. So maybe story merging week should be a calendar week.

03:16:27It’s something I’ve been kind of kicking around in my head and especially riding a doc, a big part of arh68 merging like ASAP seems best
rules is they have to be predictable. Someone has to be able to look at an action they’re considering and run the rules in their head and say, am I about to break a rule and hopefully they do that and hopefully for them, the incentive is follow the rule, not get a thrill out of breaking the rule. But it is really hard for anybody who doesn’t really closely read the site like a moderator or a major power user that they won’t know 234 days later, especially if there’s the weekend in the middle. I mean, part of my goal for the week is weekend is to not think too hard about the work day, right? And kinda reset, refresh, come back clean.

03:17:48not a lot easier, but it is easier to explain, more likely to be seen, builds on natural rhythm. So this would be a change, but it’s one of those places like that book Badass by Cathy Sa that I keep referencing where if you can’t understand what’s happening, people can’t understand it and feel competent and follow the best practice and do the good thing and be their best self. So that’s about the end of the topics that I had to talk about. This has been lobster’s office hours. If you have questions about this, feel free to pipe up. And when I say this, I mean, either the story merging stuff we’ve done or anything else on the site because I’m coming here to the end of the stream and I will take this spreadsheet and I will attach it to the stream archive page. So this is the arh68 PopGhost VoHiYo cool beans
20 24-12 dash nine stream. And I will tie in this TSV file if you want to download it and play around with it. You’re very welcome to because I want the site to be able to understand itself. And if you wanna look at this and figure out, oh, maybe we do want to go through the other 350 you can pipe up and tell me that very explicitly. Otherwise I think I’ve categorized enough to feel like we’ve seen all of stuff. Weird. Why did so this one is obviously response. What’s going up? All right, there must have been a case against op and then it got these two responses. It is so hard not to rabbit hole looking at this stuff because it’s like, oh, it’s a whole list of things I’m interested in. I’m just scrolling past 700 things that are all pretty neat. Github has sold us out. Ok. Speaking of hot takes, sometimes you can spot them from the title.

03:20:20All right. Well, thanks very much for hanging out. Folks. I really appreciate that some of you were helping read over my shoulder and helping categorize them. You all asked. Either you caught useful errors and distinctions or you asked really good questions that get at what’s going on here. And then hopefully we can on the next stream, take all of this stuff that we figured out from the site’s history and me getting forced to brain dump, what I am actually doing from the gut and put it into words and we can write up something that is much more helpful and much clearer and much easier to follow. And once that’s written up, maybe that becomes a, all right. Well, we could improve the U I, we can improve the practice and very hopefully we could do that. oh, I didn’t paste it in here. But the the stories controller thing that we keep coming back to, like I had been kicking around that around in my head, but since I wrote up the github issue for it, I just keep seeing things like the moderator, editing their own story. That’s like, oh yeah. Well, if we cleaned up the controller that wouldn’t happen. All right. Well, given no questions. I’m gonna roll out. frici cool, thanks for the stream1
arh68 take it easy y'all DinoDance
Thank you all very much for tuning in and I will see you Thursday morning for our next regularly scheduled lobster’s office hours. But feel free to message me on the site or email me or grab me on Irc or whatever is handy. Talk to you later, take care.