• shalafi@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    23 hours ago

    from a federal judge in Mississippi

    I SO want to love that state, but fuck me, this comes at zero surprise.

  • perishthethought@piefed.social
    link
    fedilink
    English
    arrow-up
    74
    ·
    1 day ago

    “If an attorney does this, a judge can demand explanations, but it’s not true in the other direction,” Frohock said. “We will probably never know what happened, unless an appellate court demands it.”

    That sucks. There should be some sort of consequence for doing this.

  • Australis13@fedia.io
    link
    fedilink
    arrow-up
    35
    arrow-down
    1
    ·
    1 day ago

    LLMs are being shoved into so many bits of software (office suites, programming tools, etc.) it doesn’t surprise me that something like this has happened.

    • unexposedhazard@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      30
      arrow-down
      2
      ·
      1 day ago

      Law people have a duty to be up to date on this stuff tho. If you dont know how to avoid LLMs from seeing or interacting with your stuff then you shouldnt be allowed to practice law.

      • tabular@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        arrow-down
        1
        ·
        edit-2
        1 day ago

        To really be sure would require knowing what software is actually doing - not just taking the claims made by the programmers (or more likely, the mere owners) of the proprietary software.

        That sounds doubly difficult job.

        • Joe@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          13
          ·
          1 day ago

          Judges usually don’t know this stuff, but they primarily work with systems and software supplied by the state…whose experts should know what they are doing.

          My bet is that this guy decided to work on personal equipment, probably in violation of the rules. Being a judge, he’s unlikely to be sanctioned for it, and will certainly learn from the experience. If anything, there may be some internal discussions which we’ll never hear about.

          Law is an area where AI can add value, though… searching through past rulings and legal opinions is tedious, and anything that can assist to find needles in haystacks would be welcome. It shouldn’t be used to write legal judgements or arguments though…

        • 14th_cylon@lemmy.zip
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 day ago

          To really be sure would require knowing what software is actually doing

          i am pretty sure you do know whether you wrote a text, or it just magically spawned in front of your eyes out of thin air - you don’t need degree in computer science for that.

          • tabular@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 day ago

            Creating text is not the only issue, it may be trained from your confidential files.

          • tabular@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            edit-2
            21 hours ago

            Also no, you don’t know what it’s doing so you could be blindsighted by the latest AI update making unexpected changes. Not only from good-intentioned features but also bugs, or malicious anti-features after the CEO throws their toys out of the Twitter pram.

            • 14th_cylon@lemmy.zip
              link
              fedilink
              English
              arrow-up
              2
              ·
              edit-2
              20 hours ago

              no malicious update can force you to generate a text and file it in court as your own work.

              • tabular@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                13 hours ago

                Consider that a program can edit the file while running at any point, not merely during user input. Like a virus with access to user’s files it could even edit a document that’s not even being displayed to the user on the screen.

                • 14th_cylon@lemmy.zip
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  10 hours ago

                  well that would be fucked up for sure. are you suggesting any existing program works like that, or are just speculating what if?