Gajim - 2024-07-12

> Sadly, this is the only chat where I can assume that my reactions will be seen. An unfortunate product of mixed-client protocols. theyre appearing as normal messages if the client doesnt support them ↺

amogus: To be clear, I mean emoji reactions, not replies

some people have told me that they don't see reactions

cal0pteryx: In case you might miss it, I am able to upload non-symlink files from the same directory as the symlink that fails to be selected, even without setting access permissions in flatseal. That's why I thought it might be a gajim issue.

fjklp: gajim has no influence on the file chooser

amogus: cheogram has a fallback showing the reaction as a reply, but that's not part of the protocol and thus not supported by most (all?) other clients

lissine: that's an implementation choice by cheogram, and gajim made the choice to not use fallback for reactions. It could have but there are strong arguments against: polluting the chat, how to handle reaction edition… Arguably in 1:1 chats this is less of a problem and maybe it could be nice to use a fallback. Maybe.

about pgp again I somehow managed to make keychain dialog work on alpine linux, gajim asking for password for gpg secret key when it's needed, but i still can' get this dialog to work on flatpak version

https://upload.magicbroccoli.de/bbe35460f17ff35b31c80fb06f8553e8a1cc4a42/iC3V6PjRsewuroGUs70JfyUp0ZUiv7hJ7fnCxoRC/1.png

https://upload.magicbroccoli.de/bbe35460f17ff35b31c80fb06f8553e8a1cc4a42/4t3QFSTFgEDJyRCfqtzDUsbnUNAzixyVASUeH3At/2.png

it should look like this

cat_petter_2012: what version of gpg-agent is running on the host system?

gpg-agent (GnuPG) 2.2.40 debian

That might be too old, see https://dev.gajim.org/gajim/gajim-plugins/-/issues/621#note_213585. Could you create a new issue

> That might be too old, see https://dev.gajim.org/gajim/gajim-plugins/-/issues/621#note_213585. Could you create a new issue this issue is exactly my issue i have right now maybe i just forgot to mention that i'm using debian 12 ↺

https://aria.im/_matrix/media/v1/download/aria-net.org/rZYKAWdqfQuRkkARseTWGnAO

^ lovetox debacle Gajim is breaking a MUST there if you aren't aware, figured you guys wanted to know ✏

Maranda: can you describe what's the problem is?

lovetox: breaking 7.5 in XEP-0045

alas it's not properly processing private messages because the x element is missing

Note: because this requirement was only added in revision 1.28 of this XEP, receiving entities MUST NOT rely on the existence of the <x/> element on private messages for proper processing.

Yes that's intentional

Well you're intentionally breaking a MUST, but as long as you're aware

Maranda, the story behind the <x> is that PMs were broken without it, MUC spec is stable so they could only add it under the condition that its totally optional.

if clients and servers dont add it, it breaks under many conditions, this was always the case. So if clients in your chat dont add it, or you as server dev dont add it, nothing changes, it stays broken.

The additon of <x> is not many years old, most clients add it, most servers add it, so you need to hit the rare condition, that you have a server that does not add it, and a client that does not add it, at the same time.

> It surely looks nice. I would like to keep the meta data display though. Could be an overlay which shows on hover, semi-transparent, showing file name/size and a "more" button ? Here we go (more or less): ↺

https://share.conversations.im/meeson_/iHjSz0NBAaawB7UF/2024-07-12_15-55-01.mkv

meson: great, that's close to how I imagined it. The delay bugs me a bit ;) Now after removing the padding, it's done? :D

cal0pteryx, there's actually no delay

don't know why it's in the video

Ah, perfect

> Now after removing the padding, it's done? :D I'm not sure how to remove it

meson: you can do a MR, then I can have a look

It feels a bit of a hack, but I tried to modify as less as possible of the existing code ✏

One known issue: The info label keeps saying "Downloading ...", after having downloaded an image, until you re-open the chat. I don't understand why ✏

meson: let's see :)

CI fails ofc, I haven't really looked into finishing it fully yet

> class PreviewAudioVideoBuilder(Builder): How did that end up there...? ;)

Also `from sqlalchemy import over`. Maybe some rebasing issue.

meson: looks rather like an automatic import from trying to complete "overlay" :D

I'll have a look later :) thanks

> Dino is based on gtk 4. Video player widgets come for free there That's actually only semi-true. as far as I know you only get a very very basic video player for free. For everything a bit more sophisticated, like overlays, you need to write it yourself using gstreamer. ✏ ↺

I see

meson, we’re working on improving compositor offloading in GTK right now, once this is working better this is definitely a candidate to move into the GtkVideo widget.

On my PinePhone it uses the most optimal path for the video, doing the decoding in hardware, then exporting a dmabuf from it, then importing it as a Wayland buffer, which the compositor can display on a DRM plane.

Link Mauve: sounds great

For a 1080p VP8 video at 30 fps, it takes 30% of CPU in Livi (a Light Video player built in GTK), and then 10% in the compositor, at idle CPU frequency.

And doesn’t use the GPU whatsoever. :)

> I see https://docs.gtk.org/gtk4/class.Video.html > GtkVideo aims to cover use cases such as previews, embedded animations, etc. It supports autoplay, looping, and simple media controls. It does not have support for video overlays, multichannel audio, device selection, or input. If you are writing a full-fledged video player, you may want to use the GdkPaintable API and a media framework such as Gstreamer directly. Alright, reading it again, it sounds sufficient for a messenger. O:-) ↺

Many checkmarks ✅

meson, and if you are missing anything, the devs would very much like to hear about it.

Link Mauve, sure. I've got just one question, is there also a component in Gtk4 you could use for an audio player? In Gajim we already have one, but maybe eg for Dino? There's GtkMediaFile and GtkMediaStream but both talk only about video playback. Is an audio a video with only sound? ;)

I would expect it to be yeah.

But AFAIK in Gajim you have a much more fancy widget for that.

(I should update at some point.)

which version are you on currently?

Something around 1.9.0 I think.

But I don’t use Gajim.

And thankfully my friends don’t send me voice messages.

I've 1/3 written a plugin for voice message to text transcription in Gajim for your friends :P

Don’t tell them. o:)

Which model are you using to do that btw?

And which tool to run the model?

I've implemented support for two models so far: openai-whisper and faster-whisper

I wonder how expensive that would be to run on my phone, since it only has a Cortex-A53…

https://github.com/openai/whisper and https://github.com/SYSTRAN/faster-whisper/

I would definitely recommend the latter

plus maybe this patch: https://github.com/SYSTRAN/faster-whisper/pull/856

Does it make sense to do transcription and translation as a single step?

I'm not sure, but it's possible with these tools

I mean that’s what they advertise, but that sounds like bloat if you only want to do transcription.

Good question whether you could separate it and how much you would actually save in terms of model size, LOCs, ... I'm not going to explore it now. 🙃️

Am I the only person noticing that the bounce animation of the text when I post a new message to chat is very noticeably slowed down in flatpak versys non-flatpak?

I only installed flatpak but it's not slow for me

instead of slow, maybe I should say the animation is choppy or not smooth

GPU acceleration?

cat_petter_2012: you have any idea how I can verify/test for that?

no idea, just a suggestion

i have gpu acceleration enabled, but I don't pay attention to smoothines or wharever

well, I am comparing flatpak to non-flatpak. Non-flatpak is smooth, flatpak is not

https://upload.magicbroccoli.de/bbe35460f17ff35b31c80fb06f8553e8a1cc4a42/hqdCwOppbZ0aSTCsGrgHHJgSYkaiLsEu3RA1Ywmf/b9797183-8a0e-4237-a18b-8c6a521df84b.png

cat_petter_2012, GTK 3.x didn’t support GPU acceleration, so that flag isn’t of any use.

Link Mauve: do you know if plain gtk4 is sufficient for responive UIs or is libadwaita or libhandy needed?

meson, responsive as in, working with the same .ui file from phone screens to huge 4K screens?

Yes

Or let's say, at least adjust the size of an image preview automatically when changjng the window's width

You want libadwaita for that, it provides widgets with breakpoints that let you do media queries and adapt the UI to the current window size.

meson, widgets all do their sizing, so you could adapt to the window size during reflow, I don’t think libadwaita provides any specific widget for that.

Do you know if that is something which could be easily done with gtk3 in Gajim too? Or has gtk4 advantages?

I know very little about GTK 3.x at this point sorry.

No problem, thank you very much anyway

I’ve spent the past four-ish years working exclusively with 4.x.

Then you are kind of an expert on that matter? :)

Mostly just on the parts which interest me, such as GPU acceleration. :p

Using the toolkit, or designing UIs, I’m very much not good at that. ^^'

I’ve done quite a bit of migration to 4.0 though, but then that was quite long ago already.

We’re already at 4.16.

That's like 2/3 of gtk3's lifetime? Anyway, I expect a port to such a huge codebase as Gajim's to be a tremendous task or how do you see it?

3.x was developed for about ten years yeah, before it went into maintainance mode.

meson, Python is an extremely bad language for such large refactorings indeed, as there is no tool to help you catch API changes or removals. :s

Nowadys with mypy it’s slightly better, but I’m not even sure the current gi.repository stuff is typed enough for that to work.

I think before attempting anything towards that I would first try to make such tools work and report misuses of the current APIs, to make sure changing the version will report everything at once.

Basically what languages with compilers get for free.

I need to go! Thanks so far for the insights

Without doing that upfront, you’re going to suffer the same way the Gajim 1.0 release suffered, for many years users were still going through the fallout of the python2 → python3 and gtk2 → gtk3 migrations.

Because there is no guarantee whatsoever that you didn’t miss a tiny call somewhere.

See you later! I probably should sleep as well, I’ve had a fever the entire day and just couldn’t stop doing things. :(

fjklp: there is no bouncy animation :D I guess what you see is rows resizing in height?

Link Mauve: pygobject is now statically typed, there are pygobject-stubs. Works really well

And with pyright there is a fast linter as well

cal0pteryx, do you use that with Gajim nowadays?

Link Mauve: yes

Cool! Then GTK 4 might be much easier than GTK 3 was!

And much shorter, as you can see when things will work, as opposed to not.

I think so, yes. But the code base is huge nevertheless

> fjklp: there is no bouncy animation :D I guess what you see is rows resizing in height? Anything that changes the vertical position of the chat text causes it to move up or down in a "smooth" motion, not suddenly ↺

Sure, but we also had that issue in Inkscape and that worked nonetheless.

fjklp: not for me :)

wtf

I don't know where that comes from but setting my theme to either Adwaita or Adwaita dark still has this animation

Alright, time to really attempt to sleep, again.

https://upload.gajim.org:5281/upload/bzWtO8ozL9G2rzU8bEdwn2wG/gajim-text-animation.webm

cal0pteryx: ^

I even have 'reduce animation' turned on in gnome

is this really not how the text is rendered for other people?