Gajim - 2018-11-01

  1. mrDoctorWho Just out of curiosity, will Gajim ever support MySQL or something that could better handle events happening in gajim and keeping the history?
  2. mrDoctorWho I know it's kinda weird for desktop apps to support such things
  3. mrDoctorWho But actually most of KDE apps have this ability
  4. lovetox you are jumping to conlusions
  5. lovetox what do you think mysql does that would benefit gajim?
  6. mrDoctorWho I just remember how poorly prosody on my server handled things when it used sqlite
  7. mrDoctorWho Well, at least all the calculations will be done in a separate process
  8. lovetox i dont know what you mean by calculations, and a server has much higher demands on a DB than a client, depending on how many users are active on the server
  9. mrDoctorWho By calculations I mean searches. I see that gajim is actually a bit slow in jumping between days in chat history
  10. lovetox a bit slow? its almost instant for me in a chat like Gajim where we write 100s of messages each day
  11. lovetox also its not the DB, you have to render the messages, pass them to plugins etc
  12. lovetox its not the DB that is slow
  13. mrDoctorWho Searching for example is horribly slow
  14. mrDoctorWho I know that python isn't so fast
  15. lovetox it also has nothing to do with python
  16. lovetox Its a GUI client you have to render everything
  17. zuglufttier Searching for me takes at most one second.
  18. lovetox but again what it slow?
  19. lovetox you searching a db with 1000s of messages for a string contained in other strings, every message has to be checked there is no optimization for text search
  20. lovetox takes me 1 second to search all Gajim history
  21. lovetox and i guess thats a lot
  22. lovetox but im curious to what other application you compare it that searches 1000s of messages?
  23. sotneo Hi, I can't setup windows dev environment for gajim. When script is installing cryptography, It can't install cffi because of cffi backend (compiling error: build/temp.mingw32_nt-6.1-2.11.1(0.329/5/3)-x86_64-3.7/c/_cffi_backend.o: file not recognized: File format not recognized). mingw-w64-i686-python3-cffi installed, can't find mingw-w64-i686-python3-cffi-backend package. Any thoughts?
  24. mrDoctorWho Actually, I didn't compare. Probably my Gajim has been swapped off to the disk out of the RAM, but tbh, search was always pain in the arse
  25. lovetox whats the size of your DB
  26. mrDoctorWho 104M
  27. lovetox mine is 86, and as i said, takes me 1 second to search all Gajim logs for a string
  28. lovetox you still didnt mention any numbers
  29. lovetox what is slow?
  30. lovetox sotneo, what script are you executing?
  31. sotneo lovetox, ./dev_env.sh
  32. lovetox yeah its a bit outdated, let me fix it
  33. sotneo another branch?
  34. lovetox no
  35. mrDoctorWho lovetox, it took me 3 seconds to switch from November, 1 to October, 1
  36. bot Philipp Hörist pushed 3 commits to branch _refs/heads/master_ of _gajim_ < https://dev.gajim.org/gajim/gajim >: https://conference.gajim.org:5281/pastebin/144a5227-11ec-4913-96c1-bccbb802b7a8
  37. asterix Daily build don't work anymore : https://conference.gajim.org:5281/pastebin/713002b7-93e9-430a-9324-c58b49db03bd
  38. lovetox sotneo, there do a pull, and try now
  39. sotneo ./dev_env.sh: строка 32: синтаксическая ошибка: неожиданный конец файла syntax error on 32
  40. mrDoctorWho It takes 10 seconds to open History Manager
  41. mrDoctorWho For the first time. The second time it opens instantly
  42. zuglufttier mrDoctorWho, what kind of system do you use? Can you say whether the CPU is working at 100%?
  43. mrDoctorWho zuglufttier, during the search?
  44. zuglufttier Yes.
  45. mrDoctorWho Wrong question. Is that Gajim CPU usage that you're interested in?
  46. zuglufttier Yep.
  47. bot Philipp Hörist pushed 1 commit to branch _refs/heads/master_ of _gajim_ < https://dev.gajim.org/gajim/gajim >: *7d5f1fba* < https://dev.gajim.org/gajim/gajim/commit/7d5f1fba5036f3a42027efb87d81a04800957029 > Windows: Fix dev_env.sh
  48. lovetox sotneo, ok now
  49. mrDoctorWho It takes about 60-70%
  50. zuglufttier And what CPU do you have? It's probably one core that is used at 100%.
  51. mrDoctorWho Intel i3-4150
  52. sotneo lovetox, same error about cffi install
  53. lovetox then find out at which package that fails and delete it from dev_env.sh
  54. ta mrDoctorWho, do you have a SSD? I still don't have, and history manager takes a very long time to open, as well as overall gajim start. I am in a lot of MUCs though.
  55. zuglufttier I just restarted gajim to check: I get only a little spike in CPU usage if I start the history manager, about 10%.
  56. zuglufttier Is that Windows or Linux?
  57. mrDoctorWho Linux
  58. zuglufttier But your CPU should be fine anyway.
  59. mrDoctorWho ta, no, I don't have an SSD at work. And yes, Gajim starts a very long time, but I don't restart it often and considering mod_shared_roster we have all our workers in each other's rosters, so my roster is quite big, about 800 contacts
  60. ta well, say this could explain your "slow" experience. Once the needed parts are in RAM, everything should perform well. It is like this for me.
  61. ta But new hardware is being delivered. I am curious for the difference
  62. lovetox asterix seems there is a bug report open that says if LC_ALL=C parsing setup.cfg fails
  63. lovetox could you check? and maybe set it to english locale or something
  64. lovetox other option is to remove all non-ascii chars
  65. bot Philipp Hörist pushed 1 commit to branch _refs/heads/master_ of _gajim_ < https://dev.gajim.org/gajim/gajim >: *110da017* < https://dev.gajim.org/gajim/gajim/commit/110da0172fd3cf758bf0ea380d63d258e1652dd6 > Remove all non-ascii chars from setup.cfg https://github.com/pypa/setuptools/issues/1062
  66. Link Mauve mrDoctorWho, doing a linear search for arbitrary words in a database will be slow no matter the database, what you probably want instead is a search engine optimised for that, such as Sphinx or Elasticsearch.
  67. mrDoctorWho Link Mauve, true, but there's one more thing. Gajim uses a single CPU for both, rendering and searching, which slows things a bit more
  68. lovetox history manager can be called on its own
  69. lovetox ./launch-history-manager.py
  70. Link Mauve Or gajim-history-manager if using a package.
  71. lovetox you could try to run this in cprofile
  72. lovetox and see where the bottleneck truly is
  73. mrDoctorWho Thanks, will check it out
  74. Link Mauve mrDoctorWho, perceived reactivity is also different from speed, using multiple threads wouldn’t bring any more speed.
  75. lovetox mrDoctorWho, see https://docs.python.org/3.7/library/profile.html
  76. mrDoctorWho Link Mauve, it depends on where the bottleneck and how you utilize the CPU
  77. Link Mauve mrDoctorWho, rendering is most likely not your issue during searching.
  78. lovetox but he does not even search, he says just loading the manager needs 3 seconds
  79. lovetox and there are no logs loaded when the manager is loaded
  80. Link Mauve Oh.
  81. Link Mauve My bad.
  82. lovetox but he also said no SSD
  83. lovetox and a DB of 100 MB
  84. lovetox so yeah under these conditions i say 3 seconds probably not bad
  85. Link Mauve mrDoctorWho, buy a SSD, you’ll feel the change very heavily in each of your applications.
  86. Link Mauve Gajim is also dead slow to start on my last non-SSD computer, but takes less than one second with a SSD.
  87. lovetox yeah i dont operate a computer without SSD anymore, cant even imagine how we could without it
  88. zuglufttier True, 100MB with a traditional HDD will take at least one or two seconds to load and then another to process the information.
  89. Link Mauve lovetox, have you implemented support for https://xmpp.org/extensions/inbox/bookmarks-conversion.html btw?
  90. Link Mauve You just need to avoid doing any synchronisation between the two bookmarks stores if the feature is advertised.
  91. lovetox no not yet, yeah i know it reasonably easy to implement, i look into in the next days
  92. aurea4497 I can use xmmp for movim
  93. Link Mauve aurea4497, Movim is an XMPP client, yes.
  94. Link Mauve Just like Gajim.
  95. aurea4497 thanks probe last
  96. aurea4497 and talk you
  97. rom1dep lovetox: is the new messagewindow on the roadmap to 1.2?
  98. lovetox yes
  99. rom1dep 👍😁
  100. bot Daniel Brötzmann modified an issue in _gajim_ < https://dev.gajim.org/gajim/gajim/issues/9416 >: #9416: < Wanted to query possible conferences on a server >
  101. bot Daniel Brötzmann modified an issue in _gajim_ < https://dev.gajim.org/gajim/gajim/issues/9416 >: #9416: < Error when on query for possible conferences on a server >
  102. bot Daniel Brötzmann modified an issue in _gajim_ < https://dev.gajim.org/gajim/gajim/issues/9416 >: #9416: < Error when on query for possible conferences on a server >
  103. bot Pascal Pieper created an issue in _gajim_ < https://dev.gajim.org/gajim/gajim/issues/9417 >: #9417: < Notification Error >
  104. bot Daniel Brötzmann closed an issue in _gajim_ < https://dev.gajim.org/gajim/gajim/issues/9417 >: #9417: < Notification Error >
  105. bot Philipp Hörist closed an issue in _gajim_ < https://dev.gajim.org/gajim/gajim/issues/9416 >: #9416: < Error when on query for possible conferences on a server >
  106. bot Daniel Brötzmann updated a merge request for _gajim/master_ < https://dev.gajim.org/gajim/gajim/merge_requests/353 >: ManageSounds GUI Update
  107. bot Philipp Hörist pushed 1 commit to branch _refs/heads/master_ of _gajim_ < https://dev.gajim.org/gajim/gajim >: *55eef518* < https://dev.gajim.org/gajim/gajim/commit/55eef5188775cc1a21c2d0418d47762b431186ad > Update win/README.md
  108. lovetox sotneo, i think the problem is probably because you started the wrong msys
  109. lovetox i updated the readme
  110. sotneo lovetox, I am already tried both msys32 msys64 :)
  111. lovetox so what package gives you the problem?
  112. lovetox you can execute all lines on that .sh script one after another
  113. lovetox not all dependencys in that script are necessary to run Gajim
  114. lovetox and i hope you followed the instructions on msys2.org before you started the script
  115. sotneo lovetox, many, they go one by one. After manual installation dev_env.sh finished. But launch.py again give me errors
  116. lovetox yeah what
  117. lovetox `?
  118. lovetox im back in half an hour then we can solve this
  119. sotneo https://conference.gajim.org:5281/pastebin/04054e5c-2bfc-4d22-8a46-93b46c1a9709
  120. sotneo openssl is installed
  121. sotneo openssl-dev too
  122. zuglufttier "PyOpenSSL not found, falling back to Python builtin SSL objects (insecure)."
  123. lovetox sotneo, do
  124. sotneo I am here
  125. lovetox pacman -Rdd mingw-w64-x86_64-python3-pyopenssl
  126. lovetox then pacman -S mingw-w64-x86_64-python3-pyopenssl
  127. lovetox all in the 64bit msys env
  128. lovetox hm but it seems the problem is not pyopenssl
  129. lovetox its cryptography
  130. sotneo same error
  131. lovetox do the same with the mingw-w64-x86_64-python3-cryptography package
  132. sotneo ok
  133. sotneo Same error
  134. lovetox and you did update msys at the beginning ? with -syu etc like the msys2.org page describes?
  135. sotneo Yes
  136. asterix Sorry, prosody was using 100% of CPU. Hard to look why now, from my phone
  137. bot Daniel Brötzmann proposed a new merge request for _gajim-plugins/master_ < https://dev.gajim.org/gajim/gajim-plugins/merge_requests/109 >: [hamster_integration] Fix hamster
  138. bot installgentoolinux created an issue in _gajim_ < https://dev.gajim.org/gajim/gajim/issues/9418 >: #9418: < joining a public MUC on a different server to what my account is registered with >
  139. daniel lovetox, I tried to use the new DataFormsWidget for Account Creation. What I noticed so far: captcha is not displayed (what am I doing wrong?) and the (*) after a required field isn't displayed
  140. daniel ( * ) was what I wanted to write
  141. bot Daniel Brötzmann modified an issue in _gajim_ < https://dev.gajim.org/gajim/gajim/issues/9418 >: #9418: < joining a public MUC on a different server to what my account is registered with >