chat_history_sync is not cleared (#279)

Wojciech Kapcia (Tigase) opened 5 years ago

select * from chat_history_sync; results in a lot of (old and stale?) entries that doesn't seem to go away:

62FA0A7E-BF95-4854-87B1-D37DB192CD79,wojtek@tigase.org,conversations@conference.siacs.eu,1589821852281,,1589822034978
F289B849-189F-4781-947C-2CFD0FDB3347,wojtek@tigase.org,conversations@conference.siacs.eu,1589846598367,,1589902793607
E10108CB-AFFA-473C-AEF1-73329C2567A3,wojtek@tigase.org,conversations@conference.siacs.eu,1589930879824,,1589990570440
08E05C0A-6DE2-43E5-8380-4BE5AE4C0614,wojtek@tigase.org,conversations@conference.siacs.eu,1590009458502,,1590077274634
D86AF403-375F-4F1F-9BF0-9DF5918A4256,wojtek@tigase.org,conversations@conference.siacs.eu,1590104787374,,1590165054536
D9E82425-641B-4CDD-98A4-7E62A5F918DD,wojtek@tigase.org,conversations@conference.siacs.eu,1590193765770,,1590416937389
3B8D059E-38D2-4148-867E-7249876066C1,wojtek@tigase.org,conversations@conference.siacs.eu,1590454671226,,1590508131572
E1BDDA73-6D87-4B1B-8ACD-63C8EEDE6C23,wojtek@tigase.org,conversations@conference.siacs.eu,1590539241814,,1590596670011
F47CE693-92D9-4A16-940F-192B94C0A574,wojtek@tigase.org,conversations@conference.siacs.eu,1590603180368,,1590603852360
38402C67-B888-4213-B0FE-0C01B80780D7,wojtek@tigase.org,conversations@conference.siacs.eu,1590603852360,,1590604068177
629B0040-0730-472A-BF0F-123C8182BFD6,wojtek@tigase.org,conversations@conference.siacs.eu,1590624147646,,1590624698959
2F12801D-0FCC-49E3-9241-AA0CE393DB74,wojtek@tigase.org,conversations@conference.siacs.eu,1590621801559,,1590682093738
ACBE39A4-E672-465F-94E4-2934B299B07C,wojtek@tigase.org,conversations@conference.siacs.eu,1590698227397,,1590768637202
CC3BAF38-46D5-4ED8-9F42-D92A0FE8E3C1,wojtek@tigase.org,conversations@conference.siacs.eu,1590791940471,,1591023758181
53FC1F93-07F5-4655-8C72-40CC14942B06,wojtek@tigase.org,conversations@conference.siacs.eu,1591029767859,,1591047495587
42F72BE8-697B-4E13-943D-8F097CDE4721,wojtek@tigase.org,conversations@conference.siacs.eu,1591052022254,,1591115805963
68828891-2203-4B6C-AA2E-B2D6B93ACBC2,wojtek@tigase.org,conversations@conference.siacs.eu,1591142232467,,1591199345168
50A8EE01-589E-4185-9C56-2243AAC48A57,wojtek@tigase.org,conversations@conference.siacs.eu,1591221325402,,1591286724816
E1D00F30-5326-4763-BBE3-D7537F0A25AB,wojtek@tigase.org,conversations@conference.siacs.eu,1591296155689,,1591298969050
F315BAC5-CB60-49E3-8BA7-D5AC2E9D5E97,wojtek@tigase.org,conversations@conference.siacs.eu,1591307071762,,1591373102746
17D3A4AD-BE95-4169-9867-626B2515C805,wojtek@tigase.org,conversations@conference.siacs.eu,1591402225433,,1591631902345
525AE60D-D1F6-4DBB-9EC1-A20D437303D3,wojtek@tigase.org,conversations@conference.siacs.eu,1591634052257,,1591636867262
F1FBB577-D9D9-4097-95A2-D6EFA90746D8,wojtek@tigase.org,conversations@conference.siacs.eu,1591668316676,,1591719066793
FA1C1B30-8D55-40D3-8BEE-1553BBF02229,wojtek@tigase.org,conversations@conference.siacs.eu,1591738093025,,1591804142132
D10597A0-D7C3-4688-986D-CF4A5F9B1939,wojtek@tigase.org,conversations@conference.siacs.eu,1591828741019,,1591893434136
6A816BF3-B474-49EE-A446-F0A0D94FE30E,wojtek@tigase.org,conversations@conference.siacs.eu,1591916087471,,1591976528737
A02E3A11-740C-4F79-A428-51AAAF8FB541,wojtek@tigase.org,conversations@conference.siacs.eu,1592013728885,,1592240499181
34F34682-073D-4B93-99BE-C9E200663E0E,wojtek@tigase.org,conversations@conference.siacs.eu,1592262920177,,1592264314512
A2431382-5BB8-4C48-BF9C-DB151B8AF67E,wojtek@tigase.org,conversations@conference.siacs.eu,1592271804238,,1592324851200
657C7D96-E715-4A8F-AFED-171CD609C3CC,wojtek@tigase.org,conversations@conference.siacs.eu,1592349373627,,1592414235959
DB2D22F2-48EA-4650-BA72-55F79471EA74,wojtek@tigase.org,conversations@conference.siacs.eu,1592439426071,,1592496396584
BE510CEF-B55F-4D11-BE81-408DAF8212B5,wojtek@tigase.org,conversations@conference.siacs.eu,1592524072191,,1592571436150
1437AB05-73C9-4CF7-8C5C-E05674C5A102,wojtek@tigase.org,conversations@conference.siacs.eu,1592602663009,,1592846437886
CCAD690A-CF62-423F-B7AA-65B44115E13D,wojtek@tigase.org,conversations@conference.siacs.eu,1592868444058,,1592939490406
033526B7-0B9F-4B9C-A981-59B45C3A075E,wojtek@tigase.org,conversations@conference.siacs.eu,1592944812159,,1593011051347
17D9FCA5-6525-4EAB-B6D4-8CF46EE6A7EB,wojtek@tigase.org,conversations@conference.siacs.eu,1593050737135,,1593111327862
1DD51D6A-6B0A-44DD-8077-9387B3D16F06,wojtek@tigase.org,conversations@conference.siacs.eu,1593129004564,,1593193895575
86D9FFDD-A597-48CF-AD14-4B775EB3E4CC,wojtek@tigase.org,conversations@conference.siacs.eu,1593215580766,,1593436832963
CD4E8244-CC4D-495C-A93B-13A5500C3CE7,wojtek@tigase.org,conversations@conference.siacs.eu,1593464821660,,1593524344927
26E8A2EE-A2D6-417C-B921-8917D5706C2E,wojtek@tigase.org,conversations@conference.siacs.eu,1593550612062,,1593607447605
90DAA82C-8850-475F-B0D6-9F06F455EAFC,wojtek@tigase.org,conversations@conference.siacs.eu,1593636302178,,1593696266213
9B3C6DE2-F613-4190-938E-311E3CD80573,wojtek@tigase.org,conversations@conference.siacs.eu,1593739028766,,1593783519060
CC9F6429-E6ED-4CC6-B123-CF0590CD0480,wojtek@tigase.org,conversations@conference.siacs.eu,1593818666129,,1594051406521
D1014195-4DDD-47C2-A4BF-8A065CFDDC7D,wojtek@tigase.org,conversations@conference.siacs.eu,1594062780341,,1594138046380
93766886-C61B-4CAF-8E7C-7527CE735D86,wojtek@tigase.org,conversations@conference.siacs.eu,1594165011953,,1594226722245
558DDBD9-713E-4B81-877D-7CBAF8C0B82A,wojtek@tigase.org,conversations@conference.siacs.eu,1594252031146,,1594307828460
415F6B6E-A085-4CB2-84EC-2BFA17C5B5E7,wojtek@tigase.org,conversations@conference.siacs.eu,1594315943533,,1594322329058
18992CC4-4D16-47B3-9B18-EE0587FCC4FF,wojtek@tigase.org,conversations@conference.siacs.eu,1594335831285,,1594393566618
52FC0CBB-6061-4B5B-B8E2-42C74EA8E57E,wojtek@tigase.org,conversations@conference.siacs.eu,1594422047742,,1594643673473
4C1CC831-0DCF-4816-A452-0B3968AD06F3,wojtek@tigase.org,conversations@conference.siacs.eu,1594685598586,,1594734304763
95893216-B53B-4336-8497-D5B0E380C1B6,wojtek@tigase.org,conversations@conference.siacs.eu,1594759885160,,1594832149634
83008A3F-C03A-4FBC-9304-A05317EA3879,wojtek@tigase.org,conversations@conference.siacs.eu,1594850947500,,1594852403660
A4FA9963-04DC-4645-8FB6-764AEF799D22,wojtek@tigase.org,conversations@conference.siacs.eu,1594854544888,,1594910979109
854A32E7-1AAF-4C94-8335-EA32853A4D5D,wojtek@tigase.org,conversations@conference.siacs.eu,1594935097368,,1594994558529
C70B438B-06CF-4BCE-A276-4A2D1F7F8AE3,wojtek@tigase.org,conversations@conference.siacs.eu,1595001981650,,1595002387031
0D0DBB4C-46AB-4D44-A58C-B807507D6E14,wojtek@tigase.org,conversations@conference.siacs.eu,1595016468947,,1595021929436
334A779A-6725-4072-A1EC-6BC87A5BD277,wojtek@tigase.org,conversations@conference.siacs.eu,1595025101121,,1595257249728
480E39DB-D9D7-42C8-A9D0-13010A5E0A80,wojtek@tigase.org,conversations@conference.siacs.eu,1595272145942,,1595345806450
B2CEA4CC-A24F-43BA-887A-D14917B87A93,wojtek@tigase.org,conversations@conference.siacs.eu,1595365138385,,1595434801681
AA05058B-A23D-4023-AF22-CD21975F61CD,wojtek@tigase.org,conversations@conference.siacs.eu,1595447600474,,1595448266479
A6DD0C78-44AC-4962-8A18-EEFC7EDBE5FA,wojtek@tigase.org,conversations@conference.siacs.eu,1595452710666,,1595529391705
97DA32C0-08CC-46A5-B120-BFAB5F8A5CBE,wojtek@tigase.org,conversations@conference.siacs.eu,1595549504996,,1595609031866
08EA35C1-AF49-4048-BF96-EA5F699E84B8,wojtek@tigase.org,conversations@conference.siacs.eu,1595628277209,,1595866530060
C79E15CA-318F-4FD3-B1B0-4D3041589E47,wojtek@tigase.org,conversations@conference.siacs.eu,1595885277431,,1595954465342
3D5EDE60-2FBC-42F6-A539-77D9C5D28B16,wojtek@tigase.org,conversations@conference.siacs.eu,1595971550311,,1596032312898
6F368892-3233-4260-BE95-ABF1056AFC2D,wojtek@tigase.org,conversations@conference.siacs.eu,1596041248746,,1596047332177
98A6F07C-84D4-4AEB-9197-69A72FAAE601,wojtek@tigase.org,conversations@conference.siacs.eu,1596047332194,,1596048752224
46808DD0-0DF7-4ADB-B12F-9D3B23A48835,wojtek@tigase.org,conversations@conference.siacs.eu,1596060486009,,1596124869897
FEF9CF06-19E4-41B7-8E1B-44085DA36EA5,wojtek@tigase.org,conversations@conference.siacs.eu,1596133176983,,1596136933551
8508F903-CC5D-43E2-9332-C7893E0046F5,wojtek@tigase.org,conversations@conference.siacs.eu,1596153526306,,1596210051905
4B82E167-2F79-42F9-8F26-5CF5865E1605,wojtek@tigase.org,conversations@conference.siacs.eu,1596233442531,,1596470563280
E4F84C2C-F03C-4266-8F38-F191B8FB53E3,wojtek@tigase.org,conversations@conference.siacs.eu,1596485069029,,1596557281199
5E00E40A-DBCB-4919-A743-A315FF7BA3C5,wojtek@tigase.org,conversations@conference.siacs.eu,1596585351644,,1596588439681
03835235-9293-460D-A4D6-E8CBEA5E4CC3,wojtek@tigase.org,conversations@conference.siacs.eu,1596591549409,,1596644014518
7A7E77DE-1440-4C94-B22E-1E7FB6BFB922,wojtek@tigase.org,conversations@conference.siacs.eu,1596656576836,,1596731634740
8AFE9C8D-9FA4-4936-9553-D8994A2C591A,wojtek@tigase.org,conversations@conference.siacs.eu,1596734523808,,1596736796379
2D9CEB48-F469-47A8-B85D-015C0B08455C,wojtek@tigase.org,conversations@conference.siacs.eu,1596751477526,,1596816108832
E7C6F96C-3283-4156-9FE8-CC93236C64B5,wojtek@tigase.org,conversations@conference.siacs.eu,1596820143544,,1596820347668
9DB1D655-B914-452F-887E-09EFCB6A6F57,wojtek@tigase.org,conversations@conference.siacs.eu,1596834692653,,1597083866391
B34FB55B-2BAC-4321-A4B5-F321C662D8C1,wojtek@tigase.org,conversations@conference.siacs.eu,1597100419242,,1597158254010
9BBFB146-FE85-406B-8CF0-DB00F70071C1,wojtek@tigase.org,conversations@conference.siacs.eu,1597184942655,,1597243252551
4D45C469-1DC8-4A3E-A5C4-D3627D3E6AE2,wojtek@tigase.org,conversations@conference.siacs.eu,1597275939240,,1597328336135
91D3C26F-00FF-4EAB-AB87-83CD67D59E4A,wojtek@tigase.org,conversations@conference.siacs.eu,1597362251140,,1597428405091
CF26909B-A447-40B8-9943-5F42B7E2C41A,wojtek@tigase.org,tigase@muc.tigase.org,1597434900669,,1597766659396
9B4012F8-6D4A-4D7D-88E4-25FD70876352,wojtek@tigase.org,conversations@conference.siacs.eu,1597437404881,,1597678498664
D647DEE5-3758-4E02-B993-C16AB0446993,wojtek@sure.im,conversations@conference.siacs.eu,1597689325016,,1598380035921
4FF7D640-7CB8-4601-BD67-65983046C747,wojtek@tigase.org,conversations@conference.siacs.eu,1597682271252,,1597699478709
11A4027A-21C5-43E6-9E9E-77EB5D50C911,wojtek@tigase.org,conversations@conference.siacs.eu,1597703717890,,1597766701021
90AA4269-1675-432B-A3AD-3E61ECB426EC,wojtek@tigase.org,tigase@muc.tigase.org,1597783921037,,1597856542359
33B03EA9-082D-4B9B-92FF-84D929C98F5B,wojtek@tigase.org,conversations@conference.siacs.eu,1597790501554,,1597856572762
0F8BB423-2075-40FF-B6B0-8E2721053472,wojtek@tigase.org,tigase@muc.tigase.org,1597879039710,,1597939772202
C53D7C5A-1BD2-4894-BDBF-8600D60A584E,wojtek@tigase.org,conversations@conference.siacs.eu,1597881977892,,1597939142685
120975A5-1228-41CC-8224-E5A4993275DC,wojtek@tigase.org,conversations@conference.siacs.eu,1597939748650,,1597939804173
32FF8BA1-ED90-4324-93EC-CC0C917EFD6E,wojtek@tigase.org,tigase@muc.tigase.org,1597951605318,,1598453716450
6AF5F846-B1CE-4716-9971-88A3B858E4F9,wojtek@tigase.org,conversations@conference.siacs.eu,1597957520676,,1598025437372
1341D21B-BB9F-4A46-98FA-FD51B43449FE,wojtek@tigase.org,conversations@conference.siacs.eu,1598028334702,,1598030459086
19B7A071-23A5-443B-B2E0-38E4F41B72F9,wojtek@tigase.org,conversations@conference.siacs.eu,1598053859058,,1598282570429
E09121BC-0161-4EA4-ABED-62967F63660C,wojtek@tigase.org,conversations@conference.siacs.eu,1598299042150,,1598373690516
F4D81953-C2C6-4490-9859-3087FD8D1D8B,wojtek@tigase.org,conversations@conference.siacs.eu,1598398219176,,1598453754582

Related
- Invalid MAM version used (tigase/_clients/siskin-im#241) Closed

Activities

Andrzej Wójcik (Tigase) commented 5 years ago

It looks like for tigase.org there is no messages in the specified timeframe. I need to check if there is proper handling for that (but it should be).
Andrzej Wójcik (Tigase) commented 5 years ago

I've checked and 0 results is now assumed to be the same as complete, which means "jump to the next period".
Andrzej Wójcik (Tigase) commented 5 years ago

Except from the issue with <iq type="result"/> not being returned by Conversations room, I've found that in some cases when we sync more messages, wrong MAM version could be used. I'll provide proper fix for that tomorrow.
Andrzej Wójcik (Tigase) commented 5 years ago

Added retry and fixed issue with possible usage of wrong MAM version in a query.
Andrzej Wójcik (Tigase) commented 5 years ago

@wojtek Please try using new version build 102
Wojciech Kapcia (Tigase) commented 5 years ago

Seems that now the table is correctly flushed and history correctly retrieved..
Login to comment

Type	Bug
Priority	Normal
Assignee	Andrzej Wójcik (Tigase)
Spent time	0

Issue Votes (0)

Watchers (0)

Reference

tigase/_clients/beagle-im#279