Commit Graph

876 Commits (f3795846b5dcd4e17433eb6f6995820a5f82acdf)

Author SHA1 Message Date
Torsten Flammiger d21030566c Rename/Add count methods to count_local_users 3 years ago
Torsten Flammiger 567cf6dbe9 Add command count_local_users to database/rooms.rs 3 years ago
Torsten Flammiger 7c1b2625cf Prepare to add an option to list local user accounts from your homeserver 3 years ago
Tglman a889e884e6 refactor:moved key watch wake logic to specific module 3 years ago
Jonas Platte aba95b20f3
Upgrade Ruma 3 years ago
Moritz Bitsch c4a438460e Use Box to store UserID and DeviceID
Userid and DeviceID are of unknown size, use Box to be able to store
them into the userdevicesessionid_uiaarequest BTreeMap
3 years ago
Torsten Flammiger 7f2445be6c On unregister_appservice(service_name), remove the appservice service_name from cache too 3 years ago
Torsten Flammiger b6c9582cf4 Fix doc style comment according to Rust; VSCode added line breaks 3 years ago
Torsten Flammiger 7857da8a0b Add ability to remove an appservice 3 years ago
Moritz Bitsch 720a54b3bb Use String to store UserId for uiaa request
Fixes compilation error after ruma upgrade
3 years ago
Moritz Bitsch 0725b69abb Clean up userdevicesessionid_uiaarequest BTreeMap
There is no need to encode or decode anything as we are not
saving to disk
3 years ago
Moritz Bitsch fe8cfe0556 Add database migration to remove stored passwords
uiaarequests can contain plaintext passwords, which were stored on disk
3 years ago
Moritz Bitsch 3d25d46dc5 Use simple BTreeMap to store uiaa requests
some uiaa requests contain plaintext passwords which should never be
persisted to disk.

Currently there is no cleanup implemented (you have to restart conduit)
3 years ago
Jonas Platte 34d3f74f36
Use Arc for EventIds in PDUs
Upgrades Ruma again to make this work.
3 years ago
Jonas Platte 0183d003d0
Revert rename of Ruma<_> parameters 3 years ago
Jonas Platte f712455047
Reduce EventId copying 3 years ago
Jonas Platte 58ea081762
Use int! macro instead of Int::from 3 years ago
Jonas Platte bffddbd487
Simplify identifier parsing code 3 years ago
Jonas Platte 41fef1da64
Remove unnecessary .to_string() calls 3 years ago
Jonas Platte 892a0525f2
Upgrade Ruma 3 years ago
Jonas Platte 1fc616320a
Use struct init shorthand 3 years ago
Moritz Bitsch 9fccbb014a Implement TURN server authentication with hmac
This is a prefered method to allow limited access to the TURN server
3 years ago
Moritz Bitsch 109892b4b7 Implement turn server settings
this fills out the infos in /_matrix/client/r0/voip/turnServer with
values specified in the server config
3 years ago
Jonas Platte 24a835647c Merge branch 'nyaaori/fix-room-creation' into 'next'
Make createRoom follow spec for m.room.create, allowing creation of spaces

See merge request famedly/conduit!220
3 years ago
Nyaaori c4bce1d0c7
Cleanup room.rs; replace unwraps with map_err 3 years ago
Nyaaori 86177faae7
Fix join panic bug 3 years ago
Nyaaori d5d25fb064
Preserve all m.room.create entries when performing room upgrades 3 years ago
Nyaaori 8087a26a35
Make createRoom follow spec for m.room.create, allowing creation of spaces 3 years ago
Nyaaori bbe16f8467
Update Ruma 3 years ago
Nyaaori 50f931a2fd
Cleanup and fix validation in report.rs, lower max report length, better html 3 years ago
Nyaaori 1541b93f45
Make reports look nicer and reduce spam potential, increase max report length to 1000 characters 3 years ago
Nyaaori ccf501a420
Initial implementation of /report, fixing #13 3 years ago
Nyaaori 484a044b50
Remove device_one_time_keys_count from is_empty() sync checks, fixing sync issue as reported by Nekron 3 years ago
Timo Kösters e88929e154 Merge branch 'nyaaori/fix-otk-reporting' into 'next'
Always send device_one_time_keys_count, fixing #178

Closes #169 and #178

See merge request famedly/conduit!213
3 years ago
Nyaaori d996d1b0e6
Always send device_one_time_keys_count, fixing #178 3 years ago
Timo Kösters dc8bc4a880 Merge branch 'up-ruma' into 'next'
Upgrade Ruma

See merge request famedly/conduit!210
3 years ago
Timo Kösters 335027e739 Merge branch 'nyaaori/admin-check' into 'next'
Implement admin check and add config option for allowing room creation

See merge request famedly/conduit!211
3 years ago
Nyaaori 9082a531c9
Make allow_encryption work again, fixing #115 3 years ago
Jonas Platte 91afa1e0e0
Make Result alias usable with any error type 3 years ago
Jonas Platte f2ef5677e0
Reduce turbofish usage
Should make the code a little bit easier to read.
3 years ago
Jonas Platte 1c4d9af586
Enable more lints and apply their suggestions 3 years ago
Jonas Platte 09895a20c8
Upgrade Ruma
Co-authored-by: Timo Kösters <timo@koesters.xyz>
3 years ago
Nyaaori 6bc8fb2ae7
Implement admin check and add config option for allowing room creation 3 years ago
Timo Kösters 5c02dc7830
improvement: batch inserts for inserting pdus 3 years ago
Timo Kösters b64538c6f1 Merge branch 'efficient-sqlite' into 'next'
improvement: more efficient sqlite

See merge request famedly/conduit!199
3 years ago
Timo Kösters 178451e9b5 Merge branch 'deduplicate-watchers' into 'next'
improvement: deduplicate watchers

See merge request famedly/conduit!201
3 years ago
Timo Kösters cbee7fe111
improvement: deduplicate watchers 3 years ago
Jonas Platte d68c93b5fa
Clean up (mostly automated with cargo clippy --fix) 3 years ago
Jonas Platte 979ec6b4fa
Upgrade ruma 3 years ago
Jonas Platte 910ad7fed1
Get rid of more unnecessary intermediate collections 3 years ago
Timo Kösters 2c8412fe58
improvement: more efficient sqlite 3 years ago
Jonathan de Jong 23c5ec8099 fix sync not firing on new events in room 3 years ago
Rasmus Thomsen 51245d34f1
fix(database): handle errors in config parsin or database creation
Showing the user a backtrace can be pretty confusing, so just printing
a nice error message makes errors easier to understand for end users.

fixes #121
3 years ago
Timo Kösters 71341ea05a
fix: make sure old events don't sneek into the timeline 3 years ago
Timo Kösters 2770ce2cf6
fix: avoid panic 3 years ago
Timo Kösters 43d693ca19
revert Arc<EventId> commit 3 years ago
Timo Kösters 875b345a5f
docs: update readme and version 3 years ago
Jonas Platte 487601a249
Remove unneeded intermediary container collection 3 years ago
Timo Kösters 4b39d7cb64
fix: batch key fetching 3 years ago
Kurt Roeckx c53d79e287
fixup! Get required keys in batch when joining a room 3 years ago
Kurt Roeckx 984ad5ecd6
fixup! Get required keys in batch when joining a room 3 years ago
Kurt Roeckx b546a5bf15
Let our server signing be valid for 1 week
It was valid for 2 minutes, which can result in the server being
asked too much for something that never changes.
3 years ago
Kurt Roeckx a87519fb71
Get required keys in batch when joining a room
We now ask the trusted server for all keys in 1 request, instead of
asking each server individual for it's own keys.
3 years ago
Timo Kösters 8518d59a0b Merge branch 'clippy' into 'master'
Fix a bunch of clippy lints

See merge request famedly/conduit!178
3 years ago
Timo Kösters 73d876643c
improvement: make pdu cache capacity configurable 3 years ago
Timo Kösters 33738dbbc2
improvement: stop prev event fetching if too many events fail 3 years ago
Jonas Platte a6bb9bbe68
Fix a bunch of clippy lints 3 years ago
Timo Kösters b9eb39a9c6
docs: documentation for every endpoint 3 years ago
Jonathan de Jong 9ec8b7f2b3 registration default true 3 years ago
Jonathan de Jong 69df9a0145 add tls 3 years ago
Timo Kösters bd4ea14a29
improvement: call /state_ids less often by using state res 3 years ago
Timo Kösters 1b25e78e3a
fix: inviting dendrite users 3 years ago
Timo Kösters d57c19802d
improvement: don't do state updates if the event was soft failed 3 years ago
Timo Kösters 632a1343eb
fix: make appservices more efficient 3 years ago
Timo Kösters 1601027605
add warning if calculated event id != requested event id 3 years ago
Timo Kösters afca61fe7c
fix: don't retry soft failed events 3 years ago
Devin Ragotzy 9bff276fa9
Use Arc<EventId> in place of most EventIds 3 years ago
Timo Kösters 19b89ab91f
fix: server resolution 3 years ago
Timo Kösters 0330d3e270
fix: server resolution with well-known files 3 years ago
Timo Kösters a1e8a99db5
improvement: less IO for auth chains 3 years ago
Timo Kösters 33172a70e6
fix: improve key fetching 3 years ago
Timo Kösters 41d07be97b
improvement: persist cached auth chains in db 3 years ago
Timo Kösters bef4fe50ce
fix: better migration, force e2ee device key updates 3 years ago
Timo Kösters 9152b877a7
fix: wrong soft fail check, too many events in /sync state response 3 years ago
Timo Kösters 9f8c45c763
fix: e2ee over federation
to device events were not being sent
3 years ago
Timo Kösters dd87066546
improvement: more efficient auth chain cache 3 years ago
Timo Kösters 81e056417c
improvement: better e2ee over fed, faster incoming event handling 3 years ago
Timo Kösters 72dd95f500 Merge branch 'createwarnings' into 'master'
fix: correct create event warnings

See merge request famedly/conduit!161
3 years ago
Timo Kösters 4f8cf3bed4 Merge branch 'send_join_v1' into 'master'
Implement federation/v1/send_join

See merge request famedly/conduit!141
3 years ago
Timo Kösters b3ea6adc9c Merge branch 'get-pdu-json' into 'master'
Consistent and escaped response in get_pdu

See merge request famedly/conduit!160
3 years ago
Timo Kösters 6d83954c40
fix: room upgrades 3 years ago
Timo Kösters 667ffb4239
fix: correct create event warnings 3 years ago
Kurt Roeckx 48494c9464 Implement federation/v1/send_join 3 years ago
Tom Smeding 2ef23b213a
Consistent and escaped response in get_pdu
1. The fallback text of the get_pdu admin room command response message
   now contains the same text as the formatted_body content (namely, the
   json instead of Debug-formatting of a serde type).
2. The formatted_body content of the get_pdu response is now
   html-escaped.
3 years ago
Timo Kösters 3b78e43a18
fmt 3 years ago
Timo Kösters 4956fb9fba
improvement: limit prev event fetching 3 years ago
Timo Kösters b09499c2df
fix: don't save empty tokens 3 years ago
Timo Kösters 46d8a46e1f
improvement: faster incoming transaction handling 3 years ago
Timo Kösters bf7e019a68
improvement: better prev event fetching, perf improvements 3 years ago
Timo Kösters 75ba8bb565
fix: faster room joins 3 years ago
Timo Kösters 0823506d05
fix: don't load endless prev events and fix room join bug 3 years ago
Timo Kösters 2c3bee34a0
improvement: better sqlite 3 years ago
Timo Kösters a4310f840e
improvement: state info cache 3 years ago
Timo Kösters 5bd5b41c70
fix: fetch event multiple times 3 years ago
Timo Kösters f9a2edc0dd
fix: also fetch prev events that are outliers already 3 years ago
Timo Kösters ecd1e45a44
fix: fetch more than one prev event 3 years ago
Timo Kösters 1d46569929
fix: don't use recursion for prev events 3 years ago
Timo Kösters 1e3a8ca35d
fmt 3 years ago
Timo Kösters 0cb22996be
remove prev event fetch limit 3 years ago
Timo Kösters 38effda799
fix: delta calculation 3 years ago
Timo Kösters 3cf0145bc5
fix: room exists panic 3 years ago
Timo Kösters 3eabaa2a95
finish implementing better state store 3 years ago
Timo Kösters 31f60ad6fd
improvement: migrations, batch inserts 3 years ago
Timo Kösters 41dd620d74
WIP improvement: much better state storage 3 years ago
Timo Kösters 9410d3ef9c
fix: long prev event fetch times for huge rooms 3 years ago
Timo Kösters 665aee11c0
less warnings 3 years ago
Timo Kösters 5173d0deb5
improvement: cache for short event ids 3 years ago
Timo Kösters c2c6a8673e
improvement: use u64s in auth chain cache 3 years ago
Timo Kösters 096e0971f1
improvement: smaller cache, better prev event fetching 3 years ago
Jonas Zohren 4cf3c432af Try to set canonical room alias on room creation.
The spec does not require servers to apply a room canonical alias event upon room creation (yet).
Still, synapse does that, since users can set their desired alias in Elements room creation dialog.
With this commit, conduit also sets that alias if it is a valid one.

This closes https://gitlab.com/famedly/conduit/-/issues/123
3 years ago
Timo Kösters e83c226b1b Merge branch 'zap-displayname' into 'master'
Set nicer displayname

See merge request famedly/conduit!149
3 years ago
Jonathan de Jong 8335f44bfe Set nicer displayname 3 years ago
Timo Kösters 3745a7cbe6 Merge branch '3pid' into 'master'
Add support for a minimal `r0/account/3pid`.

See merge request famedly/conduit!151
3 years ago
Timo Kösters 610b4f9ad1 Merge branch 'fetchprev' into 'master'
improvement: try to load missing prev events

See merge request famedly/conduit!152
3 years ago
Ahmed Charles 879aeafa9e Add support for a minimal `r0/account/3pid`. 3 years ago
Timo Kösters 260db9fcc7
improvement: try to load missing prev events 3 years ago
Timo Kösters 1cbc61c558 Merge branch 'badeventfix' into 'master'
fix: handle bad events in db better

See merge request famedly/conduit!148
3 years ago
Timo Kösters d2f406e0e8
fix: handle bad events in db better 3 years ago
Kurt Roeckx 989a20e99c Support creating rooms with a version 3 years ago
Timo Kösters 55a2ff025f
improvement: longer timeout, more descriptive errors 3 years ago
Timo Kösters df727688ef
remove rocksdb 3 years ago
Timo Kösters 902404d48d
improvement: save member count + sled fixes 3 years ago
Timo Kösters b813c34642
improvement: more auth chain caching 3 years ago
Timo Kösters ab7835dedb
fix: early return from state res 3 years ago
Timo Kösters 9bb4c3cd01
improvement: batched inserts for tokenids 3 years ago
Timo Kösters fce22362d4
improvement: better auth chain calculation 3 years ago
Timo Kösters 41ec7cf5d0
improvement: batch inserts for stateids 3 years ago
Timo Kösters 49ade0cfbd
improvement: allow batch inserts 3 years ago
Timo Kösters 0eeba86b32
fix: improve locks 3 years ago
Timo Kösters 6b06fc9707
fix: don't run push rules for users that don't exist 3 years ago
Timo Kösters bd63797213
improvement: make better use of sqlite connections 3 years ago
Timo Kösters 2c4f966d60
improvement: use sqlite properly 3 years ago
Timo Kösters dc85a8fafd
fix: migration and push edu bugs 3 years ago
Timo Kösters 5df6b8cd5f
improvement: better account data implementation 3 years ago
Timo Kösters 5c776e9ba7
feat: heed db backend (LMDB) 3 years ago
Timo Kösters c209775abd
fix: pdu without state bug 3 years ago
Timo Kösters 5e924227b6
feat: add threadpool for iterator threads, bug fixes, tracing_flame support 3 years ago
Timo Kösters e0072eff63 Merge branch 'v5' into 'master'
feat: support room version 5

See merge request famedly/conduit!138
3 years ago
Timo Kösters cae2b200cc Merge branch 'initial_state_keys' into 'master'
Implement From<AnyInitialStateEvent> on PduBuilder

Closes #116

See merge request famedly/conduit!136
3 years ago
Timo Kösters 918df9ca6d
feat: support room version 5 3 years ago
Kurt Roeckx 0d33cc4acd Implement getting room aliases
Signed-off-by: Kurt Roeckx <kurt@roeckx.be>
3 years ago
phesch 666e1d30a3 Implement From<AnyInitialStateEvent> on PduBuilder
The conversion between the two is now direct and thus shouldn't lose the state_keys.
3 years ago
Timo Kösters 1587f2cd52
fix: check events in timeline (not only state) for member changes 3 years ago
Timo Kösters f121978897
fix: state bug 3 years ago
Timo Kösters 80533bfab2
fix: improve code when skipping /state_ids 3 years ago
Timo Kösters 08a3326431
docs: Initial end-to-end encryption over federation support 3 years ago
Timo Kösters fe3b5d32a7
feat: send to-device events over federation 3 years ago
Timo Kösters e20f55970e
feat: call /query/profile over federation when local user asks 3 years ago
Timo Kösters 728e176a06
feat: /keys/query and /keys/claim over federation 3 years ago
Timo Kösters 68cc743f2a
fix: use get_auth_chain method more often 3 years ago
Timo Kösters 56e5d5e3d2
fix: add warning for strange bug 3 years ago
Timo Kösters f0ac7ed933
chore: update ruma again 3 years ago
Timo Kösters 0f8ecdc625
fix: state res fixes 3 years ago
Timo Kösters cfaa900e83
improvement: auth chain cache 3 years ago
Timo Kösters f5273f7eb1
improvement: upgrade ruma and implement blurhashes 3 years ago
Timo Kösters 0fcefa4125
fix: ruma 3 years ago
Timo Kösters d07762f596 Merge branch 'connection-cushion' into 'master'
Spillover connection cushion

See merge request famedly/conduit!133
3 years ago
Jonathan de Jong d253f9236a change fraction type 3 years ago
Jonathan de Jong ec44f3d568 change to f64 3 years ago
Jonathan de Jong e7a51c07d0 log change feedback 3 years ago
Jonathan de Jong 79bf7fc597 some logging shuffling 3 years ago
Jonathan de Jong 7e579f8d34 change to fraction-based approach 3 years ago
Jonathan de Jong 0f2dc9a239 add stuff and bits 3 years ago
Jonathan de Jong faa283d35b review feedback 3 years ago
Jonathan de Jong 3ce75d1f02 apply fix 3 years ago
Timo Kösters f924ebf8a6 Merge branch 'fix-windows-signal' into 'master'
fix signal compiling on windows

See merge request famedly/conduit!126
3 years ago
Jonathan de Jong b1993421c2 fix signal compiling on windows 3 years ago
Jonathan de Jong d76e95e8fc use existing db cache size 3 years ago
Jonathan de Jong 661101c9ae add sled cache_capacity back 3 years ago
Timo Kösters f7ecf83ac3 Merge branch 'stuff' into 'master'
fix: stuck/duplicate messages, e2ee and sync timeouts

See merge request famedly/conduit!123
3 years ago
Jonathan de Jong 952fb75795 add shutdown handler to kick sync 3 years ago
Timo Kösters e12b1ff863
improvement: locks 3 years ago
Timo Kösters e15e6d4405
improvement: efficient /sync, mutex for federation transactions 3 years ago
Timo Kösters 1c25492a7e
fix: stuck messages
Conduit did not send the event in /sync because of a race condition.
There is a brief moment in time where Conduit accepted the event, but
did not store it yet. So when the client /syncs it updates the since
token without sending the event. I hope I fixed it by significantly
shortening the race-condition period.
3 years ago
Timo Kösters 8c44312485
fix: e2ee verification 3 years ago
Timo Kösters ac0027756e
improvement: more efficient state res 3 years ago
Jonathan de Jong e1b89c1248 apply lint suggestions and version bump 3 years ago
Jonathan de Jong 15471d9ac4 update rocket and lock 3 years ago
Jonathan de Jong 9d4fa9a220 Sqlite 3 years ago
Kurt Roeckx dcb5e5900f Getting capabilities requires authentication 3 years ago
Timo Kösters 4732aa6782 Merge branch 'invalid_utf8' into 'master'
Return proper error in case of invalid UTF-8

See merge request famedly/conduit!110
3 years ago
Kurt Roeckx 699f77671f Return proper error in case of invalid UTF-8 in json_body
json_body is used in places that need authentication. In
case an unknown field is set, Ruma doesn't parse the field
and so doesn't give an error on invalid UTF-8. But Conduit
has parsed and on error makes json_body None. Return an
error to the client instead of generating an internal error.
3 years ago
Timo Kösters 13c0beafa6 Merge branch 'lib-fix' into 'master'
Export conduits Config struct and fix clippy warnings

See merge request famedly/conduit!99
3 years ago
Timo Kösters 5711467ad9 Merge branch 'state-res-closure' into 'master'
Remove auth_cache using a closure to fetch events in state-res

See merge request famedly/conduit!108
3 years ago
Aiden McClelland c53cc03ff8
address pr comments 3 years ago
Aiden McClelland f25f61d4a9
fix errors introduced by rebase 3 years ago
Aiden McClelland b2d5516058 add support for arbitrary proxies 3 years ago
Devin Ragotzy 1bb84a8e2d Fix docs for fetch_and_handle_events 3 years ago
Devin Ragotzy 98f1480e2b
Remove auth_cache using a closure to fetch events in state-res 3 years ago
Timo Kösters 05821d6fd5
improvement: pdu cache, /sync cache 3 years ago