Commit graph

87 commits

Author SHA1 Message Date
friendica
e157371c39 remote_user => remote_channel 2015-01-28 20:58:59 -08:00
friendica
a496036066 local_user => local_channel 2015-01-28 20:56:04 -08:00
friendica
ddc8557b69 hide online presence maps to DNT 2014-11-24 15:36:11 -08:00
Habeas Codice
1a5a5c7edb PostgreSQL support initial commit
There were 11 main types of changes:
- UPDATE's and DELETE's sometimes had LIMIT 1 at the end of them. This is not only non-compliant but
it would certainly not do what whoever wrote it thought it would. It is likely this mistake was just
copied from Friendica. All of these instances, the LIMIT 1 was simply removed.
- Bitwise operations (and even some non-zero int checks) erroneously rely on MySQL implicit
integer-boolean conversion in the WHERE clauses. This is non-compliant (and bad programming practice
to boot). Proper explicit boolean conversions were added. New queries should use proper conventions.
- MySQL has a different operator for bitwise XOR than postgres. Rather than add yet another dba_
func, I converted them to "& ~" ("AND NOT") when turning off, and "|" ("OR") when turning on. There
were no true toggles (XOR). New queries should refrain from using XOR when not necessary.
- There are several fields which the schema has marked as NOT NULL, but the inserts don't specify
them. The reason this works is because mysql totally ignores the constraint and adds an empty text
default automatically. Again, non-compliant, obviously. In these cases a default of empty text was
added.
- Several statements rely on a non-standard MySQL feature
(http://dev.mysql.com/doc/refman/5.5/en/group-by-handling.html). These queries can all be rewritten
to be standards compliant. Interestingly enough, the newly rewritten standards compliant queries run
a zillion times faster, even on MySQL.
- A couple of function/operator name translations were needed (RAND/RANDOM, GROUP_CONCAT/STRING_AGG,
UTC_NOW, REGEXP/~, ^/#) -- assist functions added in the dba_
- INTERVALs: postgres requires quotes around the value, mysql requires that there are not quotes
around the value -- assist functions added in the dba_
- NULL_DATE's -- Postgres does not allow the invalid date '0000-00-00 00:00:00' (there is no such
thing as year 0 or month 0 or day 0). We use '0001-01-01 00:00:00' for postgres. Conversions are
handled in Zot/item packets automagically by quoting all dates with dbescdate().
- char(##) specifications in the schema creates fields with blank spaces that aren't trimmed in the
code. MySQL apparently treats char(##) as varchar(##), again, non-compliant. Since postgres works
better with text fields anyway, this ball of bugs was simply side-stepped by using 'text' datatype
for all text fields in the postgres schema. varchar was used in a couple of places where it actually
seemed appropriate (size constraint), but without rigorously vetting that all of the PHP code
actually validates data, new bugs might come out from under the rug.
- postgres doesn't store nul bytes and a few other non-printables in text fields, even when quoted.
bytea fields were used when storing binary data (photo.data, attach.data). A new dbescbin() function
was added to handle this transparently.
- postgres does not support LIMIT #,# syntax. All databases support LIMIT # OFFSET # syntax.
Statements were updated to be standard.

These changes require corresponding changes in the coding standards. Please review those before
adding any code going forward.

Still on my TODO list:
- remove quotes from non-reserved identifiers and make reserved identifiers use dba func for quoting
- Rewrite search queries for better results (both MySQL and Postgres)
2014-11-13 12:21:58 -08:00
friendica
50c16c394f check that we have valid data 2014-11-01 01:52:27 -07:00
friendica
28a35261db What this checkin does is catch the case where a comment arrived and there's a missing top-level post to match it with. So we'll send a request back to the sender that you've never seen this thread and please send a fresh copy of the entire conversation to date. We could soon have posts in the matrix from different platforms from days gone by, which have been migrated into the modern world. We'll be polite and not deliver these to everybody. However, if someone comments on one of these antique threads we wouldn't be able to see it in our own matrix because we won't have a copy of the parent post. So this rectifies that situation. Be aware that item deletion may need to change to keep "hard deleted" items indefinitely so that they don't keep coming back. We'll have to null out the important data of the former item to accomplish the deletion aspect. 2014-10-30 19:15:03 -07:00
friendica
0350b76d85 some backend work for the remaining missing bits of mod_hubman - this is still a fair ways from being complete and is not ready for prime time. Basically we'll let a channel send out a public message saying "these are my currently approved locations" and anything that isn't in the list will be marked deleted. We'll send out this message when locations change somehow - either through direct personal involvement (hub revoke, change primary, channel import) or during a system rename or "find bad/obsolete hublocs" activity. This way we won't have clones sending back location info we just got rid of and re-importing the bad entries. 2014-09-13 16:00:09 -07:00
friendica
1accf82bd1 clean up more code duplication 2014-07-14 21:21:24 -07:00
friendica
06b7aea1a0 visage tracking opt-in/opt-out 2014-07-03 17:26:42 -07:00
friendica
1e86a88f0d session DNT - if you want it use it. 2014-07-03 02:20:40 -07:00
friendica
2a6d7b6a07 cleanup dead directory entries. This was a real b#tch, so keep your eye out for issues - which you shouldn't see until next weekend when this is scheduled to run. We're only setting flags, so if anything goes wrong we should be able to recover without too much pain. 2014-05-28 21:42:46 -07:00
friendica
abf0dd5ecf log pickups 2014-05-05 20:15:01 -07:00
friendica
bf1f18e172 Include the entire original item when notifying other channels of deletions as it contains important routing and scope information. Previously we were only sending a couple of critical fields like the message-id, flags, and creation date. The thinking was that it is deleted, let's not resend the deleted contents anywhere. But in order to route this through the same path the original post took we really need the entire original post with all of its baggage attached. 2014-04-10 16:14:19 -07:00
Thomas Willingham
5a8be68900 json_return_and_dir isn't a thing 2014-03-13 02:09:45 +00:00
friendica
74b8a38645 json_return_and_dir is a typo 2014-03-12 19:04:20 -07:00
friendica
39f18d0f16 fix third-party zid's 2014-03-04 15:25:04 -08:00
friendica
eadf5121d0 rev update and a minor fix (missing param) to force_refresh 2014-02-14 12:39:15 -08:00
friendica
d02529fde1 implement a forced directory update mode where we unconditionally create a directory sync packet. This is needed to ensure that monthly directory pings are propagated to other directory servers so they can each prove for themselves whether or not an account is alive or dead. We do not trust other directories to provide us information beyond "look at this entry and decide for yourself" as doing otherwise would invite rogue directory manipulations. As this scheduled update occurs on all channels across all servers, we should also pick up refresh messages from all existing channel clones and these should also propagate out to all directory servers using the same mechanism (though perhaps not at the same time). 2014-02-11 14:19:20 -08:00
Michael Meer
c0f02d774a started analysis of ping response and clean up more logger 2014-01-30 20:41:40 +01:00
Michael Meer
aa285b83c1 to make visible what I try, ping still won't work, but I'm confused about get_channel 2014-01-28 10:58:31 +01:00
Michael Meer
904db593df add a temporary logger command at remote server side 2014-01-27 12:01:53 +01:00
friendica
63a42480c7 add account_level, is_foreigner and is_member functions; convert all e2ee user input and prompts to hex to avoid javascipt's lame handling of quotes. !!This breaks all prior encrypted posts.!! 2013-12-23 15:13:09 -08:00
friendica
44ead61339 authtest: do a better job of success/failure indication 2013-12-17 16:35:22 -08:00
friendica
539988b62f couple of additional checks 2013-12-05 15:55:14 -08:00
friendica
d66d8ff524 mod_authtest --- magic-auth diagnostic for those that are too freaking important to read logs or code and expect others to be able to debug complex authentication transactions with no information beyond "it didn't work". This will provide a transaction report including both sides of the exchange that you can paste into a bug report and that a developer can actually figure out where in the transaction that things went wrong and maybe even be able to then figure out why. 2013-12-05 15:40:50 -08:00
friendica
cc1e906825 generate a small amount of entropy to avoid duplicate notifications from essentially simultaneous deliveries. 2013-12-04 23:54:46 -08:00
friendica
d8903f09f5 include re-organisation and more doco, post_to_red fix ampersands in categories 2013-12-04 00:19:29 -08:00
friendica
f57909d190 on successful magic-auth, put remote_service_class and remote_hub into the session 2013-12-03 16:31:05 -08:00
friendica
645e897852 more work on magic-auth 2013-12-02 19:06:54 -08:00
friendica
e0f4a76856 magic-auth re-factor 2013-12-02 17:35:44 -08:00
friendica
d9f67876dc refactor magic-auth 2013-12-02 15:15:02 -08:00
friendica
194c1e7abc file corruption 2013-12-01 19:29:11 -08:00
friendica
71e67f6347 document the ping packet - and remove the ancient rusty brown square default profile photos. 2013-12-01 19:02:36 -08:00
friendica
fa5366bb95 don't magic-auth against a deleted channel 2013-12-01 17:18:09 -08:00
friendica
77186fa7cd magic auth fix plus doco 2013-12-01 17:12:29 -08:00
friendica
b1e775a7a1 zot documentation inline in the code where we need it most. 2013-12-01 16:11:18 -08:00
friendica
8f236771c6 mark hublocs with incorrect sitekeys deleted 2013-11-21 14:42:48 -08:00
friendica
d7ee552c57 Protocol: now set data['alg'] on all encapsulated encrypted packets, so that we can more easily retire 'aes256cbc' once it is no longer viable. 2013-11-20 15:20:12 -08:00
friendica
b1a4dc7d7e set a default value for $webbie - it's the right thing to do. 2013-11-18 01:00:04 -08:00
friendica
718f69c6fc to clarify the fact, we'll remove the line we no longer need instead of commenting it 2013-11-18 00:57:56 -08:00
friendica
fa8f26c544 change the way magic-auth works - we rarely need a destination channel and if that channel has problems
it shouldn't mess up authentication to the hub.
2013-11-18 00:55:41 -08:00
friendica
dd6c64f95a magic auth issues 2013-11-17 23:12:34 -08:00
friendica
92f37fd0d5 document extra features 2013-11-17 01:10:46 -08:00
Olaf Conradi
66d2fe2289 Fix name of Bleichenbacher 2013-09-24 21:04:01 +02:00
friendica
d4ea56a77e reduce susceptibility to bleichenberger attack 2013-09-24 05:20:29 -07:00
friendica
037fd43fbd more remote error reporting for zot 2013-09-12 16:52:58 -07:00
Michael Meer
2c06a2c163 implement tip from Mike, corrected the sql statement 2013-09-11 15:24:26 +02:00
Michael Meer
2228264772 flag failed auth attempts in DB table hubloc 2013-09-11 13:59:45 +02:00
friendica
be289a96ad implement a 'ping' message type to respond if we're still here and whether our URL or keys have changed. 2013-08-29 17:48:31 -07:00
friendica
1c17d1b69c start timestamping hubloc connections so we can eventually remove dead ones 2013-08-24 18:55:07 -07:00