Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Messages - Arantor
3661
I think we'd need to do performance testing on that to be sure ;)

I'm still in a place mentally where I forget such constructs because I still find myself thinking about the cross-system methodologies I've been exposed to over the years...
3662
We've certainly talked about it and it would certainly solve some issues that a few users have had (when members are in many many membergroups)

My initial concern is that raised above: how can we efficiently get the list of groups a user is in when starting up? When it's inline, it can be trivially read during loadUserSettings() when we query for mem.*, which brings us to the two alternatives: do an inner join and get many extra rows, or do a separate query.[1]

Both have their advantages and disadvantages of course, and in theory we could bind that into permissions while we're at it, but that has its own performance concerns, and remember this is something we're doing per page, every page.

I did something similar in SimpleDesk, where I separated roles and groups (so knowing the groups a user was in, there was a query to fetch the roles that applied, then another query to fetch all the permissions for each department for all those roles, I forget why it was two queries though) so it's certainly possible, but it's something important to weigh up.

It would certainly be faster doing reverse lookups against FIND_IN_SET, though. (But looking up groups > members is far less common than members > groups)
 1. Doesn't matter whether it's a subselect or a separate select, it's still an extra query, though it should be pretty fast.
3663
The Pub / Re: The Cookie Law (in the UK at least)
« on April 21st, 2012, 02:33 PM »
Quote
This is why I like Arantor. You take your time out to reply, and educate + 1
I do try, and I do also try not to snap at people who ask for help (but when people who ask for help then throw it back at me because they didn't get the answer they wanted, that pisses me off no end)
Quote
I just viewed that website and man that looks so easy how they have done it.
Only thing is stopping these cookies from my site being stored for guests GRRRR.
But why do guests need to have cookies shoved at them, exactly?
Quote
Put in the registration agreement that they allow all cookies and *hope* SMF do something about guest cookies.
Also need a page that displays each cookie and what that cookie does. Well there is only 3 cookies I made myself.
Pretty much the official line from SMF is that it isn't their problem. I'll come back to that when replying to markham's post, though, because there's a lot more to it than that.
Quote
Which I can explain simply as they are only
Category 3: functionality  cookies
For things like the Shoutbox remembering which chat channel you are in and the theme changer lol.
Still my problem with 3rd party cookies unless they sort that out them selves.
That would mean minimal work for me XDDDDDDDDDDDDD
Depending on implementation it may not be as simple as that, or it may be. Certainly if it is functionality related, you're far more covered but as I understand the wording, you'd have to ask before setting those cookies, because it's up for debate as to whether it's 'required' functionality. A shopping site would not work very well without a cart setup, and as such a cookie there is clearly for required functionality. But for remembering preferences, as I understand it, that's not necessarily defined as 'required'.

This is part of the problem, actually, the guidance from the ICO is very vague and open to interpretation. If in doubt, seek guidance either from the ICO itself or from a separate legal institution.
Quote
Last one is analytic's, meh. What's the point in having it on the forums when you can't allow guests lol.
I mean as if a guest is really gonna OPT IN.. I wouldn't lol.
Guess I will remove that. I don't even use it anyway to be honest.
Will probably improve the speed of the website as well XD.
Well, there's nothing that says you can't allow guests. You just have to be mindful of how you approach it.

But you're exactly right, my very first thought when this was announced is that analytics cookies would be the sort of thing people would not opt-in for. Which is why I was less than thrilled at the way the ICO itself handles Google Analytics, because you can't (easily) opt in to certain cookies and not others. But I figure it will encourage a migration off Google Analytics, which from my perspective is no bad thing.
Quote
I thank you guys for making me aware of this as I seriously would never of known.
I spoken to alot of friends UK also.. They had no idea either..
Shocking heh.
The whole escapade is pretty shocking if you go back and look over the history of it - like so many recent laws, it is implemented by people who do not really understand how the internet works and is going to be abused. I personally think it's going to be withdrawn but because I just can't take the risks attached, I don't see how I can do anything other than look at it properly, as it's not just my own stuff that I have to bear in mind.

Did you know, in fact, that at one point a branch of the German government was using SMF for discussions? I don't see any reason why Wedge won't be able to appeal to that level - but it does of course require that we comply as best we are able (on a generic level) with the legislature out there, and we can take case-by-case matters separately.
Quote
Oh he's earned more than +1 from me as he seems to be the only Forum software developer who has not only taken time to research this (and other legal implications) but has demonstrated a genuine willingness to implement a decent solution.
I'm certainly willing to implement a decent solution, even taking into account my personal reservations about the whole matter - provided that I can get some meaningful information from the ICO. The big problem - as we've seen from pretty much all the forum camps - is that people look at the wording, look at the guidance, and make what is really a prognostication about the way things should be interpreted.

I know pretty much everyone is taking the view that the session cookie is probably OK and that the main cookie issued to members is also probably OK in and of themselves, but I'm not yet satisfied that this view matches the guidance the ICO themselves issue, especially considering that they don't even allow *their* session cookie to be transmitted without this consent.[1]

And if the ICO come back to me and tell me that they're satisfied with the breakdown I've given them of SMF and Wedge cookies, so be it. But I strongly doubt it, and in fact I realised there are more cookies issued by SMF and Wedge than that, but those we can work around or build into the existing systems.
Quote
You can hope and you can pray but whatever you do, don't hold your breath! Here's the solution that a (former?) SMF project person has suggested:
Actually, one of their developers has now issued a mod that should cover the fundamentals. I haven't tried it, but a quick glance at the code suggests two things: one, it'd probably work to prevent cookies being issued and two, it doesn't quite conform, because it doesn't indicate what the cookies in use are or what they do. (Nor can I see any way for mods to register such.)
Quote
However, there is another British Forum owner contributing to that same thread and he poses the following:
And, without being funny, this is why people who are neither technically nor legally qualified to make a judgement should avoid doing so.

His view is incorrect, because the wording of all the related legislature makes it very clear that any transfer of data that is 'strictly required' to function is permitted, and in any case when a user goes to a page themselves, they are the one initiating the transaction of data, and are implicitly giving permission for the bulk of the headers going anyway. (That said, there are privacy implications relating to things like the user-agent.)
Quote
The sad fact is that were things different to what they are today, there would have been an Arantor-authored modification for SMF available by now
It's probably true that were things different, I'd have gotten involved on an SMF modification. It's also probably true that working code would have been available sooner, though there is a work in progress available from the team at this point in time but even then it seems to be issued personally, not under the 'team' as it were.
Quote
I've noticed that some ISPs are placing tracking cookies for each web site visited. I wonder what ICO's views on that would be, since such cookies are outside the direct control of the web site owner.
You as a site owner cannot be held accountable for that since it is not a cookie you are issuing, and it is the ISP who is clearly at fault. If you can identify which ISP it is, take the matter to the ICO as a complaint.
 1. Yes, that's one thing that hasn't exactly been noted by those who've looked around the issue.
3664
The Pub / Re: The Cookie Law (in the UK at least)
« on April 21st, 2012, 03:16 AM »
Quote
So I believe that wedge and SMF are covered by these cookies that produce a session ID to individually identify a guest and you do not need permission.
So you don't need to worry about that.
That's the thing, it IS NOT strictly necessary. It is used strictly for analytical purposes, which is specifically noted as not being covered by that exception. Please, did you actually read the letter I wrote to the ICO discussing all of these things in detail and asking for their guidance?
Quote
So in effect, strictly necessary cookies like session ID's for guests do not need consent.
Maybe someone can correct me on that.
Session cookies for guests are not strictly necessary. I could quite easily remove them and SMF and Wedge would continue to function, albeit with reduced analytics and some very minor reduced functionality. I do not see how I can satisfactorily argue compliance for the session cookie that does not need to exist for most users. Especially with the bug I mentioned which causes the otherwise session cookie to become persistent.

And here's the thing... that session cookie makes no difference to that user in terms of 'consistency' or 'accuracy'. And when pointing out what is actually tied to that session cookie, I suspect the ICO will be less than enthusiastic considering how it is not just a session but contains an IP address, a few details about their computer and what page they have been looking at (which can trivially be turned into a limited form of behavioural tracking)
Quote
All the other cookies, such as performance and blah you could put in the registration agreement
So cookies that remember a change on your website like a theme option or what ever.
-sigh- Yes, as discussed here multiple times, yes as set out in my letter to the ICO, yes and everyone here already knows and has agreed, it's probably covered by the registration agreement, however there should still be a full list of all the cookies actively in use on the site because the user should be provided with the knowledge of what they are agreeing to.
Quote
I imagine all these need users permission.
Man this is giving me a head ache. I mean seriously.
Or if you'd read the discussion here, and noticed how the ICO handles it, it's a single opt-in for *all* site cookies.
Quote
Another head ache is we use analytic's and have images from photo bucket that some one posted on the home page.
All these are storing cookies on users computers!
Paypal some how have a cookie stored, youtube because there is a youtube video in the shoutbox... Facebook like.
Google plus one.
That said, most of the reason for this implementation is to cut back on the cookies used by Facebook, Google etc. that are well known to be used for behavioural tracking to serve you 'more relevant' ads.
Quote
I can see the reason why they are implying these laws, but some of them are stupid.
Like changing a theme layout and storing a cookie you need users permission for a cookie that probably only has the option a, b or c.
Or not, seeing how it's tied to the user account and not through a cookie most of the time.
Quote
What can I do about these 3rd paty cookies that are simply being placed on the website simply because of a donate button, or an image from photobucket, a video from youtube being posted.
Do what the ICO does.
Quote
Like every person who owns a site in the UK has the time to do all this and research it :(
If you want to run a website, yes, you have to research it, or pay someone who knows about it. Just as you can't randomly just set up a business or non-profit organisation, you have to go through the correct channels.
Quote
I really don't understand what to do about all the youtube cookies, paypal or any content that can be on the home page and what not.. Do I have to disable use for guests?
It would really help if you started by reading what's been posted. The ICO does some of these things, since they even have Google Analytics on their site.
Quote
These laws should be put in place for websites that display adverts or sell a product or something..
Not to the standard website owner.. Its just too much effort for us to comply with this.. I mean seriously a lot of effort.
I have spent hours already on this subject alone and not even started to implement it.......... HEAD ACHE...
This is half the problem. Most of the existing legislature doesn't work online. That said, boo frickedy hoo about how hard it is: if you want to run a website, you should check the local laws before you do so, simple as that. You're the site owner, it is your responsibility to be compliant with the laws as they stand, and no amount of complaining about how much it sucks is going to change that.

The thing is, the type of website must not matter. If you draft something where only 'displaying adverts' or 'selling a product' is cause for being overseen, what about non-profit organisations? What about review sites? Aggregators who collate and republish others' content? Where does the line end? Answer: it doesn't, and there is no consistent way it can be done other than applying it to everyone.
Quote
I really don't wanna waste a hell of alot more time actually implementing this and the thought is like I really don't wanna do it.
But I have to... You know that feeling right.?
1st I dunno how I am going to do it lol.
How do you think I feel? I have to take this into account in all its forms for Wedge users.
3665
The Pub / Re: The Cookie Law (in the UK at least)
« on April 21st, 2012, 01:29 AM »
Quote
So let me try and understand this some more.
Basically I have to display a notice that says we use cookies and what they do?
No, you have to put up a prompt to users before cookies are used, and ask them for permission *TO* use cookies. Until you receive permission you cannot use cookies in any fashion.
Quote
After looking on the additional info it even states the ICC website so it looks like they are complying with this just by providing this option.
They're not properly complying. Go look at the ICO's website and check your cookies - note that no cookies are set until you agree to them.
Quote
So if I put an icon with basic information of what cookies are applied and what they track, I would be covered?
As has been said many times in this thread, no, you would not be covered. Providing information is not sufficient, you have to seek consent before using cookies.
Quote
Simple fact is.. I will have to apply this so I need some help on what todo..
Do they take into account that some users might not even be aware of what cookies the software they use on their website do?
No, they don't. They figure you will contact the manufacturers of the software you use, i.e. us, or the SMF team or the phpBB team.
3666
The Pub / Re: The Cookie Law (in the UK at least)
« on April 21st, 2012, 12:00 AM »
Yes, where it's used strictly for carrying through in order to make certain things work, it should come under the exemption attached to 'facilitating communication', but be sure to only start the session when you actually need it, rather than straight away.

I don't think the ICO is fucked up, I think it's a worthwhile idea, let down by stupid implementation. A lot of the problem, as even they note, is that the browsers don't have the capabilities to properly cope with differentiating between first and third party cookies and such like.
3667
Plugins / Re: Message view count.
« on April 20th, 2012, 11:58 PM »
I don't think it would be any use, certainly not as a core feature. If anything I'd rather remove topic views before implementing this.

There are major performance considerations attached, namely that you'd *HAVE* to put this in its own database table otherwise the nightmare of updating the messages table (and preventing any other process even viewing threads while that update occurred, as default on MySQL prior to 5.5)[1]

Even then, you'd have to exclude search engines (which in itself is unreliable, just as it is excluded in theory from topic view counts), and even after that, the strong likelihood is that all you're going to see is a stream of increases over time, proportionate to the age of the message.

Ten messages each posted in close proximity to each other are going to have an almost horizontal (level) trend, messages further apart will get a proportionately higher spike, but that's all it'll tell you.
 1. Tables in MySQL before 5.5 are defaulted to MyISAM, where an update to the table requires table-level locking, meaning nothing else can touch the table. You can use InnoDB in 5.0/5.1 and it's default in 5.5 but that's not widespread yet.
3668
Plugins / Re: Light URL Plugin Maybe?
« on April 20th, 2012, 11:51 PM »
OK, let me explain a few things.

Routing is the process of getting from a URL to the right PHP file(s) to make it work. When the URL directly has index.php in it, it usually works out OK, the webserver calls index.php with the rest of the URL as parameters. Anything that deviates from the norm in ANY fashion is going to be unreliable.

Using index.php?stuff where you're not using index.php?stuff=stuff is going to be unreliable at best.

The other problem is that applying this to Wedge is a fucking nightmare, to put it bluntly. How many places are there index.php?topic=x but that it forms part of something else? Even cases like index.php?topic=1.0 is not the same as index.php?topic=1.15 which still has to be converted and processed, before you get into the realms of index.php?action=dlattch;attach=1;topic=1 for something else.
Quote
I mean you can spare one IF statement right?
You make it sound really complicated.To me it sounds like an easy process to do this.
That's because it is really complicated.

It's not just about the fact you have multiple URLs going to the same place, it's the fact you also have to serve up those forms of URL too. What's the point of using index.php?do/txxxxx when nothing else uses that? So then you get into the realms of rewriting URLs on the fly (unless you REALLY want to rewrite every single place where topic URLs are generated), which brings me back to the aforementioned problem.

Then you're still talking about yet more ifs that have to be run every single page view. Which means for a feature I don't want, I don't like, I'd still have to cope with the load of it in the core, and before anyone says about how it's 'just an if', it's still an if plus all the related code that is loaded every page view that I don't want to cope with.
Quote
I spoken to you a few times, over at SMF when i required help and you always get a lil hot headed.. Chill man.
Passes a spliff :P
Have you ever had to deal with people who are addicted to drugs? Have you ever been attacked by people who are trying to mug you for their next drug fix? Until you have, please do not tell me how I should approach my life.

In any case, the reason I'm "making this so difficult" is because I know how much of a nightmare this is to actually use in real life, as opposed to a script operating in a vacuum. If something like this gets added to the core, you won't be the person supporting it, I will be. And if it's a plugin, it's still going to be my problem because people will use that plugin and other plugins I write (since I'm likely to write the most plugins for Wedge) and will complain when plugins don't play nicely together, so again it's still going to be my problem.

This is why I'm hot headed, because I'm usually the one that has to pick up the mess others leave behind. Never mind the tens of thousands of hours I've spent learning my trade. I'm not actively making a living at this precise moment in time having just moved house and broken up with my long term girlfriend after ten years, but once I get sorted out here, I'll be back to making my living writing code, something a lot of people actually forget about me. They forget that I'm not just some cantankerous hermit doing it in my spare time, it's what puts food on my table. So yes, when I deal with people who think they know better than me, I will be short with them until they can demonstrate they actually are, because they're invariably not depending on it to put food on their table.
3669
The Pub / Re: The Cookie Law (in the UK at least)
« on April 20th, 2012, 11:38 PM »
Quote
It sounds ridiculous you know, for the fact I can be persecuted for something I was unaware of.
I still don't understand it and if I get bitten by it.
Ignorance of the law is no excuse, and if you prepare to run a website you should generally go out and make sure you are compliant. I've done a considerable amount of legwork for this reason over the years.
Quote
Sounds to me like the want to abolish cookies.
What else are they going todo. Do we need to start displaying HUGE notices explaining what information is cached on your PC also lol.
No, they want to make sure your privacy isn't screwed over. The real target of this law isn't to penalise site owners, it's to fuck over Google, and in particular the way Google's cookies track your actions, both their analytics and their ad cookies.

Also, read the discussions. They're not asking for huge notices. They're asking for prominent ones discussing cookies - the thing is, most sites don't really need cookies at all.

Consider this fact: SMF and Wedge, currently, use two principle cookies. One is issued to guests, whose sole purpose is to track what a guest is doing, and if you read my letter to the ICO, there are even privacy concerns about that. On the other hand, one cookie is only issued to members when they sign up, which will typically be covered by the agreement, so really all we're fighting about in Wedge's case is a cookie whose sole point is to identify a unique user. It's only really required to validate the uniqueness of the user, it's not really required for any other valid reason.
Quote
I can say that almost every website I know on the internet is not even close to complying with this.
It's not your problem. You only have to worry about the sites you manage. However if you find a site in the UK that issues you with cookies that don't really fall under the current laws, you can actually take them to the ICO. So yes, it is a problem if you run a site, but if you don't, it's no issue.
Quote
For the fact of, how can you comply with something you don't even know about and don't even understand.
Ignorance of the law is your problem, not the law's problem. No court of law will consider that a valid defence. As a site owner you are responsible for investigating the laws in your country/region and making sure that you continue to be informed about those rules.

In this particular case, it's been referenced many times on tech news sites, so I suspect if it were tested in court, it would be even further against you - it isn't as if this is a law that has been pushed through quietly.
Quote
Should set myself up as a user suing all websites that do not comply with something and make a million lol.
I am sure with all these stupid laws its possible lol.
You wouldn't win.

I forget whether this happened in the US or UK, but a few years ago, one or other of those places introduced some legislation to ensure that shops and offices introduced suitable measures for access by disabled people. Thinking about it, it might well have been the UK when the Disability Discrimination Act came in. Anyway, this guy in a wheelchair went around place after place after place, and each place that fell foul, he took them to court. The first couple went to court but after a short amount of time he was declared a vexatious litigant (i.e. someone going to court because they're a pain in the arse, not because they necessarily have a valid complaint) and was forbidden from doing it thereafter.
3670
The Pub / Re: The Cookie Law (in the UK at least)
« on April 20th, 2012, 10:58 PM »
Quote
I live in the UK but my hosting servers are in the US, do I have to comply with these rules on my website?
Yes, because you're the site operator.
Quote
If we have visitors from the UK so we have to comply for them visitors?
Yes, if the site is owned or operated within the EU, since this is an EU directive. If there is no EU-based management, there is no requirement to comply - at the present time, since I don't see how a user from within the EU can make a complaint to their respective data management body, when there's no way that can further on be enforced.
Quote
Also isn't the notice on the registration agreement enough to say what cookies are stored on your computer and what they are used for?
You're not the first person to ask this, and the answer is unequivocally NO.

This is the part that people do not follow. What you state in the registration is, frankly, irrelevant. You are supposed to obtain permission before setting ANY cookies. Even guests. The registration process would cover the more complex cookie, but it is not sufficient to cover for guests for whom a cookie is set straight away anyway.
Quote
Will this be applicable to voluntary small websites who can basically be bitten by a cookie law?
Yes, if you use a cookie. This is one of the points we've debated here: all sites that operate within the UK at least (and in time the EU) should comply, and a user can lodge a complaint with the ICO if they do not comply with the rules. (Or the respective country's equivalent)
Quote
I would of never heard about this other than reading this website.
AND I LIVE IN THE UK!!! That's a but stupid init?
You want to know the real fuck-up? This was introduced almost a year ago back in May 2011, but the ICO made it very clear that they would not enforce for a minimum of one year (and that date is fast approaching, it will be May 26th this year), however during that time we have been waiting for guidance from the ICO on how exactly this should work.
Quote
I noticed on my ISP website they have information at the bottom of their website, like little icons that you don't even know what they are until you hover or click them which allow you to control the use of cookies they store.
That's not really satisfactory. The ICO's own site is so far the only site I have seen that actively follows the guidance.
3671
Off-topic / Re: QapTcha
« on April 20th, 2012, 10:52 PM »
Oh, I'm not afraid. I just don't want there to be any illusions about whether this is a 'security' measure or not, you know?

It is a form of anti-bot measure.
3672
Features / Re: New revs
« on April 20th, 2012, 09:59 PM »
(6 modified, 2 added, 11KB)

Revision: 1555
Author: arantor
Date: 20 April 2012 20:58:49
Message:
! Moving some strings out of the main index file. (MoveTopic.php, SplitTopics.php, index and ManageTopics language files)
! Making one string out of two hybrids. (SSI.php, Boards.template.php, index language file)
----
Modified : /trunk/SSI.php
Modified : /trunk/Sources/MoveTopic.php
Modified : /trunk/Sources/SplitTopics.php
Modified : /trunk/Themes/default/Boards.template.php
Added : /trunk/Themes/default/languages/ManageTopics.english.php
Added : /trunk/Themes/default/languages/ManageTopics.french.php
Modified : /trunk/Themes/default/languages/index.english.php
Modified : /trunk/Themes/default/languages/index.french.php
3673
Off-topic / Re: Extract images with a certain tag from Instagram
« on April 20th, 2012, 09:31 PM »
Quote
Uhm, I know but doing so I have to wait 12 hours to see the image on the website after I took it. Right..? I'd like to have max 10/15 min delay... do you think it's not possible?
And therein lies the problem. Your code is passive, it's doing lookups to see if there's something new. So if you want it to appear with no more than 10 minutes delay, that's the maximum caching time. But then your server does much, much more work in doing lookups to figure out if there's something new.

If you don't like these options, you have to figure out something different, namely something such that when you perform an upload, you somehow notify your other site.
Quote
So I was wondering if the user-stream only snippet is less intrusive for the server because it has to scan a stream only.
*shrug* I doubt there's much in it.
3674
Off-topic / Re: Extract images with a certain tag from Instagram
« on April 20th, 2012, 08:57 PM »
If you're talking about one a day or thereabouts, there's really no need to be fetching any more frequently than perhaps once every 12 hours, or if you're really bothered, 1 to 6 hours.

I can't tell you whether using your account vs tags would be better. Which better describes what you want to show?
3675
Off-topic / Re: Extract images with a certain tag from Instagram
« on April 20th, 2012, 08:42 PM »
So you're fetching tags from Instagram... how often are items posted from Instagram that fit your tags?

If they're posted every 5 minutes or so, 3-4 minutes (180-240 seconds) is fine, if they're posted every 10 minutes, 8 minutes of cache is fine.