FA adds "SFW" toggle, site grinds to a halt as a result

[Conan]

Today on Adventures in Bad Website Development...

Sometime yesterday a bit of Javascript was added to FA that added a "Suitable For Work" option to the mainsite proper (as opposed to the sfw.furaffinity.net site). This button added a single cookie to the user's computer.

At the same time, the site began shitting the bed, with response times flying off the charts.

This has been going on for 36 hours with no word from the staff until just a while ago when the poor response times were chalked up to unspecified "work on the site" that has been "ongoing".

Discuss.

[Gryphoneer]

At this point "addition of whatever breaks site" is as newsworthy as "dog bites man".

I'm waiting for The Big One that deletes so-and-so-much GB of dogdick.

[Ketsuban]

Are they still doggedly insisting that FA is an art site, not a porn site, despite 99.8% of the userbase browsing onehanded?

[winserv03fan]

Of course, deny it.


I just wish it wasn't so ugly too. But when has a new feature looking like shit on FA been a surprise.

[Fantastigasm]

I don't think it's a good idea to browse furaffinity at work no matter how safe it might be.

[ColonThree]

This button added a single cookie to the user's computer.

I was under the impression that the mature filter has always worked like this (I'm sure it made sense at the time), and the SFW button simply saves going to the account page to perform the same action.

[Conan]

This button added a single cookie to the user's computer.

I was under the impression that the mature filter has always worked like this (I'm sure it made sense at the time), and the SFW button simply saves going to the account page to perform the same action.

The General/Mature/Adult filter is stored in the database afaik. The only cookies you get from FA are UUID's (sessions I'd imagine) and one that's a string of numbers.

[Conan]

So it seems they snuck in another feature: Flood protection

http://forums.furaffinity.net/threads/123355-What-re-your-feelings-on-the-new-flood-protection-FA-has

$50 says this is what's causing the problems.

[yak]

$50 says this is what's causing the problems.

It was a database backup gone wrong that was causing problems. My guess is that --order-by-primary option to mysqldump doesn't work very well for backing up very large tables (index scanning, buffering, diff between the checkpoint created by --single-transaction and current data).
mysqldump is past its usefulness at this point. xtrabackup is a viable alternative, but I need to familiarize myself with it. backing up a disconnected slave is another.

[ColonThree]

The General/Mature/Adult filter is stored in the database afaik. The only cookies you get from FA are UUID's (sessions I'd imagine) and one that's a string of numbers.

I tried it myself and it does indeed appear to be an entirely separate mechanism, with the presence of the cookie overriding the current setting in the DB. I would hazard a guess that it's done this way as the filter can have 3 settings, whereas the SFW is a simple on/off toggle.

[Conan]

backing up a disconnected slave is another.

Wouldn't this be a better use for the "backup" machine than it's current task of storing "fa.tar.gz" or whatever it was called?

[ProvincialTwit]

Whoops looks like I forgot to restart IPTables last time Viv rebooted.

[Conan]

it_keeps_happening.png

[Conan]

Is this still a "backup" and if so why is it running in the middle of the afternoon during peak hours.

EDIT: And now the whole thing has fallen over and is consistently serving error 500 messages.

[ColonThree]

Is this still a "backup"...

As of about 10 hours ago:
<yak[away]> I'm making a database backup
...
<yak[away]> furaffinity-2012-08-15-data.sql     â”‚ 112892M│-rw-r--r--   I'm 29 and what is this. Goddamn the people on FA like to talk.

[My client mongled a few characters]

No idea if it's related or still going. I assume that means ~112GB?

[winserv03fan]

Now I'm even getting 504 Gateway Timeouts.

Looks like shit hit the fan. I mean, I know that no one has heard of working on the server at off hours, but at peak times? Eugh.

[Conan]

Now it's the fault of the load balancer.

Because that always makes SQL load times skyrocket.

[zed]

Code: [Select]

/**
 * Balances load, experimental
 */
public class LoadBalancerImpl extends LoadBalancer implements FurAffinityWhoAmIKiddingTheyUsePHPForChristsSake {

  // TO-DO: fix magic not working
  //private static boolean magic = true;
  private static boolean magic = false;

  public LoadBalancerImpl() {
    super(magic);
  }

}

[zed]

And now that the load balancer is done, let's move on to the database controller.

Code: [Select]

public class SFWSubmissionLoader extends SubmissionLoader {

  public Submission load(int id) {
    //if (id = 45) {
      //doMagic(12);
    //}
    Submission sub = super.load(id), temp = null;
    if (sub.sfw != null && (sub.sfw.equals("yes") || sub.sfw.equals("true") || sub.sfw.equals("trUe"))) {
      // Makes sure the image is still SFW
      for (int i = 0; i < 50; i++) {
        temp = super.load(id);
        if (temp.sfw != null && (temp.sfw.equals("yes") || temp.sfw.equals("true") || temp.sfw.equals("trUe"))) {
          sub = null;
        } else {
          // continues
          continue;
          // ends continue
        }
      }
    }
    return sub;
  }
}